2024-07-27T02:58:24.939 INFO:root:teuthology version: 0.0.1.dev379+g53ce146 2024-07-27T02:58:24.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-07-27T02:58:25.095 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981 branch: wip-pdonnell-testing-20240726.202642-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/exports} email: pdonnell@redhat.com first_in_suite: false job_id: '7820981' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240726.202642-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds sha1: af8fdbf079811fe158ce62927bd145c35b74d4b8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: af8fdbf079811fe158ce62927bd145c35b74d4b8 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240726.202642-debug sha1: af8fdbf079811fe158ce62927bd145c35b74d4b8 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6029 sha1: af8fdbf079811fe158ce62927bd145c35b74d4b8 sleep_before_teardown: 0 subset: 246/512 suite: fs suite_branch: wip-pdonnell-testing-20240726.202642-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: af8fdbf079811fe158ce62927bd145c35b74d4b8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfFUK5hSrS6gnX+HwArg+FmHlElHhUNCBuwmbKEcTpRkxiRovZ6LKIU6RPTjLhlPGGh13kyN8mEz29o/FuZi6w= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKPqdxbSoAMZNANjQW3rmiYvDlBNP4nWdtDx0qmPKkfNgE+tsgZcYyqpsyeQjdosPFHJK+IryW9oZtV7AUX5bgE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_exports teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 53ce1462e129f6eb4071986336534c740fdebd31 timestamp: 2024-07-26_23:45:44 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.4074525 2024-07-27T02:58:25.096 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa; will attempt to use it 2024-07-27T02:58:25.097 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa/tasks 2024-07-27T02:58:25.097 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-07-27T02:58:25.203 INFO:teuthology.task.internal:Checking packages... 2024-07-27T02:58:25.226 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'af8fdbf079811fe158ce62927bd145c35b74d4b8' 2024-07-27T02:58:25.226 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-07-27T02:58:25.226 INFO:teuthology.packaging:ref: None 2024-07-27T02:58:25.226 INFO:teuthology.packaging:tag: None 2024-07-27T02:58:25.227 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240726.202642-debug 2024-07-27T02:58:25.227 INFO:teuthology.packaging:sha1: af8fdbf079811fe158ce62927bd145c35b74d4b8 2024-07-27T02:58:25.227 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240726.202642-debug 2024-07-27T02:58:25.373 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-5358.gaf8fdbf0 2024-07-27T02:58:25.375 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-07-27T02:58:25.381 INFO:teuthology.task.internal:no buildpackages task found 2024-07-27T02:58:25.381 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-07-27T02:58:25.445 INFO:teuthology.task.internal:Saving configuration 2024-07-27T02:58:25.462 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-07-27T02:58:25.479 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-07-27T02:58:25.501 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-27 02:53:36.147458', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfFUK5hSrS6gnX+HwArg+FmHlElHhUNCBuwmbKEcTpRkxiRovZ6LKIU6RPTjLhlPGGh13kyN8mEz29o/FuZi6w='} 2024-07-27T02:58:25.522 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-27 02:53:36.149351', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKPqdxbSoAMZNANjQW3rmiYvDlBNP4nWdtDx0qmPKkfNgE+tsgZcYyqpsyeQjdosPFHJK+IryW9oZtV7AUX5bgE='} 2024-07-27T02:58:25.522 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-07-27T02:58:25.529 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-07-27T02:58:25.529 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-07-27T02:58:25.529 INFO:teuthology.run_tasks:Running task console_log... 2024-07-27T02:58:25.635 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd795ee3ac0>, signals=[15]) 2024-07-27T02:58:25.636 INFO:teuthology.run_tasks:Running task internal.connect... 2024-07-27T02:58:25.642 INFO:teuthology.task.internal:Opening connections... 2024-07-27T02:58:25.642 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T02:58:25.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-27T02:58:25.720 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T02:58:25.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-27T02:58:25.793 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-07-27T02:58:25.803 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-07-27T02:58:25.821 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-07-27T02:58:25.821 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-07-27T02:58:25.878 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-07-27T02:58:25.878 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-07-27T02:58:25.878 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-07-27T02:58:25.878 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-07-27T02:58:25.878 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-07-27T02:58:25.878 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-07-27T02:58:25.878 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-27T02:58:25.878 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-07-27T02:58:25.878 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-07-27T02:58:25.878 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-27T02:58:25.878 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-07-27T02:58:25.879 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-27T02:58:25.879 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-27T02:58:25.879 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-27T02:58:25.879 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-07-27T02:58:25.900 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-07-27T02:58:25.917 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-07-27T02:58:25.918 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-07-27T02:58:25.974 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-27T02:58:25.975 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-27T02:58:25.976 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-27T02:58:25.976 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-07-27T02:58:25.999 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-07-27T02:58:26.008 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-07-27T02:58:26.037 INFO:teuthology.task.internal:Checking for old test directory... 2024-07-27T02:58:26.037 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-07-27T02:58:26.040 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-07-27T02:58:26.055 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-07-27T02:58:26.070 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-07-27T02:58:26.070 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-07-27T02:58:26.096 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-07-27T02:58:26.198 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-07-27T02:58:26.247 INFO:teuthology.run_tasks:Running task kernel... 2024-07-27T02:58:26.261 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-07-27T02:58:26.261 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-07-27T02:58:26.262 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-07-27T02:58:26.262 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-27T02:58:26.262 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-27T02:58:26.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T02:58:26.280 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-07-27T02:58:26.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T02:58:26.281 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-07-27T02:58:26.337 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-437.el9.x86_64 2024-07-27T02:58:26.337 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.14.0-437.el9.x86_64 2024-07-27T02:58:26.337 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum install -y kernel 2024-07-27T02:58:26.339 INFO:teuthology.orchestra.run.smithi121.stdout:5.14.0-437.el9.x86_64 2024-07-27T02:58:26.340 INFO:teuthology.task.kernel:Running kernel on smithi121: 5.14.0-437.el9.x86_64 2024-07-27T02:58:26.342 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum install -y kernel 2024-07-27T02:58:28.614 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-07-27T02:58:30.481 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-07-27T02:58:30.879 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-07-27T02:58:32.672 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-07-27T02:58:35.668 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-07-27T02:58:37.208 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 18 kB 00:00 2024-07-27T02:58:37.664 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.5 MB 00:01 2024-07-27T02:58:38.387 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 21 MB/s | 22 MB 00:01 2024-07-27T02:58:39.381 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 18 kB 00:00 2024-07-27T02:58:40.693 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 19 MB/s | 22 MB 00:01 2024-07-27T02:58:43.776 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-07-27T02:58:45.816 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-07-27T02:58:45.816 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-07-27T02:58:45.912 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-07-27T02:58:45.924 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-07-27T02:58:45.924 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-07-27T02:58:45.924 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-07-27T02:58:45.924 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-07-27T02:58:45.925 INFO:teuthology.orchestra.run.smithi120.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-07-27T02:58:45.925 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-07-27T02:58:45.925 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core x86_64 5.14.0-480.el9 baseos 17 M 2024-07-27T02:58:45.925 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules x86_64 5.14.0-480.el9 baseos 36 M 2024-07-27T02:58:45.925 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core x86_64 5.14.0-480.el9 baseos 30 M 2024-07-27T02:58:45.925 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T02:58:45.925 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-07-27T02:58:45.926 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-07-27T02:58:45.926 INFO:teuthology.orchestra.run.smithi120.stdout:Install 4 Packages 2024-07-27T02:58:45.926 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T02:58:45.927 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 84 M 2024-07-27T02:58:45.927 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 126 M 2024-07-27T02:58:45.927 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-07-27T02:58:46.024 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-07-27T02:58:46.169 INFO:teuthology.orchestra.run.smithi120.stdout:(1/4): kernel-5.14.0-480.el9.x86_64.rpm 8.3 MB/s | 1.5 MB 00:00 2024-07-27T02:58:46.861 INFO:teuthology.orchestra.run.smithi120.stdout:(2/4): kernel-modules-5.14.0-480.el9.x86_64.rpm 41 MB/s | 36 MB 00:00 2024-07-27T02:58:47.595 INFO:teuthology.orchestra.run.smithi120.stdout:(3/4): kernel-core-5.14.0-480.el9.x86_64.rpm 11 MB/s | 17 MB 00:01 2024-07-27T02:58:48.030 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-07-27T02:58:48.030 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-07-27T02:58:48.128 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-07-27T02:58:48.133 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-07-27T02:58:48.133 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-core x86_64 5.14.0-480.el9 baseos 17 M 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules x86_64 5.14.0-480.el9 baseos 36 M 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-core x86_64 5.14.0-480.el9 baseos 30 M 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout:Install 4 Packages 2024-07-27T02:58:48.134 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T02:58:48.135 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 84 M 2024-07-27T02:58:48.135 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 126 M 2024-07-27T02:58:48.135 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-07-27T02:58:48.212 INFO:teuthology.orchestra.run.smithi120.stdout:(4/4): kernel-modules-core-5.14.0-480.el9.x86_6 15 MB/s | 30 MB 00:02 2024-07-27T02:58:48.212 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-07-27T02:58:48.212 INFO:teuthology.orchestra.run.smithi120.stdout:Total 37 MB/s | 84 MB 00:02 2024-07-27T02:58:48.509 INFO:teuthology.orchestra.run.smithi121.stdout:(1/4): kernel-5.14.0-480.el9.x86_64.rpm 4.9 MB/s | 1.5 MB 00:00 2024-07-27T02:58:48.943 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-07-27T02:58:49.286 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-07-27T02:58:49.286 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-07-27T02:58:49.301 INFO:teuthology.orchestra.run.smithi121.stdout:(2/4): kernel-core-5.14.0-480.el9.x86_64.rpm 16 MB/s | 17 MB 00:01 2024-07-27T02:58:49.951 INFO:teuthology.orchestra.run.smithi121.stdout:(3/4): kernel-modules-core-5.14.0-480.el9.x86_6 21 MB/s | 30 MB 00:01 2024-07-27T02:58:50.267 INFO:teuthology.orchestra.run.smithi121.stdout:(4/4): kernel-modules-5.14.0-480.el9.x86_64.rpm 17 MB/s | 36 MB 00:02 2024-07-27T02:58:50.268 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-07-27T02:58:50.268 INFO:teuthology.orchestra.run.smithi121.stdout:Total 40 MB/s | 84 MB 00:02 2024-07-27T02:58:50.297 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-07-27T02:58:50.297 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-07-27T02:58:50.999 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-07-27T02:58:51.344 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-07-27T02:58:51.344 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-07-27T02:58:52.340 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-07-27T02:58:52.341 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-07-27T02:58:52.748 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-07-27T02:58:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-core-5.14.0-480.el9.x86_64 1/4 2024-07-27T02:58:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-27T02:58:54.793 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-07-27T02:58:55.458 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-modules-core-5.14.0-480.el9.x86_64 1/4 2024-07-27T02:58:55.560 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-27T02:58:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-27T02:58:56.334 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-27T02:58:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-27T02:58:58.372 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-27T02:59:01.174 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-27T02:59:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:03.208 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-27T02:59:03.422 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:06.122 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:08.245 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:36.054 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:36.094 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:36.404 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:36.405 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/4 2024-07-27T02:59:36.405 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-27T02:59:36.405 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-27T02:59:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T02:59:37.198 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-07-27T02:59:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-5.14.0-480.el9.x86_64 2024-07-27T02:59:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core-5.14.0-480.el9.x86_64 2024-07-27T02:59:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-5.14.0-480.el9.x86_64 2024-07-27T02:59:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core-5.14.0-480.el9.x86_64 2024-07-27T02:59:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T02:59:37.198 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-07-27T02:59:37.584 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-07-27T02:59:37.664 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-480.el9.x86_64 2024-07-27T02:59:37.665 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-07-27T02:59:37.665 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-480.el9.x86_64 2024-07-27T02:59:37.665 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-07-27T02:59:37.665 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-07-27T02:59:37.665 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-07-27T02:59:37.665 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-07-27T02:59:37.666 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-07-27T02:59:37.724 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-480.el9.x86_64 2024-07-27T02:59:37.724 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-07-27T02:59:37.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -qi grub2-tools 2024-07-27T02:59:37.759 INFO:teuthology.orchestra.run.smithi120.stdout:Name : grub2-tools 2024-07-27T02:59:37.759 INFO:teuthology.orchestra.run.smithi120.stdout:Epoch : 1 2024-07-27T02:59:37.759 INFO:teuthology.orchestra.run.smithi120.stdout:Version : 2.06 2024-07-27T02:59:37.759 INFO:teuthology.orchestra.run.smithi120.stdout:Release : 68.el9 2024-07-27T02:59:37.759 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: x86_64 2024-07-27T02:59:37.759 INFO:teuthology.orchestra.run.smithi120.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-07-27T02:59:37.759 INFO:teuthology.orchestra.run.smithi120.stdout:Group : Unspecified 2024-07-27T02:59:37.759 INFO:teuthology.orchestra.run.smithi120.stdout:Size : 8264254 2024-07-27T02:59:37.759 INFO:teuthology.orchestra.run.smithi120.stdout:License : GPLv3+ 2024-07-27T02:59:37.759 INFO:teuthology.orchestra.run.smithi120.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:Packager : builder@centos.org 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:Vendor : CentOS 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:URL : http://www.gnu.org/software/grub/ 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:Summary : Support tools for GRUB. 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:Description : 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:customizable bootloader with modular architecture. It supports a rich 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:variety of kernel formats, file systems, computer architectures and 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:hardware devices. 2024-07-27T02:59:37.760 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T02:59:37.761 INFO:teuthology.orchestra.run.smithi120.stdout:This subpackage provides tools for support of all platforms. 2024-07-27T02:59:37.761 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-07-27T02:59:37.762 INFO:teuthology.task.kernel:Updating grub on smithi120 to boot 5.14.0-480.el9.x86_64 2024-07-27T02:59:37.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-07-27T02:59:38.105 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:38.146 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:38.358 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-07-27T02:59:38.530 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:38.530 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/4 2024-07-27T02:59:38.530 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-27T02:59:38.530 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-27T02:59:39.339 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-07-27T02:59:39.339 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T02:59:39.339 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-07-27T02:59:39.339 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-5.14.0-480.el9.x86_64 2024-07-27T02:59:39.339 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-core-5.14.0-480.el9.x86_64 2024-07-27T02:59:39.340 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-5.14.0-480.el9.x86_64 2024-07-27T02:59:39.340 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-core-5.14.0-480.el9.x86_64 2024-07-27T02:59:39.340 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T02:59:39.340 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-07-27T02:59:39.709 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2024-07-27T02:59:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-07-27T02:59:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-07-27T02:59:39.754 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-07-27T02:59:39.770 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.hSvLZ9zqz6 2024-07-27T02:59:39.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hSvLZ9zqz6 2024-07-27T02:59:39.780 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-480.el9.x86_64 2024-07-27T02:59:39.780 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-07-27T02:59:39.780 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-480.el9.x86_64 2024-07-27T02:59:39.781 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-07-27T02:59:39.781 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-07-27T02:59:39.781 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-07-27T02:59:39.781 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi121.front.sepia.ceph.com, path=None, version=distro) 2024-07-27T02:59:39.781 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2024-07-27T02:59:39.837 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-480.el9.x86_64 2024-07-27T02:59:39.837 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-07-27T02:59:39.837 DEBUG:teuthology.orchestra.run.smithi121:> sudo rpm -qi grub2-tools 2024-07-27T02:59:39.863 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.hSvLZ9zqz6 2024-07-27T02:59:39.871 INFO:teuthology.orchestra.run.smithi121.stdout:Name : grub2-tools 2024-07-27T02:59:39.871 INFO:teuthology.orchestra.run.smithi121.stdout:Epoch : 1 2024-07-27T02:59:39.871 INFO:teuthology.orchestra.run.smithi121.stdout:Version : 2.06 2024-07-27T02:59:39.871 INFO:teuthology.orchestra.run.smithi121.stdout:Release : 68.el9 2024-07-27T02:59:39.871 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: x86_64 2024-07-27T02:59:39.871 INFO:teuthology.orchestra.run.smithi121.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-07-27T02:59:39.871 INFO:teuthology.orchestra.run.smithi121.stdout:Group : Unspecified 2024-07-27T02:59:39.871 INFO:teuthology.orchestra.run.smithi121.stdout:Size : 8264254 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:License : GPLv3+ 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:Packager : builder@centos.org 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:Vendor : CentOS 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:URL : http://www.gnu.org/software/grub/ 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:Summary : Support tools for GRUB. 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:Description : 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:customizable bootloader with modular architecture. It supports a rich 2024-07-27T02:59:39.872 INFO:teuthology.orchestra.run.smithi121.stdout:variety of kernel formats, file systems, computer architectures and 2024-07-27T02:59:39.873 INFO:teuthology.orchestra.run.smithi121.stdout:hardware devices. 2024-07-27T02:59:39.873 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T02:59:39.873 INFO:teuthology.orchestra.run.smithi121.stdout:This subpackage provides tools for support of all platforms. 2024-07-27T02:59:39.873 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-07-27T02:59:39.874 INFO:teuthology.task.kernel:Updating grub on smithi121 to boot 5.14.0-480.el9.x86_64 2024-07-27T02:59:39.874 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-07-27T02:59:39.957 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.hSvLZ9zqz6 is 6KB 2024-07-27T02:59:40.005 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.hSvLZ9zqz6 2024-07-27T02:59:40.019 DEBUG:teuthology.orchestra.run.smithi120:> sudo /bin/ls /boot/loader/entries || true 2024-07-27T02:59:40.086 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-07-27T02:59:40.087 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-07-27T02:59:40.087 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-07-27T02:59:40.087 INFO:teuthology.orchestra.run.smithi120.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64.conf 2024-07-27T02:59:40.088 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64 2024-07-27T02:59:40.237 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-07-27T02:59:40.545 INFO:teuthology.orchestra.run.smithi121.stderr:Generating grub configuration file ... 2024-07-27T02:59:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-07-27T02:59:41.977 INFO:teuthology.orchestra.run.smithi121.stderr:done 2024-07-27T02:59:41.979 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-07-27T02:59:41.995 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.4fSdbceaf1 2024-07-27T02:59:41.996 DEBUG:teuthology.orchestra.run.smithi121:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4fSdbceaf1 2024-07-27T02:59:42.063 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.4fSdbceaf1 2024-07-27T02:59:42.204 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.4fSdbceaf1 is 6KB 2024-07-27T02:59:42.252 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.4fSdbceaf1 2024-07-27T02:59:42.266 DEBUG:teuthology.orchestra.run.smithi121:> sudo /bin/ls /boot/loader/entries || true 2024-07-27T02:59:42.328 INFO:teuthology.orchestra.run.smithi121.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-07-27T02:59:42.328 INFO:teuthology.orchestra.run.smithi121.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-07-27T02:59:42.328 INFO:teuthology.orchestra.run.smithi121.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-07-27T02:59:42.328 INFO:teuthology.orchestra.run.smithi121.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64.conf 2024-07-27T02:59:42.329 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64 2024-07-27T02:59:42.477 DEBUG:teuthology.orchestra.run.smithi121:> sudo shutdown -r now 2024-07-27T03:00:10.266 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-07-27T03:00:10.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-07-27T03:00:10.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-27T03:00:12.482 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-07-27T03:00:12.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-07-27T03:00:12.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-27T03:01:10.307 DEBUG:teuthology.orchestra.remote:timed out 2024-07-27T03:01:12.486 DEBUG:teuthology.orchestra.remote:timed out 2024-07-27T03:01:19.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-07-27T03:01:19.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-27T03:01:19.769 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-07-27T03:01:20.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-07-27T03:01:20.138 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-480.el9.x86_64"... 2024-07-27T03:01:20.138 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-07-27T03:01:20.193 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-480.el9.x86_64 2024-07-27T03:01:20.193 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-480.el9.x86_64 vs 5.14.0-480.el9.x86_64 2024-07-27T03:01:20.194 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-07-27T03:01:20.194 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-07-27T03:01:21.194 DEBUG:teuthology.parallel:result is None 2024-07-27T03:01:21.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-07-27T03:01:21.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-27T03:01:22.972 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-07-27T03:01:23.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-07-27T03:01:23.491 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-480.el9.x86_64"... 2024-07-27T03:01:23.492 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-07-27T03:01:23.506 INFO:teuthology.orchestra.run.smithi121.stdout:5.14.0-480.el9.x86_64 2024-07-27T03:01:23.506 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-480.el9.x86_64 vs 5.14.0-480.el9.x86_64 2024-07-27T03:01:23.507 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-07-27T03:01:23.507 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-07-27T03:01:24.508 DEBUG:teuthology.parallel:result is None 2024-07-27T03:01:24.508 INFO:teuthology.run_tasks:Running task internal.base... 2024-07-27T03:01:24.516 INFO:teuthology.task.internal:Creating test directory... 2024-07-27T03:01:24.516 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-27T03:01:24.520 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-27T03:01:24.567 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-07-27T03:01:24.574 INFO:teuthology.run_tasks:Running task internal.archive... 2024-07-27T03:01:24.698 INFO:teuthology.task.internal:Creating archive directory... 2024-07-27T03:01:24.698 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-27T03:01:24.701 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-27T03:01:24.753 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-07-27T03:01:24.760 INFO:teuthology.task.internal:Enabling coredump saving... 2024-07-27T03:01:24.760 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-27T03:01:24.762 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-27T03:01:24.857 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-27T03:01:24.863 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-27T03:01:24.889 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-27T03:01:24.892 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-27T03:01:24.895 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-07-27T03:01:24.902 INFO:teuthology.task.internal:Configuring sudo... 2024-07-27T03:01:24.902 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-27T03:01:24.905 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-27T03:01:24.971 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-07-27T03:01:24.980 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-07-27T03:01:24.980 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-27T03:01:24.982 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-27T03:01:25.008 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-27T03:01:25.102 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-27T03:01:25.152 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-27T03:01:25.234 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-27T03:01:25.276 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:01:25.276 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-27T03:01:25.343 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-27T03:01:25.383 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-27T03:01:25.437 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-27T03:01:25.518 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-27T03:01:25.560 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:01:25.560 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-27T03:01:25.655 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-07-27T03:01:25.658 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-07-27T03:01:25.713 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-27T03:01:25.745 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-27T03:01:26.257 INFO:teuthology.run_tasks:Running task internal.timer... 2024-07-27T03:01:26.265 INFO:teuthology.task.internal:Starting timer... 2024-07-27T03:01:26.265 INFO:teuthology.run_tasks:Running task pcp... 2024-07-27T03:01:26.312 INFO:teuthology.run_tasks:Running task selinux... 2024-07-27T03:01:26.401 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-07-27T03:01:26.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2024-07-27T03:01:26.445 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: 2024-07-27T03:01:26.447 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-07-27T03:01:26.515 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-07-27T03:01:26.517 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-07-27T03:01:26.517 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2024-07-27T03:01:26.540 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2024-07-27T03:01:26.540 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-07-27T03:01:26.569 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-07-27T03:01:26.569 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi120.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi121.front.sepia.ceph.com': 'permissive'} 2024-07-27T03:01:26.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-27T03:01:26.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:01:26.605 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-27T03:01:26.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:01:26.635 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-07-27T03:01:26.635 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2024-07-27T03:01:26.673 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-07-27T03:01:26.701 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-07-27T03:01:26.711 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-07-27T03:01:26.714 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-07-27T03:01:26.837 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-07-27T03:01:26.848 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-07-27T03:01:26.849 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi120.front.sepia.ceph.com,smithi121.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-07-27T03:05:54.844 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com')] 2024-07-27T03:05:54.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-07-27T03:05:54.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-27T03:05:54.927 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-07-27T03:05:55.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-07-27T03:05:55.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-07-27T03:05:55.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-27T03:05:55.076 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-07-27T03:05:55.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-07-27T03:05:55.162 INFO:teuthology.run_tasks:Running task clock... 2024-07-27T03:05:55.172 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-07-27T03:05:55.173 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-27T03:05:55.173 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-27T03:05:55.176 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-27T03:05:55.176 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-27T03:05:55.202 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-27T03:05:55.216 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-27T03:05:55.231 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-27T03:05:55.240 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: ntpd: command not found 2024-07-27T03:05:55.245 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-27T03:05:55.251 INFO:teuthology.orchestra.run.smithi120.stdout:506 Cannot talk to daemon 2024-07-27T03:05:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-27T03:05:55.270 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-07-27T03:05:55.279 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-27T03:05:55.280 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-07-27T03:05:55.295 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-27T03:05:55.309 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-27T03:05:55.334 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-07-27T03:05:55.338 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-27T03:05:55.338 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-07-27T03:05:55.338 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-27T03:05:55.338 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-27T03:05:55.339 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-27T03:05:55.339 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-27T03:05:55.365 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-07-27T03:05:55.368 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-27T03:05:55.369 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-07-27T03:05:55.369 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-27T03:05:55.369 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-27T03:05:55.369 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-27T03:05:55.369 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-27T03:05:55.369 INFO:teuthology.run_tasks:Running task install... 2024-07-27T03:05:55.377 DEBUG:teuthology.task.install:project ceph 2024-07-27T03:05:55.377 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'af8fdbf079811fe158ce62927bd145c35b74d4b8'}} 2024-07-27T03:05:55.377 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'af8fdbf079811fe158ce62927bd145c35b74d4b8'} 2024-07-27T03:05:55.377 INFO:teuthology.task.install:Using flavor: default 2024-07-27T03:05:55.382 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-07-27T03:05:55.383 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-07-27T03:05:55.383 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'af8fdbf079811fe158ce62927bd145c35b74d4b8', 'tag': None, 'wait_for_package': False} 2024-07-27T03:05:55.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=af8fdbf079811fe158ce62927bd145c35b74d4b8 2024-07-27T03:05:55.386 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'af8fdbf079811fe158ce62927bd145c35b74d4b8', 'tag': None, 'wait_for_package': False} 2024-07-27T03:05:55.386 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=af8fdbf079811fe158ce62927bd145c35b74d4b8 2024-07-27T03:05:55.538 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240726.202642-debug/af8fdbf079811fe158ce62927bd145c35b74d4b8/centos/9/flavors/default/ 2024-07-27T03:05:55.538 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5358.gaf8fdbf0 2024-07-27T03:05:55.542 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240726.202642-debug/af8fdbf079811fe158ce62927bd145c35b74d4b8/centos/9/flavors/default/ 2024-07-27T03:05:55.542 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5358.gaf8fdbf0 2024-07-27T03:05:55.656 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240726.202642-debug/af8fdbf079811fe158ce62927bd145c35b74d4b8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240726.202642-debug/af8fdbf079811fe158ce62927bd145c35b74d4b8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240726.202642-debug/af8fdbf079811fe158ce62927bd145c35b74d4b8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-27T03:05:55.656 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:05:55.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-27T03:05:55.659 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240726.202642-debug/af8fdbf079811fe158ce62927bd145c35b74d4b8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240726.202642-debug/af8fdbf079811fe158ce62927bd145c35b74d4b8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240726.202642-debug/af8fdbf079811fe158ce62927bd145c35b74d4b8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-27T03:05:55.659 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:05:55.659 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-27T03:05:55.685 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-27T03:05:55.685 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/af8fdbf079811fe158ce62927bd145c35b74d4b8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-27T03:05:55.687 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-27T03:05:55.687 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/af8fdbf079811fe158ce62927bd145c35b74d4b8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-27T03:05:55.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-27T03:05:55.752 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-27T03:05:55.826 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-27T03:05:55.827 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-27T03:05:55.890 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2024-07-27T03:05:55.892 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2024-07-27T03:05:55.892 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-07-27T03:05:55.893 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-07-27T03:05:56.123 INFO:teuthology.orchestra.run.smithi120.stdout:45 files removed 2024-07-27T03:05:56.128 INFO:teuthology.orchestra.run.smithi121.stdout:45 files removed 2024-07-27T03:05:56.150 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-27T03:05:56.155 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-27T03:05:56.740 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 270 kB/s | 83 kB 00:00 2024-07-27T03:05:56.756 INFO:teuthology.orchestra.run.smithi120.stdout:ceph packages for x86_64 255 kB/s | 83 kB 00:00 2024-07-27T03:05:57.107 INFO:teuthology.orchestra.run.smithi120.stdout:ceph noarch packages 80 kB/s | 24 kB 00:00 2024-07-27T03:05:57.107 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 76 kB/s | 24 kB 00:00 2024-07-27T03:05:57.432 INFO:teuthology.orchestra.run.smithi120.stdout:ceph source packages 6.8 kB/s | 1.9 kB 00:00 2024-07-27T03:05:57.441 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 6.6 kB/s | 1.9 kB 00:00 2024-07-27T03:05:58.266 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-07-27T03:06:00.043 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-07-27T03:06:00.883 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.2 MB 00:03 2024-07-27T03:06:04.218 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 20 MB 00:02 2024-07-27T03:06:05.179 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-07-27T03:06:07.945 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 18 kB 00:01 2024-07-27T03:06:08.926 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 6.5 MB 00:00 2024-07-27T03:06:09.149 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 21 MB/s | 22 MB 00:01 2024-07-27T03:06:11.019 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 18 kB 00:00 2024-07-27T03:06:12.173 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 22 MB/s | 22 MB 00:01 2024-07-27T03:06:14.380 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-07-27T03:06:16.675 INFO:teuthology.orchestra.run.smithi120.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-27T03:06:16.676 INFO:teuthology.orchestra.run.smithi120.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-27T03:06:16.687 INFO:teuthology.orchestra.run.smithi120.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-27T03:06:16.687 INFO:teuthology.orchestra.run.smithi120.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-27T03:06:16.688 INFO:teuthology.orchestra.run.smithi120.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-27T03:06:16.689 INFO:teuthology.orchestra.run.smithi120.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-27T03:06:16.691 INFO:teuthology.orchestra.run.smithi120.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-27T03:06:16.693 INFO:teuthology.orchestra.run.smithi120.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-27T03:06:16.694 INFO:teuthology.orchestra.run.smithi120.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-27T03:06:16.759 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-07-27T03:06:16.790 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-07-27T03:06:16.790 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-07-27T03:06:16.790 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-07-27T03:06:16.791 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-07-27T03:06:16.791 INFO:teuthology.orchestra.run.smithi120.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-27T03:06:16.791 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 6.6 k 2024-07-27T03:06:16.791 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 5.5 M 2024-07-27T03:06:16.791 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 872 k 2024-07-27T03:06:16.791 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 148 k 2024-07-27T03:06:16.791 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 1.5 M 2024-07-27T03:06:16.791 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 149 k 2024-07-27T03:06:16.791 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 14 M 2024-07-27T03:06:16.792 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 7.4 M 2024-07-27T03:06:16.792 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 49 k 2024-07-27T03:06:16.792 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 10 M 2024-07-27T03:06:16.792 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 44 M 2024-07-27T03:06:16.792 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 274 k 2024-07-27T03:06:16.792 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 770 k 2024-07-27T03:06:16.792 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 225 k 2024-07-27T03:06:16.792 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-shell x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 27 k 2024-07-27T03:06:16.792 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-top noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 18 k 2024-07-27T03:06:16.792 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-27T03:06:16.792 INFO:teuthology.orchestra.run.smithi120.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-27T03:06:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-27T03:06:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 32 k 2024-07-27T03:06:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 766 k 2024-07-27T03:06:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 127 k 2024-07-27T03:06:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-27T03:06:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-27T03:06:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-27T03:06:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-27T03:06:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-27T03:06:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-27T03:06:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 188 k 2024-07-27T03:06:16.794 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 371 k 2024-07-27T03:06:16.794 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 355 k 2024-07-27T03:06:16.794 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 116 k 2024-07-27T03:06:16.794 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 86 k 2024-07-27T03:06:16.794 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 3.1 M 2024-07-27T03:06:16.794 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 170 k 2024-07-27T03:06:16.794 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-27T03:06:16.794 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2024-07-27T03:06:16.794 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-27T03:06:16.794 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-27T03:06:16.794 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 3.4 M 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 3.1 M 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-27T03:06:16.795 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-27T03:06:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 20 M 2024-07-27T03:06:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 34 k 2024-07-27T03:06:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 2.3 M 2024-07-27T03:06:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 284 k 2024-07-27T03:06:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 4.9 M 2024-07-27T03:06:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 18 M 2024-07-27T03:06:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 16 k 2024-07-27T03:06:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 25 k 2024-07-27T03:06:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-27T03:06:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-27T03:06:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 158 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 504 k 2024-07-27T03:06:16.797 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 5.3 M 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-27T03:06:16.798 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 45 k 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 138 k 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-27T03:06:16.799 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-27T03:06:16.800 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-27T03:06:16.801 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-27T03:06:16.801 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-27T03:06:16.801 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-27T03:06:16.801 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-27T03:06:16.801 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-27T03:06:16.801 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-27T03:06:16.801 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-27T03:06:16.801 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-27T03:06:16.801 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-27T03:06:16.802 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-27T03:06:16.802 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-27T03:06:16.802 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-27T03:06:16.802 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-27T03:06:16.802 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-27T03:06:16.802 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-27T03:06:16.802 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-27T03:06:16.802 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-27T03:06:16.802 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-27T03:06:16.802 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-27T03:06:16.803 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-27T03:06:16.804 INFO:teuthology.orchestra.run.smithi120.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-27T03:06:16.805 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-27T03:06:16.805 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-27T03:06:16.805 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2024-07-27T03:06:16.805 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-27T03:06:16.805 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:06:16.805 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-07-27T03:06:16.805 INFO:teuthology.orchestra.run.smithi120.stdout:======================================================================================= 2024-07-27T03:06:16.805 INFO:teuthology.orchestra.run.smithi120.stdout:Install 148 Packages 2024-07-27T03:06:16.805 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 12 Packages 2024-07-27T03:06:16.805 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:06:16.806 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 232 M 2024-07-27T03:06:16.806 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-07-27T03:06:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:(1/160): ceph-19.0.0-5358.gaf8fdbf0.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-07-27T03:06:17.586 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-07-27T03:06:17.665 INFO:teuthology.orchestra.run.smithi120.stdout:(2/160): ceph-fuse-19.0.0-5358.gaf8fdbf0.el9.x8 4.5 MB/s | 872 kB 00:00 2024-07-27T03:06:17.740 INFO:teuthology.orchestra.run.smithi120.stdout:(3/160): ceph-immutable-object-cache-19.0.0-535 1.9 MB/s | 148 kB 00:00 2024-07-27T03:06:17.840 INFO:teuthology.orchestra.run.smithi120.stdout:(4/160): ceph-base-19.0.0-5358.gaf8fdbf0.el9.x8 10 MB/s | 5.5 MB 00:00 2024-07-27T03:06:17.966 INFO:teuthology.orchestra.run.smithi120.stdout:(5/160): ceph-mds-19.0.0-5358.gaf8fdbf0.el9.x86 10 MB/s | 2.3 MB 00:00 2024-07-27T03:06:17.999 INFO:teuthology.orchestra.run.smithi120.stdout:(6/160): ceph-mgr-19.0.0-5358.gaf8fdbf0.el9.x86 9.6 MB/s | 1.5 MB 00:00 2024-07-27T03:06:18.433 INFO:teuthology.orchestra.run.smithi120.stdout:(7/160): ceph-common-19.0.0-5358.gaf8fdbf0.el9. 18 MB/s | 20 MB 00:01 2024-07-27T03:06:18.517 INFO:teuthology.orchestra.run.smithi120.stdout:(8/160): ceph-mon-19.0.0-5358.gaf8fdbf0.el9.x86 8.9 MB/s | 4.9 MB 00:00 2024-07-27T03:06:18.576 INFO:teuthology.orchestra.run.smithi120.stdout:(9/160): ceph-selinux-19.0.0-5358.gaf8fdbf0.el9 432 kB/s | 25 kB 00:00 2024-07-27T03:06:19.043 INFO:teuthology.orchestra.run.smithi120.stdout:(10/160): ceph-osd-19.0.0-5358.gaf8fdbf0.el9.x8 17 MB/s | 18 MB 00:01 2024-07-27T03:06:19.161 INFO:teuthology.orchestra.run.smithi120.stdout:(11/160): ceph-radosgw-19.0.0-5358.gaf8fdbf0.el 14 MB/s | 10 MB 00:00 2024-07-27T03:06:19.185 INFO:teuthology.orchestra.run.smithi120.stdout:(12/160): cephfs-mirror-19.0.0-5358.gaf8fdbf0.e 1.5 MB/s | 225 kB 00:00 2024-07-27T03:06:19.210 INFO:teuthology.orchestra.run.smithi120.stdout:(13/160): cephfs-shell-19.0.0-5358.gaf8fdbf0.el 540 kB/s | 27 kB 00:00 2024-07-27T03:06:19.227 INFO:teuthology.orchestra.run.smithi120.stdout:(14/160): libcephfs-devel-19.0.0-5358.gaf8fdbf0 754 kB/s | 32 kB 00:00 2024-07-27T03:06:19.278 INFO:teuthology.orchestra.run.smithi120.stdout:(15/160): libcephsqlite-19.0.0-5358.gaf8fdbf0.e 3.1 MB/s | 158 kB 00:00 2024-07-27T03:06:19.319 INFO:teuthology.orchestra.run.smithi120.stdout:(16/160): libcephfs2-19.0.0-5358.gaf8fdbf0.el9. 6.9 MB/s | 766 kB 00:00 2024-07-27T03:06:19.345 INFO:teuthology.orchestra.run.smithi120.stdout:(17/160): librados-devel-19.0.0-5358.gaf8fdbf0. 1.9 MB/s | 127 kB 00:00 2024-07-27T03:06:19.387 INFO:teuthology.orchestra.run.smithi120.stdout:(18/160): libradosstriper1-19.0.0-5358.gaf8fdbf 7.4 MB/s | 504 kB 00:00 2024-07-27T03:06:19.454 INFO:teuthology.orchestra.run.smithi120.stdout:(19/160): python3-ceph-argparse-19.0.0-5358.gaf 679 kB/s | 45 kB 00:00 2024-07-27T03:06:19.521 INFO:teuthology.orchestra.run.smithi120.stdout:(20/160): python3-ceph-common-19.0.0-5358.gaf8f 2.0 MB/s | 138 kB 00:00 2024-07-27T03:06:19.638 INFO:teuthology.orchestra.run.smithi120.stdout:(21/160): librgw2-19.0.0-5358.gaf8fdbf0.el9.x86 18 MB/s | 5.3 MB 00:00 2024-07-27T03:06:19.663 INFO:teuthology.orchestra.run.smithi120.stdout:(22/160): python3-cephfs-19.0.0-5358.gaf8fdbf0. 1.3 MB/s | 188 kB 00:00 2024-07-27T03:06:19.697 INFO:teuthology.orchestra.run.smithi120.stdout:(23/160): python3-rados-19.0.0-5358.gaf8fdbf0.e 6.2 MB/s | 371 kB 00:00 2024-07-27T03:06:19.730 INFO:teuthology.orchestra.run.smithi120.stdout:(24/160): python3-rbd-19.0.0-5358.gaf8fdbf0.el9 5.2 MB/s | 355 kB 00:00 2024-07-27T03:06:19.756 INFO:teuthology.orchestra.run.smithi120.stdout:(25/160): python3-rgw-19.0.0-5358.gaf8fdbf0.el9 1.9 MB/s | 116 kB 00:00 2024-07-27T03:06:19.781 INFO:teuthology.orchestra.run.smithi120.stdout:(26/160): rbd-fuse-19.0.0-5358.gaf8fdbf0.el9.x8 1.7 MB/s | 86 kB 00:00 2024-07-27T03:06:19.831 INFO:teuthology.orchestra.run.smithi120.stdout:(27/160): rbd-nbd-19.0.0-5358.gaf8fdbf0.el9.x86 3.3 MB/s | 170 kB 00:00 2024-07-27T03:06:19.879 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-27T03:06:19.880 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-27T03:06:19.891 INFO:teuthology.orchestra.run.smithi121.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-27T03:06:19.892 INFO:teuthology.orchestra.run.smithi121.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-27T03:06:19.893 INFO:teuthology.orchestra.run.smithi121.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-27T03:06:19.894 INFO:teuthology.orchestra.run.smithi121.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-27T03:06:19.895 INFO:teuthology.orchestra.run.smithi121.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-27T03:06:19.897 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-27T03:06:19.898 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-27T03:06:19.923 INFO:teuthology.orchestra.run.smithi120.stdout:(28/160): rbd-mirror-19.0.0-5358.gaf8fdbf0.el9. 18 MB/s | 3.1 MB 00:00 2024-07-27T03:06:19.949 INFO:teuthology.orchestra.run.smithi120.stdout:(29/160): ceph-grafana-dashboards-19.0.0-5358.g 293 kB/s | 34 kB 00:00 2024-07-27T03:06:19.962 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-07-27T03:06:19.974 INFO:teuthology.orchestra.run.smithi120.stdout:(30/160): ceph-mgr-cephadm-19.0.0-5358.gaf8fdbf 2.9 MB/s | 149 kB 00:00 2024-07-27T03:06:19.988 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-07-27T03:06:19.988 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-07-27T03:06:19.988 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-07-27T03:06:19.988 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-07-27T03:06:19.988 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-27T03:06:19.988 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 6.6 k 2024-07-27T03:06:19.988 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 5.5 M 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 872 k 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 148 k 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 1.5 M 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 149 k 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 14 M 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 7.4 M 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 49 k 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 10 M 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 44 M 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 274 k 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 770 k 2024-07-27T03:06:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 225 k 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 27 k 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 18 k 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 32 k 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 766 k 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 127 k 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-27T03:06:19.990 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 188 k 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 371 k 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 355 k 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 116 k 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 86 k 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 3.1 M 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 170 k 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-27T03:06:19.991 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 3.4 M 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 3.1 M 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-27T03:06:19.992 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 20 M 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 34 k 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 2.3 M 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 284 k 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 4.9 M 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 18 M 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5358.gaf8fdbf0.el9 ceph-noarch 16 k 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 25 k 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-27T03:06:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 158 k 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 504 k 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 5.3 M 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-27T03:06:19.994 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-27T03:06:19.995 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 45 k 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:19.0.0-5358.gaf8fdbf0.el9 ceph 138 k 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-27T03:06:19.996 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-27T03:06:19.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-27T03:06:19.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-27T03:06:19.999 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-27T03:06:20.000 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-27T03:06:20.001 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2024-07-27T03:06:20.001 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-27T03:06:20.001 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:06:20.001 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-07-27T03:06:20.001 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-07-27T03:06:20.001 INFO:teuthology.orchestra.run.smithi121.stdout:Install 148 Packages 2024-07-27T03:06:20.001 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 12 Packages 2024-07-27T03:06:20.001 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:06:20.002 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 232 M 2024-07-27T03:06:20.002 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-07-27T03:06:20.416 INFO:teuthology.orchestra.run.smithi120.stdout:(31/160): ceph-mgr-diskprediction-local-19.0.0- 17 MB/s | 7.4 MB 00:00 2024-07-27T03:06:20.483 INFO:teuthology.orchestra.run.smithi120.stdout:(32/160): ceph-mgr-modules-core-19.0.0-5358.gaf 4.2 MB/s | 284 kB 00:00 2024-07-27T03:06:20.542 INFO:teuthology.orchestra.run.smithi120.stdout:(33/160): ceph-mgr-rook-19.0.0-5358.gaf8fdbf0.e 849 kB/s | 49 kB 00:00 2024-07-27T03:06:20.600 INFO:teuthology.orchestra.run.smithi120.stdout:(34/160): ceph-prometheus-alerts-19.0.0-5358.ga 282 kB/s | 16 kB 00:00 2024-07-27T03:06:20.668 INFO:teuthology.orchestra.run.smithi120.stdout:(35/160): ceph-volume-19.0.0-5358.gaf8fdbf0.el9 4.0 MB/s | 274 kB 00:00 2024-07-27T03:06:20.671 INFO:teuthology.orchestra.run.smithi121.stdout:(1/160): ceph-19.0.0-5358.gaf8fdbf0.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-07-27T03:06:20.843 INFO:teuthology.orchestra.run.smithi120.stdout:(36/160): ceph-mgr-dashboard-19.0.0-5358.gaf8fd 16 MB/s | 14 MB 00:00 2024-07-27T03:06:20.877 INFO:teuthology.orchestra.run.smithi120.stdout:(37/160): cephadm-19.0.0-5358.gaf8fdbf0.el9.noa 3.6 MB/s | 770 kB 00:00 2024-07-27T03:06:20.904 INFO:teuthology.orchestra.run.smithi121.stdout:(2/160): ceph-fuse-19.0.0-5358.gaf8fdbf0.el9.x8 3.7 MB/s | 872 kB 00:00 2024-07-27T03:06:20.927 INFO:teuthology.orchestra.run.smithi120.stdout:(38/160): cephfs-top-19.0.0-5358.gaf8fdbf0.el9. 219 kB/s | 18 kB 00:00 2024-07-27T03:06:20.996 INFO:teuthology.orchestra.run.smithi121.stdout:(3/160): ceph-immutable-object-cache-19.0.0-535 1.6 MB/s | 148 kB 00:00 2024-07-27T03:06:21.071 INFO:teuthology.orchestra.run.smithi121.stdout:(4/160): ceph-base-19.0.0-5358.gaf8fdbf0.el9.x8 9.4 MB/s | 5.5 MB 00:00 2024-07-27T03:06:21.188 INFO:teuthology.orchestra.run.smithi121.stdout:(5/160): ceph-mgr-19.0.0-5358.gaf8fdbf0.el9.x86 13 MB/s | 1.5 MB 00:00 2024-07-27T03:06:21.330 INFO:teuthology.orchestra.run.smithi121.stdout:(6/160): ceph-mds-19.0.0-5358.gaf8fdbf0.el9.x86 6.8 MB/s | 2.3 MB 00:00 2024-07-27T03:06:21.352 INFO:teuthology.orchestra.run.smithi120.stdout:(39/160): ceph-test-19.0.0-5358.gaf8fdbf0.el9.x 16 MB/s | 44 MB 00:02 2024-07-27T03:06:21.514 INFO:teuthology.orchestra.run.smithi121.stdout:(7/160): ceph-mon-19.0.0-5358.gaf8fdbf0.el9.x86 15 MB/s | 4.9 MB 00:00 2024-07-27T03:06:21.722 INFO:teuthology.orchestra.run.smithi121.stdout:(8/160): ceph-common-19.0.0-5358.gaf8fdbf0.el9. 16 MB/s | 20 MB 00:01 2024-07-27T03:06:21.773 INFO:teuthology.orchestra.run.smithi121.stdout:(9/160): ceph-selinux-19.0.0-5358.gaf8fdbf0.el9 505 kB/s | 25 kB 00:00 2024-07-27T03:06:22.027 INFO:teuthology.orchestra.run.smithi120.stdout:(40/160): fuse-2.9.9-16.el9.x86_64.rpm 69 kB/s | 80 kB 00:01 2024-07-27T03:06:22.048 INFO:teuthology.orchestra.run.smithi121.stdout:(10/160): ceph-radosgw-19.0.0-5358.gaf8fdbf0.el 19 MB/s | 10 MB 00:00 2024-07-27T03:06:22.124 INFO:teuthology.orchestra.run.smithi121.stdout:(11/160): cephfs-mirror-19.0.0-5358.gaf8fdbf0.e 2.9 MB/s | 225 kB 00:00 2024-07-27T03:06:22.178 INFO:teuthology.orchestra.run.smithi120.stdout:(41/160): libquadmath-11.4.1-3.el9.x86_64.rpm 237 kB/s | 195 kB 00:00 2024-07-27T03:06:22.207 INFO:teuthology.orchestra.run.smithi121.stdout:(12/160): cephfs-shell-19.0.0-5358.gaf8fdbf0.el 325 kB/s | 27 kB 00:00 2024-07-27T03:06:22.270 INFO:teuthology.orchestra.run.smithi120.stdout:(42/160): libgfortran-11.4.1-3.el9.x86_64.rpm 598 kB/s | 803 kB 00:01 2024-07-27T03:06:22.291 INFO:teuthology.orchestra.run.smithi121.stdout:(13/160): libcephfs-devel-19.0.0-5358.gaf8fdbf0 381 kB/s | 32 kB 00:00 2024-07-27T03:06:22.391 INFO:teuthology.orchestra.run.smithi121.stdout:(14/160): libcephfs2-19.0.0-5358.gaf8fdbf0.el9. 7.5 MB/s | 766 kB 00:00 2024-07-27T03:06:22.483 INFO:teuthology.orchestra.run.smithi121.stdout:(15/160): libcephsqlite-19.0.0-5358.gaf8fdbf0.e 1.7 MB/s | 158 kB 00:00 2024-07-27T03:06:22.650 INFO:teuthology.orchestra.run.smithi121.stdout:(16/160): ceph-osd-19.0.0-5358.gaf8fdbf0.el9.x8 13 MB/s | 18 MB 00:01 2024-07-27T03:06:22.683 INFO:teuthology.orchestra.run.smithi121.stdout:(17/160): librados-devel-19.0.0-5358.gaf8fdbf0. 632 kB/s | 127 kB 00:00 2024-07-27T03:06:22.717 INFO:teuthology.orchestra.run.smithi121.stdout:(18/160): libradosstriper1-19.0.0-5358.gaf8fdbf 7.4 MB/s | 504 kB 00:00 2024-07-27T03:06:22.784 INFO:teuthology.orchestra.run.smithi121.stdout:(19/160): python3-ceph-argparse-19.0.0-5358.gaf 677 kB/s | 45 kB 00:00 2024-07-27T03:06:22.876 INFO:teuthology.orchestra.run.smithi121.stdout:(20/160): python3-ceph-common-19.0.0-5358.gaf8f 1.5 MB/s | 138 kB 00:00 2024-07-27T03:06:22.927 INFO:teuthology.orchestra.run.smithi121.stdout:(21/160): python3-cephfs-19.0.0-5358.gaf8fdbf0. 3.7 MB/s | 188 kB 00:00 2024-07-27T03:06:22.953 INFO:teuthology.orchestra.run.smithi120.stdout:(43/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 274 kB/s | 253 kB 00:00 2024-07-27T03:06:23.002 INFO:teuthology.orchestra.run.smithi121.stdout:(22/160): python3-rados-19.0.0-5358.gaf8fdbf0.e 4.8 MB/s | 371 kB 00:00 2024-07-27T03:06:23.077 INFO:teuthology.orchestra.run.smithi121.stdout:(23/160): python3-rbd-19.0.0-5358.gaf8fdbf0.el9 4.6 MB/s | 355 kB 00:00 2024-07-27T03:06:23.144 INFO:teuthology.orchestra.run.smithi121.stdout:(24/160): librgw2-19.0.0-5358.gaf8fdbf0.el9.x86 11 MB/s | 5.3 MB 00:00 2024-07-27T03:06:23.145 INFO:teuthology.orchestra.run.smithi120.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 122 kB/s | 106 kB 00:00 2024-07-27T03:06:23.178 INFO:teuthology.orchestra.run.smithi121.stdout:(25/160): python3-rgw-19.0.0-5358.gaf8fdbf0.el9 1.1 MB/s | 116 kB 00:00 2024-07-27T03:06:23.203 INFO:teuthology.orchestra.run.smithi121.stdout:(26/160): rbd-fuse-19.0.0-5358.gaf8fdbf0.el9.x8 1.4 MB/s | 86 kB 00:00 2024-07-27T03:06:23.254 INFO:teuthology.orchestra.run.smithi121.stdout:(27/160): rbd-nbd-19.0.0-5358.gaf8fdbf0.el9.x86 3.3 MB/s | 170 kB 00:00 2024-07-27T03:06:23.287 INFO:teuthology.orchestra.run.smithi120.stdout:(45/160): python3-cryptography-36.0.1-4.el9.x86 1.1 MB/s | 1.2 MB 00:01 2024-07-27T03:06:23.320 INFO:teuthology.orchestra.run.smithi121.stdout:(28/160): rbd-mirror-19.0.0-5358.gaf8fdbf0.el9. 22 MB/s | 3.1 MB 00:00 2024-07-27T03:06:23.351 INFO:teuthology.orchestra.run.smithi121.stdout:(29/160): ceph-grafana-dashboards-19.0.0-5358.g 355 kB/s | 34 kB 00:00 2024-07-27T03:06:23.371 INFO:teuthology.orchestra.run.smithi121.stdout:(30/160): ceph-mgr-cephadm-19.0.0-5358.gaf8fdbf 2.9 MB/s | 149 kB 00:00 2024-07-27T03:06:23.746 INFO:teuthology.orchestra.run.smithi120.stdout:(46/160): python3-pycparser-2.20-6.el9.noarch.r 171 kB/s | 135 kB 00:00 2024-07-27T03:06:23.822 INFO:teuthology.orchestra.run.smithi121.stdout:(31/160): ceph-test-19.0.0-5358.gaf8fdbf0.el9.x 21 MB/s | 44 MB 00:02 2024-07-27T03:06:23.872 INFO:teuthology.orchestra.run.smithi121.stdout:(32/160): ceph-mgr-modules-core-19.0.0-5358.gaf 5.6 MB/s | 284 kB 00:00 2024-07-27T03:06:23.938 INFO:teuthology.orchestra.run.smithi120.stdout:(47/160): python3-requests-2.25.1-8.el9.noarch. 158 kB/s | 125 kB 00:00 2024-07-27T03:06:23.955 INFO:teuthology.orchestra.run.smithi121.stdout:(33/160): ceph-mgr-rook-19.0.0-5358.gaf8fdbf0.e 593 kB/s | 49 kB 00:00 2024-07-27T03:06:24.066 INFO:teuthology.orchestra.run.smithi121.stdout:(34/160): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-07-27T03:06:24.089 INFO:teuthology.orchestra.run.smithi121.stdout:(35/160): ceph-prometheus-alerts-19.0.0-5358.ga 123 kB/s | 16 kB 00:00 2024-07-27T03:06:24.113 INFO:teuthology.orchestra.run.smithi120.stdout:(48/160): python3-urllib3-1.26.5-6.el9.noarch.r 260 kB/s | 215 kB 00:00 2024-07-27T03:06:24.123 INFO:teuthology.orchestra.run.smithi121.stdout:(36/160): ceph-volume-19.0.0-5358.gaf8fdbf0.el9 4.6 MB/s | 274 kB 00:00 2024-07-27T03:06:24.157 INFO:teuthology.orchestra.run.smithi121.stdout:(37/160): cephadm-19.0.0-5358.gaf8fdbf0.el9.noa 11 MB/s | 770 kB 00:00 2024-07-27T03:06:24.182 INFO:teuthology.orchestra.run.smithi121.stdout:(38/160): cephfs-top-19.0.0-5358.gaf8fdbf0.el9. 311 kB/s | 18 kB 00:00 2024-07-27T03:06:24.340 INFO:teuthology.orchestra.run.smithi121.stdout:(39/160): ceph-mgr-dashboard-19.0.0-5358.gaf8fd 14 MB/s | 14 MB 00:00 2024-07-27T03:06:24.466 INFO:teuthology.orchestra.run.smithi121.stdout:(40/160): fuse-2.9.9-16.el9.x86_64.rpm 258 kB/s | 80 kB 00:00 2024-07-27T03:06:24.497 INFO:teuthology.orchestra.run.smithi120.stdout:(49/160): automake-1.16.2-8.el9.noarch.rpm 918 kB/s | 689 kB 00:00 2024-07-27T03:06:24.522 INFO:teuthology.orchestra.run.smithi120.stdout:(50/160): boost-program-options-1.75.0-8.el9.x8 262 kB/s | 107 kB 00:00 2024-07-27T03:06:24.558 INFO:teuthology.orchestra.run.smithi121.stdout:(41/160): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-07-27T03:06:24.583 INFO:teuthology.orchestra.run.smithi121.stdout:(42/160): libquadmath-11.4.1-3.el9.x86_64.rpm 807 kB/s | 195 kB 00:00 2024-07-27T03:06:24.614 INFO:teuthology.orchestra.run.smithi120.stdout:(51/160): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-07-27T03:06:24.616 INFO:teuthology.orchestra.run.smithi121.stdout:(43/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-07-27T03:06:24.639 INFO:teuthology.orchestra.run.smithi120.stdout:(52/160): elfutils-libelf-devel-0.191-4.el9.x86 153 kB/s | 22 kB 00:00 2024-07-27T03:06:24.650 INFO:teuthology.orchestra.run.smithi121.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-07-27T03:06:24.664 INFO:teuthology.orchestra.run.smithi120.stdout:(53/160): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-07-27T03:06:24.678 INFO:teuthology.orchestra.run.smithi121.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-07-27T03:06:24.715 INFO:teuthology.orchestra.run.smithi120.stdout:(54/160): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-07-27T03:06:24.734 INFO:teuthology.orchestra.run.smithi121.stdout:(46/160): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-07-27T03:06:24.768 INFO:teuthology.orchestra.run.smithi121.stdout:(47/160): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-07-27T03:06:24.793 INFO:teuthology.orchestra.run.smithi121.stdout:(48/160): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-07-27T03:06:24.815 INFO:teuthology.orchestra.run.smithi120.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 121 kB/s | 18 kB 00:00 2024-07-27T03:06:24.890 INFO:teuthology.orchestra.run.smithi120.stdout:(56/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-07-27T03:06:24.915 INFO:teuthology.orchestra.run.smithi120.stdout:(57/160): libaio-devel-0.3.111-13.el9.x86_64.rp 55 kB/s | 11 kB 00:00 2024-07-27T03:06:24.949 INFO:teuthology.orchestra.run.smithi120.stdout:(58/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-07-27T03:06:24.960 INFO:teuthology.orchestra.run.smithi121.stdout:(49/160): boost-program-options-1.75.0-8.el9.x8 641 kB/s | 107 kB 00:00 2024-07-27T03:06:25.010 INFO:teuthology.orchestra.run.smithi121.stdout:(50/160): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-07-27T03:06:25.016 INFO:teuthology.orchestra.run.smithi120.stdout:(59/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-07-27T03:06:25.044 INFO:teuthology.orchestra.run.smithi121.stdout:(51/160): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-07-27T03:06:25.050 INFO:teuthology.orchestra.run.smithi120.stdout:(60/160): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-07-27T03:06:25.078 INFO:teuthology.orchestra.run.smithi121.stdout:(52/160): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-07-27T03:06:25.083 INFO:teuthology.orchestra.run.smithi120.stdout:(61/160): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-07-27T03:06:25.103 INFO:teuthology.orchestra.run.smithi121.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-07-27T03:06:25.117 INFO:teuthology.orchestra.run.smithi120.stdout:(62/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 256 kB/s | 25 kB 00:00 2024-07-27T03:06:25.137 INFO:teuthology.orchestra.run.smithi121.stdout:(54/160): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-07-27T03:06:25.151 INFO:teuthology.orchestra.run.smithi120.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 476 kB/s | 47 kB 00:00 2024-07-27T03:06:25.162 INFO:teuthology.orchestra.run.smithi121.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-07-27T03:06:25.185 INFO:teuthology.orchestra.run.smithi120.stdout:(64/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-07-27T03:06:25.195 INFO:teuthology.orchestra.run.smithi121.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-07-27T03:06:25.210 INFO:teuthology.orchestra.run.smithi120.stdout:(65/160): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-07-27T03:06:25.221 INFO:teuthology.orchestra.run.smithi121.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-07-27T03:06:25.243 INFO:teuthology.orchestra.run.smithi120.stdout:(66/160): openblas-0.3.21-2.el9.x86_64.rpm 381 kB/s | 35 kB 00:00 2024-07-27T03:06:25.254 INFO:teuthology.orchestra.run.smithi121.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-07-27T03:06:25.313 INFO:teuthology.orchestra.run.smithi121.stdout:(59/160): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-07-27T03:06:25.372 INFO:teuthology.orchestra.run.smithi121.stdout:(60/160): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-07-27T03:06:25.397 INFO:teuthology.orchestra.run.smithi121.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 304 kB/s | 25 kB 00:00 2024-07-27T03:06:25.436 INFO:teuthology.orchestra.run.smithi120.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 19 MB/s | 4.7 MB 00:00 2024-07-27T03:06:25.456 INFO:teuthology.orchestra.run.smithi121.stdout:(62/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.9 MB/s | 3.0 MB 00:00 2024-07-27T03:06:25.481 INFO:teuthology.orchestra.run.smithi121.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-07-27T03:06:25.506 INFO:teuthology.orchestra.run.smithi121.stdout:(64/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-07-27T03:06:25.532 INFO:teuthology.orchestra.run.smithi121.stdout:(65/160): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-07-27T03:06:25.565 INFO:teuthology.orchestra.run.smithi121.stdout:(66/160): openblas-0.3.21-2.el9.x86_64.rpm 419 kB/s | 35 kB 00:00 2024-07-27T03:06:25.603 INFO:teuthology.orchestra.run.smithi120.stdout:(68/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-07-27T03:06:25.778 INFO:teuthology.orchestra.run.smithi120.stdout:(69/160): postgresql-13.14-1.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2024-07-27T03:06:25.811 INFO:teuthology.orchestra.run.smithi120.stdout:(70/160): postgresql-contrib-13.14-1.el9.x86_64 2.4 MB/s | 911 kB 00:00 2024-07-27T03:06:25.832 INFO:teuthology.orchestra.run.smithi121.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-07-27T03:06:25.836 INFO:teuthology.orchestra.run.smithi120.stdout:(71/160): postgresql-private-libs-13.14-1.el9.x 575 kB/s | 133 kB 00:00 2024-07-27T03:06:25.918 INFO:teuthology.orchestra.run.smithi121.stdout:(68/160): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-07-27T03:06:25.958 INFO:teuthology.orchestra.run.smithi121.stdout:(69/160): postgresql-13.14-1.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-07-27T03:06:26.000 INFO:teuthology.orchestra.run.smithi121.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-07-27T03:06:26.012 INFO:teuthology.orchestra.run.smithi120.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 500 kB/s | 87 kB 00:00 2024-07-27T03:06:26.067 INFO:teuthology.orchestra.run.smithi121.stdout:(71/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-07-27T03:06:26.079 INFO:teuthology.orchestra.run.smithi120.stdout:(73/160): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-07-27T03:06:26.101 INFO:teuthology.orchestra.run.smithi121.stdout:(72/160): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-07-27T03:06:26.112 INFO:teuthology.orchestra.run.smithi120.stdout:(74/160): protobuf-3.14.0-13.el9.x86_64.rpm 3.7 MB/s | 1.0 MB 00:00 2024-07-27T03:06:26.126 INFO:teuthology.orchestra.run.smithi121.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-07-27T03:06:26.184 INFO:teuthology.orchestra.run.smithi121.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-07-27T03:06:26.251 INFO:teuthology.orchestra.run.smithi121.stdout:(75/160): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-07-27T03:06:26.296 INFO:teuthology.orchestra.run.smithi120.stdout:(75/160): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-07-27T03:06:26.321 INFO:teuthology.orchestra.run.smithi120.stdout:(76/160): python3-colorama-0.4.6-3.el9.noarch.r 297 kB/s | 61 kB 00:00 2024-07-27T03:06:26.335 INFO:teuthology.orchestra.run.smithi121.stdout:(76/160): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-07-27T03:06:26.346 INFO:teuthology.orchestra.run.smithi120.stdout:(77/160): python3-devel-3.9.18-3.el9.x86_64.rpm 1.0 MB/s | 244 kB 00:00 2024-07-27T03:06:26.397 INFO:teuthology.orchestra.run.smithi120.stdout:(78/160): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-07-27T03:06:26.414 INFO:teuthology.orchestra.run.smithi121.stdout:(77/160): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-07-27T03:06:26.436 INFO:teuthology.orchestra.run.smithi121.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-07-27T03:06:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:(79/160): python3-jsonpatch-1.21-16.el9.noarch. 255 kB/s | 26 kB 00:00 2024-07-27T03:06:26.461 INFO:teuthology.orchestra.run.smithi121.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 409 kB/s | 19 kB 00:00 2024-07-27T03:06:26.472 INFO:teuthology.orchestra.run.smithi120.stdout:(80/160): python3-jsonpointer-2.0-4.el9.noarch. 152 kB/s | 19 kB 00:00 2024-07-27T03:06:26.495 INFO:teuthology.orchestra.run.smithi121.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-07-27T03:06:26.506 INFO:teuthology.orchestra.run.smithi120.stdout:(81/160): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-07-27T03:06:26.528 INFO:teuthology.orchestra.run.smithi121.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 519 kB/s | 35 kB 00:00 2024-07-27T03:06:26.573 INFO:teuthology.orchestra.run.smithi120.stdout:(82/160): python3-markupsafe-1.1.1-12.el9.x86_6 277 kB/s | 35 kB 00:00 2024-07-27T03:06:26.845 INFO:teuthology.orchestra.run.smithi121.stdout:(82/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-07-27T03:06:26.904 INFO:teuthology.orchestra.run.smithi121.stdout:(83/160): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-07-27T03:06:26.907 INFO:teuthology.orchestra.run.smithi120.stdout:(83/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-07-27T03:06:26.941 INFO:teuthology.orchestra.run.smithi120.stdout:(84/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 577 kB/s | 250 kB 00:00 2024-07-27T03:06:26.962 INFO:teuthology.orchestra.run.smithi121.stdout:(84/160): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-07-27T03:06:26.966 INFO:teuthology.orchestra.run.smithi120.stdout:(85/160): python3-oauthlib-3.1.1-5.el9.noarch.r 566 kB/s | 222 kB 00:00 2024-07-27T03:06:26.988 INFO:teuthology.orchestra.run.smithi121.stdout:(85/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 546 kB/s | 250 kB 00:00 2024-07-27T03:06:27.008 INFO:teuthology.orchestra.run.smithi120.stdout:(86/160): python3-packaging-20.9-5.el9.noarch.r 771 kB/s | 77 kB 00:00 2024-07-27T03:06:27.013 INFO:teuthology.orchestra.run.smithi121.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-07-27T03:06:27.055 INFO:teuthology.orchestra.run.smithi121.stdout:(87/160): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-07-27T03:06:27.066 INFO:teuthology.orchestra.run.smithi120.stdout:(87/160): python3-prettytable-0.7.2-27.el9.noar 421 kB/s | 42 kB 00:00 2024-07-27T03:06:27.092 INFO:teuthology.orchestra.run.smithi120.stdout:(88/160): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-07-27T03:06:27.117 INFO:teuthology.orchestra.run.smithi120.stdout:(89/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-07-27T03:06:27.130 INFO:teuthology.orchestra.run.smithi121.stdout:(88/160): postgresql-server-13.14-1.el9.x86_64. 4.9 MB/s | 5.8 MB 00:01 2024-07-27T03:06:27.156 INFO:teuthology.orchestra.run.smithi121.stdout:(89/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-07-27T03:06:27.167 INFO:teuthology.orchestra.run.smithi120.stdout:(90/160): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-07-27T03:06:27.189 INFO:teuthology.orchestra.run.smithi121.stdout:(90/160): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-07-27T03:06:27.193 INFO:teuthology.orchestra.run.smithi120.stdout:(91/160): python3-pytz-2021.1-5.el9.noarch.rpm 508 kB/s | 51 kB 00:00 2024-07-27T03:06:27.215 INFO:teuthology.orchestra.run.smithi121.stdout:(91/160): python3-pytz-2021.1-5.el9.noarch.rpm 607 kB/s | 51 kB 00:00 2024-07-27T03:06:27.218 INFO:teuthology.orchestra.run.smithi120.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 533 kB/s | 54 kB 00:00 2024-07-27T03:06:27.240 INFO:teuthology.orchestra.run.smithi121.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 640 kB/s | 54 kB 00:00 2024-07-27T03:06:27.315 INFO:teuthology.orchestra.run.smithi121.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 558 kB/s | 42 kB 00:00 2024-07-27T03:06:27.340 INFO:teuthology.orchestra.run.smithi121.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 442 kB/s | 44 kB 00:00 2024-07-27T03:06:27.360 INFO:teuthology.orchestra.run.smithi120.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 250 kB/s | 42 kB 00:00 2024-07-27T03:06:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-07-27T03:06:27.385 INFO:teuthology.orchestra.run.smithi120.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 264 kB/s | 44 kB 00:00 2024-07-27T03:06:27.407 INFO:teuthology.orchestra.run.smithi121.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 537 kB/s | 36 kB 00:00 2024-07-27T03:06:27.441 INFO:teuthology.orchestra.run.smithi121.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-07-27T03:06:27.500 INFO:teuthology.orchestra.run.smithi121.stdout:(98/160): uuid-1.6.2-55.el9.x86_64.rpm 994 kB/s | 58 kB 00:00 2024-07-27T03:06:27.525 INFO:teuthology.orchestra.run.smithi121.stdout:(99/160): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-07-27T03:06:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:(100/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-07-27T03:06:27.569 INFO:teuthology.orchestra.run.smithi120.stdout:(95/160): qatlib-service-24.02.0-1.el9.x86_64.r 198 kB/s | 36 kB 00:00 2024-07-27T03:06:27.584 INFO:teuthology.orchestra.run.smithi121.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-07-27T03:06:27.618 INFO:teuthology.orchestra.run.smithi121.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-07-27T03:06:27.669 INFO:teuthology.orchestra.run.smithi120.stdout:(96/160): qatlib-24.02.0-1.el9.x86_64.rpm 715 kB/s | 221 kB 00:00 2024-07-27T03:06:27.844 INFO:teuthology.orchestra.run.smithi120.stdout:(97/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-07-27T03:06:27.870 INFO:teuthology.orchestra.run.smithi120.stdout:(98/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 159 kB/s | 47 kB 00:00 2024-07-27T03:06:27.895 INFO:teuthology.orchestra.run.smithi120.stdout:(99/160): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-07-27T03:06:27.971 INFO:teuthology.orchestra.run.smithi120.stdout:(100/160): uuid-1.6.2-55.el9.x86_64.rpm 580 kB/s | 58 kB 00:00 2024-07-27T03:06:27.985 INFO:teuthology.orchestra.run.smithi121.stdout:(103/160): lua-devel-5.4.4-4.el9.x86_64.rpm 56 kB/s | 22 kB 00:00 2024-07-27T03:06:27.996 INFO:teuthology.orchestra.run.smithi120.stdout:(101/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 766 kB/s | 96 kB 00:00 2024-07-27T03:06:28.021 INFO:teuthology.orchestra.run.smithi120.stdout:(102/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 507 kB/s | 64 kB 00:00 2024-07-27T03:06:28.071 INFO:teuthology.orchestra.run.smithi120.stdout:(103/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 448 kB/s | 45 kB 00:00 2024-07-27T03:06:28.155 INFO:teuthology.orchestra.run.smithi120.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-07-27T03:06:28.170 INFO:teuthology.orchestra.run.smithi121.stdout:(104/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-07-27T03:06:28.172 INFO:teuthology.orchestra.run.smithi120.stdout:(105/160): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-07-27T03:06:28.222 INFO:teuthology.orchestra.run.smithi120.stdout:(106/160): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-07-27T03:06:28.247 INFO:teuthology.orchestra.run.smithi120.stdout:(107/160): grpc-data-1.46.7-10.el9.noarch.rpm 258 kB/s | 19 kB 00:00 2024-07-27T03:06:28.252 INFO:teuthology.orchestra.run.smithi121.stdout:(105/160): abseil-cpp-20211102.0-3.el9.x86_64.r 2.0 MB/s | 548 kB 00:00 2024-07-27T03:06:28.272 INFO:teuthology.orchestra.run.smithi120.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-07-27T03:06:28.277 INFO:teuthology.orchestra.run.smithi121.stdout:(106/160): gperftools-libs-2.9.1-2.el9.x86_64.r 2.9 MB/s | 309 kB 00:00 2024-07-27T03:06:28.298 INFO:teuthology.orchestra.run.smithi120.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-07-27T03:06:28.302 INFO:teuthology.orchestra.run.smithi121.stdout:(107/160): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-07-27T03:06:28.328 INFO:teuthology.orchestra.run.smithi121.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-07-27T03:06:28.331 INFO:teuthology.orchestra.run.smithi120.stdout:(110/160): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-07-27T03:06:28.348 INFO:teuthology.orchestra.run.smithi120.stdout:(111/160): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-07-27T03:06:28.353 INFO:teuthology.orchestra.run.smithi121.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-07-27T03:06:28.379 INFO:teuthology.orchestra.run.smithi121.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-07-27T03:06:28.420 INFO:teuthology.orchestra.run.smithi121.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-07-27T03:06:28.424 INFO:teuthology.orchestra.run.smithi120.stdout:(112/160): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-07-27T03:06:28.496 INFO:teuthology.orchestra.run.smithi121.stdout:(112/160): protobuf-compiler-3.14.0-13.el9.x86_ 984 kB/s | 863 kB 00:00 2024-07-27T03:06:28.499 INFO:teuthology.orchestra.run.smithi120.stdout:(113/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-07-27T03:06:28.533 INFO:teuthology.orchestra.run.smithi120.stdout:(114/160): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-07-27T03:06:28.559 INFO:teuthology.orchestra.run.smithi120.stdout:(115/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-07-27T03:06:28.563 INFO:teuthology.orchestra.run.smithi121.stdout:(113/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-07-27T03:06:28.584 INFO:teuthology.orchestra.run.smithi120.stdout:(116/160): python3-cachetools-4.2.4-1.el9.noarc 637 kB/s | 32 kB 00:00 2024-07-27T03:06:28.596 INFO:teuthology.orchestra.run.smithi121.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-07-27T03:06:28.609 INFO:teuthology.orchestra.run.smithi120.stdout:(117/160): python3-certifi-2023.05.07-4.el9.noa 279 kB/s | 14 kB 00:00 2024-07-27T03:06:28.621 INFO:teuthology.orchestra.run.smithi121.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-07-27T03:06:28.651 INFO:teuthology.orchestra.run.smithi120.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-07-27T03:06:28.655 INFO:teuthology.orchestra.run.smithi121.stdout:(116/160): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-07-27T03:06:28.681 INFO:teuthology.orchestra.run.smithi121.stdout:(117/160): python3-certifi-2023.05.07-4.el9.noa 240 kB/s | 14 kB 00:00 2024-07-27T03:06:28.706 INFO:teuthology.orchestra.run.smithi121.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-07-27T03:06:28.726 INFO:teuthology.orchestra.run.smithi120.stdout:(119/160): libarrow-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-07-27T03:06:28.740 INFO:teuthology.orchestra.run.smithi121.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-07-27T03:06:28.765 INFO:teuthology.orchestra.run.smithi121.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-07-27T03:06:28.769 INFO:teuthology.orchestra.run.smithi120.stdout:(120/160): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2024-07-27T03:06:28.794 INFO:teuthology.orchestra.run.smithi120.stdout:(121/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-07-27T03:06:28.819 INFO:teuthology.orchestra.run.smithi120.stdout:(122/160): python3-google-auth-2.32.0-1.el9.noa 2.3 MB/s | 216 kB 00:00 2024-07-27T03:06:28.823 INFO:teuthology.orchestra.run.smithi121.stdout:(121/160): libarrow-9.0.0-11.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2024-07-27T03:06:28.844 INFO:teuthology.orchestra.run.smithi120.stdout:(123/160): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-07-27T03:06:28.857 INFO:teuthology.orchestra.run.smithi121.stdout:(122/160): python3-google-auth-2.32.0-1.el9.noa 1.8 MB/s | 216 kB 00:00 2024-07-27T03:06:28.870 INFO:teuthology.orchestra.run.smithi120.stdout:(124/160): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-07-27T03:06:28.883 INFO:teuthology.orchestra.run.smithi121.stdout:(123/160): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-07-27T03:06:28.895 INFO:teuthology.orchestra.run.smithi120.stdout:(125/160): python3-jaraco-classes-3.2.1-5.el9.n 350 kB/s | 18 kB 00:00 2024-07-27T03:06:28.908 INFO:teuthology.orchestra.run.smithi121.stdout:(124/160): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-07-27T03:06:28.920 INFO:teuthology.orchestra.run.smithi120.stdout:(126/160): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-07-27T03:06:28.933 INFO:teuthology.orchestra.run.smithi121.stdout:(125/160): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-07-27T03:06:28.945 INFO:teuthology.orchestra.run.smithi120.stdout:(127/160): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-07-27T03:06:28.958 INFO:teuthology.orchestra.run.smithi121.stdout:(126/160): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-07-27T03:06:28.971 INFO:teuthology.orchestra.run.smithi120.stdout:(128/160): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-07-27T03:06:28.996 INFO:teuthology.orchestra.run.smithi120.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-07-27T03:06:29.004 INFO:teuthology.orchestra.run.smithi121.stdout:(127/160): python3-jaraco-functools-3.5.0-2.el9 276 kB/s | 19 kB 00:00 2024-07-27T03:06:29.026 INFO:teuthology.orchestra.run.smithi121.stdout:(128/160): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-07-27T03:06:29.030 INFO:teuthology.orchestra.run.smithi120.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-07-27T03:06:29.051 INFO:teuthology.orchestra.run.smithi121.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-07-27T03:06:29.064 INFO:teuthology.orchestra.run.smithi120.stdout:(131/160): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-07-27T03:06:29.089 INFO:teuthology.orchestra.run.smithi120.stdout:(132/160): python3-natsort-7.1.1-5.el9.noarch.r 981 kB/s | 58 kB 00:00 2024-07-27T03:06:29.093 INFO:teuthology.orchestra.run.smithi121.stdout:(130/160): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-07-27T03:06:29.114 INFO:teuthology.orchestra.run.smithi120.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-07-27T03:06:29.118 INFO:teuthology.orchestra.run.smithi121.stdout:(131/160): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-07-27T03:06:29.131 INFO:teuthology.orchestra.run.smithi120.stdout:(134/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 5.3 MB/s | 90 kB 00:00 2024-07-27T03:06:29.152 INFO:teuthology.orchestra.run.smithi121.stdout:(132/160): python3-natsort-7.1.1-5.el9.noarch.r 987 kB/s | 58 kB 00:00 2024-07-27T03:06:29.156 INFO:teuthology.orchestra.run.smithi120.stdout:(135/160): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-07-27T03:06:29.178 INFO:teuthology.orchestra.run.smithi121.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-07-27T03:06:29.182 INFO:teuthology.orchestra.run.smithi120.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 559 kB/s | 28 kB 00:00 2024-07-27T03:06:29.203 INFO:teuthology.orchestra.run.smithi121.stdout:(134/160): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-07-27T03:06:29.207 INFO:teuthology.orchestra.run.smithi120.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-07-27T03:06:29.233 INFO:teuthology.orchestra.run.smithi120.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-07-27T03:06:29.245 INFO:teuthology.orchestra.run.smithi121.stdout:(135/160): python3-grpcio-1.46.7-10.el9.x86_64. 4.2 MB/s | 2.0 MB 00:00 2024-07-27T03:06:29.258 INFO:teuthology.orchestra.run.smithi120.stdout:(139/160): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-07-27T03:06:29.270 INFO:teuthology.orchestra.run.smithi121.stdout:(136/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 977 kB/s | 90 kB 00:00 2024-07-27T03:06:29.295 INFO:teuthology.orchestra.run.smithi121.stdout:(137/160): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-07-27T03:06:29.317 INFO:teuthology.orchestra.run.smithi120.stdout:(140/160): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-07-27T03:06:29.320 INFO:teuthology.orchestra.run.smithi121.stdout:(138/160): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-07-27T03:06:29.342 INFO:teuthology.orchestra.run.smithi120.stdout:(141/160): python3-tempora-5.0.0-2.el9.noarch.r 327 kB/s | 36 kB 00:00 2024-07-27T03:06:29.346 INFO:teuthology.orchestra.run.smithi121.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-07-27T03:06:29.367 INFO:teuthology.orchestra.run.smithi120.stdout:(142/160): python3-typing-extensions-4.4.0-2.el 469 kB/s | 51 kB 00:00 2024-07-27T03:06:29.371 INFO:teuthology.orchestra.run.smithi121.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-07-27T03:06:29.393 INFO:teuthology.orchestra.run.smithi120.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-07-27T03:06:29.396 INFO:teuthology.orchestra.run.smithi121.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-07-27T03:06:29.418 INFO:teuthology.orchestra.run.smithi120.stdout:(144/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-07-27T03:06:29.422 INFO:teuthology.orchestra.run.smithi121.stdout:(142/160): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-07-27T03:06:29.443 INFO:teuthology.orchestra.run.smithi120.stdout:(145/160): python3-zc-lockfile-2.0-10.el9.noarc 396 kB/s | 20 kB 00:00 2024-07-27T03:06:29.447 INFO:teuthology.orchestra.run.smithi121.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-07-27T03:06:29.469 INFO:teuthology.orchestra.run.smithi120.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-07-27T03:06:29.472 INFO:teuthology.orchestra.run.smithi121.stdout:(144/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-07-27T03:06:29.489 INFO:teuthology.orchestra.run.smithi121.stdout:(145/160): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-07-27T03:06:29.494 INFO:teuthology.orchestra.run.smithi120.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-07-27T03:06:29.523 INFO:teuthology.orchestra.run.smithi121.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-07-27T03:06:29.544 INFO:teuthology.orchestra.run.smithi120.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-07-27T03:06:29.548 INFO:teuthology.orchestra.run.smithi121.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-07-27T03:06:29.607 INFO:teuthology.orchestra.run.smithi121.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-07-27T03:06:29.770 INFO:teuthology.orchestra.run.smithi120.stdout:(149/160): librados2-19.0.0-5358.gaf8fdbf0.el9. 11 MB/s | 3.4 MB 00:00 2024-07-27T03:06:29.807 INFO:teuthology.orchestra.run.smithi121.stdout:(149/160): librados2-19.0.0-5358.gaf8fdbf0.el9. 12 MB/s | 3.4 MB 00:00 2024-07-27T03:06:29.820 INFO:teuthology.orchestra.run.smithi120.stdout:(150/160): librbd1-19.0.0-5358.gaf8fdbf0.el9.x8 9.6 MB/s | 3.1 MB 00:00 2024-07-27T03:06:29.949 INFO:teuthology.orchestra.run.smithi121.stdout:(150/160): NetworkManager-1.48.2-2.el9.x86_64.r 7.3 MB/s | 2.3 MB 00:00 2024-07-27T03:06:30.008 INFO:teuthology.orchestra.run.smithi121.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 699 kB/s | 41 kB 00:00 2024-07-27T03:06:30.058 INFO:teuthology.orchestra.run.smithi121.stdout:(152/160): librbd1-19.0.0-5358.gaf8fdbf0.el9.x8 6.2 MB/s | 3.1 MB 00:00 2024-07-27T03:06:30.092 INFO:teuthology.orchestra.run.smithi121.stdout:(153/160): NetworkManager-tui-1.48.2-2.el9.x86_ 2.9 MB/s | 247 kB 00:00 2024-07-27T03:06:30.176 INFO:teuthology.orchestra.run.smithi121.stdout:(154/160): NetworkManager-libnm-1.48.2-2.el9.x8 4.9 MB/s | 1.8 MB 00:00 2024-07-27T03:06:30.201 INFO:teuthology.orchestra.run.smithi121.stdout:(155/160): elfutils-debuginfod-client-0.191-4.e 258 kB/s | 37 kB 00:00 2024-07-27T03:06:30.226 INFO:teuthology.orchestra.run.smithi121.stdout:(156/160): elfutils-libelf-0.191-4.el9.x86_64.r 1.5 MB/s | 207 kB 00:00 2024-07-27T03:06:30.252 INFO:teuthology.orchestra.run.smithi121.stdout:(157/160): elfutils-libs-0.191-4.el9.x86_64.rpm 3.4 MB/s | 260 kB 00:00 2024-07-27T03:06:30.352 INFO:teuthology.orchestra.run.smithi121.stdout:(158/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-07-27T03:06:30.402 INFO:teuthology.orchestra.run.smithi121.stdout:(159/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-07-27T03:06:30.537 INFO:teuthology.orchestra.run.smithi120.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 59 kB/s | 41 kB 00:00 2024-07-27T03:06:30.627 INFO:teuthology.orchestra.run.smithi121.stdout:(160/160): openssl-3.2.2-2.el9.x86_64.rpm 3.2 MB/s | 1.4 MB 00:00 2024-07-27T03:06:30.634 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-07-27T03:06:30.634 INFO:teuthology.orchestra.run.smithi121.stdout:Total 22 MB/s | 232 MB 00:10 2024-07-27T03:06:30.721 INFO:teuthology.orchestra.run.smithi120.stdout:(152/160): NetworkManager-1.48.2-2.el9.x86_64.r 2.0 MB/s | 2.3 MB 00:01 2024-07-27T03:06:30.921 INFO:teuthology.orchestra.run.smithi120.stdout:(153/160): NetworkManager-libnm-1.48.2-2.el9.x8 1.6 MB/s | 1.8 MB 00:01 2024-07-27T03:06:31.363 INFO:teuthology.orchestra.run.smithi120.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 57 kB/s | 37 kB 00:00 2024-07-27T03:06:31.488 INFO:teuthology.orchestra.run.smithi120.stdout:(155/160): NetworkManager-tui-1.48.2-2.el9.x86_ 260 kB/s | 247 kB 00:00 2024-07-27T03:06:31.780 INFO:teuthology.orchestra.run.smithi120.stdout:(156/160): elfutils-libelf-0.191-4.el9.x86_64.r 241 kB/s | 207 kB 00:00 2024-07-27T03:06:31.886 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-07-27T03:06:32.090 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-07-27T03:06:32.090 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-07-27T03:06:32.214 INFO:teuthology.orchestra.run.smithi120.stdout:(157/160): elfutils-libs-0.191-4.el9.x86_64.rpm 305 kB/s | 260 kB 00:00 2024-07-27T03:06:32.556 INFO:teuthology.orchestra.run.smithi120.stdout:(158/160): openssl-3.2.2-2.el9.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2024-07-27T03:06:32.922 INFO:teuthology.orchestra.run.smithi120.stdout:(159/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-07-27T03:06:33.256 INFO:teuthology.orchestra.run.smithi120.stdout:(160/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 1.0 MB/s | 1.1 MB 00:01 2024-07-27T03:06:33.264 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-07-27T03:06:33.264 INFO:teuthology.orchestra.run.smithi120.stdout:Total 14 MB/s | 232 MB 00:16 2024-07-27T03:06:34.274 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-07-27T03:06:34.275 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-07-27T03:06:34.513 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-07-27T03:06:34.718 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-07-27T03:06:34.718 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-07-27T03:06:37.181 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-07-27T03:06:37.181 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-07-27T03:06:40.651 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-07-27T03:06:40.748 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-27T03:06:40.786 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-27T03:06:40.857 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-27T03:06:40.898 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-27T03:06:40.924 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-07-27T03:06:40.979 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-07-27T03:06:41.344 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-07-27T03:06:41.458 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 8/172 2024-07-27T03:06:41.592 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 8/172 2024-07-27T03:06:41.626 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 9/172 2024-07-27T03:06:41.722 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 9/172 2024-07-27T03:06:41.747 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 10/172 2024-07-27T03:06:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-07-27T03:06:41.995 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-07-27T03:06:42.045 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-27T03:06:42.073 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 14/172 2024-07-27T03:06:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 14/172 2024-07-27T03:06:42.208 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:19.0.0-5358.gaf8fdbf0.el9.x86 15/172 2024-07-27T03:06:42.271 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5358.gaf8fdbf0.el9.x86 15/172 2024-07-27T03:06:42.302 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-27T03:06:42.322 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-27T03:06:42.519 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-27T03:06:42.624 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-27T03:06:42.886 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-27T03:06:43.084 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-27T03:06:43.137 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-27T03:06:43.256 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-27T03:06:43.337 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-27T03:06:43.493 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-07-27T03:06:43.555 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-27T03:06:43.578 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-27T03:06:43.624 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-27T03:06:43.684 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-27T03:06:43.686 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-27T03:06:43.720 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-27T03:06:43.725 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-27T03:06:43.746 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-07-27T03:06:43.759 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-27T03:06:43.792 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-07-27T03:06:43.826 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-27T03:06:43.871 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-27T03:06:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-27T03:06:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-27T03:06:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-27T03:06:44.025 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-27T03:06:44.093 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-27T03:06:44.146 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-27T03:06:44.177 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-27T03:06:44.213 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-27T03:06:44.239 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-07-27T03:06:44.281 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librados2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 8/172 2024-07-27T03:06:44.288 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-27T03:06:44.332 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:19.0.0-5358.gaf8fdbf0.el9. 35/172 2024-07-27T03:06:44.386 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:19.0.0-5358.gaf8fdbf0.el 36/172 2024-07-27T03:06:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 8/172 2024-07-27T03:06:44.421 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:19.0.0-5358.gaf8fdbf0.el9.x86_6 37/172 2024-07-27T03:06:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 9/172 2024-07-27T03:06:44.490 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-27T03:06:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 9/172 2024-07-27T03:06:44.552 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-27T03:06:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rados-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 10/172 2024-07-27T03:06:44.626 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-27T03:06:44.651 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-07-27T03:06:44.757 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-27T03:06:44.812 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-27T03:06:44.852 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-07-27T03:06:44.911 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-27T03:06:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephsqlite-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 14/172 2024-07-27T03:06:45.035 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 14/172 2024-07-27T03:06:45.065 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libradosstriper1-2:19.0.0-5358.gaf8fdbf0.el9.x86 15/172 2024-07-27T03:06:45.128 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5358.gaf8fdbf0.el9.x86 15/172 2024-07-27T03:06:45.149 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-27T03:06:45.173 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-27T03:06:45.326 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-27T03:06:45.335 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-27T03:06:45.400 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-27T03:06:45.424 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-27T03:06:45.429 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-27T03:06:45.481 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-27T03:06:45.531 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-27T03:06:45.570 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_6 48/172 2024-07-27T03:06:45.611 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-07-27T03:06:45.778 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-27T03:06:45.834 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-27T03:06:45.855 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-27T03:06:46.013 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-27T03:06:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-27T03:06:46.167 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-27T03:06:46.273 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-27T03:06:46.279 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-27T03:06:46.345 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-27T03:06:46.360 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-27T03:06:46.385 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-27T03:06:46.419 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-27T03:06:46.474 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-27T03:06:46.518 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-27T03:06:46.561 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-27T03:06:46.578 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-27T03:06:46.603 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-27T03:06:46.699 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-27T03:06:46.731 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-27T03:06:46.738 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-27T03:06:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-27T03:06:46.780 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-27T03:06:46.821 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-27T03:06:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-27T03:06:46.875 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-27T03:06:46.907 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-27T03:06:46.920 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-27T03:06:46.950 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-27T03:06:46.963 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-27T03:06:46.985 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-27T03:06:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-27T03:06:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-27T03:06:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-27T03:06:47.062 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-27T03:06:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-27T03:06:47.141 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-27T03:06:47.142 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-27T03:06:47.172 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-27T03:06:47.217 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-27T03:06:47.278 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-27T03:06:47.292 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-27T03:06:47.311 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-27T03:06:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-common-2:19.0.0-5358.gaf8fdbf0.el9. 35/172 2024-07-27T03:06:47.338 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-27T03:06:47.372 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-argparse-2:19.0.0-5358.gaf8fdbf0.el 36/172 2024-07-27T03:06:47.376 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-27T03:06:47.398 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cephfs-2:19.0.0-5358.gaf8fdbf0.el9.x86_6 37/172 2024-07-27T03:06:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-27T03:06:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-27T03:06:47.469 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-27T03:06:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-27T03:06:47.525 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-27T03:06:47.538 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-27T03:06:47.575 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-27T03:06:47.612 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-27T03:06:47.616 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-27T03:06:47.651 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-27T03:06:47.737 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-27T03:06:47.747 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-27T03:06:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-27T03:06:47.800 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-27T03:06:47.838 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-27T03:06:47.940 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-27T03:06:47.997 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-27T03:06:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-27T03:06:48.411 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-27T03:06:48.440 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-27T03:06:48.486 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-27T03:06:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-27T03:06:48.563 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librados-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_6 48/172 2024-07-27T03:06:48.647 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-07-27T03:06:48.709 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-27T03:06:48.752 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-27T03:06:48.786 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-27T03:06:48.884 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-27T03:06:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-27T03:06:48.932 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-27T03:06:48.986 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-27T03:06:48.999 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-27T03:06:49.074 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-27T03:06:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-27T03:06:49.105 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-27T03:06:49.155 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-27T03:06:49.229 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-27T03:06:49.267 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-27T03:06:49.282 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-27T03:06:49.303 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-27T03:06:49.329 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-27T03:06:49.350 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-27T03:06:49.386 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-27T03:06:49.406 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-27T03:06:49.429 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-27T03:06:49.471 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-27T03:06:49.610 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-27T03:06:49.656 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-27T03:06:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-27T03:06:49.805 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-27T03:06:49.849 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-27T03:06:49.892 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-27T03:06:49.921 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-27T03:06:49.946 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-27T03:06:50.048 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-27T03:06:50.125 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-27T03:06:50.180 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-27T03:06:50.219 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-27T03:06:50.243 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-27T03:06:50.247 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-27T03:06:50.282 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-27T03:06:50.321 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-27T03:06:50.353 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-27T03:06:50.382 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-27T03:06:50.417 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-27T03:06:50.450 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-27T03:06:50.491 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-27T03:06:50.526 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-27T03:06:50.613 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-27T03:06:50.657 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-27T03:06:50.688 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-27T03:06:50.791 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-27T03:06:50.847 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-27T03:06:51.482 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-27T03:06:51.569 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-27T03:06:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-27T03:06:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-27T03:06:51.674 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-27T03:06:51.710 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-27T03:06:51.744 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-27T03:06:51.752 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-27T03:06:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-27T03:06:51.852 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-27T03:06:51.941 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-27T03:06:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-27T03:06:52.081 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-27T03:06:52.132 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 104/172 2024-07-27T03:06:52.155 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-27T03:06:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-27T03:06:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 104/172 2024-07-27T03:06:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 105/172 2024-07-27T03:06:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-27T03:06:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-27T03:06:52.786 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-27T03:06:52.826 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 108/172 2024-07-27T03:06:52.890 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 108/172 2024-07-27T03:06:52.928 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 109/172 2024-07-27T03:06:52.936 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-27T03:06:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-27T03:06:54.330 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-27T03:06:54.423 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-27T03:06:54.451 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-27T03:06:54.484 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-27T03:06:54.812 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-27T03:06:54.863 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librbd1-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 104/172 2024-07-27T03:06:54.967 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 104/172 2024-07-27T03:06:54.993 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 105/172 2024-07-27T03:06:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-27T03:06:55.196 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 110/172 2024-07-27T03:06:55.232 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 110/172 2024-07-27T03:06:55.525 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-27T03:06:55.557 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librgw2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 108/172 2024-07-27T03:06:55.629 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librgw2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 108/172 2024-07-27T03:06:55.659 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 109/172 2024-07-27T03:06:55.797 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 110/172 2024-07-27T03:06:55.836 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 111/172 2024-07-27T03:06:55.928 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 111/172 2024-07-27T03:06:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-27T03:06:55.928 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-27T03:06:55.928 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:06:55.962 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 112/172 2024-07-27T03:06:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 110/172 2024-07-27T03:06:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 110/172 2024-07-27T03:06:58.530 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 110/172 2024-07-27T03:06:58.575 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-base-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 111/172 2024-07-27T03:06:58.668 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-base-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 111/172 2024-07-27T03:06:58.668 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-27T03:06:58.668 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-27T03:06:58.668 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:06:58.701 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-selinux-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 112/172 2024-07-27T03:07:07.429 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 112/172 2024-07-27T03:07:07.429 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-07-27T03:07:07.429 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-07-27T03:07:07.429 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-07-27T03:07:07.429 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-07-27T03:07:07.429 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-07-27T03:07:07.429 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2024-07-27T03:07:07.429 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-07-27T03:07:07.429 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:07.605 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:19.0.0-5358.gaf8fdbf0.el9.noarch 113/172 2024-07-27T03:07:07.632 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:19.0.0-5358.gaf8fdbf0.el9.noarch 113/172 2024-07-27T03:07:07.632 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:07.632 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-27T03:07:07.632 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:09.217 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 114/172 2024-07-27T03:07:09.244 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 114/172 2024-07-27T03:07:09.244 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:09.244 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-27T03:07:09.244 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-27T03:07:09.244 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-27T03:07:09.244 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:09.476 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 115/172 2024-07-27T03:07:09.499 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 115/172 2024-07-27T03:07:09.500 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:09.500 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-27T03:07:09.500 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-27T03:07:09.500 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-27T03:07:09.500 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:09.968 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 116/172 2024-07-27T03:07:09.992 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 116/172 2024-07-27T03:07:09.992 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:09.992 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-27T03:07:09.992 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-27T03:07:09.992 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-27T03:07:09.992 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:10.107 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-27T03:07:10.164 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-27T03:07:10.227 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-27T03:07:10.412 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-27T03:07:10.461 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-27T03:07:10.540 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-27T03:07:10.635 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-27T03:07:10.728 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 112/172 2024-07-27T03:07:10.728 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /sys 2024-07-27T03:07:10.728 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /proc 2024-07-27T03:07:10.729 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /mnt 2024-07-27T03:07:10.729 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /var/tmp 2024-07-27T03:07:10.729 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /home 2024-07-27T03:07:10.729 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /root 2024-07-27T03:07:10.729 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /tmp 2024-07-27T03:07:10.729 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-27T03:07:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-27T03:07:10.844 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-27T03:07:10.871 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-27T03:07:10.910 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-volume-2:19.0.0-5358.gaf8fdbf0.el9.noarch 113/172 2024-07-27T03:07:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-volume-2:19.0.0-5358.gaf8fdbf0.el9.noarch 113/172 2024-07-27T03:07:10.928 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:10.928 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-27T03:07:10.928 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:11.333 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noarch 128/172 2024-07-27T03:07:11.362 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noarch 128/172 2024-07-27T03:07:11.394 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5358.gaf8fdbf0.e 129/172 2024-07-27T03:07:11.457 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5358.gaf8fdbf0. 130/172 2024-07-27T03:07:11.484 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noa 131/172 2024-07-27T03:07:12.515 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-osd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 114/172 2024-07-27T03:07:12.541 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-osd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 114/172 2024-07-27T03:07:12.541 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:12.541 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-27T03:07:12.541 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-27T03:07:12.541 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-27T03:07:12.542 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:12.766 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mds-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 115/172 2024-07-27T03:07:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mds-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 115/172 2024-07-27T03:07:12.788 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:12.788 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-27T03:07:12.788 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-27T03:07:12.788 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-27T03:07:12.788 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:13.250 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mon-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 116/172 2024-07-27T03:07:13.272 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mon-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 116/172 2024-07-27T03:07:13.272 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:13.272 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-27T03:07:13.272 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-27T03:07:13.273 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-27T03:07:13.273 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:13.380 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-27T03:07:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-27T03:07:13.497 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-27T03:07:13.687 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-27T03:07:13.735 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-27T03:07:13.812 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-27T03:07:13.909 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-27T03:07:14.057 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-27T03:07:14.102 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-27T03:07:14.134 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-27T03:07:14.161 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-27T03:07:14.617 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noa 131/172 2024-07-27T03:07:14.623 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noarch 128/172 2024-07-27T03:07:14.652 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noarch 128/172 2024-07-27T03:07:14.665 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5358.gaf8fdbf0.el9.n 132/172 2024-07-27T03:07:14.684 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5358.gaf8fdbf0.e 129/172 2024-07-27T03:07:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5358.gaf8fdbf0. 130/172 2024-07-27T03:07:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noa 131/172 2024-07-27T03:07:15.624 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5358.gaf8fdbf0.el9.n 132/172 2024-07-27T03:07:15.666 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5358.gaf8 133/172 2024-07-27T03:07:15.777 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5358.gaf8 133/172 2024-07-27T03:07:15.950 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5358.gaf8fdbf0.el 134/172 2024-07-27T03:07:15.976 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 135/172 2024-07-27T03:07:16.000 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 135/172 2024-07-27T03:07:16.001 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:16.001 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-27T03:07:16.001 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-27T03:07:16.001 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-27T03:07:16.001 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:16.052 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:19.0.0-5358.gaf8fdbf0.el9.noarch 136/172 2024-07-27T03:07:16.064 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5358.gaf8fdbf0.el9.noarch 136/172 2024-07-27T03:07:16.162 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 137/172 2024-07-27T03:07:16.219 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 138/172 2024-07-27T03:07:17.180 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-27T03:07:17.204 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 140/172 2024-07-27T03:07:17.229 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 140/172 2024-07-27T03:07:17.229 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:17.229 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-27T03:07:17.229 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-27T03:07:17.229 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-27T03:07:17.229 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:17.274 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5358.gaf8fd 141/172 2024-07-27T03:07:17.294 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5358.gaf8fd 141/172 2024-07-27T03:07:17.294 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:17.294 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-27T03:07:17.294 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:17.338 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 142/172 2024-07-27T03:07:17.361 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 142/172 2024-07-27T03:07:17.361 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:17.361 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-27T03:07:17.362 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-27T03:07:17.362 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-27T03:07:17.362 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:17.682 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 143/172 2024-07-27T03:07:17.704 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 143/172 2024-07-27T03:07:17.705 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:17.705 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-27T03:07:17.705 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-27T03:07:17.705 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-27T03:07:17.705 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:17.944 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noa 131/172 2024-07-27T03:07:18.007 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5358.gaf8fdbf0.el9.n 132/172 2024-07-27T03:07:18.966 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5358.gaf8fdbf0.el9.n 132/172 2024-07-27T03:07:18.999 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5358.gaf8 133/172 2024-07-27T03:07:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5358.gaf8 133/172 2024-07-27T03:07:19.284 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5358.gaf8fdbf0.el 134/172 2024-07-27T03:07:19.310 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 135/172 2024-07-27T03:07:19.334 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 135/172 2024-07-27T03:07:19.334 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:19.334 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-27T03:07:19.334 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-27T03:07:19.334 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-27T03:07:19.334 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-rook-2:19.0.0-5358.gaf8fdbf0.el9.noarch 136/172 2024-07-27T03:07:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5358.gaf8fdbf0.el9.noarch 136/172 2024-07-27T03:07:19.504 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 137/172 2024-07-27T03:07:19.562 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 138/172 2024-07-27T03:07:20.522 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-27T03:07:20.555 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-radosgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 140/172 2024-07-27T03:07:20.577 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 140/172 2024-07-27T03:07:20.578 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:20.578 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-27T03:07:20.578 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-27T03:07:20.578 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-27T03:07:20.578 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:20.622 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5358.gaf8fd 141/172 2024-07-27T03:07:20.644 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5358.gaf8fd 141/172 2024-07-27T03:07:20.644 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:20.644 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-27T03:07:20.644 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:20.689 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 142/172 2024-07-27T03:07:20.712 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 142/172 2024-07-27T03:07:20.712 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:20.712 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-27T03:07:20.712 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-27T03:07:20.713 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-27T03:07:20.713 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 143/172 2024-07-27T03:07:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 143/172 2024-07-27T03:07:21.055 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-27T03:07:21.055 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-27T03:07:21.055 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-27T03:07:21.055 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-27T03:07:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:22.044 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 144/172 2024-07-27T03:07:22.084 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 145/172 2024-07-27T03:07:22.124 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 146/172 2024-07-27T03:07:22.157 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-27T03:07:22.184 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-27T03:07:22.375 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-shell-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 149/172 2024-07-27T03:07:22.422 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-27T03:07:22.447 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_ 151/172 2024-07-27T03:07:22.478 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-27T03:07:22.508 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-27T03:07:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-27T03:07:23.158 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-27T03:07:23.194 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-27T03:07:23.214 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-27T03:07:24.048 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-top-2:19.0.0-5358.gaf8fdbf0.el9.noarch 156/172 2024-07-27T03:07:24.146 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-27T03:07:24.187 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-27T03:07:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-27T03:07:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-27T03:07:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-27T03:07:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-27T03:07:24.385 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-27T03:07:24.385 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-27T03:07:24.470 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-27T03:07:24.503 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-27T03:07:24.503 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-27T03:07:24.596 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-27T03:07:24.621 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-27T03:07:24.627 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-27T03:07:24.627 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-27T03:07:24.806 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-27T03:07:24.806 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-27T03:07:24.891 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-27T03:07:24.915 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-27T03:07:24.942 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-27T03:07:25.017 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-27T03:07:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-test-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 144/172 2024-07-27T03:07:25.427 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 145/172 2024-07-27T03:07:25.468 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-nbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 146/172 2024-07-27T03:07:25.500 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-27T03:07:25.527 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-27T03:07:25.715 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-shell-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 149/172 2024-07-27T03:07:25.766 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-27T03:07:25.800 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_ 151/172 2024-07-27T03:07:25.839 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-27T03:07:25.869 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-27T03:07:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-27T03:07:26.529 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-27T03:07:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-27T03:07:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-27T03:07:27.431 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-top-2:19.0.0-5358.gaf8fdbf0.el9.noarch 156/172 2024-07-27T03:07:27.520 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-27T03:07:27.578 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-27T03:07:27.663 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-27T03:07:27.698 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-27T03:07:27.724 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-27T03:07:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-27T03:07:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-27T03:07:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-27T03:07:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-27T03:07:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-27T03:07:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-27T03:07:27.986 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-27T03:07:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-27T03:07:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-27T03:07:28.016 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-27T03:07:28.197 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-27T03:07:28.198 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-27T03:07:28.282 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-27T03:07:28.306 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-27T03:07:28.366 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-27T03:07:28.431 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-27T03:07:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-27T03:07:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 1/172 2024-07-27T03:07:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2/172 2024-07-27T03:07:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 3/172 2024-07-27T03:07:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 4/172 2024-07-27T03:07:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5358.gaf8fd 5/172 2024-07-27T03:07:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 6/172 2024-07-27T03:07:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 7/172 2024-07-27T03:07:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 8/172 2024-07-27T03:07:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 9/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 10/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 11/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 12/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 13/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-shell-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 14/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_ 15/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 16/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 17/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_6 18/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:19.0.0-5358.gaf8fdbf0.el9.x86 19/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 20/172 2024-07-27T03:07:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5358.gaf8fdbf0.el 21/172 2024-07-27T03:07:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:19.0.0-5358.gaf8fdbf0.el9. 22/172 2024-07-27T03:07:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:19.0.0-5358.gaf8fdbf0.el9.x86_6 23/172 2024-07-27T03:07:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 24/172 2024-07-27T03:07:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 25/172 2024-07-27T03:07:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 26/172 2024-07-27T03:07:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 27/172 2024-07-27T03:07:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 28/172 2024-07-27T03:07:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 29/172 2024-07-27T03:07:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5358.gaf8fdbf0. 30/172 2024-07-27T03:07:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noa 31/172 2024-07-27T03:07:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5358.gaf8fdbf0.el9.n 32/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5358.gaf8 33/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5358.gaf8fdbf0.el 34/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5358.gaf8fdbf0.el9.noarch 35/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5358.gaf8fdbf0.e 36/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:19.0.0-5358.gaf8fdbf0.el9.noarch 37/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noarch 38/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-top-2:19.0.0-5358.gaf8fdbf0.el9.noarch 39/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-27T03:07:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-27T03:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-27T03:07:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-27T03:07:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-27T03:07:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-27T03:07:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-27T03:07:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-27T03:07:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 149/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 151/172 2024-07-27T03:07:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-27T03:07:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-27T03:07:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-27T03:07:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-27T03:07:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-27T03:07:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-27T03:07:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-27T03:07:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-27T03:07:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-27T03:07:34.268 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-27T03:07:34.268 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:34.268 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-07-27T03:07:34.268 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-27T03:07:34.268 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-27T03:07:34.268 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-27T03:07:34.268 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-27T03:07:34.268 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-27T03:07:34.268 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-27T03:07:34.268 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.2-8.el9.noarch 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.7.4-5.el9.x86_64 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.269 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:34.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:34.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:34.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:34.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:34.270 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:34.271 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.271 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.271 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:34.271 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.271 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.271 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.4-9.el9.x86_64 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-27T03:07:34.272 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-27T03:07:34.273 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-27T03:07:34.273 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-27T03:07:34.273 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-27T03:07:34.273 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.273 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.273 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.273 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-27T03:07:34.273 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-27T03:07:34.274 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-27T03:07:34.274 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-27T03:07:34.274 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-27T03:07:34.274 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.274 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.274 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-27T03:07:34.274 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.274 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-27T03:07:34.274 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-27T03:07:34.274 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: lua-5.4.4-4.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-13.14-1.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-27T03:07:34.275 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-27T03:07:34.276 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-27T03:07:34.277 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-27T03:07:34.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-27T03:07:34.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-27T03:07:34.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-27T03:07:34.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-27T03:07:34.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-27T03:07:34.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-27T03:07:34.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-27T03:07:34.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-27T03:07:34.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-27T03:07:34.278 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-27T03:07:34.279 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-27T03:07:34.280 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-27T03:07:34.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-27T03:07:34.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-27T03:07:34.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-27T03:07:34.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-27T03:07:34.281 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-27T03:07:34.281 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-27T03:07:34.281 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-27T03:07:34.281 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-27T03:07:34.282 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.282 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.282 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:34.282 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-3.el9.x86_64 2024-07-27T03:07:34.282 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-27T03:07:34.282 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-27T03:07:34.282 INFO:teuthology.orchestra.run.smithi121.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-27T03:07:34.282 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-27T03:07:34.282 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-27T03:07:34.283 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-27T03:07:34.283 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:34.283 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-07-27T03:07:34.749 DEBUG:teuthology.parallel:result is None 2024-07-27T03:07:34.881 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-27T03:07:34.881 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 1/172 2024-07-27T03:07:34.881 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-base-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2/172 2024-07-27T03:07:34.881 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 3/172 2024-07-27T03:07:34.881 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 4/172 2024-07-27T03:07:34.881 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5358.gaf8fd 5/172 2024-07-27T03:07:34.881 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mds-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 6/172 2024-07-27T03:07:34.881 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 7/172 2024-07-27T03:07:34.881 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mon-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 8/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-osd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 9/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-radosgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 10/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-selinux-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 11/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-test-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 12/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 13/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-shell-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 14/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_ 15/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 16/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephsqlite-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 17/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_6 18/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libradosstriper1-2:19.0.0-5358.gaf8fdbf0.el9.x86 19/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librgw2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 20/172 2024-07-27T03:07:34.882 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5358.gaf8fdbf0.el 21/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-common-2:19.0.0-5358.gaf8fdbf0.el9. 22/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cephfs-2:19.0.0-5358.gaf8fdbf0.el9.x86_6 23/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rados-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 24/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 25/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 26/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 27/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 28/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-nbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 29/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5358.gaf8fdbf0. 30/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noa 31/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5358.gaf8fdbf0.el9.n 32/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5358.gaf8 33/172 2024-07-27T03:07:34.883 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5358.gaf8fdbf0.el 34/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5358.gaf8fdbf0.el9.noarch 35/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5358.gaf8fdbf0.e 36/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-volume-2:19.0.0-5358.gaf8fdbf0.el9.noarch 37/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noarch 38/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-top-2:19.0.0-5358.gaf8fdbf0.el9.noarch 39/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-27T03:07:34.884 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-27T03:07:34.885 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-27T03:07:34.886 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-27T03:07:34.887 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-27T03:07:34.888 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-27T03:07:34.889 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-27T03:07:34.889 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-27T03:07:34.889 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-27T03:07:34.889 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-27T03:07:34.889 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-27T03:07:34.889 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-27T03:07:34.889 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-27T03:07:34.889 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-27T03:07:34.890 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-27T03:07:34.891 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-27T03:07:34.892 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 149/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 151/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-27T03:07:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-27T03:07:34.894 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-27T03:07:34.894 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-27T03:07:34.894 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-27T03:07:34.894 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-27T03:07:34.894 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-27T03:07:34.894 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-27T03:07:34.894 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-27T03:07:34.894 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-27T03:07:34.894 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-27T03:07:34.894 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-27T03:07:34.894 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-27T03:07:37.746 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-27T03:07:37.746 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:37.746 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2024-07-27T03:07:37.746 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-27T03:07:37.746 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout: librados2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-07-27T03:07:37.747 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: automake-1.16.2-8.el9.noarch 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: bison-3.7.4-5.el9.x86_64 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:37.748 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.749 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-shell-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-top-2:19.0.0-5358.gaf8fdbf0.el9.noarch 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: flex-2.6.4-9.el9.x86_64 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-27T03:07:37.750 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-27T03:07:37.751 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: lua-5.4.4-4.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-13.14-1.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-27T03:07:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-27T03:07:37.753 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-27T03:07:37.754 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-27T03:07:37.755 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply-3.11-14.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-27T03:07:37.756 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-27T03:07:37.757 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-27T03:07:37.758 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-27T03:07:37.758 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-27T03:07:37.758 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-27T03:07:37.758 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-27T03:07:37.758 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-27T03:07:37.758 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-27T03:07:37.758 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-27T03:07:37.758 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.758 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.758 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd-2:19.0.0-5358.gaf8fdbf0.el9.x86_64 2024-07-27T03:07:37.758 INFO:teuthology.orchestra.run.smithi120.stdout: re2-1:20211101-3.el9.x86_64 2024-07-27T03:07:37.759 INFO:teuthology.orchestra.run.smithi120.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-27T03:07:37.759 INFO:teuthology.orchestra.run.smithi120.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-27T03:07:37.759 INFO:teuthology.orchestra.run.smithi120.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-27T03:07:37.759 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-27T03:07:37.759 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-27T03:07:37.759 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-27T03:07:37.759 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:37.760 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-07-27T03:07:38.197 DEBUG:teuthology.parallel:result is None 2024-07-27T03:07:38.198 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=af8fdbf079811fe158ce62927bd145c35b74d4b8 2024-07-27T03:07:38.348 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-27T03:07:38.371 INFO:teuthology.orchestra.run.smithi120.stdout:19.0.0-5358.gaf8fdbf0.el9 2024-07-27T03:07:38.372 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5358.gaf8fdbf0.el9 2024-07-27T03:07:38.372 INFO:teuthology.task.install:The correct ceph version 19.0.0-5358.gaf8fdbf0 is installed. 2024-07-27T03:07:38.374 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=af8fdbf079811fe158ce62927bd145c35b74d4b8 2024-07-27T03:07:38.528 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-27T03:07:38.554 INFO:teuthology.orchestra.run.smithi121.stdout:19.0.0-5358.gaf8fdbf0.el9 2024-07-27T03:07:38.555 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5358.gaf8fdbf0.el9 2024-07-27T03:07:38.555 INFO:teuthology.task.install:The correct ceph version 19.0.0-5358.gaf8fdbf0 is installed. 2024-07-27T03:07:38.556 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-07-27T03:07:38.557 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:07:38.557 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-27T03:07:38.584 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:07:38.584 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-27T03:07:38.628 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-07-27T03:07:38.628 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:07:38.628 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-07-27T03:07:38.654 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-27T03:07:38.719 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:07:38.719 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-07-27T03:07:38.748 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-27T03:07:38.816 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-07-27T03:07:38.816 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:07:38.816 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-27T03:07:38.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-27T03:07:38.904 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:07:38.905 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-27T03:07:38.933 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-27T03:07:39.001 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-07-27T03:07:39.002 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:07:39.002 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-07-27T03:07:39.026 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-27T03:07:39.090 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:07:39.090 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-07-27T03:07:39.120 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-27T03:07:39.189 INFO:teuthology.run_tasks:Running task ceph... 2024-07-27T03:07:39.271 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-07-27T03:07:39.271 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-07-27T03:07:39.274 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2024-07-27T03:07:39.301 INFO:tasks.ceph:Disabling ceph logrotate... 2024-07-27T03:07:39.301 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-07-27T03:07:39.338 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2024-07-27T03:07:39.368 INFO:tasks.ceph:Creating extra log directories... 2024-07-27T03:07:39.368 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-07-27T03:07:39.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-07-27T03:07:39.441 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-07-27T03:07:39.441 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-07-27T03:07:39.442 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-07-27T03:07:39.442 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:07:39.442 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-07-27T03:07:39.481 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-07-27T03:07:39.589 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-07-27T03:07:39.613 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:07:39.613 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-07-27T03:07:39.630 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-07-27T03:07:39.744 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-07-27T03:07:39.776 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-07-27T03:07:39.776 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-07-27T03:07:39.776 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981', 'branch': 'wip-pdonnell-testing-20240726.202642-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/exports}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7820981', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240726.202642-debug'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds'], 'sha1': 'af8fdbf079811fe158ce62927bd145c35b74d4b8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'af8fdbf079811fe158ce62927bd145c35b74d4b8'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240726.202642-debug', 'sha1': 'af8fdbf079811fe158ce62927bd145c35b74d4b8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6029, 'sha1': 'af8fdbf079811fe158ce62927bd145c35b74d4b8', 'sleep_before_teardown': 0, 'subset': '246/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240726.202642-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'af8fdbf079811fe158ce62927bd145c35b74d4b8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFfFUK5hSrS6gnX+HwArg+FmHlElHhUNCBuwmbKEcTpRkxiRovZ6LKIU6RPTjLhlPGGh13kyN8mEz29o/FuZi6w=', 'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKPqdxbSoAMZNANjQW3rmiYvDlBNP4nWdtDx0qmPKkfNgE+tsgZcYyqpsyeQjdosPFHJK+IryW9oZtV7AUX5bgE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'af8fdbf079811fe158ce62927bd145c35b74d4b8'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds'], 'sha1': 'af8fdbf079811fe158ce62927bd145c35b74d4b8', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_exports']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '53ce1462e129f6eb4071986336534c740fdebd31', 'timestamp': '2024-07-26_23:45:44', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.4074525'} 2024-07-27T03:07:39.777 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-07-27T03:07:39.779 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-07-27T03:07:39.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-07-27T03:07:39.835 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2024-07-27T03:07:39.892 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:07:39.892 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-07-27T03:07:39.913 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-27T03:07:39.913 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-07-27T03:07:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-27T03:07:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-27T03:07:39.970 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 673 Links: 1 2024-07-27T03:07:39.971 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-27T03:07:39.971 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-07-27T03:07:39.971 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-07-27 03:07:28.774418582 +0000 2024-07-27T03:07:39.971 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-07-27 03:05:12.909390215 +0000 2024-07-27T03:07:39.971 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-07-27 03:05:12.909390215 +0000 2024-07-27T03:07:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-07-27 03:05:12.909390215 +0000 2024-07-27T03:07:39.971 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-27T03:07:40.033 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-07-27T03:07:40.033 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-07-27T03:07:40.033 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.00020617 s, 2.5 MB/s 2024-07-27T03:07:40.035 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-27T03:07:40.092 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-07-27T03:07:40.148 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-27T03:07:40.148 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-27T03:07:40.148 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-07-27T03:07:40.148 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-27T03:07:40.148 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-07-27T03:07:40.148 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-07-27 03:07:28.774418582 +0000 2024-07-27T03:07:40.148 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-07-27 03:05:13.251382168 +0000 2024-07-27T03:07:40.148 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-07-27 03:05:13.251382168 +0000 2024-07-27T03:07:40.149 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-07-27 03:05:13.251382168 +0000 2024-07-27T03:07:40.149 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-27T03:07:40.211 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-07-27T03:07:40.211 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-07-27T03:07:40.211 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000201392 s, 2.5 MB/s 2024-07-27T03:07:40.212 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-27T03:07:40.268 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-07-27T03:07:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-27T03:07:40.323 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-27T03:07:40.323 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 712 Links: 1 2024-07-27T03:07:40.323 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-27T03:07:40.323 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-07-27T03:07:40.323 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-07-27 03:07:28.774418582 +0000 2024-07-27T03:07:40.323 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-07-27 03:05:13.611373698 +0000 2024-07-27T03:07:40.324 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-07-27 03:05:13.611373698 +0000 2024-07-27T03:07:40.324 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-07-27 03:05:13.611373698 +0000 2024-07-27T03:07:40.324 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-27T03:07:40.386 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-07-27T03:07:40.386 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-07-27T03:07:40.386 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000185416 s, 2.8 MB/s 2024-07-27T03:07:40.388 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-27T03:07:40.444 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-07-27T03:07:40.500 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-27T03:07:40.500 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-27T03:07:40.500 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 730 Links: 1 2024-07-27T03:07:40.500 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-27T03:07:40.500 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-07-27T03:07:40.500 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-07-27 03:07:28.775418558 +0000 2024-07-27T03:07:40.500 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-07-27 03:05:13.949365745 +0000 2024-07-27T03:07:40.500 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-07-27 03:05:13.949365745 +0000 2024-07-27T03:07:40.500 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-07-27 03:05:13.949365745 +0000 2024-07-27T03:07:40.500 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-27T03:07:40.563 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-07-27T03:07:40.563 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-07-27T03:07:40.563 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.00016315 s, 3.1 MB/s 2024-07-27T03:07:40.565 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-27T03:07:40.621 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-07-27T03:07:40.622 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:07:40.622 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-07-27T03:07:40.641 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-27T03:07:40.641 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-07-27T03:07:40.700 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-27T03:07:40.700 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-27T03:07:40.700 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-07-27T03:07:40.700 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-27T03:07:40.700 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-07-27T03:07:40.700 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-07-27 03:07:25.378540200 +0000 2024-07-27T03:07:40.700 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-07-27 03:05:12.898766296 +0000 2024-07-27T03:07:40.700 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-07-27 03:05:12.898766296 +0000 2024-07-27T03:07:40.700 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-07-27 03:05:12.898766296 +0000 2024-07-27T03:07:40.700 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-27T03:07:40.768 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-07-27T03:07:40.768 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-07-27T03:07:40.768 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000201257 s, 2.5 MB/s 2024-07-27T03:07:40.769 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-27T03:07:40.829 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-07-27T03:07:40.888 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-27T03:07:40.888 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-27T03:07:40.888 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-07-27T03:07:40.888 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-27T03:07:40.888 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-07-27T03:07:40.888 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-07-27 03:07:25.379540188 +0000 2024-07-27T03:07:40.888 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-07-27 03:05:13.239761739 +0000 2024-07-27T03:07:40.888 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-07-27 03:05:13.239761739 +0000 2024-07-27T03:07:40.889 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-07-27 03:05:13.239761739 +0000 2024-07-27T03:07:40.889 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-27T03:07:40.954 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-07-27T03:07:40.954 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-07-27T03:07:40.954 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000187814 s, 2.7 MB/s 2024-07-27T03:07:40.955 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-27T03:07:41.015 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-07-27T03:07:41.071 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-27T03:07:41.072 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-27T03:07:41.072 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-07-27T03:07:41.072 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-27T03:07:41.072 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-07-27T03:07:41.072 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-07-27 03:07:25.379540188 +0000 2024-07-27T03:07:41.072 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-07-27 03:05:13.586757102 +0000 2024-07-27T03:07:41.072 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-07-27 03:05:13.586757102 +0000 2024-07-27T03:07:41.072 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-07-27 03:05:13.586757102 +0000 2024-07-27T03:07:41.072 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-27T03:07:41.137 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-07-27T03:07:41.137 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-07-27T03:07:41.137 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000213813 s, 2.4 MB/s 2024-07-27T03:07:41.139 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-27T03:07:41.196 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-07-27T03:07:41.252 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-27T03:07:41.253 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-27T03:07:41.253 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-07-27T03:07:41.253 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-27T03:07:41.253 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-07-27T03:07:41.253 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-07-27 03:07:25.379540188 +0000 2024-07-27T03:07:41.253 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-07-27 03:05:13.921752625 +0000 2024-07-27T03:07:41.253 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-07-27 03:05:13.921752625 +0000 2024-07-27T03:07:41.253 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-07-27 03:05:13.921752625 +0000 2024-07-27T03:07:41.254 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-27T03:07:41.317 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-07-27T03:07:41.317 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-07-27T03:07:41.318 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000190379 s, 2.7 MB/s 2024-07-27T03:07:41.319 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-27T03:07:41.376 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-07-27T03:07:41.376 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-07-27T03:07:41.376 INFO:tasks.ceph:Generating config... 2024-07-27T03:07:41.377 INFO:tasks.ceph:[client] pid file = 2024-07-27T03:07:41.377 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-07-27T03:07:41.378 INFO:tasks.ceph:[mgr] debug client = 20 2024-07-27T03:07:41.378 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-07-27T03:07:41.378 INFO:tasks.ceph:[mgr] debug ms = 1 2024-07-27T03:07:41.378 INFO:tasks.ceph:[mon] debug mon = 20 2024-07-27T03:07:41.378 INFO:tasks.ceph:[mon] debug ms = 1 2024-07-27T03:07:41.378 INFO:tasks.ceph:[mon] debug paxos = 20 2024-07-27T03:07:41.378 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-07-27T03:07:41.378 INFO:tasks.ceph:[osd] bdev async discard = True 2024-07-27T03:07:41.378 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-07-27T03:07:41.378 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-07-27T03:07:41.378 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-07-27T03:07:41.378 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-07-27T03:07:41.378 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-07-27T03:07:41.378 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-07-27T03:07:41.379 INFO:tasks.ceph:[osd] debug ms = 1 2024-07-27T03:07:41.379 INFO:tasks.ceph:[osd] debug osd = 20 2024-07-27T03:07:41.379 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-07-27T03:07:41.379 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-07-27T03:07:41.379 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-07-27T03:07:41.379 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-07-27T03:07:41.379 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-07-27T03:07:41.379 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-07-27T03:07:41.379 INFO:tasks.ceph:Setting up mon.a... 2024-07-27T03:07:41.380 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-07-27T03:07:41.442 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.keyring 2024-07-27T03:07:41.445 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-07-27T03:07:41.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-07-27T03:07:41.520 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.120'), ('mon.b', '172.21.15.121'), ('mon.c', '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]')] 2024-07-27T03:07:41.521 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.120,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-07-27T03:07:41.522 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:07:41.522 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-07-27T03:07:41.576 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.120 --add b 172.21.15.121 --addv c '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:07:41.674 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: generated fsid 81c6fc84-d59a-4d77-bf87-f698cf0d6963 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:setting min_mon_release = quincy 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 0 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:fsid 81c6fc84-d59a-4d77-bf87-f698cf0d6963 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:last_changed 2024-07-27T03:07:41.673183+0000 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-07-27T03:07:41.673183+0000 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:min_mon_release 17 (quincy) 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:election_strategy: 1 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:2: [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] mon.c 2024-07-27T03:07:41.675 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-07-27T03:07:41.677 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-07-27T03:07:41.691 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 81c6fc84-d59a-4d77-bf87-f698cf0d6963... 2024-07-27T03:07:41.692 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-07-27T03:07:41.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-07-27T03:07:41.775 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-07-27T03:07:41.775 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-07-27T03:07:41.775 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-07-27T03:07:41.775 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.776 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-07-27T03:07:41.777 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-07-27T03:07:41.778 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-07-27T03:07:41.778 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-07-27T03:07:41.778 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-07-27T03:07:41.778 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-07-27T03:07:41.778 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-07-27T03:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-07-27T03:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-07-27T03:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.779 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-07-27T03:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-07-27T03:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-07-27T03:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-07-27T03:07:41.780 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.120,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]" 2024-07-27T03:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on skipped message = False 2024-07-27T03:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = 81c6fc84-d59a-4d77-bf87-f698cf0d6963 2024-07-27T03:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-07-27T03:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-07-27T03:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-07-27T03:07:41.781 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-07-27T03:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-07-27T03:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-07-27T03:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-07-27T03:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-07-27T03:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-07-27T03:07:41.782 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-07-27T03:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug trim objects = true 2024-07-27T03:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-07-27T03:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-07-27T03:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-07-27T03:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.783 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-07-27T03:07:41.784 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.784 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-07-27T03:07:41.784 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.784 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-07-27T03:07:41.784 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-07-27T03:07:41.784 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.784 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-07-27T03:07:41.784 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-07-27T03:07:41.785 INFO:teuthology.orchestra.run.smithi120.stdout: bdev async discard = True 2024-07-27T03:07:41.785 INFO:teuthology.orchestra.run.smithi120.stdout: bdev enable discard = True 2024-07-27T03:07:41.785 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore allocator = bitmap 2024-07-27T03:07:41.785 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-07-27T03:07:41.785 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-07-27T03:07:41.785 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2024-07-27T03:07:41.785 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2024-07-27T03:07:41.785 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-07-27T03:07:41.786 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-07-27T03:07:41.786 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2024-07-27T03:07:41.786 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-07-27T03:07:41.786 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-07-27T03:07:41.786 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-07-27T03:07:41.786 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-07-27T03:07:41.786 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-07-27T03:07:41.787 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.788 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-07-27T03:07:41.788 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-07-27T03:07:41.788 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-07-27T03:07:41.788 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-07-27T03:07:41.788 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-07-27T03:07:41.788 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-07-27T03:07:41.788 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-07-27T03:07:41.788 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-07-27T03:07:41.788 INFO:teuthology.orchestra.run.smithi120.stdout: debug client = 20 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-07-27T03:07:41.789 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.790 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout: mon down mkfs grace = 300 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = "" 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2024-07-27T03:07:41.791 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c] 2024-07-27T03:07:41.792 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2024-07-27T03:07:41.792 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.d] 2024-07-27T03:07:41.793 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-07-27T03:07:41.793 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-07-27T03:07:41.793 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-07-27T03:07:41.793 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-07-27T03:07:41.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.793 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-07-27T03:07:41.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.793 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-07-27T03:07:41.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.793 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-07-27T03:07:41.793 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.794 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.795 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.120,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]" 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on skipped message = False 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = 81c6fc84-d59a-4d77-bf87-f698cf0d6963 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-07-27T03:07:41.796 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug trim objects = true 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.797 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-07-27T03:07:41.798 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: bdev async discard = True 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: bdev enable discard = True 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore allocator = bitmap 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 1/20 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 1/20 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 4/10 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-07-27T03:07:41.799 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: debug client = 20 2024-07-27T03:07:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-07-27T03:07:41.801 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: mon down mkfs grace = 300 2024-07-27T03:07:41.802 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = "" 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-07-27T03:07:41.803 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2024-07-27T03:07:41.805 INFO:tasks.ceph:Creating admin key on mon.a... 2024-07-27T03:07:41.805 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-07-27T03:07:41.908 INFO:tasks.ceph:Copying monmap to all nodes... 2024-07-27T03:07:41.909 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:07:41.909 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-07-27T03:07:41.924 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:07:41.924 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-07-27T03:07:41.979 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:07:41.979 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:07:41.979 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-07-27T03:07:41.979 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-07-27T03:07:42.053 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:07:42.053 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:07:42.108 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:07:42.109 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:07:42.109 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2024-07-27T03:07:42.109 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-07-27T03:07:42.149 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:07:42.150 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:07:42.207 INFO:tasks.ceph:Setting up mon nodes... 2024-07-27T03:07:42.208 INFO:tasks.ceph:Setting up mgr nodes... 2024-07-27T03:07:42.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-07-27T03:07:42.268 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-07-27T03:07:42.271 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-07-27T03:07:42.345 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-07-27T03:07:42.348 INFO:tasks.ceph:Setting up mds nodes... 2024-07-27T03:07:42.348 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-07-27T03:07:42.409 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-07-27T03:07:42.412 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-07-27T03:07:42.437 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-07-27T03:07:42.537 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-07-27T03:07:42.540 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-07-27T03:07:42.565 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-07-27T03:07:42.630 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-07-27T03:07:42.633 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-07-27T03:07:42.658 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-07-27T03:07:42.759 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-07-27T03:07:42.762 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-07-27T03:07:42.786 INFO:tasks.ceph_client:Setting up client nodes... 2024-07-27T03:07:42.787 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-07-27T03:07:42.837 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-07-27T03:07:42.851 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-07-27T03:07:42.901 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-07-27T03:07:42.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-07-27T03:07:42.964 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-07-27T03:07:42.978 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-07-27T03:07:43.027 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-07-27T03:07:43.040 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-07-27T03:07:43.040 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-07-27T03:07:43.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-07-27T03:07:43.065 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-07-27T03:07:43.065 INFO:tasks.ceph:role: osd.0 2024-07-27T03:07:43.065 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:07:43.065 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-07-27T03:07:43.136 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-07-27T03:07:43.137 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-27T03:07:43.137 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-27T03:07:43.137 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-27T03:07:43.137 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-27T03:07:43.137 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-07-27T03:07:43.137 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-27T03:07:43.137 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-27T03:07:43.137 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-27T03:07:43.137 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-27T03:07:43.637 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-07-27T03:07:43.639 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-07-27T03:07:43.639 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-07-27T03:07:43.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-07-27T03:07:43.794 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-07-27T03:07:43.859 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-07-27T03:07:43.860 INFO:tasks.ceph:role: osd.1 2024-07-27T03:07:43.860 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:07:43.860 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-07-27T03:07:43.933 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-07-27T03:07:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-27T03:07:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-27T03:07:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-27T03:07:43.933 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-27T03:07:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-07-27T03:07:43.933 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-27T03:07:43.933 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-27T03:07:43.933 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-27T03:07:43.933 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-27T03:07:44.403 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-07-27T03:07:44.405 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-07-27T03:07:44.406 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-07-27T03:07:44.495 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-07-27T03:07:44.525 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-07-27T03:07:44.589 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-07-27T03:07:44.590 INFO:tasks.ceph:role: osd.2 2024-07-27T03:07:44.590 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:07:44.590 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-07-27T03:07:44.663 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-07-27T03:07:44.663 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-27T03:07:44.663 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-27T03:07:44.663 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-27T03:07:44.663 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-27T03:07:44.664 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-07-27T03:07:44.664 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-27T03:07:44.664 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-27T03:07:44.664 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-27T03:07:44.664 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-27T03:07:45.155 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-07-27T03:07:45.158 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-07-27T03:07:45.158 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-07-27T03:07:45.269 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-07-27T03:07:45.301 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-07-27T03:07:45.366 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-07-27T03:07:45.366 INFO:tasks.ceph:role: osd.3 2024-07-27T03:07:45.366 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:07:45.366 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-07-27T03:07:45.438 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-07-27T03:07:45.438 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-27T03:07:45.438 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-27T03:07:45.438 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-27T03:07:45.439 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-27T03:07:45.439 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-07-27T03:07:45.439 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-27T03:07:45.439 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-27T03:07:45.439 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-27T03:07:45.439 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-27T03:07:45.923 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-07-27T03:07:45.925 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-07-27T03:07:45.926 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-07-27T03:07:46.037 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-07-27T03:07:46.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:07:46.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:46.172+0000 7f2b7f40e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-07-27T03:07:46.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:46.172+0000 7f2b7f40e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-07-27T03:07:46.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:46.172+0000 7f2b7f40e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-07-27T03:07:46.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:46.172+0000 7f2b7f40e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-07-27T03:07:46.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:46.172+0000 7f2b7f40e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-07-27T03:07:46.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:46.173+0000 7f2b7f40e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-07-27T03:07:49.025 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-07-27T03:07:49.051 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:07:49.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:49.143+0000 7f9099432640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-07-27T03:07:49.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:49.143+0000 7f9099432640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-07-27T03:07:49.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:49.143+0000 7f9099432640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-07-27T03:07:49.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:49.143+0000 7f9099432640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-07-27T03:07:49.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:49.143+0000 7f9099432640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-07-27T03:07:49.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:49.144+0000 7f9099432640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-07-27T03:07:51.989 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-07-27T03:07:52.015 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:07:52.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:52.107+0000 7f9a619cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-07-27T03:07:52.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:52.107+0000 7f9a619cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-07-27T03:07:52.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:52.107+0000 7f9a619cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-07-27T03:07:52.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:52.107+0000 7f9a619cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-07-27T03:07:52.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:52.107+0000 7f9a619cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-07-27T03:07:52.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:52.108+0000 7f9a619cb640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-07-27T03:07:54.959 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-07-27T03:07:54.985 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:07:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:55.078+0000 7fb3dbc86640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-07-27T03:07:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:55.078+0000 7fb3dbc86640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-07-27T03:07:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:55.078+0000 7fb3dbc86640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-07-27T03:07:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:55.079+0000 7fb3dbc86640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-07-27T03:07:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:55.079+0000 7fb3dbc86640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-07-27T03:07:55.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:07:55.079+0000 7fb3dbc86640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-07-27T03:07:57.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-07-27T03:07:57.964 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-07-27T03:07:57.995 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-07-27T03:07:57.995 INFO:tasks.ceph:role: osd.4 2024-07-27T03:07:57.995 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:07:57.996 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-07-27T03:07:58.071 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-07-27T03:07:58.072 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-27T03:07:58.072 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-27T03:07:58.072 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-27T03:07:58.072 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-27T03:07:58.072 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-07-27T03:07:58.072 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-27T03:07:58.072 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-27T03:07:58.072 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-27T03:07:58.072 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-27T03:07:58.579 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-07-27T03:07:58.580 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-07-27T03:07:58.581 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-07-27T03:07:58.689 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-07-27T03:07:58.719 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-07-27T03:07:58.785 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-07-27T03:07:58.785 INFO:tasks.ceph:role: osd.5 2024-07-27T03:07:58.785 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:07:58.785 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-07-27T03:07:58.857 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-07-27T03:07:58.858 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-27T03:07:58.858 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-27T03:07:58.858 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-27T03:07:58.858 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-27T03:07:58.858 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-07-27T03:07:58.858 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-27T03:07:58.858 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-27T03:07:58.858 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-27T03:07:58.858 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-27T03:07:59.317 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-07-27T03:07:59.319 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-07-27T03:07:59.320 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-07-27T03:07:59.392 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-07-27T03:07:59.464 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-07-27T03:07:59.529 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-07-27T03:07:59.529 INFO:tasks.ceph:role: osd.6 2024-07-27T03:07:59.529 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:07:59.530 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-07-27T03:07:59.601 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-07-27T03:07:59.602 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-27T03:07:59.602 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-27T03:07:59.602 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-27T03:07:59.602 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-27T03:07:59.602 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-07-27T03:07:59.602 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-27T03:07:59.602 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-27T03:07:59.602 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-27T03:07:59.602 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-27T03:08:00.090 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-07-27T03:08:00.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-07-27T03:08:00.093 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-07-27T03:08:00.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-07-27T03:08:00.220 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-07-27T03:08:00.285 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-07-27T03:08:00.285 INFO:tasks.ceph:role: osd.7 2024-07-27T03:08:00.285 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:08:00.285 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-07-27T03:08:00.357 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-07-27T03:08:00.357 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-27T03:08:00.357 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-27T03:08:00.357 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-27T03:08:00.357 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-27T03:08:00.357 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-07-27T03:08:00.357 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-27T03:08:00.357 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-27T03:08:00.357 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-27T03:08:00.357 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-27T03:08:00.861 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-07-27T03:08:00.863 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-07-27T03:08:00.863 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-07-27T03:08:01.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-07-27T03:08:01.051 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:08:01.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:01.152+0000 7f783ec16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-07-27T03:08:01.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:01.156+0000 7f783ec16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-07-27T03:08:01.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:01.156+0000 7f783ec16640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-07-27T03:08:01.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:01.156+0000 7f783ec16640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-07-27T03:08:01.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:01.156+0000 7f783ec16640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-07-27T03:08:01.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:01.163+0000 7f783ec16640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-07-27T03:08:04.011 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-07-27T03:08:04.038 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:08:04.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:04.132+0000 7fd56640f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-07-27T03:08:04.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:04.133+0000 7fd56640f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-07-27T03:08:04.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:04.133+0000 7fd56640f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-07-27T03:08:04.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:04.133+0000 7fd56640f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-07-27T03:08:04.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:04.133+0000 7fd56640f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-07-27T03:08:04.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:04.133+0000 7fd56640f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-07-27T03:08:06.991 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-07-27T03:08:07.017 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:08:07.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:07.110+0000 7f0653550640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-07-27T03:08:07.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:07.110+0000 7f0653550640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-07-27T03:08:07.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:07.110+0000 7f0653550640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-07-27T03:08:07.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:07.110+0000 7f0653550640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-07-27T03:08:07.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:07.110+0000 7f0653550640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-07-27T03:08:07.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:07.110+0000 7f0653550640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-07-27T03:08:09.779 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:08:09.782 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:08:09.960 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-07-27T03:08:09.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:08:10.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:10.076+0000 7f2358a0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-07-27T03:08:10.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:10.076+0000 7f2358a0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-07-27T03:08:10.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:10.076+0000 7f2358a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-07-27T03:08:10.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:10.076+0000 7f2358a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-07-27T03:08:10.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:10.076+0000 7f2358a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-07-27T03:08:10.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:10.077+0000 7f2358a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-07-27T03:08:12.939 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-07-27T03:08:12.969 INFO:tasks.ceph:Reading keys from all nodes... 2024-07-27T03:08:12.969 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:12.969 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-07-27T03:08:13.000 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:13.000 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-07-27T03:08:13.069 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:13.069 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-07-27T03:08:13.136 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:13.137 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-07-27T03:08:13.204 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:13.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-07-27T03:08:13.270 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:13.271 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-07-27T03:08:13.336 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:13.337 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-07-27T03:08:13.402 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:13.402 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-07-27T03:08:13.432 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:13.432 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-07-27T03:08:13.502 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:13.502 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-07-27T03:08:13.570 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:13.571 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-07-27T03:08:13.637 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:13.637 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-07-27T03:08:13.704 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:13.704 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-07-27T03:08:13.771 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:13.771 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-07-27T03:08:13.837 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:13.837 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-07-27T03:08:13.853 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:13.853 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-07-27T03:08:13.909 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:13.910 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-07-27T03:08:13.925 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:13.925 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-07-27T03:08:13.981 INFO:tasks.ceph:Adding keys to all mons... 2024-07-27T03:08:13.981 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2024-07-27T03:08:13.984 DEBUG:teuthology.orchestra.run.smithi121:> sudo tee -a /etc/ceph/ceph.keyring 2024-07-27T03:08:14.024 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.y] 2024-07-27T03:08:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmWLnrDxAAfy1pvcoGJESVPs9k+so+/A== 2024-07-27T03:08:14.024 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2024-07-27T03:08:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRm7HVTGBAADA2eiX5COiTN6OTelto+6g== 2024-07-27T03:08:14.024 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c] 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmDnDuHxAAWKoH2jvhBqPNxL7NrtCJuw== 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCCZKRmtTNTChAAYbSo/j1WO/4nocsPhy8JRw== 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCFZKRmLRqlCBAAYgYpmzL3If445MkxGxBKHw== 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCIZKRmDhKBBhAAl6K58lvyVrAqfWffwAr1Mg== 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCLZKRmUDrLBBAAyUyAP/dCtMZVZpzi7TZIzA== 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmFsR+FBAA8tKKAi2Y/Yaxxca+ep3BRQ== 2024-07-27T03:08:14.025 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmMfl8JRAA+4W3m5lICDf6dIU1dELj5Q== 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.d] 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmxkcwLRAAMzpPET/zdPCxfhbsMeLJuQ== 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.4] 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCRZKRmXRMoCRAAcfX7u17DIoxM9dK3/TFu8Q== 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.5] 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCUZKRmyaL0BxAANbxggtK64zbog9+KDXeOew== 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.6] 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCXZKRmATKrBhAAeEBqJxkOoQozFzw1yeL6lw== 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.7] 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCaZKRmCh6nBBAA8Cc+xOuBxqDAUgpweyq23A== 2024-07-27T03:08:14.026 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-07-27T03:08:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmI8baMRAArCIL9NNNVlevij0JAWwGwg== 2024-07-27T03:08:14.027 INFO:teuthology.orchestra.run.smithi120.stdout:[client.2] 2024-07-27T03:08:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmwOSdNRAALgx82wMQ+5fPOrFL/qhj8g== 2024-07-27T03:08:14.027 INFO:teuthology.orchestra.run.smithi120.stdout:[client.1] 2024-07-27T03:08:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmgOpnORAAkcLaNUd6cnsV/sHwOOI+2w== 2024-07-27T03:08:14.027 INFO:teuthology.orchestra.run.smithi120.stdout:[client.3] 2024-07-27T03:08:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB/ZKRmHh6PARAAZ9nBBam/kVvT6C1aFbNC3g== 2024-07-27T03:08:14.044 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.y] 2024-07-27T03:08:14.044 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQB+ZKRmWLnrDxAAfy1pvcoGJESVPs9k+so+/A== 2024-07-27T03:08:14.044 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-07-27T03:08:14.044 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQB+ZKRm7HVTGBAADA2eiX5COiTN6OTelto+6g== 2024-07-27T03:08:14.044 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQB+ZKRmDnDuHxAAWKoH2jvhBqPNxL7NrtCJuw== 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCCZKRmtTNTChAAYbSo/j1WO/4nocsPhy8JRw== 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCFZKRmLRqlCBAAYgYpmzL3If445MkxGxBKHw== 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCIZKRmDhKBBhAAl6K58lvyVrAqfWffwAr1Mg== 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.3] 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCLZKRmUDrLBBAAyUyAP/dCtMZVZpzi7TZIzA== 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.x] 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQB+ZKRmFsR+FBAA8tKKAi2Y/Yaxxca+ep3BRQ== 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQB+ZKRmMfl8JRAA+4W3m5lICDf6dIU1dELj5Q== 2024-07-27T03:08:14.045 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQB+ZKRmxkcwLRAAMzpPET/zdPCxfhbsMeLJuQ== 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.4] 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCRZKRmXRMoCRAAcfX7u17DIoxM9dK3/TFu8Q== 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.5] 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCUZKRmyaL0BxAANbxggtK64zbog9+KDXeOew== 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.6] 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCXZKRmATKrBhAAeEBqJxkOoQozFzw1yeL6lw== 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.7] 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQCaZKRmCh6nBBAA8Cc+xOuBxqDAUgpweyq23A== 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQB+ZKRmI8baMRAArCIL9NNNVlevij0JAWwGwg== 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout:[client.2] 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQB+ZKRmwOSdNRAALgx82wMQ+5fPOrFL/qhj8g== 2024-07-27T03:08:14.046 INFO:teuthology.orchestra.run.smithi121.stdout:[client.1] 2024-07-27T03:08:14.047 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQB+ZKRmgOpnORAAkcLaNUd6cnsV/sHwOOI+2w== 2024-07-27T03:08:14.047 INFO:teuthology.orchestra.run.smithi121.stdout:[client.3] 2024-07-27T03:08:14.047 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQB/ZKRmHh6PARAAZ9nBBam/kVvT6C1aFbNC3g== 2024-07-27T03:08:14.047 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-07-27T03:08:14.070 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-07-27T03:08:14.149 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-27T03:08:14.151 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-27T03:08:14.215 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-27T03:08:14.217 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-27T03:08:14.281 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.283 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.343 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.345 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.406 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.408 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.469 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.471 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.534 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-07-27T03:08:14.536 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-07-27T03:08:14.597 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-27T03:08:14.600 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-27T03:08:14.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-27T03:08:14.667 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-27T03:08:14.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.796 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.798 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.859 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.862 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.926 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-27T03:08:14.986 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-27T03:08:14.989 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-27T03:08:15.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-27T03:08:15.057 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-27T03:08:15.121 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-27T03:08:15.123 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-27T03:08:15.187 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-27T03:08:15.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-27T03:08:15.255 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-07-27T03:08:15.255 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-07-27T03:08:15.280 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-07-27T03:08:15.387 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-07-27T03:08:15.412 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-07-27T03:08:15.437 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-07-27T03:08:15.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-07-27T03:08:15.568 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-07-27T03:08:15.633 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-07-27T03:08:15.740 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-07-27T03:08:15.764 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:08:15.767 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-07-27T03:08:15.820 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-07-27T03:08:15.820 INFO:tasks.ceph.mon.a:Restarting daemon 2024-07-27T03:08:15.821 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-07-27T03:08:15.823 INFO:tasks.ceph.mon.a:Started 2024-07-27T03:08:15.823 INFO:tasks.ceph.mon.b:Restarting daemon 2024-07-27T03:08:15.823 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-07-27T03:08:15.862 INFO:tasks.ceph.mon.b:Started 2024-07-27T03:08:15.862 INFO:tasks.ceph.mon.c:Restarting daemon 2024-07-27T03:08:15.862 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-07-27T03:08:15.864 INFO:tasks.ceph.mon.c:Started 2024-07-27T03:08:15.864 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-07-27T03:08:15.865 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-07-27T03:08:15.865 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-07-27T03:08:15.867 INFO:tasks.ceph.mgr.y:Started 2024-07-27T03:08:15.867 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-07-27T03:08:15.867 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-07-27T03:08:15.869 INFO:tasks.ceph.mgr.x:Started 2024-07-27T03:08:15.869 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-07-27T03:08:15.870 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-07-27T03:08:15.872 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-07-27T03:08:15.872 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set client debug_client 20 2024-07-27T03:08:15.915 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-07-27T03:08:15.915 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set client debug_ms 1 2024-07-27T03:08:15.958 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-07-27T03:08:15.958 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-07-27T03:08:16.001 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-07-27T03:08:16.001 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-07-27T03:08:16.045 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-07-27T03:08:16.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-07-27T03:08:16.088 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-07-27T03:08:16.088 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-07-27T03:08:16.131 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-07-27T03:08:16.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-07-27T03:08:16.176 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-07-27T03:08:16.176 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-07-27T03:08:16.226 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-07-27T03:08:16.226 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-07-27T03:08:16.275 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-07-27T03:08:16.275 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-07-27T03:08:16.327 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-07-27T03:08:16.327 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-07-27T03:08:16.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.318+0000 7f9cf4ff9640 1 -- 172.21.15.120:0/1954740992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d080cebb0 msgr2=0x7f9d080cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.318+0000 7f9cf4ff9640 1 --2- 172.21.15.120:0/1954740992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d080cebb0 0x7f9d080cefc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9d00033000 tx=0x7f9d00004730 comp rx=0 tx=0).stop 2024-07-27T03:08:16.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.318+0000 7f9cf4ff9640 1 -- 172.21.15.120:0/1954740992 shutdown_connections 2024-07-27T03:08:16.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.318+0000 7f9cf4ff9640 1 --2- 172.21.15.120:0/1954740992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d080cebb0 0x7f9d080cefc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.318+0000 7f9cf4ff9640 1 --2- 172.21.15.120:0/1954740992 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d081f3740 0x7f9d081f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.318+0000 7f9cf4ff9640 1 --2- 172.21.15.120:0/1954740992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9cf0004370 0x7f9d08153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.318+0000 7f9cf4ff9640 1 -- 172.21.15.120:0/1954740992 >> 172.21.15.120:0/1954740992 conn(0x7f9d080b2dc0 msgr2=0x7f9d081598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.318+0000 7f9cf4ff9640 1 -- 172.21.15.120:0/1954740992 shutdown_connections 2024-07-27T03:08:16.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.319+0000 7f9cf4ff9640 1 -- 172.21.15.120:0/1954740992 wait complete. 2024-07-27T03:08:16.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.320+0000 7f066225a640 1 -- 172.21.15.120:0/1264315556 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f065c09ffc0 msgr2=0x7f065c1f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.320+0000 7f066225a640 1 --2- 172.21.15.120:0/1264315556 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f065c09ffc0 0x7f065c1f4b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0650030000 tx=0x7f065c0d00d0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.320+0000 7f066225a640 1 -- 172.21.15.120:0/1264315556 shutdown_connections 2024-07-27T03:08:16.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.320+0000 7f066225a640 1 --2- 172.21.15.120:0/1264315556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f065c1f50d0 0x7f065c0a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.320+0000 7f066225a640 1 --2- 172.21.15.120:0/1264315556 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f065c09ffc0 0x7f065c1f4b90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.320+0000 7f066225a640 1 --2- 172.21.15.120:0/1264315556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0644004800 0x7f065c09e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.320+0000 7f066225a640 1 -- 172.21.15.120:0/1264315556 >> 172.21.15.120:0/1264315556 conn(0x7f065c0d3fb0 msgr2=0x7f065c0b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.328+0000 7f066225a640 1 -- 172.21.15.120:0/1264315556 shutdown_connections 2024-07-27T03:08:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.328+0000 7f066225a640 1 -- 172.21.15.120:0/1264315556 wait complete. 2024-07-27T03:08:16.337 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-07-27T03:08:16.337 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-07-27T03:08:16.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.330+0000 7f0320ff9640 1 -- 172.21.15.120:0/907047264 <== mon.2 v2:172.21.15.121:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f03180117f0 con 0x7f03241f3500 2024-07-27T03:08:16.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.331+0000 7f0320ff9640 1 -- 172.21.15.120:0/907047264 <== mon.2 v2:172.21.15.121:3301/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v4)=0 v4) ==== 123+0+0 (secure 0 0 0) 0x7f0318011a40 con 0x7f03241f3500 2024-07-27T03:08:16.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.333+0000 7f119dffb640 1 -- 172.21.15.120:0/2546983141 <== mon.1 v2:172.21.15.121:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f1198010c00 con 0x7f11a8156550 2024-07-27T03:08:16.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.333+0000 7f032a957640 1 -- 172.21.15.120:0/907047264 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03241f3500 msgr2=0x7f0324148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.333+0000 7f032a957640 1 --2- 172.21.15.120:0/907047264 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03241f3500 0x7f0324148590 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f031800e600 tx=0x7f031800eac0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.333+0000 7f032a957640 1 -- 172.21.15.120:0/907047264 shutdown_connections 2024-07-27T03:08:16.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.333+0000 7f032a957640 1 --2- 172.21.15.120:0/907047264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03241efeb0 0x7f03241f02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.333+0000 7f032a957640 1 --2- 172.21.15.120:0/907047264 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03241f3500 0x7f0324148590 secure :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f031800e600 tx=0x7f031800eac0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.333+0000 7f032a957640 1 --2- 172.21.15.120:0/907047264 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f030c005150 0x7f03240ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.333+0000 7f032a957640 1 -- 172.21.15.120:0/907047264 >> 172.21.15.120:0/907047264 conn(0x7f03240d0480 msgr2=0x7f0324157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.333+0000 7f7dbcff9640 1 -- 172.21.15.120:0/1694788382 <== mon.0 v2:172.21.15.120:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f7db401e7a0 con 0x7f7dc00c7b20 2024-07-27T03:08:16.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.333+0000 7f9c617fa640 1 -- 172.21.15.120:0/1650320648 <== mon.1 v2:172.21.15.121:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f9c6402ebe0 con 0x7f9c6c0d28f0 2024-07-27T03:08:16.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.335+0000 7f032a957640 1 -- 172.21.15.120:0/907047264 shutdown_connections 2024-07-27T03:08:16.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.335+0000 7f032a957640 1 -- 172.21.15.120:0/907047264 wait complete. 2024-07-27T03:08:16.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.349+0000 7f11af5d9640 1 -- 172.21.15.120:0/2546983141 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f1184005310 con 0x7f11a8156550 2024-07-27T03:08:16.356 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-07-27T03:08:16.356 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-07-27T03:08:16.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.351+0000 7f7dc5331640 1 -- 172.21.15.120:0/1694788382 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f7d98005310 con 0x7f7dc00c7b20 2024-07-27T03:08:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.352+0000 7f578e75d640 1 -- 172.21.15.120:0/3547320074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788162c50 msgr2=0x7f57880ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.352+0000 7f578e75d640 1 --2- 172.21.15.120:0/3547320074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788162c50 0x7f57880ccc30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5788073370 tx=0x7f577c02a460 comp rx=0 tx=0).stop 2024-07-27T03:08:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.353+0000 7f578e75d640 1 -- 172.21.15.120:0/3547320074 shutdown_connections 2024-07-27T03:08:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.353+0000 7f578e75d640 1 --2- 172.21.15.120:0/3547320074 >> v2:172.21.15.121:3300/0 conn(0x7f57880cd170 0x7f57880cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.353+0000 7f578e75d640 1 --2- 172.21.15.120:0/3547320074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788162c50 0x7f57880ccc30 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5788073370 tx=0x7f577c02a460 comp rx=0 tx=0).stop 2024-07-27T03:08:16.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.353+0000 7f578e75d640 1 -- 172.21.15.120:0/3547320074 >> 172.21.15.120:0/3547320074 conn(0x7f578806d140 msgr2=0x7f57880b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.357+0000 7f119dffb640 1 -- 172.21.15.120:0/2546983141 <== mon.1 v2:172.21.15.121:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f1198022450 con 0x7f11a8156550 2024-07-27T03:08:16.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.358+0000 7f119dffb640 1 -- 172.21.15.120:0/2546983141 <== mon.1 v2:172.21.15.121:3300/0 11 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f1198022770 con 0x7f11a8156550 2024-07-27T03:08:16.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.359+0000 7f7dbcff9640 1 -- 172.21.15.120:0/1694788382 <== mon.0 v2:172.21.15.120:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f7db401ea20 con 0x7f7dc00c7b20 2024-07-27T03:08:16.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.359+0000 7f9c617fa640 1 -- 172.21.15.120:0/1650320648 <== mon.1 v2:172.21.15.121:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f9c6402c930 con 0x7f9c6c0d28f0 2024-07-27T03:08:16.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.357+0000 7f578e75d640 1 -- 172.21.15.120:0/3547320074 shutdown_connections 2024-07-27T03:08:16.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.357+0000 7f578e75d640 1 -- 172.21.15.120:0/3547320074 wait complete. 2024-07-27T03:08:16.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.360+0000 7f578e75d640 1 Processor -- start 2024-07-27T03:08:16.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.360+0000 7f11af5d9640 1 -- 172.21.15.120:0/2546983141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11a8156550 msgr2=0x7f11a80c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.360+0000 7f11af5d9640 1 --2- 172.21.15.120:0/2546983141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11a8156550 0x7f11a80c7e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f119800bfc0 tx=0x7f1198003a80 comp rx=0 tx=0).stop 2024-07-27T03:08:16.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.360+0000 7f578e75d640 1 -- start start 2024-07-27T03:08:16.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.362+0000 7f11af5d9640 1 -- 172.21.15.120:0/2546983141 shutdown_connections 2024-07-27T03:08:16.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.362+0000 7f11af5d9640 1 --2- 172.21.15.120:0/2546983141 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11a8156960 0x7f11a81f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.362+0000 7f11af5d9640 1 --2- 172.21.15.120:0/2546983141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11a8156550 0x7f11a80c7e70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.362+0000 7f11af5d9640 1 --2- 172.21.15.120:0/2546983141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1194004db0 0x7f11a8157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.362+0000 7f11af5d9640 1 -- 172.21.15.120:0/2546983141 >> 172.21.15.120:0/2546983141 conn(0x7f11a80d0df0 msgr2=0x7f11a80ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.371 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-07-27T03:08:16.371 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-07-27T03:08:16.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.365+0000 7f11af5d9640 1 -- 172.21.15.120:0/2546983141 shutdown_connections 2024-07-27T03:08:16.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.365+0000 7f11af5d9640 1 -- 172.21.15.120:0/2546983141 wait complete. 2024-07-27T03:08:16.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.364+0000 7f9c617fa640 1 -- 172.21.15.120:0/1650320648 <== mon.1 v2:172.21.15.121:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c6402ccd0 con 0x7f9c6c0d28f0 2024-07-27T03:08:16.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.362+0000 7f578e75d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57880cd170 0x7f57881611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.363+0000 7f578e75d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57880cf7c0 0x7f578815be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.363+0000 7f578e75d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f57880ae620 0x7f57882056f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.363+0000 7f578e75d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5788143ff0 con 0x7f57880cf7c0 2024-07-27T03:08:16.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.363+0000 7f578e75d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5788143e70 con 0x7f57880cd170 2024-07-27T03:08:16.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.363+0000 7f578e75d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f578815ea40 con 0x7f57880ae620 2024-07-27T03:08:16.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.364+0000 7f57877fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57880cf7c0 0x7f578815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.364+0000 7f57877fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57880cf7c0 0x7f578815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46642/0 (socket says 172.21.15.120:46642) 2024-07-27T03:08:16.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.364+0000 7f57877fe640 1 -- 172.21.15.120:0/283512012 learned_addr learned my addr 172.21.15.120:0/283512012 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.364+0000 7f5787fff640 1 --2- 172.21.15.120:0/283512012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57880cd170 0x7f57881611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.364+0000 7f578ccfa640 1 --2- 172.21.15.120:0/283512012 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f57880ae620 0x7f57882056f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.365+0000 7f578ccfa640 1 -- 172.21.15.120:0/283512012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57880cd170 msgr2=0x7f57881611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.365+0000 7f578ccfa640 1 --2- 172.21.15.120:0/283512012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57880cd170 0x7f57881611b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.365+0000 7f578ccfa640 1 -- 172.21.15.120:0/283512012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57880cf7c0 msgr2=0x7f578815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.365+0000 7f578ccfa640 1 --2- 172.21.15.120:0/283512012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57880cf7c0 0x7f578815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.365+0000 7f578ccfa640 1 -- 172.21.15.120:0/283512012 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57880ad500 con 0x7f57880ae620 2024-07-27T03:08:16.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.367+0000 7f7dbcff9640 1 -- 172.21.15.120:0/1694788382 <== mon.0 v2:172.21.15.120:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f7db401ec50 con 0x7f7dc00c7b20 2024-07-27T03:08:16.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.367+0000 7f7dbcff9640 1 -- 172.21.15.120:0/1694788382 <== mon.0 v2:172.21.15.120:3300/0 12 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7db4014c60 con 0x7f7dc00c7b20 2024-07-27T03:08:16.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.368+0000 7f578ccfa640 1 --2- 172.21.15.120:0/283512012 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f57880ae620 0x7f57882056f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f577800b410 tx=0x7f577800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.368+0000 7f5784ff9640 1 -- 172.21.15.120:0/283512012 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778015020 con 0x7f57880ae620 2024-07-27T03:08:16.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.368+0000 7f5784ff9640 1 -- 172.21.15.120:0/283512012 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5778011920 con 0x7f57880ae620 2024-07-27T03:08:16.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.368+0000 7f578e75d640 1 -- 172.21.15.120:0/283512012 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57880ad7e0 con 0x7f57880ae620 2024-07-27T03:08:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.368+0000 7f578e75d640 1 -- 172.21.15.120:0/283512012 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57882051d0 con 0x7f57880ae620 2024-07-27T03:08:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.369+0000 7f5784ff9640 1 -- 172.21.15.120:0/283512012 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778011d70 con 0x7f57880ae620 2024-07-27T03:08:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.369+0000 7f5784ff9640 1 -- 172.21.15.120:0/283512012 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5778018020 con 0x7f57880ae620 2024-07-27T03:08:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.369+0000 7f5784ff9640 1 -- 172.21.15.120:0/283512012 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f57780199c0 con 0x7f57880ae620 2024-07-27T03:08:16.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.374+0000 7f578e75d640 1 -- 172.21.15.120:0/283512012 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5768005290 con 0x7f57880ae620 2024-07-27T03:08:16.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.374+0000 7f7dc5331640 1 -- 172.21.15.120:0/1694788382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dc00c7b20 msgr2=0x7f7dc00cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.374+0000 7f7dc5331640 1 --2- 172.21.15.120:0/1694788382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dc00c7b20 0x7f7dc00cbf80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7db400b6b0 tx=0x7f7db400bb70 comp rx=0 tx=0).stop 2024-07-27T03:08:16.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.375+0000 7f7dc5331640 1 -- 172.21.15.120:0/1694788382 shutdown_connections 2024-07-27T03:08:16.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.375+0000 7f7dc5331640 1 --2- 172.21.15.120:0/1694788382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7dc00c7b20 0x7f7dc00cbf80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.375+0000 7f7dc5331640 1 --2- 172.21.15.120:0/1694788382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7dc00ce550 0x7f7dc00cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.375+0000 7f7dc5331640 1 --2- 172.21.15.120:0/1694788382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7dc00c39d0 0x7f7dc01f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.375+0000 7f7dc5331640 1 -- 172.21.15.120:0/1694788382 >> 172.21.15.120:0/1694788382 conn(0x7f7dc00d0340 msgr2=0x7f7dc00b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.379 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-07-27T03:08:16.379 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-07-27T03:08:16.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.377+0000 7f7dc5331640 1 -- 172.21.15.120:0/1694788382 shutdown_connections 2024-07-27T03:08:16.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.377+0000 7f7dc5331640 1 -- 172.21.15.120:0/1694788382 wait complete. 2024-07-27T03:08:16.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.382+0000 7f5784ff9640 1 -- 172.21.15.120:0/283512012 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7f577801f020 con 0x7f57880ae620 2024-07-27T03:08:16.392 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-07-27T03:08:16.392 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-07-27T03:08:16.401 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-07-27T03:08:16.401 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-07-27T03:08:16.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.439+0000 7fe6405ea640 1 -- 172.21.15.120:0/1778023410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6380b2660 msgr2=0x7fe63816afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.439+0000 7fe6405ea640 1 --2- 172.21.15.120:0/1778023410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6380b2660 0x7fe63816afb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe63806f9b0 tx=0x7fe6340327a0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.439+0000 7fe6405ea640 1 -- 172.21.15.120:0/1778023410 shutdown_connections 2024-07-27T03:08:16.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.439+0000 7fe6405ea640 1 --2- 172.21.15.120:0/1778023410 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe6380ced00 0x7fe6380cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.439+0000 7fe6405ea640 1 --2- 172.21.15.120:0/1778023410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6380b2660 0x7fe63816afb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.439+0000 7fe6405ea640 1 -- 172.21.15.120:0/1778023410 >> 172.21.15.120:0/1778023410 conn(0x7fe6380b1b40 msgr2=0x7fe6380b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.439+0000 7fe6405ea640 1 -- 172.21.15.120:0/1778023410 shutdown_connections 2024-07-27T03:08:16.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.439+0000 7fe6405ea640 1 -- 172.21.15.120:0/1778023410 wait complete. 2024-07-27T03:08:16.444 DEBUG:tasks.ceph:set 18 configs 2024-07-27T03:08:16.444 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.445 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.445 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.445 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.445 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.450 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.451+0000 7f9c52ffd640 1 -- 172.21.15.120:0/1650320648 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f9c440052f0 con 0x7f9c6c0d28f0 2024-07-27T03:08:16.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.454+0000 7fe6405ea640 1 Processor -- start 2024-07-27T03:08:16.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.459+0000 7f9c617fa640 1 -- 172.21.15.120:0/1650320648 <== mon.1 v2:172.21.15.121:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f9c6403d070 con 0x7f9c6c0d28f0 2024-07-27T03:08:16.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.462+0000 7f9c52ffd640 1 -- 172.21.15.120:0/1650320648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c0d28f0 msgr2=0x7f9c6c1f5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.462+0000 7f9c52ffd640 1 --2- 172.21.15.120:0/1650320648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c0d28f0 0x7f9c6c1f5cb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9c64032000 tx=0x7f9c64004a40 comp rx=0 tx=0).stop 2024-07-27T03:08:16.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.462+0000 7f9c52ffd640 1 -- 172.21.15.120:0/1650320648 shutdown_connections 2024-07-27T03:08:16.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.462+0000 7f9c52ffd640 1 --2- 172.21.15.120:0/1650320648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c6c0ce840 0x7f9c6c1f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.462+0000 7f9c52ffd640 1 --2- 172.21.15.120:0/1650320648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c6c0d28f0 0x7f9c6c1f5cb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.462+0000 7f9c52ffd640 1 --2- 172.21.15.120:0/1650320648 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9c6c0b75b0 0x7f9c6c0c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.462+0000 7f9c52ffd640 1 -- 172.21.15.120:0/1650320648 >> 172.21.15.120:0/1650320648 conn(0x7f9c6c0d1dd0 msgr2=0x7f9c6c071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7f9c52ffd640 1 -- 172.21.15.120:0/1650320648 shutdown_connections 2024-07-27T03:08:16.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7f9c52ffd640 1 -- 172.21.15.120:0/1650320648 wait complete. 2024-07-27T03:08:16.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.471+0000 7fe6405ea640 1 -- start start 2024-07-27T03:08:16.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7fe6405ea640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6380b2660 0x7fe6381f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7fe6405ea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6380ced00 0x7fe6381556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7fe6405ea640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe63816ed20 0x7fe638155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7fe6405ea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe638073d90 con 0x7fe6380ced00 2024-07-27T03:08:16.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7fe6405ea640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe638073f10 con 0x7fe6380b2660 2024-07-27T03:08:16.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7fe6405ea640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe638074090 con 0x7fe63816ed20 2024-07-27T03:08:16.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7fe63eb87640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe63816ed20 0x7fe638155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7fe63eb87640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe63816ed20 0x7fe638155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.120:58550/0 (socket says 172.21.15.120:58550) 2024-07-27T03:08:16.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7fe63eb87640 1 -- 172.21.15.120:0/3739033970 learned_addr learned my addr 172.21.15.120:0/3739033970 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7fe63db85640 1 --2- 172.21.15.120:0/3739033970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6380ced00 0x7fe6381556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.474+0000 7fe63e386640 1 --2- 172.21.15.120:0/3739033970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6380b2660 0x7fe6381f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.475+0000 7fe63eb87640 1 -- 172.21.15.120:0/3739033970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6380b2660 msgr2=0x7fe6381f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.475+0000 7fe63eb87640 1 --2- 172.21.15.120:0/3739033970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6380b2660 0x7fe6381f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.475+0000 7fe63eb87640 1 -- 172.21.15.120:0/3739033970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6380ced00 msgr2=0x7fe6381556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.475+0000 7fe63eb87640 1 --2- 172.21.15.120:0/3739033970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6380ced00 0x7fe6381556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.475+0000 7fe63eb87640 1 -- 172.21.15.120:0/3739033970 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe638153790 con 0x7fe63816ed20 2024-07-27T03:08:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.476+0000 7fe63eb87640 1 --2- 172.21.15.120:0/3739033970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe63816ed20 0x7fe638155c30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe62800c3f0 tx=0x7fe62800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.476+0000 7fe62effd640 1 -- 172.21.15.120:0/3739033970 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628017070 con 0x7fe63816ed20 2024-07-27T03:08:16.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.476+0000 7fe62effd640 1 -- 172.21.15.120:0/3739033970 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6280053c0 con 0x7fe63816ed20 2024-07-27T03:08:16.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.476+0000 7fe62effd640 1 -- 172.21.15.120:0/3739033970 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628003850 con 0x7fe63816ed20 2024-07-27T03:08:16.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.477+0000 7fe6405ea640 1 -- 172.21.15.120:0/3739033970 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe638153a70 con 0x7fe63816ed20 2024-07-27T03:08:16.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.477+0000 7fe6405ea640 1 -- 172.21.15.120:0/3739033970 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe638154030 con 0x7fe63816ed20 2024-07-27T03:08:16.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.478+0000 7fe62effd640 1 -- 172.21.15.120:0/3739033970 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe62801a070 con 0x7fe63816ed20 2024-07-27T03:08:16.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.478+0000 7fe62effd640 1 -- 172.21.15.120:0/3739033970 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe62801c440 con 0x7fe63816ed20 2024-07-27T03:08:16.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.480+0000 7fe6405ea640 1 -- 172.21.15.120:0/3739033970 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe620005290 con 0x7fe63816ed20 2024-07-27T03:08:16.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.483+0000 7fe62effd640 1 -- 172.21.15.120:0/3739033970 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7fe628021080 con 0x7fe63816ed20 2024-07-27T03:08:16.524 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.528+0000 7ffafe76c640 1 -- 172.21.15.120:0/2461086348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf806f7e0 msgr2=0x7ffaf80b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.528+0000 7ffafe76c640 1 --2- 172.21.15.120:0/2461086348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf806f7e0 0x7ffaf80b4240 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffae8005fd0 tx=0x7ffae802a5a0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.540+0000 7fcda07a1640 1 -- 172.21.15.120:0/2736820347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd9815f3c0 msgr2=0x7fcd980ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.540+0000 7fcda07a1640 1 --2- 172.21.15.120:0/2736820347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd9815f3c0 0x7fcd980ae290 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009860 tx=0x7fcd8c02a580 comp rx=0 tx=0).stop 2024-07-27T03:08:16.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.542+0000 7ffafe76c640 1 -- 172.21.15.120:0/2461086348 shutdown_connections 2024-07-27T03:08:16.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.542+0000 7ffafe76c640 1 --2- 172.21.15.120:0/2461086348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf806f7e0 0x7ffaf80b4240 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.542+0000 7ffafe76c640 1 --2- 172.21.15.120:0/2461086348 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffaf80713f0 0x7ffaf806f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.542+0000 7ffafe76c640 1 -- 172.21.15.120:0/2461086348 >> 172.21.15.120:0/2461086348 conn(0x7ffaf80d0b30 msgr2=0x7ffaf80d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.542+0000 7fcda07a1640 1 -- 172.21.15.120:0/2736820347 shutdown_connections 2024-07-27T03:08:16.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.542+0000 7fcda07a1640 1 --2- 172.21.15.120:0/2736820347 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd980ae7d0 0x7fcd980b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.542+0000 7fcda07a1640 1 --2- 172.21.15.120:0/2736820347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd9815f3c0 0x7fcd980ae290 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.542+0000 7fcda07a1640 1 -- 172.21.15.120:0/2736820347 >> 172.21.15.120:0/2736820347 conn(0x7fcd9806d170 msgr2=0x7fcd980b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.544+0000 7ffafe76c640 1 -- 172.21.15.120:0/2461086348 shutdown_connections 2024-07-27T03:08:16.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.544+0000 7fcda07a1640 1 -- 172.21.15.120:0/2736820347 shutdown_connections 2024-07-27T03:08:16.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.544+0000 7fcda07a1640 1 -- 172.21.15.120:0/2736820347 wait complete. 2024-07-27T03:08:16.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.547+0000 7fcda07a1640 1 Processor -- start 2024-07-27T03:08:16.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.548+0000 7ffafe76c640 1 -- 172.21.15.120:0/2461086348 wait complete. 2024-07-27T03:08:16.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.548+0000 7fcda07a1640 1 -- start start 2024-07-27T03:08:16.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.550+0000 7fcda07a1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd980ae7d0 0x7fcd98154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.550+0000 7ffafe76c640 1 Processor -- start 2024-07-27T03:08:16.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.551+0000 7ffafe76c640 1 -- start start 2024-07-27T03:08:16.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.552+0000 7f30c0814640 1 -- 172.21.15.120:0/401251682 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b40e71d0 msgr2=0x7f30b4005de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.552+0000 7f30c0814640 1 --2- 172.21.15.120:0/401251682 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b40e71d0 0x7f30b4005de0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f30bc050ca0 tx=0x7f30bc06c6b0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.552+0000 7f30c0814640 1 -- 172.21.15.120:0/401251682 shutdown_connections 2024-07-27T03:08:16.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.552+0000 7f30c0814640 1 --2- 172.21.15.120:0/401251682 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b40e71d0 0x7f30b4005de0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.552+0000 7f30c0814640 1 -- 172.21.15.120:0/401251682 >> 172.21.15.120:0/401251682 conn(0x7f30b401d9a0 msgr2=0x7f30b4039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.552+0000 7fcda07a1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd9815e8d0 0x7fcd980aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.552+0000 7fcda07a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd9815f3c0 0x7fcd980aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7fcda07a1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcd980b4280 con 0x7fcd9815f3c0 2024-07-27T03:08:16.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7fcda07a1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcd980b4100 con 0x7fcd980ae7d0 2024-07-27T03:08:16.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7fcda07a1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fcd980b4400 con 0x7fcd9815e8d0 2024-07-27T03:08:16.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7fcd9ed3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd9815f3c0 0x7fcd980aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7ffafe76c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffaf806f7e0 0x7ffaf8129b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7ffafe76c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaf80ccef0 0x7ffaf814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7ffafe76c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf8158b60 0x7ffaf8156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7ffafe76c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf80b4bc0 con 0x7ffaf8158b60 2024-07-27T03:08:16.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafe76c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf80b4a40 con 0x7ffaf80ccef0 2024-07-27T03:08:16.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafe76c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf80b4d40 con 0x7ffaf806f7e0 2024-07-27T03:08:16.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafdf6b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf8158b60 0x7ffaf8156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafdf6b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf8158b60 0x7ffaf8156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46690/0 (socket says 172.21.15.120:46690) 2024-07-27T03:08:16.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafdf6b640 1 -- 172.21.15.120:0/1424902019 learned_addr learned my addr 172.21.15.120:0/1424902019 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7fcd9e53d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd980ae7d0 0x7fcd98154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7fcd9e53d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd980ae7d0 0x7fcd98154390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.120:42282/0 (socket says 172.21.15.120:42282) 2024-07-27T03:08:16.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7fcd9e53d640 1 -- 172.21.15.120:0/1660432424 learned_addr learned my addr 172.21.15.120:0/1660432424 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.553+0000 7fcd9dd3c640 1 --2- 172.21.15.120:0/1660432424 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd9815e8d0 0x7fcd980aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7fcd9e53d640 1 -- 172.21.15.120:0/1660432424 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd9815e8d0 msgr2=0x7fcd980aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7fcd9e53d640 1 --2- 172.21.15.120:0/1660432424 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd9815e8d0 0x7fcd980aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7fcd9e53d640 1 -- 172.21.15.120:0/1660432424 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd9815f3c0 msgr2=0x7fcd980aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafcf69640 1 --2- 172.21.15.120:0/1424902019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaf80ccef0 0x7ffaf814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafd76a640 1 --2- 172.21.15.120:0/1424902019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffaf806f7e0 0x7ffaf8129b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafdf6b640 1 -- 172.21.15.120:0/1424902019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffaf806f7e0 msgr2=0x7ffaf8129b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafdf6b640 1 --2- 172.21.15.120:0/1424902019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffaf806f7e0 0x7ffaf8129b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafdf6b640 1 -- 172.21.15.120:0/1424902019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaf80ccef0 msgr2=0x7ffaf814d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafdf6b640 1 --2- 172.21.15.120:0/1424902019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaf80ccef0 0x7ffaf814d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.554+0000 7ffafdf6b640 1 -- 172.21.15.120:0/1424902019 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf8155c50 con 0x7ffaf8158b60 2024-07-27T03:08:16.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.555+0000 7ffafdf6b640 1 --2- 172.21.15.120:0/1424902019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf8158b60 0x7ffaf8156cf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffae8006010 tx=0x7ffae8004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.555+0000 7ffaedffb640 1 -- 172.21.15.120:0/1424902019 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae803f020 con 0x7ffaf8158b60 2024-07-27T03:08:16.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.555+0000 7ffafe76c640 1 -- 172.21.15.120:0/1424902019 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf8155f30 con 0x7ffaf8158b60 2024-07-27T03:08:16.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.555+0000 7ffafe76c640 1 -- 172.21.15.120:0/1424902019 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf81564f0 con 0x7ffaf8158b60 2024-07-27T03:08:16.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.557+0000 7ffaedffb640 1 -- 172.21.15.120:0/1424902019 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffae8003af0 con 0x7ffaf8158b60 2024-07-27T03:08:16.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.557+0000 7ffaedffb640 1 -- 172.21.15.120:0/1424902019 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8035070 con 0x7ffaf8158b60 2024-07-27T03:08:16.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.559+0000 7ffae37fe640 1 -- 172.21.15.120:0/1424902019 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad8005290 con 0x7ffaf8158b60 2024-07-27T03:08:16.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.559+0000 7fcd9e53d640 1 --2- 172.21.15.120:0/1660432424 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd9815f3c0 0x7fcd980aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.559+0000 7fcd9e53d640 1 -- 172.21.15.120:0/1660432424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd981548d0 con 0x7fcd980ae7d0 2024-07-27T03:08:16.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.559+0000 7fcd9ed3e640 1 --2- 172.21.15.120:0/1660432424 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd9815f3c0 0x7fcd980aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:16.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.559+0000 7fcd9e53d640 1 --2- 172.21.15.120:0/1660432424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd980ae7d0 0x7fcd98154390 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800cbc0 tx=0x7fcd8800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.558+0000 7f30c0814640 1 -- 172.21.15.120:0/401251682 shutdown_connections 2024-07-27T03:08:16.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.558+0000 7f30c0814640 1 -- 172.21.15.120:0/401251682 wait complete. 2024-07-27T03:08:16.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.566+0000 7ffaedffb640 1 -- 172.21.15.120:0/1424902019 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffae8042020 con 0x7ffaf8158b60 2024-07-27T03:08:16.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.566+0000 7ffaedffb640 1 -- 172.21.15.120:0/1424902019 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffae8005520 con 0x7ffaf8158b60 2024-07-27T03:08:16.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.566+0000 7ffaedffb640 1 -- 172.21.15.120:0/1424902019 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7ffae8049070 con 0x7ffaf8158b60 2024-07-27T03:08:16.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.567+0000 7fcd96ffd640 1 -- 172.21.15.120:0/1660432424 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88016020 con 0x7fcd980ae7d0 2024-07-27T03:08:16.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.567+0000 7fcd96ffd640 1 -- 172.21.15.120:0/1660432424 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd8800ad90 con 0x7fcd980ae7d0 2024-07-27T03:08:16.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.567+0000 7fcd96ffd640 1 -- 172.21.15.120:0/1660432424 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88012680 con 0x7fcd980ae7d0 2024-07-27T03:08:16.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.569+0000 7fcda07a1640 1 -- 172.21.15.120:0/1660432424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd98156aa0 con 0x7fcd980ae7d0 2024-07-27T03:08:16.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.569+0000 7fcda07a1640 1 -- 172.21.15.120:0/1660432424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd98157060 con 0x7fcd980ae7d0 2024-07-27T03:08:16.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.561+0000 7f30c0814640 1 Processor -- start 2024-07-27T03:08:16.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.562+0000 7f30c0814640 1 -- start start 2024-07-27T03:08:16.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.564+0000 7f30c0814640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b4006320 0x7f30b4048f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.564+0000 7f30c0814640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b4052360 0x7f30b40e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.564+0000 7f30ba59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b4006320 0x7f30b4048f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.564+0000 7f30ba59c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b4006320 0x7f30b4048f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.120:58590/0 (socket says 172.21.15.120:58590) 2024-07-27T03:08:16.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.564+0000 7f30ba59c640 1 -- 172.21.15.120:0/1462183841 learned_addr learned my addr 172.21.15.120:0/1462183841 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.564+0000 7f30b9d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b4052360 0x7f30b40e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.564+0000 7f30c0814640 1 --2- 172.21.15.120:0/1462183841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b417de70 0x7f30b417e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.565+0000 7f30c0814640 1 -- 172.21.15.120:0/1462183841 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f30b4006730 con 0x7f30b417de70 2024-07-27T03:08:16.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.565+0000 7f30c0814640 1 -- 172.21.15.120:0/1462183841 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40e3620 con 0x7f30b4052360 2024-07-27T03:08:16.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.565+0000 7f30c0814640 1 -- 172.21.15.120:0/1462183841 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f30b40068b0 con 0x7f30b4006320 2024-07-27T03:08:16.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.565+0000 7f30b9d9b640 1 -- 172.21.15.120:0/1462183841 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b4006320 msgr2=0x7f30b4048f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.565+0000 7f30b9d9b640 1 --2- 172.21.15.120:0/1462183841 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b4006320 0x7f30b4048f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.565+0000 7f30b9d9b640 1 -- 172.21.15.120:0/1462183841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b417de70 msgr2=0x7f30b417e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.565+0000 7f30b9d9b640 1 --2- 172.21.15.120:0/1462183841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b417de70 0x7f30b417e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.565+0000 7f30b9d9b640 1 -- 172.21.15.120:0/1462183841 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b417eb60 con 0x7f30b4052360 2024-07-27T03:08:16.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.565+0000 7f30b9d9b640 1 --2- 172.21.15.120:0/1462183841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b4052360 0x7f30b40e4f10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f30bc000b60 tx=0x7f30bc0aead0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.571+0000 7fcd96ffd640 1 -- 172.21.15.120:0/1660432424 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd88019020 con 0x7fcd980ae7d0 2024-07-27T03:08:16.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.571+0000 7fcd96ffd640 1 -- 172.21.15.120:0/1660432424 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcd88005400 con 0x7fcd980ae7d0 2024-07-27T03:08:16.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.571+0000 7fcd94ff9640 1 -- 172.21.15.120:0/1660432424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd980b4940 con 0x7fcd980ae7d0 2024-07-27T03:08:16.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.568+0000 7f30aaffd640 1 -- 172.21.15.120:0/1462183841 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0b3050 con 0x7f30b4052360 2024-07-27T03:08:16.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.568+0000 7f30c0814640 1 -- 172.21.15.120:0/1462183841 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b4048420 con 0x7f30b4052360 2024-07-27T03:08:16.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.568+0000 7f30c0814640 1 -- 172.21.15.120:0/1462183841 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b40489e0 con 0x7f30b4052360 2024-07-27T03:08:16.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.568+0000 7f30aaffd640 1 -- 172.21.15.120:0/1462183841 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30bc0b4040 con 0x7f30b4052360 2024-07-27T03:08:16.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.568+0000 7f30aaffd640 1 -- 172.21.15.120:0/1462183841 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0dc680 con 0x7f30b4052360 2024-07-27T03:08:16.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.568+0000 7f30aaffd640 1 -- 172.21.15.120:0/1462183841 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f30bc0e3020 con 0x7f30b4052360 2024-07-27T03:08:16.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.568+0000 7f30aaffd640 1 -- 172.21.15.120:0/1462183841 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f30bc0e5640 con 0x7f30b4052360 2024-07-27T03:08:16.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.570+0000 7f30c0814640 1 -- 172.21.15.120:0/1462183841 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b4005de0 con 0x7f30b4052360 2024-07-27T03:08:16.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.575+0000 7fcd96ffd640 1 -- 172.21.15.120:0/1660432424 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7fcd981548d0 con 0x7fcd980ae7d0 2024-07-27T03:08:16.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.573+0000 7f30aaffd640 1 -- 172.21.15.120:0/1462183841 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7f30bc0dc820 con 0x7f30b4052360 2024-07-27T03:08:16.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.628+0000 7f578e75d640 1 -- 172.21.15.120:0/283512012 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f5768005580 con 0x7f57880ae620 2024-07-27T03:08:16.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.634+0000 7f5784ff9640 1 -- 172.21.15.120:0/283512012 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f57780193b0 con 0x7f57880ae620 2024-07-27T03:08:16.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.637+0000 7fa95f280640 1 -- 172.21.15.120:0/4113767183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9500519a0 msgr2=0x7fa950051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.637+0000 7fa95f280640 1 --2- 172.21.15.120:0/4113767183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9500519a0 0x7fa950051db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa958050ca0 tx=0x7fa958066620 comp rx=0 tx=0).stop 2024-07-27T03:08:16.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.637+0000 7fa95f280640 1 -- 172.21.15.120:0/4113767183 shutdown_connections 2024-07-27T03:08:16.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.637+0000 7fa95f280640 1 --2- 172.21.15.120:0/4113767183 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa950006820 0x7fa950006c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.637+0000 7fa95f280640 1 --2- 172.21.15.120:0/4113767183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9500519a0 0x7fa950051db0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.637+0000 7fa95f280640 1 --2- 172.21.15.120:0/4113767183 >> v2:172.21.15.121:3300/0 conn(0x7fa9500df800 0x7fa950007c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.637+0000 7fa95f280640 1 -- 172.21.15.120:0/4113767183 >> 172.21.15.120:0/4113767183 conn(0x7fa95001e260 msgr2=0x7fa950039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.637+0000 7fa95f280640 1 -- 172.21.15.120:0/4113767183 shutdown_connections 2024-07-27T03:08:16.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.637+0000 7fa95f280640 1 -- 172.21.15.120:0/4113767183 wait complete. 2024-07-27T03:08:16.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.640+0000 7f578e75d640 1 -- 172.21.15.120:0/283512012 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f57880ae620 msgr2=0x7f57882056f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.640+0000 7f578e75d640 1 --2- 172.21.15.120:0/283512012 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f57880ae620 0x7f57882056f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f577800b410 tx=0x7f577800b8d0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.640+0000 7f578e75d640 1 -- 172.21.15.120:0/283512012 shutdown_connections 2024-07-27T03:08:16.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.640+0000 7f578e75d640 1 --2- 172.21.15.120:0/283512012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57880cf7c0 0x7f578815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.640+0000 7f578e75d640 1 --2- 172.21.15.120:0/283512012 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f57880ae620 0x7f57882056f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.640+0000 7f578e75d640 1 --2- 172.21.15.120:0/283512012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57880cd170 0x7f57881611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.640+0000 7f578e75d640 1 -- 172.21.15.120:0/283512012 >> 172.21.15.120:0/283512012 conn(0x7f578806d140 msgr2=0x7f5788141b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.640+0000 7fa95f280640 1 Processor -- start 2024-07-27T03:08:16.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.640+0000 7fa95f280640 1 -- start start 2024-07-27T03:08:16.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.642+0000 7fa95f280640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa950006820 0x7fa950186650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.642+0000 7fa95f280640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9500519a0 0x7fa9500e1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.642+0000 7fa95f280640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9500df800 0x7fa9500e23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.642+0000 7fa95f280640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa950037360 con 0x7fa950006820 2024-07-27T03:08:16.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.642+0000 7fa95f280640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa9500371e0 con 0x7fa9500df800 2024-07-27T03:08:16.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.642+0000 7fa95f280640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa950007170 con 0x7fa9500519a0 2024-07-27T03:08:16.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.643+0000 7fa95e27e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa950006820 0x7fa950186650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.643+0000 7fa95e27e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa950006820 0x7fa950186650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46726/0 (socket says 172.21.15.120:46726) 2024-07-27T03:08:16.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.643+0000 7fa95e27e640 1 -- 172.21.15.120:0/504354955 learned_addr learned my addr 172.21.15.120:0/504354955 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.643+0000 7fa95e27e640 1 -- 172.21.15.120:0/504354955 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9500519a0 msgr2=0x7fa9500e1ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-27T03:08:16.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.643+0000 7fa95e27e640 1 --2- 172.21.15.120:0/504354955 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9500519a0 0x7fa9500e1ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.643+0000 7fa95e27e640 1 -- 172.21.15.120:0/504354955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9500df800 msgr2=0x7fa9500e23e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-27T03:08:16.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.643+0000 7fa95e27e640 1 --2- 172.21.15.120:0/504354955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9500df800 0x7fa9500e23e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.643+0000 7fa95e27e640 1 -- 172.21.15.120:0/504354955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9500dc490 con 0x7fa950006820 2024-07-27T03:08:16.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.643+0000 7fa95e27e640 1 --2- 172.21.15.120:0/504354955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa950006820 0x7fa950186650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa94800d9a0 tx=0x7fa94800de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.644+0000 7f578e75d640 1 -- 172.21.15.120:0/283512012 shutdown_connections 2024-07-27T03:08:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.644+0000 7fa94effd640 1 -- 172.21.15.120:0/504354955 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948017070 con 0x7fa950006820 2024-07-27T03:08:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.644+0000 7fa94effd640 1 -- 172.21.15.120:0/504354955 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa948009bd0 con 0x7fa950006820 2024-07-27T03:08:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.644+0000 7fa94effd640 1 -- 172.21.15.120:0/504354955 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948010460 con 0x7fa950006820 2024-07-27T03:08:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.644+0000 7f578e75d640 1 -- 172.21.15.120:0/283512012 wait complete. 2024-07-27T03:08:16.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.644+0000 7fa95f280640 1 -- 172.21.15.120:0/504354955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95004e5d0 con 0x7fa950006820 2024-07-27T03:08:16.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.644+0000 7fa95f280640 1 -- 172.21.15.120:0/504354955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa95004eb90 con 0x7fa950006820 2024-07-27T03:08:16.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.644+0000 7fa94effd640 1 -- 172.21.15.120:0/504354955 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa94801a070 con 0x7fa950006820 2024-07-27T03:08:16.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.645+0000 7fa94effd640 1 -- 172.21.15.120:0/504354955 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa94801cb50 con 0x7fa950006820 2024-07-27T03:08:16.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.646+0000 7fa95f280640 1 -- 172.21.15.120:0/504354955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa940005290 con 0x7fa950006820 2024-07-27T03:08:16.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.650+0000 7fa94effd640 1 -- 172.21.15.120:0/504354955 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7fa9480106a0 con 0x7fa950006820 2024-07-27T03:08:16.679 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.679+0000 7f91b1d85640 1 -- 172.21.15.120:0/294686851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91ac155380 msgr2=0x7f91ac162240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.679+0000 7f91b1d85640 1 --2- 172.21.15.120:0/294686851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91ac155380 0x7f91ac162240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0b42c0 tx=0x7f919c02a460 comp rx=0 tx=0).stop 2024-07-27T03:08:16.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.679+0000 7f91b1d85640 1 -- 172.21.15.120:0/294686851 shutdown_connections 2024-07-27T03:08:16.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.679+0000 7f91b1d85640 1 --2- 172.21.15.120:0/294686851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91ac155380 0x7f91ac162240 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.679+0000 7f91b1d85640 1 --2- 172.21.15.120:0/294686851 >> v2:172.21.15.120:3300/0 conn(0x7f91ac154f70 0x7f91ac161d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.679+0000 7f91b1d85640 1 -- 172.21.15.120:0/294686851 >> 172.21.15.120:0/294686851 conn(0x7f91ac06cfd0 msgr2=0x7f91ac0b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.682+0000 7f91b1d85640 1 -- 172.21.15.120:0/294686851 shutdown_connections 2024-07-27T03:08:16.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.682+0000 7f91b1d85640 1 -- 172.21.15.120:0/294686851 wait complete. 2024-07-27T03:08:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.686+0000 7f4f98684640 1 -- 172.21.15.120:0/834338327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f90073260 msgr2=0x7f4f90150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.686+0000 7f4f98684640 1 --2- 172.21.15.120:0/834338327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f90073260 0x7f4f90150970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c005fd0 tx=0x7f4f8c02a4a0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.685+0000 7f91b1d85640 1 Processor -- start 2024-07-27T03:08:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.685+0000 7f91b1d85640 1 -- start start 2024-07-27T03:08:16.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.688+0000 7f91b1d85640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91ac0b30f0 0x7f91ac15e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.688+0000 7f91b1d85640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91ac154f70 0x7f91ac146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.688+0000 7f91b0d83640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91ac0b30f0 0x7f91ac15e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.688+0000 7f91b0d83640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91ac0b30f0 0x7f91ac15e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46740/0 (socket says 172.21.15.120:46740) 2024-07-27T03:08:16.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.688+0000 7f91b0d83640 1 -- 172.21.15.120:0/945840987 learned_addr learned my addr 172.21.15.120:0/945840987 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.688+0000 7f91b1d85640 1 --2- 172.21.15.120:0/945840987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f91ac146740 0x7f91ac157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.689+0000 7f4f98684640 1 -- 172.21.15.120:0/834338327 shutdown_connections 2024-07-27T03:08:16.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.689+0000 7f4f98684640 1 --2- 172.21.15.120:0/834338327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f90073260 0x7f4f90150970 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.689+0000 7f4f98684640 1 -- 172.21.15.120:0/834338327 >> 172.21.15.120:0/834338327 conn(0x7f4f900b2dc0 msgr2=0x7f4f900d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.688+0000 7f91b1d85640 1 -- 172.21.15.120:0/945840987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac0cf1d0 con 0x7f91ac0b30f0 2024-07-27T03:08:16.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.688+0000 7f91b1d85640 1 -- 172.21.15.120:0/945840987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac0cf050 con 0x7f91ac154f70 2024-07-27T03:08:16.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.688+0000 7f91b1d85640 1 -- 172.21.15.120:0/945840987 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f91ac0cf350 con 0x7f91ac146740 2024-07-27T03:08:16.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.689+0000 7f91b0d83640 1 -- 172.21.15.120:0/945840987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f91ac146740 msgr2=0x7f91ac157be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-27T03:08:16.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.689+0000 7f91b0d83640 1 --2- 172.21.15.120:0/945840987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f91ac146740 0x7f91ac157be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.689+0000 7f91b0d83640 1 -- 172.21.15.120:0/945840987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91ac154f70 msgr2=0x7f91ac146200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-27T03:08:16.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.689+0000 7f91b0d83640 1 --2- 172.21.15.120:0/945840987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91ac154f70 0x7f91ac146200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.689+0000 7f91b0d83640 1 -- 172.21.15.120:0/945840987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac160dc0 con 0x7f91ac0b30f0 2024-07-27T03:08:16.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.689+0000 7f91b0d83640 1 --2- 172.21.15.120:0/945840987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91ac0b30f0 0x7f91ac15e6d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f91a400caa0 tx=0x7f91a400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.690+0000 7f91a97fa640 1 -- 172.21.15.120:0/945840987 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4017070 con 0x7f91ac0b30f0 2024-07-27T03:08:16.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.690+0000 7f91a97fa640 1 -- 172.21.15.120:0/945840987 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91a400a6d0 con 0x7f91ac0b30f0 2024-07-27T03:08:16.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.692+0000 7f91a97fa640 1 -- 172.21.15.120:0/945840987 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a400ab00 con 0x7f91ac0b30f0 2024-07-27T03:08:16.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.692+0000 7f91b1d85640 1 -- 172.21.15.120:0/945840987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ac161030 con 0x7f91ac0b30f0 2024-07-27T03:08:16.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.692+0000 7f91b1d85640 1 -- 172.21.15.120:0/945840987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ac1615f0 con 0x7f91ac0b30f0 2024-07-27T03:08:16.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.693+0000 7f8bea0a1640 1 -- 172.21.15.120:0/2636520067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8be4073260 msgr2=0x7f8be4150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.693+0000 7f8bea0a1640 1 --2- 172.21.15.120:0/2636520067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8be4073260 0x7f8be4150970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc005fd0 tx=0x7f8bdc02aac0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.693+0000 7f8bea0a1640 1 -- 172.21.15.120:0/2636520067 shutdown_connections 2024-07-27T03:08:16.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.693+0000 7f8bea0a1640 1 --2- 172.21.15.120:0/2636520067 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8be4150eb0 0x7f8be41512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.693+0000 7f8bea0a1640 1 --2- 172.21.15.120:0/2636520067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8be4073260 0x7f8be4150970 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.693+0000 7f8bea0a1640 1 -- 172.21.15.120:0/2636520067 >> 172.21.15.120:0/2636520067 conn(0x7f8be40b2dc0 msgr2=0x7f8be40d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.694+0000 7f91a97fa640 1 -- 172.21.15.120:0/945840987 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f91a401a070 con 0x7f91ac0b30f0 2024-07-27T03:08:16.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.694+0000 7f91a97fa640 1 -- 172.21.15.120:0/945840987 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f91a4012890 con 0x7f91ac0b30f0 2024-07-27T03:08:16.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.696+0000 7fe6405ea640 1 -- 172.21.15.120:0/3739033970 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fe620005580 con 0x7fe63816ed20 2024-07-27T03:08:16.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.697+0000 7f8bea0a1640 1 -- 172.21.15.120:0/2636520067 shutdown_connections 2024-07-27T03:08:16.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.697+0000 7f4f98684640 1 -- 172.21.15.120:0/834338327 shutdown_connections 2024-07-27T03:08:16.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.697+0000 7f4f98684640 1 -- 172.21.15.120:0/834338327 wait complete. 2024-07-27T03:08:16.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.700+0000 7f4f98684640 1 Processor -- start 2024-07-27T03:08:16.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.700+0000 7f4f98684640 1 -- start start 2024-07-27T03:08:16.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.697+0000 7f8bea0a1640 1 -- 172.21.15.120:0/2636520067 wait complete. 2024-07-27T03:08:16.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.700+0000 7f8bea0a1640 1 Processor -- start 2024-07-27T03:08:16.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.702+0000 7f8bea0a1640 1 -- start start 2024-07-27T03:08:16.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.705+0000 7f8bea0a1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be4072e50 0x7f8be4147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.705+0000 7f8bea0a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8be4073260 0x7f8be415c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.705+0000 7f8bea0a1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8be4150eb0 0x7f8be415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.705+0000 7f8bea0a1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4160d00 con 0x7f8be4073260 2024-07-27T03:08:16.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.705+0000 7f8bea0a1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4160b80 con 0x7f8be4072e50 2024-07-27T03:08:16.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.705+0000 7f8bea0a1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8be4160e80 con 0x7f8be4150eb0 2024-07-27T03:08:16.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f8be37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be4072e50 0x7f8be4147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f8be37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be4072e50 0x7f8be4147e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.120:42352/0 (socket says 172.21.15.120:42352) 2024-07-27T03:08:16.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f8be37fe640 1 -- 172.21.15.120:0/832250948 learned_addr learned my addr 172.21.15.120:0/832250948 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.706+0000 7f4f98684640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f90072e50 0x7f4f9014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.706+0000 7f4f98684640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f90150eb0 0x7f4f90202850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.706+0000 7f4f98684640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f9014d7f0 0x7f4f9014a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.706+0000 7f4f98684640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90161080 con 0x7f4f90072e50 2024-07-27T03:08:16.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.706+0000 7f4f98684640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90151690 con 0x7f4f9014d7f0 2024-07-27T03:08:16.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.706+0000 7f4f98684640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4f90161200 con 0x7f4f90150eb0 2024-07-27T03:08:16.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.706+0000 7f4f96420640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f90072e50 0x7f4f9014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f4f96420640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f90072e50 0x7f4f9014af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46770/0 (socket says 172.21.15.120:46770) 2024-07-27T03:08:16.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f4f96420640 1 -- 172.21.15.120:0/2272939982 learned_addr learned my addr 172.21.15.120:0/2272939982 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.694+0000 7f9192ffd640 1 -- 172.21.15.120:0/945840987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9184005290 con 0x7f91ac0b30f0 2024-07-27T03:08:16.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.699+0000 7f91a97fa640 1 -- 172.21.15.120:0/945840987 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7f91a400aca0 con 0x7f91ac0b30f0 2024-07-27T03:08:16.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f8be37fe640 1 -- 172.21.15.120:0/832250948 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8be4150eb0 msgr2=0x7f8be415cb60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-27T03:08:16.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f4f96c21640 1 --2- 172.21.15.120:0/2272939982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f9014d7f0 0x7f4f9014a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f4f95c1f640 1 --2- 172.21.15.120:0/2272939982 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f90150eb0 0x7f4f90202850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f7459a84640 1 -- 172.21.15.120:0/585714019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f745415dd90 msgr2=0x7f745415e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f7459a84640 1 --2- 172.21.15.120:0/585714019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f745415dd90 0x7f745415e1a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7454072040 tx=0x7f744802c6e0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f7459a84640 1 -- 172.21.15.120:0/585714019 shutdown_connections 2024-07-27T03:08:16.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f7459a84640 1 --2- 172.21.15.120:0/585714019 >> v2:172.21.15.121:3300/0 conn(0x7f745415a7a0 0x7f745415abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f7459a84640 1 --2- 172.21.15.120:0/585714019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f745415dd90 0x7f745415e1a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f7459a84640 1 --2- 172.21.15.120:0/585714019 >> v2:172.21.15.120:3300/0 conn(0x7f7454151360 0x7f745406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.707+0000 7f7459a84640 1 -- 172.21.15.120:0/585714019 >> 172.21.15.120:0/585714019 conn(0x7f745406d060 msgr2=0x7f74540b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f8be37fe640 1 --2- 172.21.15.120:0/832250948 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8be4150eb0 0x7f8be415cb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f8be37fe640 1 -- 172.21.15.120:0/832250948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8be4073260 msgr2=0x7f8be415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f8be37fe640 1 --2- 172.21.15.120:0/832250948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8be4073260 0x7f8be415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f8be37fe640 1 -- 172.21.15.120:0/832250948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be4205d60 con 0x7f8be4072e50 2024-07-27T03:08:16.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f8be37fe640 1 --2- 172.21.15.120:0/832250948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be4072e50 0x7f8be4147e90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c400 tx=0x7f8bd400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f4f96c21640 1 -- 172.21.15.120:0/2272939982 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f90150eb0 msgr2=0x7f4f90202850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f4f96c21640 1 --2- 172.21.15.120:0/2272939982 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f90150eb0 0x7f4f90202850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f4f96c21640 1 -- 172.21.15.120:0/2272939982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f90072e50 msgr2=0x7f4f9014af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f4f96c21640 1 --2- 172.21.15.120:0/2272939982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f90072e50 0x7f4f9014af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f4f96c21640 1 -- 172.21.15.120:0/2272939982 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f90203080 con 0x7f4f9014d7f0 2024-07-27T03:08:16.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.708+0000 7f4f96c21640 1 --2- 172.21.15.120:0/2272939982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f9014d7f0 0x7f4f9014a140 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4f90068ef0 tx=0x7f4f8000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.709+0000 7f8bd3fff640 1 -- 172.21.15.120:0/832250948 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4017070 con 0x7f8be4072e50 2024-07-27T03:08:16.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.709+0000 7f8bea0a1640 1 -- 172.21.15.120:0/832250948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be4206040 con 0x7f8be4072e50 2024-07-27T03:08:16.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.709+0000 7f8bea0a1640 1 -- 172.21.15.120:0/832250948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be4206600 con 0x7f8be4072e50 2024-07-27T03:08:16.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.710+0000 7f7459a84640 1 -- 172.21.15.120:0/585714019 shutdown_connections 2024-07-27T03:08:16.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.710+0000 7f8bd3fff640 1 -- 172.21.15.120:0/832250948 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bd40053c0 con 0x7f8be4072e50 2024-07-27T03:08:16.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.710+0000 7f4f86ffd640 1 -- 172.21.15.120:0/2272939982 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80015020 con 0x7f4f9014d7f0 2024-07-27T03:08:16.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.712+0000 7f8bd3fff640 1 -- 172.21.15.120:0/832250948 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4003850 con 0x7f8be4072e50 2024-07-27T03:08:16.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.713+0000 7f8bd1ffb640 1 -- 172.21.15.120:0/832250948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc0005290 con 0x7f8be4072e50 2024-07-27T03:08:16.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.710+0000 7f4f98684640 1 -- 172.21.15.120:0/2272939982 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f90203360 con 0x7f4f9014d7f0 2024-07-27T03:08:16.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.711+0000 7f4f98684640 1 -- 172.21.15.120:0/2272939982 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f90203c20 con 0x7f4f9014d7f0 2024-07-27T03:08:16.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.710+0000 7f7459a84640 1 -- 172.21.15.120:0/585714019 wait complete. 2024-07-27T03:08:16.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.713+0000 7f7459a84640 1 Processor -- start 2024-07-27T03:08:16.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.714+0000 7f4f86ffd640 1 -- 172.21.15.120:0/2272939982 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f80011920 con 0x7f4f9014d7f0 2024-07-27T03:08:16.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.714+0000 7f4f86ffd640 1 -- 172.21.15.120:0/2272939982 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80011d50 con 0x7f4f9014d7f0 2024-07-27T03:08:16.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.714+0000 7f4f86ffd640 1 -- 172.21.15.120:0/2272939982 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4f80018020 con 0x7f4f9014d7f0 2024-07-27T03:08:16.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.714+0000 7f4f86ffd640 1 -- 172.21.15.120:0/2272939982 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4f80019970 con 0x7f4f9014d7f0 2024-07-27T03:08:16.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.714+0000 7f8bd3fff640 1 -- 172.21.15.120:0/832250948 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8bd401a070 con 0x7f8be4072e50 2024-07-27T03:08:16.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.714+0000 7f8bd3fff640 1 -- 172.21.15.120:0/832250948 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8bd401c780 con 0x7f8be4072e50 2024-07-27T03:08:16.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.715+0000 7f4f98684640 1 -- 172.21.15.120:0/2272939982 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f90202df0 con 0x7f4f9014d7f0 2024-07-27T03:08:16.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.715+0000 7fe62effd640 1 -- 172.21.15.120:0/3739033970 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7fe6380cf650 con 0x7fe63816ed20 2024-07-27T03:08:16.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.714+0000 7f7459a84640 1 -- start start 2024-07-27T03:08:16.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.716+0000 7f7459a84640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7454151360 0x7f74540cef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.716+0000 7f7459a84640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f745415a7a0 0x7f745414b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.716+0000 7f7459a84640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f745409ab50 0x7f7454152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.716+0000 7f7459a84640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f745406fd30 con 0x7f745415a7a0 2024-07-27T03:08:16.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.716+0000 7f7459a84640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f745406fbb0 con 0x7f7454151360 2024-07-27T03:08:16.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.716+0000 7f7453fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f745409ab50 0x7f7454152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.716+0000 7f7453fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f745409ab50 0x7f7454152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.120:58686/0 (socket says 172.21.15.120:58686) 2024-07-27T03:08:16.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.716+0000 7f7453fff640 1 -- 172.21.15.120:0/3139982521 learned_addr learned my addr 172.21.15.120:0/3139982521 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.717+0000 7f8bd3fff640 1 -- 172.21.15.120:0/832250948 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7f8bd4021070 con 0x7f8be4072e50 2024-07-27T03:08:16.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.717+0000 7f7459a84640 1 -- 172.21.15.120:0/3139982521 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f74540703a0 con 0x7f745409ab50 2024-07-27T03:08:16.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.717+0000 7f74537fe640 1 --2- 172.21.15.120:0/3139982521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7454151360 0x7f74540cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.717+0000 7f7453fff640 1 -- 172.21.15.120:0/3139982521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7454151360 msgr2=0x7f74540cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.717+0000 7f7453fff640 1 --2- 172.21.15.120:0/3139982521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7454151360 0x7f74540cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.717+0000 7f7453fff640 1 -- 172.21.15.120:0/3139982521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f745415a7a0 msgr2=0x7f745414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.717+0000 7f7453fff640 1 --2- 172.21.15.120:0/3139982521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f745415a7a0 0x7f745414b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.717+0000 7f7453fff640 1 -- 172.21.15.120:0/3139982521 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f745409d970 con 0x7f745409ab50 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.717+0000 7f7453fff640 1 --2- 172.21.15.120:0/3139982521 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f745409ab50 0x7f7454152860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f744c00e9d0 tx=0x7f744c00edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.718+0000 7f743bfff640 1 -- 172.21.15.120:0/3139982521 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c00cd80 con 0x7f745409ab50 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.718+0000 7f743bfff640 1 -- 172.21.15.120:0/3139982521 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f744c004b20 con 0x7f745409ab50 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.718+0000 7f7459a84640 1 -- 172.21.15.120:0/3139982521 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74540cde80 con 0x7f745409ab50 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.718+0000 7f7459a84640 1 -- 172.21.15.120:0/3139982521 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74540ce440 con 0x7f745409ab50 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.720+0000 7f743bfff640 1 -- 172.21.15.120:0/3139982521 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c005020 con 0x7f745409ab50 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.720+0000 7f743bfff640 1 -- 172.21.15.120:0/3139982521 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f744c0055d0 con 0x7f745409ab50 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.720+0000 7f743bfff640 1 -- 172.21.15.120:0/3139982521 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f744c018770 con 0x7f745409ab50 2024-07-27T03:08:16.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.722+0000 7f7439ffb640 1 -- 172.21.15.120:0/3139982521 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745406e150 con 0x7f745409ab50 2024-07-27T03:08:16.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.724+0000 7f743bfff640 1 -- 172.21.15.120:0/3139982521 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7f744c021d50 con 0x7f745409ab50 2024-07-27T03:08:16.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.728+0000 7fe6405ea640 1 -- 172.21.15.120:0/3739033970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe63816ed20 msgr2=0x7fe638155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.728+0000 7fe6405ea640 1 --2- 172.21.15.120:0/3739033970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe63816ed20 0x7fe638155c30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe62800c3f0 tx=0x7fe62800c8b0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.728+0000 7fe6405ea640 1 -- 172.21.15.120:0/3739033970 shutdown_connections 2024-07-27T03:08:16.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.728+0000 7fe6405ea640 1 --2- 172.21.15.120:0/3739033970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6380ced00 0x7fe6381556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.728+0000 7fe6405ea640 1 --2- 172.21.15.120:0/3739033970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe63816ed20 0x7fe638155c30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.728+0000 7fe6405ea640 1 --2- 172.21.15.120:0/3739033970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6380b2660 0x7fe6381f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.728+0000 7fe6405ea640 1 -- 172.21.15.120:0/3739033970 >> 172.21.15.120:0/3739033970 conn(0x7fe6380b1b40 msgr2=0x7fe6380b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.728+0000 7fe6405ea640 1 -- 172.21.15.120:0/3739033970 shutdown_connections 2024-07-27T03:08:16.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.728+0000 7fe6405ea640 1 -- 172.21.15.120:0/3739033970 wait complete. 2024-07-27T03:08:16.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.723+0000 7f4f86ffd640 1 -- 172.21.15.120:0/2272939982 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7f4f8001f020 con 0x7f4f9014d7f0 2024-07-27T03:08:16.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.755+0000 7f84b34c6640 1 -- 172.21.15.120:0/303574634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84ac0718f0 msgr2=0x7f84ac15e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.755+0000 7f84b34c6640 1 --2- 172.21.15.120:0/303574634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84ac0718f0 0x7f84ac15e7f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0c4640 tx=0x7f84a802a530 comp rx=0 tx=0).stop 2024-07-27T03:08:16.759 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.764+0000 7f84b34c6640 1 -- 172.21.15.120:0/303574634 shutdown_connections 2024-07-27T03:08:16.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.764+0000 7f84b34c6640 1 --2- 172.21.15.120:0/303574634 >> v2:172.21.15.121:3300/0 conn(0x7f84ac071220 0x7f84ac06fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.764+0000 7f84b34c6640 1 --2- 172.21.15.120:0/303574634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84ac0718f0 0x7f84ac15e7f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.764+0000 7f84b34c6640 1 -- 172.21.15.120:0/303574634 >> 172.21.15.120:0/303574634 conn(0x7f84ac0d0b40 msgr2=0x7f84ac0d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.766+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/2936557029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0c0035330 msgr2=0x7fc0c0036ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.766+0000 7fc0cd6ee640 1 --2- 172.21.15.120:0/2936557029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0c0035330 0x7fc0c0036ab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8050ca0 tx=0x7fc0c8066620 comp rx=0 tx=0).stop 2024-07-27T03:08:16.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.770+0000 7f84b34c6640 1 -- 172.21.15.120:0/303574634 shutdown_connections 2024-07-27T03:08:16.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.773+0000 7f30c0814640 1 -- 172.21.15.120:0/1462183841 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f30b404eb50 con 0x7f30b4052360 2024-07-27T03:08:16.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.773+0000 7f84b34c6640 1 -- 172.21.15.120:0/303574634 wait complete. 2024-07-27T03:08:16.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.774+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/2936557029 shutdown_connections 2024-07-27T03:08:16.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.774+0000 7fc0cd6ee640 1 --2- 172.21.15.120:0/2936557029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0c0035330 0x7fc0c0036ab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.774+0000 7fc0cd6ee640 1 --2- 172.21.15.120:0/2936557029 >> v2:172.21.15.121:3300/0 conn(0x7fc0c00343e0 0x7fc0c0054640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.774+0000 7fc0cd6ee640 1 --2- 172.21.15.120:0/2936557029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0c00e10d0 0x7fc0c0054100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.774+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/2936557029 >> 172.21.15.120:0/2936557029 conn(0x7fc0c001e260 msgr2=0x7fc0c0039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.776+0000 7f84b34c6640 1 Processor -- start 2024-07-27T03:08:16.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.777+0000 7f84b34c6640 1 -- start start 2024-07-27T03:08:16.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.777+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/2936557029 shutdown_connections 2024-07-27T03:08:16.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.777+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/2936557029 wait complete. 2024-07-27T03:08:16.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.781+0000 7f30aaffd640 1 -- 172.21.15.120:0/1462183841 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v10)=0 v10) ==== 121+0+0 (secure 0 0 0) 0x7f30bc0dca00 con 0x7f30b4052360 2024-07-27T03:08:16.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.781+0000 7fc0cd6ee640 1 Processor -- start 2024-07-27T03:08:16.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.781+0000 7fc0cd6ee640 1 -- start start 2024-07-27T03:08:16.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.783+0000 7f84b34c6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84ac071220 0x7f84ac201f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7fc0cd6ee640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0c00343e0 0x7fc0c01797d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f30a8ff9640 1 -- 172.21.15.120:0/1462183841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b4052360 msgr2=0x7f30b40e4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f30a8ff9640 1 --2- 172.21.15.120:0/1462183841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b4052360 0x7f30b40e4f10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f30bc000b60 tx=0x7f30bc0aead0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f30a8ff9640 1 -- 172.21.15.120:0/1462183841 shutdown_connections 2024-07-27T03:08:16.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f30a8ff9640 1 --2- 172.21.15.120:0/1462183841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b417de70 0x7f30b417e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f30a8ff9640 1 --2- 172.21.15.120:0/1462183841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b4052360 0x7f30b40e4f10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f30a8ff9640 1 --2- 172.21.15.120:0/1462183841 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b4006320 0x7f30b4048f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f30a8ff9640 1 -- 172.21.15.120:0/1462183841 >> 172.21.15.120:0/1462183841 conn(0x7f30b401d9a0 msgr2=0x7f30b40e2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f84b34c6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84ac0718f0 0x7f84ac0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f30a8ff9640 1 -- 172.21.15.120:0/1462183841 shutdown_connections 2024-07-27T03:08:16.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f30a8ff9640 1 -- 172.21.15.120:0/1462183841 wait complete. 2024-07-27T03:08:16.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f84b1262640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84ac071220 0x7f84ac201f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f84b1262640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84ac071220 0x7f84ac201f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.120:42386/0 (socket says 172.21.15.120:42386) 2024-07-27T03:08:16.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f84b1262640 1 -- 172.21.15.120:0/2815222437 learned_addr learned my addr 172.21.15.120:0/2815222437 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.786+0000 7f84b0a61640 1 --2- 172.21.15.120:0/2815222437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84ac0718f0 0x7f84ac0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.787+0000 7f84b34c6640 1 --2- 172.21.15.120:0/2815222437 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84ac0cb290 0x7f84ac0c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.787+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac0cec30 con 0x7f84ac0718f0 2024-07-27T03:08:16.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.787+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac0ceab0 con 0x7f84ac071220 2024-07-27T03:08:16.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.787+0000 7f84b1a63640 1 --2- 172.21.15.120:0/2815222437 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84ac0cb290 0x7f84ac0c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.787+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f84ac0cedb0 con 0x7f84ac0cb290 2024-07-27T03:08:16.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.787+0000 7fc0cd6ee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0c0035330 0x7fc0c0050d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.788+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0c00343e0 0x7fc0c01797d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.788+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0c00343e0 0x7fc0c01797d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46806/0 (socket says 172.21.15.120:46806) 2024-07-27T03:08:16.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.788+0000 7fc0c7fff640 1 -- 172.21.15.120:0/3190261585 learned_addr learned my addr 172.21.15.120:0/3190261585 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:16.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.788+0000 7fc0cd6ee640 1 --2- 172.21.15.120:0/3190261585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0c00516b0 0x7fc0c00e2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:16.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.788+0000 7fc0c77fe640 1 --2- 172.21.15.120:0/3190261585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0c0035330 0x7fc0c0050d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.789+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c0037380 con 0x7fc0c00343e0 2024-07-27T03:08:16.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.788+0000 7f84b0a61640 1 -- 172.21.15.120:0/2815222437 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84ac0cb290 msgr2=0x7f84ac0c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.789+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c0037200 con 0x7fc0c0035330 2024-07-27T03:08:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.788+0000 7f84b0a61640 1 --2- 172.21.15.120:0/2815222437 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84ac0cb290 0x7f84ac0c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.788+0000 7f84b0a61640 1 -- 172.21.15.120:0/2815222437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84ac071220 msgr2=0x7f84ac201f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.788+0000 7f84b0a61640 1 --2- 172.21.15.120:0/2815222437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84ac071220 0x7f84ac201f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.788+0000 7f84b0a61640 1 -- 172.21.15.120:0/2815222437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac0b5cd0 con 0x7f84ac0718f0 2024-07-27T03:08:16.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.789+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c0037500 con 0x7fc0c00516b0 2024-07-27T03:08:16.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.789+0000 7f84b0a61640 1 --2- 172.21.15.120:0/2815222437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84ac0718f0 0x7f84ac0b6170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0b6cd0 tx=0x7f849c00eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.789+0000 7f84b1a63640 1 --2- 172.21.15.120:0/2815222437 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84ac0cb290 0x7f84ac0c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:08:16.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.790+0000 7f84a1ffb640 1 -- 172.21.15.120:0/2815222437 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c004220 con 0x7f84ac0718f0 2024-07-27T03:08:16.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.790+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ac206150 con 0x7f84ac0718f0 2024-07-27T03:08:16.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.791+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ac206710 con 0x7f84ac0718f0 2024-07-27T03:08:16.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.788+0000 7ffae37fe640 1 -- 172.21.15.120:0/1424902019 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7ffad8005580 con 0x7ffaf8158b60 2024-07-27T03:08:16.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.791+0000 7fc0cceed640 1 --2- 172.21.15.120:0/3190261585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0c00516b0 0x7fc0c00e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:16.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.791+0000 7fc0c7fff640 1 -- 172.21.15.120:0/3190261585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0c00516b0 msgr2=0x7fc0c00e2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.791+0000 7fc0c7fff640 1 --2- 172.21.15.120:0/3190261585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0c00516b0 0x7fc0c00e2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.791+0000 7fc0c7fff640 1 -- 172.21.15.120:0/3190261585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0c0035330 msgr2=0x7fc0c0050d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.791+0000 7fc0c7fff640 1 --2- 172.21.15.120:0/3190261585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0c0035330 0x7fc0c0050d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.791+0000 7fc0c7fff640 1 -- 172.21.15.120:0/3190261585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c0051290 con 0x7fc0c00343e0 2024-07-27T03:08:16.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.791+0000 7fc0c77fe640 1 --2- 172.21.15.120:0/3190261585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0c0035330 0x7fc0c0050d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:16.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.793+0000 7fc0c7fff640 1 --2- 172.21.15.120:0/3190261585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0c00343e0 0x7fc0c01797d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00b410 tx=0x7fc0bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:16.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.797+0000 7fc0c4ff9640 1 -- 172.21.15.120:0/3190261585 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc015020 con 0x7fc0c00343e0 2024-07-27T03:08:16.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.797+0000 7fc0c4ff9640 1 -- 172.21.15.120:0/3190261585 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0bc011920 con 0x7fc0c00343e0 2024-07-27T03:08:16.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.797+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c0175950 con 0x7fc0c00343e0 2024-07-27T03:08:16.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.798+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c0175f10 con 0x7fc0c00343e0 2024-07-27T03:08:16.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.798+0000 7fc0c4ff9640 1 -- 172.21.15.120:0/3190261585 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc011d70 con 0x7fc0c00343e0 2024-07-27T03:08:16.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.798+0000 7fc0c4ff9640 1 -- 172.21.15.120:0/3190261585 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc0bc018020 con 0x7fc0c00343e0 2024-07-27T03:08:16.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.800+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a8005290 con 0x7fc0c00343e0 2024-07-27T03:08:16.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.794+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ac0cf2d0 con 0x7f84ac0718f0 2024-07-27T03:08:16.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.802+0000 7f84a1ffb640 1 -- 172.21.15.120:0/2815222437 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f849c0043c0 con 0x7f84ac0718f0 2024-07-27T03:08:16.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.803+0000 7f84a1ffb640 1 -- 172.21.15.120:0/2815222437 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c00cb10 con 0x7f84ac0718f0 2024-07-27T03:08:16.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.803+0000 7f84a1ffb640 1 -- 172.21.15.120:0/2815222437 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f849c004b70 con 0x7f84ac0718f0 2024-07-27T03:08:16.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.803+0000 7f84a1ffb640 1 -- 172.21.15.120:0/2815222437 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f849c003ae0 con 0x7f84ac0718f0 2024-07-27T03:08:16.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.808+0000 7ffaedffb640 1 -- 172.21.15.120:0/1424902019 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v11)=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7ffae803b7f0 con 0x7ffaf8158b60 2024-07-27T03:08:16.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.803+0000 7fc0c4ff9640 1 -- 172.21.15.120:0/3190261585 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc0bc019a20 con 0x7fc0c00343e0 2024-07-27T03:08:16.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.811+0000 7ffae37fe640 1 -- 172.21.15.120:0/1424902019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf8158b60 msgr2=0x7ffaf8156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.811+0000 7ffae37fe640 1 --2- 172.21.15.120:0/1424902019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf8158b60 0x7ffaf8156cf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffae8006010 tx=0x7ffae8004f60 comp rx=0 tx=0).stop 2024-07-27T03:08:16.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.811+0000 7ffae37fe640 1 -- 172.21.15.120:0/1424902019 shutdown_connections 2024-07-27T03:08:16.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.811+0000 7ffae37fe640 1 --2- 172.21.15.120:0/1424902019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf8158b60 0x7ffaf8156cf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.811+0000 7ffae37fe640 1 --2- 172.21.15.120:0/1424902019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffaf80ccef0 0x7ffaf814d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.811+0000 7ffae37fe640 1 --2- 172.21.15.120:0/1424902019 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffaf806f7e0 0x7ffaf8129b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.811+0000 7ffae37fe640 1 -- 172.21.15.120:0/1424902019 >> 172.21.15.120:0/1424902019 conn(0x7ffaf80d0b30 msgr2=0x7ffaf815cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.811+0000 7ffae37fe640 1 -- 172.21.15.120:0/1424902019 shutdown_connections 2024-07-27T03:08:16.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.811+0000 7ffae37fe640 1 -- 172.21.15.120:0/1424902019 wait complete. 2024-07-27T03:08:16.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.812+0000 7fc0c4ff9640 1 -- 172.21.15.120:0/3190261585 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7fc0bc01f020 con 0x7fc0c00343e0 2024-07-27T03:08:16.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.810+0000 7f84a1ffb640 1 -- 172.21.15.120:0/2815222437 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7f849c00ccb0 con 0x7f84ac0718f0 2024-07-27T03:08:16.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.816+0000 7fcd94ff9640 1 -- 172.21.15.120:0/1660432424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fcd9815e090 con 0x7fcd980ae7d0 2024-07-27T03:08:16.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.830+0000 7fa95f280640 1 -- 172.21.15.120:0/504354955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fa940005580 con 0x7fa950006820 2024-07-27T03:08:16.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.831+0000 7fcd96ffd640 1 -- 172.21.15.120:0/1660432424 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fcd980aebe0 con 0x7fcd980ae7d0 2024-07-27T03:08:16.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.832+0000 7fcd94ff9640 1 -- 172.21.15.120:0/1660432424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd980ae7d0 msgr2=0x7fcd98154390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.832+0000 7fcd94ff9640 1 --2- 172.21.15.120:0/1660432424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd980ae7d0 0x7fcd98154390 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800cbc0 tx=0x7fcd8800a060 comp rx=0 tx=0).stop 2024-07-27T03:08:16.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.836+0000 7fcd94ff9640 1 -- 172.21.15.120:0/1660432424 shutdown_connections 2024-07-27T03:08:16.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.836+0000 7fcd94ff9640 1 --2- 172.21.15.120:0/1660432424 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd9815f3c0 0x7fcd980aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.836+0000 7fcd94ff9640 1 --2- 172.21.15.120:0/1660432424 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd9815e8d0 0x7fcd980aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.836+0000 7fcd94ff9640 1 --2- 172.21.15.120:0/1660432424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd980ae7d0 0x7fcd98154390 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.836+0000 7fcd94ff9640 1 -- 172.21.15.120:0/1660432424 >> 172.21.15.120:0/1660432424 conn(0x7fcd9806d170 msgr2=0x7fcd98070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.836+0000 7fcd94ff9640 1 -- 172.21.15.120:0/1660432424 shutdown_connections 2024-07-27T03:08:16.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.836+0000 7fcd94ff9640 1 -- 172.21.15.120:0/1660432424 wait complete. 2024-07-27T03:08:16.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.837+0000 7fa94effd640 1 -- 172.21.15.120:0/504354955 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v13)=0 v13) ==== 119+0+0 (secure 0 0 0) 0x7fa948010960 con 0x7fa950006820 2024-07-27T03:08:16.843 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.843+0000 7fa94cff9640 1 -- 172.21.15.120:0/504354955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa950006820 msgr2=0x7fa950186650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.843+0000 7fa94cff9640 1 --2- 172.21.15.120:0/504354955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa950006820 0x7fa950186650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa94800d9a0 tx=0x7fa94800de60 comp rx=0 tx=0).stop 2024-07-27T03:08:16.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.849+0000 7fa94cff9640 1 -- 172.21.15.120:0/504354955 shutdown_connections 2024-07-27T03:08:16.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.849+0000 7fa94cff9640 1 --2- 172.21.15.120:0/504354955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9500df800 0x7fa9500e23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.849+0000 7fa94cff9640 1 --2- 172.21.15.120:0/504354955 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9500519a0 0x7fa9500e1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.849+0000 7fa94cff9640 1 --2- 172.21.15.120:0/504354955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa950006820 0x7fa950186650 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.849+0000 7fa94cff9640 1 -- 172.21.15.120:0/504354955 >> 172.21.15.120:0/504354955 conn(0x7fa95001e260 msgr2=0x7fa950053680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.849+0000 7fa94cff9640 1 -- 172.21.15.120:0/504354955 shutdown_connections 2024-07-27T03:08:16.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.849+0000 7fa94cff9640 1 -- 172.21.15.120:0/504354955 wait complete. 2024-07-27T03:08:16.856 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.856 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.853+0000 7f7439ffb640 1 -- 172.21.15.120:0/3139982521 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f74540b1550 con 0x7f745409ab50 2024-07-27T03:08:16.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.861+0000 7f743bfff640 1 -- 172.21.15.120:0/3139982521 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7f744c0189c0 con 0x7f745409ab50 2024-07-27T03:08:16.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.861+0000 7f8bd1ffb640 1 -- 172.21.15.120:0/832250948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f8bc0005850 con 0x7f8be4072e50 2024-07-27T03:08:16.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.863+0000 7f7439ffb640 1 -- 172.21.15.120:0/3139982521 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f745409ab50 msgr2=0x7f7454152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.863+0000 7f7439ffb640 1 --2- 172.21.15.120:0/3139982521 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f745409ab50 0x7f7454152860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f744c00e9d0 tx=0x7f744c00edd0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.863+0000 7f7439ffb640 1 -- 172.21.15.120:0/3139982521 shutdown_connections 2024-07-27T03:08:16.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.863+0000 7f7439ffb640 1 --2- 172.21.15.120:0/3139982521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f745415a7a0 0x7f745414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.863+0000 7f7439ffb640 1 --2- 172.21.15.120:0/3139982521 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f745409ab50 0x7f7454152860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.863+0000 7f7439ffb640 1 --2- 172.21.15.120:0/3139982521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7454151360 0x7f74540cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.863+0000 7f7439ffb640 1 -- 172.21.15.120:0/3139982521 >> 172.21.15.120:0/3139982521 conn(0x7f745406d060 msgr2=0x7f74540b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.863+0000 7f7439ffb640 1 -- 172.21.15.120:0/3139982521 shutdown_connections 2024-07-27T03:08:16.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.863+0000 7f7439ffb640 1 -- 172.21.15.120:0/3139982521 wait complete. 2024-07-27T03:08:16.868 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.869+0000 7f8bd3fff640 1 -- 172.21.15.120:0/832250948 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f8bd4011d10 con 0x7f8be4072e50 2024-07-27T03:08:16.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.871+0000 7f8bd1ffb640 1 -- 172.21.15.120:0/832250948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be4072e50 msgr2=0x7f8be4147e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.871+0000 7f8bd1ffb640 1 --2- 172.21.15.120:0/832250948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be4072e50 0x7f8be4147e90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c400 tx=0x7f8bd400c8c0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.871+0000 7f8bd1ffb640 1 -- 172.21.15.120:0/832250948 shutdown_connections 2024-07-27T03:08:16.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.871+0000 7f8bd1ffb640 1 --2- 172.21.15.120:0/832250948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8be4073260 0x7f8be415c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.871+0000 7f8bd1ffb640 1 --2- 172.21.15.120:0/832250948 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8be4150eb0 0x7f8be415cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.871+0000 7f8bd1ffb640 1 --2- 172.21.15.120:0/832250948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be4072e50 0x7f8be4147e90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.871+0000 7f8bd1ffb640 1 -- 172.21.15.120:0/832250948 >> 172.21.15.120:0/832250948 conn(0x7f8be40b2dc0 msgr2=0x7f8be415db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.871+0000 7f8bd1ffb640 1 -- 172.21.15.120:0/832250948 shutdown_connections 2024-07-27T03:08:16.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.871+0000 7f8bd1ffb640 1 -- 172.21.15.120:0/832250948 wait complete. 2024-07-27T03:08:16.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.892+0000 7f9192ffd640 1 -- 172.21.15.120:0/945840987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f9184005850 con 0x7f91ac0b30f0 2024-07-27T03:08:16.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.897+0000 7f91a97fa640 1 -- 172.21.15.120:0/945840987 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f91a4012a90 con 0x7f91ac0b30f0 2024-07-27T03:08:16.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.898+0000 7f9192ffd640 1 -- 172.21.15.120:0/945840987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91ac0b30f0 msgr2=0x7f91ac15e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.898+0000 7f9192ffd640 1 --2- 172.21.15.120:0/945840987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91ac0b30f0 0x7f91ac15e6d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f91a400caa0 tx=0x7f91a400cf60 comp rx=0 tx=0).stop 2024-07-27T03:08:16.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.898+0000 7f9192ffd640 1 -- 172.21.15.120:0/945840987 shutdown_connections 2024-07-27T03:08:16.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.898+0000 7f9192ffd640 1 --2- 172.21.15.120:0/945840987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f91ac146740 0x7f91ac157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.898+0000 7f9192ffd640 1 --2- 172.21.15.120:0/945840987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91ac154f70 0x7f91ac146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.898+0000 7f9192ffd640 1 --2- 172.21.15.120:0/945840987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91ac0b30f0 0x7f91ac15e6d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.898+0000 7f9192ffd640 1 -- 172.21.15.120:0/945840987 >> 172.21.15.120:0/945840987 conn(0x7f91ac06cfd0 msgr2=0x7f91ac06e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.898+0000 7f9192ffd640 1 -- 172.21.15.120:0/945840987 shutdown_connections 2024-07-27T03:08:16.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.898+0000 7f9192ffd640 1 -- 172.21.15.120:0/945840987 wait complete. 2024-07-27T03:08:16.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.901+0000 7f4f98684640 1 -- 172.21.15.120:0/2272939982 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f4f90150970 con 0x7f4f9014d7f0 2024-07-27T03:08:16.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.906+0000 7f4f86ffd640 1 -- 172.21.15.120:0/2272939982 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v17)=0 v17) ==== 120+0+0 (secure 0 0 0) 0x7f4f800193b0 con 0x7f4f9014d7f0 2024-07-27T03:08:16.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.908+0000 7f4f98684640 1 -- 172.21.15.120:0/2272939982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f9014d7f0 msgr2=0x7f4f9014a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.908+0000 7f4f98684640 1 --2- 172.21.15.120:0/2272939982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f9014d7f0 0x7f4f9014a140 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4f90068ef0 tx=0x7f4f8000b870 comp rx=0 tx=0).stop 2024-07-27T03:08:16.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.908+0000 7f4f98684640 1 -- 172.21.15.120:0/2272939982 shutdown_connections 2024-07-27T03:08:16.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.908+0000 7f4f98684640 1 --2- 172.21.15.120:0/2272939982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f9014d7f0 0x7f4f9014a140 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.908+0000 7f4f98684640 1 --2- 172.21.15.120:0/2272939982 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f90150eb0 0x7f4f90202850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.908+0000 7f4f98684640 1 --2- 172.21.15.120:0/2272939982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f90072e50 0x7f4f9014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.908+0000 7f4f98684640 1 -- 172.21.15.120:0/2272939982 >> 172.21.15.120:0/2272939982 conn(0x7f4f900b2dc0 msgr2=0x7f4f9015ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.908+0000 7f4f98684640 1 -- 172.21.15.120:0/2272939982 shutdown_connections 2024-07-27T03:08:16.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.908+0000 7f4f98684640 1 -- 172.21.15.120:0/2272939982 wait complete. 2024-07-27T03:08:16.914 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.921 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.921 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.921 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.950+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fc0a8005850 con 0x7fc0c00343e0 2024-07-27T03:08:16.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.953+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f84ac15bac0 con 0x7f84ac0718f0 2024-07-27T03:08:16.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.954+0000 7fc0c4ff9640 1 -- 172.21.15.120:0/3190261585 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7fc0bc0193b0 con 0x7fc0c00343e0 2024-07-27T03:08:16.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.955+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0c00343e0 msgr2=0x7fc0c01797d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.955+0000 7fc0cd6ee640 1 --2- 172.21.15.120:0/3190261585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0c00343e0 0x7fc0c01797d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00b410 tx=0x7fc0bc00b8d0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.955+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 shutdown_connections 2024-07-27T03:08:16.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.955+0000 7fc0cd6ee640 1 --2- 172.21.15.120:0/3190261585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0c00516b0 0x7fc0c00e2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.955+0000 7fc0cd6ee640 1 --2- 172.21.15.120:0/3190261585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0c0035330 0x7fc0c0050d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.955+0000 7fc0cd6ee640 1 --2- 172.21.15.120:0/3190261585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0c00343e0 0x7fc0c01797d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.955+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 >> 172.21.15.120:0/3190261585 conn(0x7fc0c001e260 msgr2=0x7fc0c000bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.956+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 shutdown_connections 2024-07-27T03:08:16.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.956+0000 7fc0cd6ee640 1 -- 172.21.15.120:0/3190261585 wait complete. 2024-07-27T03:08:16.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.959+0000 7f84a1ffb640 1 -- 172.21.15.120:0/2815222437 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v19)=0 v19) ==== 125+0+0 (secure 0 0 0) 0x7f849c005000 con 0x7f84ac0718f0 2024-07-27T03:08:16.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.961+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84ac0718f0 msgr2=0x7f84ac0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:16.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.961+0000 7f84b34c6640 1 --2- 172.21.15.120:0/2815222437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84ac0718f0 0x7f84ac0b6170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0b6cd0 tx=0x7f849c00eb30 comp rx=0 tx=0).stop 2024-07-27T03:08:16.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.961+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 shutdown_connections 2024-07-27T03:08:16.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.961+0000 7f84b34c6640 1 --2- 172.21.15.120:0/2815222437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84ac0718f0 0x7f84ac0b6170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.961+0000 7f84b34c6640 1 --2- 172.21.15.120:0/2815222437 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f84ac0cb290 0x7f84ac0c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.961+0000 7f84b34c6640 1 --2- 172.21.15.120:0/2815222437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84ac071220 0x7f84ac201f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:16.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.961+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 >> 172.21.15.120:0/2815222437 conn(0x7f84ac0d0b40 msgr2=0x7f84ac0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:16.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.961+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 shutdown_connections 2024-07-27T03:08:16.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:16.961+0000 7f84b34c6640 1 -- 172.21.15.120:0/2815222437 wait complete. 2024-07-27T03:08:16.975 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi120') 2024-07-27T03:08:16.976 INFO:tasks.ceph:Setting crush tunables to default 2024-07-27T03:08:16.976 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd crush tunables default 2024-07-27T03:08:17.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.127+0000 7fdf3b299640 1 -- 172.21.15.120:0/1744029243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf340cca50 msgr2=0x7fdf3406eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:17.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.127+0000 7fdf3b299640 1 --2- 172.21.15.120:0/1744029243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf340cca50 0x7fdf3406eca0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009830 tx=0x7fdf3002a5c0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.127+0000 7fdf3b299640 1 -- 172.21.15.120:0/1744029243 shutdown_connections 2024-07-27T03:08:17.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.127+0000 7fdf3b299640 1 --2- 172.21.15.120:0/1744029243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf340cca50 0x7fdf3406eca0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.127+0000 7fdf3b299640 1 -- 172.21.15.120:0/1744029243 >> 172.21.15.120:0/1744029243 conn(0x7fdf340b2dc0 msgr2=0x7fdf340d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:17.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.127+0000 7fdf3b299640 1 -- 172.21.15.120:0/1744029243 shutdown_connections 2024-07-27T03:08:17.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.127+0000 7fdf3b299640 1 -- 172.21.15.120:0/1744029243 wait complete. 2024-07-27T03:08:17.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.129+0000 7fdf3b299640 1 Processor -- start 2024-07-27T03:08:17.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.129+0000 7fdf3b299640 1 -- start start 2024-07-27T03:08:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.130+0000 7fdf3b299640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf3406f1e0 0x7fdf340ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.130+0000 7fdf3b299640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf340cca50 0x7fdf34072c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.130+0000 7fdf3b299640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf3415ec00 0x7fdf340731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf3b299640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdf34151e70 con 0x7fdf340cca50 2024-07-27T03:08:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf3b299640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdf340b4ee0 con 0x7fdf3406f1e0 2024-07-27T03:08:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf3b299640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fdf34151ff0 con 0x7fdf3415ec00 2024-07-27T03:08:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf38834640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf340cca50 0x7fdf34072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf38834640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf340cca50 0x7fdf34072c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46820/0 (socket says 172.21.15.120:46820) 2024-07-27T03:08:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf38834640 1 -- 172.21.15.120:0/1065367477 learned_addr learned my addr 172.21.15.120:0/1065367477 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf39035640 1 --2- 172.21.15.120:0/1065367477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf3406f1e0 0x7fdf340ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf39836640 1 --2- 172.21.15.120:0/1065367477 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf3415ec00 0x7fdf340731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf38834640 1 -- 172.21.15.120:0/1065367477 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf3415ec00 msgr2=0x7fdf340731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf38834640 1 --2- 172.21.15.120:0/1065367477 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf3415ec00 0x7fdf340731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf38834640 1 -- 172.21.15.120:0/1065367477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf3406f1e0 msgr2=0x7fdf340ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf38834640 1 --2- 172.21.15.120:0/1065367477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf3406f1e0 0x7fdf340ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf38834640 1 -- 172.21.15.120:0/1065367477 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf340ae0d0 con 0x7fdf340cca50 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf38834640 1 --2- 172.21.15.120:0/1065367477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf340cca50 0x7fdf34072c70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf30000c00 tx=0x7fdf30033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf29ffb640 1 -- 172.21.15.120:0/1065367477 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30031d60 con 0x7fdf340cca50 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf29ffb640 1 -- 172.21.15.120:0/1065367477 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf300330d0 con 0x7fdf340cca50 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf3b299640 1 -- 172.21.15.120:0/1065367477 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf340ae3b0 con 0x7fdf340cca50 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.131+0000 7fdf29ffb640 1 -- 172.21.15.120:0/1065367477 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30033520 con 0x7fdf340cca50 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.132+0000 7fdf3b299640 1 -- 172.21.15.120:0/1065367477 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf340ae970 con 0x7fdf340cca50 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.132+0000 7fdf29ffb640 1 -- 172.21.15.120:0/1065367477 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdf300035f0 con 0x7fdf340cca50 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.132+0000 7fdf29ffb640 1 -- 172.21.15.120:0/1065367477 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdf3003b750 con 0x7fdf340cca50 2024-07-27T03:08:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.133+0000 7fdf3b299640 1 -- 172.21.15.120:0/1065367477 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf340ade40 con 0x7fdf340cca50 2024-07-27T03:08:17.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.135+0000 7fdf29ffb640 1 -- 172.21.15.120:0/1065367477 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7fdf30051020 con 0x7fdf340cca50 2024-07-27T03:08:17.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.201+0000 7fdf3b299640 1 -- 172.21.15.120:0/1065367477 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fdf3406eca0 con 0x7fdf340cca50 2024-07-27T03:08:17.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.204+0000 7fdf29ffb640 1 -- 172.21.15.120:0/1065367477 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fdf3003f030 con 0x7fdf340cca50 2024-07-27T03:08:17.207 INFO:teuthology.orchestra.run.smithi120.stderr:adjusted tunables profile to default 2024-07-27T03:08:17.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.205+0000 7fdf3b299640 1 -- 172.21.15.120:0/1065367477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf340cca50 msgr2=0x7fdf34072c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:17.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.205+0000 7fdf3b299640 1 --2- 172.21.15.120:0/1065367477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf340cca50 0x7fdf34072c70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf30000c00 tx=0x7fdf30033d60 comp rx=0 tx=0).stop 2024-07-27T03:08:17.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.205+0000 7fdf3b299640 1 -- 172.21.15.120:0/1065367477 shutdown_connections 2024-07-27T03:08:17.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.205+0000 7fdf3b299640 1 --2- 172.21.15.120:0/1065367477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdf340cca50 0x7fdf34072c70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.205+0000 7fdf3b299640 1 --2- 172.21.15.120:0/1065367477 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdf3415ec00 0x7fdf340731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.205+0000 7fdf3b299640 1 --2- 172.21.15.120:0/1065367477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf3406f1e0 0x7fdf340ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.205+0000 7fdf3b299640 1 -- 172.21.15.120:0/1065367477 >> 172.21.15.120:0/1065367477 conn(0x7fdf340b2dc0 msgr2=0x7fdf34151260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:17.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.205+0000 7fdf3b299640 1 -- 172.21.15.120:0/1065367477 shutdown_connections 2024-07-27T03:08:17.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:17.205+0000 7fdf3b299640 1 -- 172.21.15.120:0/1065367477 wait complete. 2024-07-27T03:08:17.218 INFO:tasks.ceph:check_enable_crimson: False 2024-07-27T03:08:17.218 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-07-27T03:08:17.219 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:17.219 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-07-27T03:08:17.243 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:17.243 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-07-27T03:08:17.308 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:17.308 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-07-27T03:08:17.372 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:17.373 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-07-27T03:08:17.438 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:17.438 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-07-27T03:08:17.464 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:17.464 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-07-27T03:08:17.530 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:17.530 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-07-27T03:08:17.596 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:17.596 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-07-27T03:08:17.662 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 77e44dfb-d125-400d-8e7b-f42652ccad24 0 2024-07-27T03:08:17.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.813+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/1087261919 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b6415f6c0 msgr2=0x7f6b640718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:17.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.813+0000 7f6b6ab3c640 1 --2- 172.21.15.121:0/1087261919 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b6415f6c0 0x7f6b640718c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009820 tx=0x7f6b5002a3f0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.813+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/1087261919 shutdown_connections 2024-07-27T03:08:17.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.813+0000 7f6b6ab3c640 1 --2- 172.21.15.121:0/1087261919 >> v2:172.21.15.120:3300/0 conn(0x7f6b640733c0 0x7f6b640737d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.813+0000 7f6b6ab3c640 1 --2- 172.21.15.121:0/1087261919 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b6415f6c0 0x7f6b640718c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.813+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/1087261919 >> 172.21.15.121:0/1087261919 conn(0x7f6b640d0df0 msgr2=0x7f6b640d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:17.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.813+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/1087261919 shutdown_connections 2024-07-27T03:08:17.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.813+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/1087261919 wait complete. 2024-07-27T03:08:17.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.815+0000 7f6b6ab3c640 1 Processor -- start 2024-07-27T03:08:17.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.815+0000 7f6b6ab3c640 1 -- start start 2024-07-27T03:08:17.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.816+0000 7f6b6ab3c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b640733c0 0x7f6b640b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:17.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.816+0000 7f6b6ab3c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b640d0450 0x7f6b6406c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.816+0000 7f6b6ab3c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6415f6c0 0x7f6b6406ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.816+0000 7f6b6ab3c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6415bc00 con 0x7f6b640d0450 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.816+0000 7f6b6ab3c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6415ba80 con 0x7f6b6415f6c0 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.816+0000 7f6b6ab3c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6b6415bd80 con 0x7f6b640733c0 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.816+0000 7f6b688d8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b640733c0 0x7f6b640b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.816+0000 7f6b690d9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6415f6c0 0x7f6b6406ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.816+0000 7f6b688d8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b640733c0 0x7f6b640b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:34426/0 (socket says 172.21.15.121:34426) 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.816+0000 7f6b690d9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6415f6c0 0x7f6b6406ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53458/0 (socket says 172.21.15.121:53458) 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.816+0000 7f6b688d8640 1 -- 172.21.15.121:0/225860465 learned_addr learned my addr 172.21.15.121:0/225860465 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b63fff640 1 --2- 172.21.15.121:0/225860465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b640d0450 0x7f6b6406c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b688d8640 1 -- 172.21.15.121:0/225860465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6415f6c0 msgr2=0x7f6b6406ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b688d8640 1 --2- 172.21.15.121:0/225860465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6415f6c0 0x7f6b6406ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b688d8640 1 -- 172.21.15.121:0/225860465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b640d0450 msgr2=0x7f6b6406c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b688d8640 1 --2- 172.21.15.121:0/225860465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b640d0450 0x7f6b6406c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b688d8640 1 -- 172.21.15.121:0/225860465 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b641f65c0 con 0x7f6b640733c0 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b690d9640 1 --2- 172.21.15.121:0/225860465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6415f6c0 0x7f6b6406ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b63fff640 1 --2- 172.21.15.121:0/225860465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b640d0450 0x7f6b6406c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b688d8640 1 --2- 172.21.15.121:0/225860465 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b640733c0 0x7f6b640b5390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800c3f0 tx=0x7f6b5800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b617fa640 1 -- 172.21.15.121:0/225860465 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b58017070 con 0x7f6b640733c0 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b617fa640 1 -- 172.21.15.121:0/225860465 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b580035f0 con 0x7f6b640733c0 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/225860465 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b640ae4d0 con 0x7f6b640733c0 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b617fa640 1 -- 172.21.15.121:0/225860465 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b58003a40 con 0x7f6b640733c0 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/225860465 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b640b4910 con 0x7f6b640733c0 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b617fa640 1 -- 172.21.15.121:0/225860465 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6b5801a070 con 0x7f6b640733c0 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.817+0000 7f6b617fa640 1 -- 172.21.15.121:0/225860465 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f6b58012740 con 0x7f6b640733c0 2024-07-27T03:08:17.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.818+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/225860465 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6415c310 con 0x7f6b640733c0 2024-07-27T03:08:17.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.822+0000 7f6b617fa640 1 -- 172.21.15.121:0/225860465 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7f6b58021020 con 0x7f6b640733c0 2024-07-27T03:08:17.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.895+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/225860465 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "77e44dfb-d125-400d-8e7b-f42652ccad24", "id": 0} v 0) -- 0x7f6b640cb1b0 con 0x7f6b640733c0 2024-07-27T03:08:17.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.899+0000 7f6b617fa640 1 -- 172.21.15.121:0/225860465 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "77e44dfb-d125-400d-8e7b-f42652ccad24", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f6b64073d10 con 0x7f6b640733c0 2024-07-27T03:08:17.902 INFO:teuthology.orchestra.run.smithi121.stdout:0 2024-07-27T03:08:17.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.900+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/225860465 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b640733c0 msgr2=0x7f6b640b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:17.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.900+0000 7f6b6ab3c640 1 --2- 172.21.15.121:0/225860465 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b640733c0 0x7f6b640b5390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800c3f0 tx=0x7f6b5800c8b0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.900+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/225860465 shutdown_connections 2024-07-27T03:08:17.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.900+0000 7f6b6ab3c640 1 --2- 172.21.15.121:0/225860465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b640d0450 0x7f6b6406c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.900+0000 7f6b6ab3c640 1 --2- 172.21.15.121:0/225860465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6415f6c0 0x7f6b6406ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.900+0000 7f6b6ab3c640 1 --2- 172.21.15.121:0/225860465 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b640733c0 0x7f6b640b5390 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:17.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.900+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/225860465 >> 172.21.15.121:0/225860465 conn(0x7f6b640d0df0 msgr2=0x7f6b640cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:17.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.900+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/225860465 shutdown_connections 2024-07-27T03:08:17.904 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:17.900+0000 7f6b6ab3c640 1 -- 172.21.15.121:0/225860465 wait complete. 2024-07-27T03:08:17.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 91adc03f-7cad-4b11-a450-aa2c0f804e7b 1 2024-07-27T03:08:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.024+0000 7f693d0a8640 1 -- 172.21.15.121:0/3796749744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69380b4650 msgr2=0x7f69380b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.024+0000 7f693d0a8640 1 --2- 172.21.15.121:0/3796749744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69380b4650 0x7f69380b4a60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f692c005fd0 tx=0x7f692c02a540 comp rx=0 tx=0).stop 2024-07-27T03:08:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.024+0000 7f693d0a8640 1 -- 172.21.15.121:0/3796749744 shutdown_connections 2024-07-27T03:08:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.024+0000 7f693d0a8640 1 --2- 172.21.15.121:0/3796749744 >> v2:172.21.15.120:3300/0 conn(0x7f69380add70 0x7f69380ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.024+0000 7f693d0a8640 1 --2- 172.21.15.121:0/3796749744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69380b4650 0x7f69380b4a60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.024+0000 7f693d0a8640 1 -- 172.21.15.121:0/3796749744 >> 172.21.15.121:0/3796749744 conn(0x7f69380b2e40 msgr2=0x7f69380b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.024+0000 7f693d0a8640 1 -- 172.21.15.121:0/3796749744 shutdown_connections 2024-07-27T03:08:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.024+0000 7f693d0a8640 1 -- 172.21.15.121:0/3796749744 wait complete. 2024-07-27T03:08:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.026+0000 7f693d0a8640 1 Processor -- start 2024-07-27T03:08:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.026+0000 7f693d0a8640 1 -- start start 2024-07-27T03:08:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693d0a8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69380add70 0x7f69380d0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693d0a8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69380b4650 0x7f69381533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693d0a8640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6938152360 0x7f69381e5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693d0a8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6938073bd0 con 0x7f69380b4650 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693d0a8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6938073a50 con 0x7f69380add70 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693d0a8640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6938073d50 con 0x7f6938152360 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f6936d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69380add70 0x7f69380d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693759e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6938152360 0x7f69381e5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69380b4650 0x7f69381533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693759e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6938152360 0x7f69381e5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:34446/0 (socket says 172.21.15.121:34446) 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f6936d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69380add70 0x7f69380d0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53470/0 (socket says 172.21.15.121:53470) 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693759e640 1 -- 172.21.15.121:0/268804324 learned_addr learned my addr 172.21.15.121:0/268804324 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69380b4650 0x7f69381533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.121:50794/0 (socket says 172.21.15.121:50794) 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693659c640 1 -- 172.21.15.121:0/268804324 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6938152360 msgr2=0x7f69381e5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693659c640 1 --2- 172.21.15.121:0/268804324 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6938152360 0x7f69381e5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693659c640 1 -- 172.21.15.121:0/268804324 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69380add70 msgr2=0x7f69380d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693659c640 1 --2- 172.21.15.121:0/268804324 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69380add70 0x7f69380d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693659c640 1 -- 172.21.15.121:0/268804324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69381f64f0 con 0x7f69380b4650 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693759e640 1 --2- 172.21.15.121:0/268804324 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6938152360 0x7f69381e5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.028+0000 7f693659c640 1 --2- 172.21.15.121:0/268804324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69380b4650 0x7f69381533f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f692c031000 tx=0x7f692c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.029+0000 7f691f7fe640 1 -- 172.21.15.121:0/268804324 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c03e030 con 0x7f69380b4650 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.029+0000 7f691f7fe640 1 -- 172.21.15.121:0/268804324 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f692c003ca0 con 0x7f69380b4650 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.029+0000 7f691f7fe640 1 -- 172.21.15.121:0/268804324 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c035040 con 0x7f69380b4650 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.029+0000 7f693d0a8640 1 -- 172.21.15.121:0/268804324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69381f69f0 con 0x7f69380b4650 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.029+0000 7f693d0a8640 1 -- 172.21.15.121:0/268804324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69381f6fb0 con 0x7f69380b4650 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.029+0000 7f691f7fe640 1 -- 172.21.15.121:0/268804324 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f692c041030 con 0x7f69380b4650 2024-07-27T03:08:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.029+0000 7f691f7fe640 1 -- 172.21.15.121:0/268804324 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f692c043c00 con 0x7f69380b4650 2024-07-27T03:08:18.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.030+0000 7f693d0a8640 1 -- 172.21.15.121:0/268804324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f693806f600 con 0x7f69380b4650 2024-07-27T03:08:18.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.032+0000 7f691f7fe640 1 -- 172.21.15.121:0/268804324 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7f693806f600 con 0x7f69380b4650 2024-07-27T03:08:18.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.104+0000 7f693d0a8640 1 -- 172.21.15.121:0/268804324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "91adc03f-7cad-4b11-a450-aa2c0f804e7b", "id": 1} v 0) -- 0x7f693809ef10 con 0x7f69380b4650 2024-07-27T03:08:18.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.106+0000 7f691f7fe640 1 -- 172.21.15.121:0/268804324 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "91adc03f-7cad-4b11-a450-aa2c0f804e7b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f693809ef10 con 0x7f69380b4650 2024-07-27T03:08:18.109 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-07-27T03:08:18.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.107+0000 7f693d0a8640 1 -- 172.21.15.121:0/268804324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69380b4650 msgr2=0x7f69381533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.107+0000 7f693d0a8640 1 --2- 172.21.15.121:0/268804324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69380b4650 0x7f69381533f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f692c031000 tx=0x7f692c0038a0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.107+0000 7f693d0a8640 1 -- 172.21.15.121:0/268804324 shutdown_connections 2024-07-27T03:08:18.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.107+0000 7f693d0a8640 1 --2- 172.21.15.121:0/268804324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69380b4650 0x7f69381533f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.107+0000 7f693d0a8640 1 --2- 172.21.15.121:0/268804324 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6938152360 0x7f69381e5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.107+0000 7f693d0a8640 1 --2- 172.21.15.121:0/268804324 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69380add70 0x7f69380d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.107+0000 7f693d0a8640 1 -- 172.21.15.121:0/268804324 >> 172.21.15.121:0/268804324 conn(0x7f69380b2e40 msgr2=0x7f6938151040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:18.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.107+0000 7f693d0a8640 1 -- 172.21.15.121:0/268804324 shutdown_connections 2024-07-27T03:08:18.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.107+0000 7f693d0a8640 1 -- 172.21.15.121:0/268804324 wait complete. 2024-07-27T03:08:18.122 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 1519e899-7647-4e13-b547-abc8d361b9bc 2 2024-07-27T03:08:18.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.232+0000 7fc07c50e640 1 -- 172.21.15.121:0/287781360 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0740adf80 msgr2=0x7fc07406c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.232+0000 7fc07c50e640 1 --2- 172.21.15.121:0/287781360 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0740adf80 0x7fc07406c780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc064009830 tx=0x7fc06402a3f0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.232+0000 7fc07c50e640 1 -- 172.21.15.121:0/287781360 shutdown_connections 2024-07-27T03:08:18.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.232+0000 7fc07c50e640 1 --2- 172.21.15.121:0/287781360 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0740adf80 0x7fc07406c780 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.232+0000 7fc07c50e640 1 --2- 172.21.15.121:0/287781360 >> v2:172.21.15.120:3300/0 conn(0x7fc0740cb4e0 0x7fc07415c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.232+0000 7fc07c50e640 1 -- 172.21.15.121:0/287781360 >> 172.21.15.121:0/287781360 conn(0x7fc0740d0de0 msgr2=0x7fc0740d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:18.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.232+0000 7fc07c50e640 1 -- 172.21.15.121:0/287781360 shutdown_connections 2024-07-27T03:08:18.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.232+0000 7fc07c50e640 1 -- 172.21.15.121:0/287781360 wait complete. 2024-07-27T03:08:18.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.234+0000 7fc07c50e640 1 Processor -- start 2024-07-27T03:08:18.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.234+0000 7fc07c50e640 1 -- start start 2024-07-27T03:08:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.235+0000 7fc07c50e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07406f210 0x7fc074159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.235+0000 7fc07c50e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0740adf80 0x7fc0740c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.235+0000 7fc07c50e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0740cb4e0 0x7fc0740ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.235+0000 7fc07c50e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc0740cc610 con 0x7fc0740cb4e0 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.235+0000 7fc07c50e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc07406d070 con 0x7fc07406f210 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.235+0000 7fc07c50e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc0740cc790 con 0x7fc0740adf80 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc07a2aa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07406f210 0x7fc074159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc079aa9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0740adf80 0x7fc0740c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc07a2aa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07406f210 0x7fc074159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53474/0 (socket says 172.21.15.121:53474) 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc07a2aa640 1 -- 172.21.15.121:0/1430332209 learned_addr learned my addr 172.21.15.121:0/1430332209 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc079aa9640 1 --2- 172.21.15.121:0/1430332209 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0740adf80 0x7fc0740c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:34456/0 (socket says 172.21.15.121:34456) 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc07aaab640 1 --2- 172.21.15.121:0/1430332209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0740cb4e0 0x7fc0740ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc079aa9640 1 -- 172.21.15.121:0/1430332209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07406f210 msgr2=0x7fc074159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc079aa9640 1 --2- 172.21.15.121:0/1430332209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07406f210 0x7fc074159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc079aa9640 1 -- 172.21.15.121:0/1430332209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0740cb4e0 msgr2=0x7fc0740ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc079aa9640 1 --2- 172.21.15.121:0/1430332209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0740cb4e0 0x7fc0740ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc079aa9640 1 -- 172.21.15.121:0/1430332209 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0741f53d0 con 0x7fc0740adf80 2024-07-27T03:08:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc07a2aa640 1 --2- 172.21.15.121:0/1430332209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07406f210 0x7fc074159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc07aaab640 1 --2- 172.21.15.121:0/1430332209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0740cb4e0 0x7fc0740ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc079aa9640 1 --2- 172.21.15.121:0/1430332209 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0740adf80 0x7fc0740c7e90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc0740ae950 tx=0x7fc064033ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc06affd640 1 -- 172.21.15.121:0/1430332209 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064031b50 con 0x7fc0740adf80 2024-07-27T03:08:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc06affd640 1 -- 172.21.15.121:0/1430332209 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc064031e00 con 0x7fc0740adf80 2024-07-27T03:08:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc07c50e640 1 -- 172.21.15.121:0/1430332209 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0740c93f0 con 0x7fc0740adf80 2024-07-27T03:08:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc06affd640 1 -- 172.21.15.121:0/1430332209 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064033330 con 0x7fc0740adf80 2024-07-27T03:08:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.236+0000 7fc07c50e640 1 -- 172.21.15.121:0/1430332209 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0741f5970 con 0x7fc0740adf80 2024-07-27T03:08:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.237+0000 7fc06affd640 1 -- 172.21.15.121:0/1430332209 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc0640334d0 con 0x7fc0740adf80 2024-07-27T03:08:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.237+0000 7fc06affd640 1 -- 172.21.15.121:0/1430332209 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc06403b410 con 0x7fc0740adf80 2024-07-27T03:08:18.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.237+0000 7fc07c50e640 1 -- 172.21.15.121:0/1430332209 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0740cccb0 con 0x7fc0740adf80 2024-07-27T03:08:18.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.239+0000 7fc06affd640 1 -- 172.21.15.121:0/1430332209 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7fc06403f030 con 0x7fc0740adf80 2024-07-27T03:08:18.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.312+0000 7fc07c50e640 1 -- 172.21.15.121:0/1430332209 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1519e899-7647-4e13-b547-abc8d361b9bc", "id": 2} v 0) -- 0x7fc0740b2300 con 0x7fc0740adf80 2024-07-27T03:08:18.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.316+0000 7fc06affd640 1 -- 172.21.15.121:0/1430332209 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1519e899-7647-4e13-b547-abc8d361b9bc", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc0640035f0 con 0x7fc0740adf80 2024-07-27T03:08:18.319 INFO:teuthology.orchestra.run.smithi121.stdout:2 2024-07-27T03:08:18.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.317+0000 7fc07c50e640 1 -- 172.21.15.121:0/1430332209 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0740adf80 msgr2=0x7fc0740c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.317+0000 7fc07c50e640 1 --2- 172.21.15.121:0/1430332209 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0740adf80 0x7fc0740c7e90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc0740ae950 tx=0x7fc064033ba0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.317+0000 7fc07c50e640 1 -- 172.21.15.121:0/1430332209 shutdown_connections 2024-07-27T03:08:18.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.317+0000 7fc07c50e640 1 --2- 172.21.15.121:0/1430332209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0740cb4e0 0x7fc0740ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.317+0000 7fc07c50e640 1 --2- 172.21.15.121:0/1430332209 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0740adf80 0x7fc0740c7e90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.317+0000 7fc07c50e640 1 --2- 172.21.15.121:0/1430332209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc07406f210 0x7fc074159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.317+0000 7fc07c50e640 1 -- 172.21.15.121:0/1430332209 >> 172.21.15.121:0/1430332209 conn(0x7fc0740d0de0 msgr2=0x7fc0740758c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:18.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.317+0000 7fc07c50e640 1 -- 172.21.15.121:0/1430332209 shutdown_connections 2024-07-27T03:08:18.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.317+0000 7fc07c50e640 1 -- 172.21.15.121:0/1430332209 wait complete. 2024-07-27T03:08:18.331 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 5eca6d77-c3cb-4415-8e16-500bf4479ee7 3 2024-07-27T03:08:18.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.442+0000 7f6a0e475640 1 -- 172.21.15.121:0/3984130779 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a080cda50 msgr2=0x7f6a080b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.442+0000 7f6a0e475640 1 --2- 172.21.15.121:0/3984130779 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a080cda50 0x7f6a080b6fb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009850 tx=0x7f69f802a4f0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.442+0000 7f6a0e475640 1 -- 172.21.15.121:0/3984130779 shutdown_connections 2024-07-27T03:08:18.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.442+0000 7f6a0e475640 1 --2- 172.21.15.121:0/3984130779 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a080cda50 0x7f6a080b6fb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.442+0000 7f6a0e475640 1 -- 172.21.15.121:0/3984130779 >> 172.21.15.121:0/3984130779 conn(0x7f6a080d1e20 msgr2=0x7f6a080d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:18.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.442+0000 7f6a0e475640 1 -- 172.21.15.121:0/3984130779 shutdown_connections 2024-07-27T03:08:18.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.442+0000 7f6a0e475640 1 -- 172.21.15.121:0/3984130779 wait complete. 2024-07-27T03:08:18.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.444+0000 7f6a0e475640 1 Processor -- start 2024-07-27T03:08:18.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.444+0000 7f6a0e475640 1 -- start start 2024-07-27T03:08:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.445+0000 7f6a0e475640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a080cda50 0x7f6a08153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.445+0000 7f6a0e475640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a080cfd20 0x7f6a0815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.445+0000 7f6a0e475640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080d0130 0x7f6a08158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.445+0000 7f6a0e475640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6a08167ae0 con 0x7f6a080d0130 2024-07-27T03:08:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.445+0000 7f6a0e475640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6a08167960 con 0x7f6a080cfd20 2024-07-27T03:08:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.445+0000 7f6a0e475640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6a08167c60 con 0x7f6a080cda50 2024-07-27T03:08:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.445+0000 7f6a07fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a080cda50 0x7f6a08153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.445+0000 7f69fffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a080cfd20 0x7f6a0815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.445+0000 7f6a07fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a080cda50 0x7f6a08153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:34478/0 (socket says 172.21.15.121:34478) 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.445+0000 7f6a07fff640 1 -- 172.21.15.121:0/1811957730 learned_addr learned my addr 172.21.15.121:0/1811957730 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.445+0000 7f6a0ca12640 1 --2- 172.21.15.121:0/1811957730 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080d0130 0x7f6a08158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a07fff640 1 -- 172.21.15.121:0/1811957730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a080cfd20 msgr2=0x7f6a0815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a07fff640 1 --2- 172.21.15.121:0/1811957730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a080cfd20 0x7f6a0815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a07fff640 1 -- 172.21.15.121:0/1811957730 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080d0130 msgr2=0x7f6a08158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a07fff640 1 --2- 172.21.15.121:0/1811957730 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080d0130 0x7f6a08158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a07fff640 1 -- 172.21.15.121:0/1811957730 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0809eff0 con 0x7f6a080cda50 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f69fffff640 1 --2- 172.21.15.121:0/1811957730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a080cfd20 0x7f6a0815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a07fff640 1 --2- 172.21.15.121:0/1811957730 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a080cda50 0x7f6a08153bd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f69f802aae0 tx=0x7f69f8005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a057fa640 1 -- 172.21.15.121:0/1811957730 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8005c30 con 0x7f6a080cda50 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a057fa640 1 -- 172.21.15.121:0/1811957730 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69f8031c40 con 0x7f6a080cda50 2024-07-27T03:08:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a0e475640 1 -- 172.21.15.121:0/1811957730 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0809f2d0 con 0x7f6a080cda50 2024-07-27T03:08:18.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a057fa640 1 -- 172.21.15.121:0/1811957730 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8005670 con 0x7f6a080cda50 2024-07-27T03:08:18.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a0e475640 1 -- 172.21.15.121:0/1811957730 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0809f890 con 0x7f6a080cda50 2024-07-27T03:08:18.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a057fa640 1 -- 172.21.15.121:0/1811957730 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f69f802ad10 con 0x7f6a080cda50 2024-07-27T03:08:18.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.446+0000 7f6a057fa640 1 -- 172.21.15.121:0/1811957730 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f69f8033640 con 0x7f6a080cda50 2024-07-27T03:08:18.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.447+0000 7f6a0e475640 1 -- 172.21.15.121:0/1811957730 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0809ed70 con 0x7f6a080cda50 2024-07-27T03:08:18.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.449+0000 7f6a057fa640 1 -- 172.21.15.121:0/1811957730 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7f6a0809ed70 con 0x7f6a080cda50 2024-07-27T03:08:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.521+0000 7f6a0e475640 1 -- 172.21.15.121:0/1811957730 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5eca6d77-c3cb-4415-8e16-500bf4479ee7", "id": 3} v 0) -- 0x7f6a0809fad0 con 0x7f6a080cda50 2024-07-27T03:08:18.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.526+0000 7f6a057fa640 1 -- 172.21.15.121:0/1811957730 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5eca6d77-c3cb-4415-8e16-500bf4479ee7", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f69f803f030 con 0x7f6a080cda50 2024-07-27T03:08:18.529 INFO:teuthology.orchestra.run.smithi121.stdout:3 2024-07-27T03:08:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.526+0000 7f6a0e475640 1 -- 172.21.15.121:0/1811957730 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a080cda50 msgr2=0x7f6a08153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.526+0000 7f6a0e475640 1 --2- 172.21.15.121:0/1811957730 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a080cda50 0x7f6a08153bd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f69f802aae0 tx=0x7f69f8005270 comp rx=0 tx=0).stop 2024-07-27T03:08:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.526+0000 7f6a0e475640 1 -- 172.21.15.121:0/1811957730 shutdown_connections 2024-07-27T03:08:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.526+0000 7f6a0e475640 1 --2- 172.21.15.121:0/1811957730 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a080d0130 0x7f6a08158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.526+0000 7f6a0e475640 1 --2- 172.21.15.121:0/1811957730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a080cfd20 0x7f6a0815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.526+0000 7f6a0e475640 1 --2- 172.21.15.121:0/1811957730 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6a080cda50 0x7f6a08153bd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.526+0000 7f6a0e475640 1 -- 172.21.15.121:0/1811957730 >> 172.21.15.121:0/1811957730 conn(0x7f6a080d1e20 msgr2=0x7f6a080b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:18.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.526+0000 7f6a0e475640 1 -- 172.21.15.121:0/1811957730 shutdown_connections 2024-07-27T03:08:18.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.527+0000 7f6a0e475640 1 -- 172.21.15.121:0/1811957730 wait complete. 2024-07-27T03:08:18.540 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2 4 2024-07-27T03:08:18.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.651+0000 7fa46f564640 1 -- 172.21.15.121:0/3996125972 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4680b75b0 msgr2=0x7fa4680d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.651+0000 7fa46f564640 1 --2- 172.21.15.121:0/3996125972 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4680b75b0 0x7fa4680d0790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa458005fd0 tx=0x7fa45802a540 comp rx=0 tx=0).stop 2024-07-27T03:08:18.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.651+0000 7fa46f564640 1 -- 172.21.15.121:0/3996125972 shutdown_connections 2024-07-27T03:08:18.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.651+0000 7fa46f564640 1 --2- 172.21.15.121:0/3996125972 >> v2:172.21.15.120:3300/0 conn(0x7fa4680d28f0 0x7fa4680ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.651+0000 7fa46f564640 1 --2- 172.21.15.121:0/3996125972 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4680b75b0 0x7fa4680d0790 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.651+0000 7fa46f564640 1 -- 172.21.15.121:0/3996125972 >> 172.21.15.121:0/3996125972 conn(0x7fa4680d1dd0 msgr2=0x7fa4680d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:18.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.651+0000 7fa46f564640 1 -- 172.21.15.121:0/3996125972 shutdown_connections 2024-07-27T03:08:18.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.651+0000 7fa46f564640 1 -- 172.21.15.121:0/3996125972 wait complete. 2024-07-27T03:08:18.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.653+0000 7fa46f564640 1 Processor -- start 2024-07-27T03:08:18.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.653+0000 7fa46f564640 1 -- start start 2024-07-27T03:08:18.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46f564640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4680b75b0 0x7fa468166490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46f564640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4680ced80 0x7fa4680caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46f564640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4680d28f0 0x7fa4680b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46f564640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa4680b2000 con 0x7fa4680d28f0 2024-07-27T03:08:18.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46f564640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa4680b1e80 con 0x7fa4680ced80 2024-07-27T03:08:18.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46f564640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa468166aa0 con 0x7fa4680b75b0 2024-07-27T03:08:18.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46d300640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4680b75b0 0x7fa468166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46caff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4680ced80 0x7fa4680caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46d300640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4680b75b0 0x7fa468166490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:34488/0 (socket says 172.21.15.121:34488) 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46d300640 1 -- 172.21.15.121:0/726245389 learned_addr learned my addr 172.21.15.121:0/726245389 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46db01640 1 --2- 172.21.15.121:0/726245389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4680d28f0 0x7fa4680b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46d300640 1 -- 172.21.15.121:0/726245389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4680ced80 msgr2=0x7fa4680caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46d300640 1 --2- 172.21.15.121:0/726245389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4680ced80 0x7fa4680caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46d300640 1 -- 172.21.15.121:0/726245389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4680d28f0 msgr2=0x7fa4680b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46d300640 1 --2- 172.21.15.121:0/726245389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4680d28f0 0x7fa4680b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46d300640 1 -- 172.21.15.121:0/726245389 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46815c850 con 0x7fa4680b75b0 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.654+0000 7fa46caff640 1 --2- 172.21.15.121:0/726245389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4680ced80 0x7fa4680caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.655+0000 7fa46d300640 1 --2- 172.21.15.121:0/726245389 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4680b75b0 0x7fa468166490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa458006010 tx=0x7fa4580038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.655+0000 7fa45dffb640 1 -- 172.21.15.121:0/726245389 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45803e030 con 0x7fa4680b75b0 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.655+0000 7fa45dffb640 1 -- 172.21.15.121:0/726245389 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa458003d90 con 0x7fa4680b75b0 2024-07-27T03:08:18.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.655+0000 7fa46f564640 1 -- 172.21.15.121:0/726245389 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4681f8ea0 con 0x7fa4680b75b0 2024-07-27T03:08:18.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.655+0000 7fa45dffb640 1 -- 172.21.15.121:0/726245389 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458035040 con 0x7fa4680b75b0 2024-07-27T03:08:18.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.655+0000 7fa46f564640 1 -- 172.21.15.121:0/726245389 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4681f9140 con 0x7fa4680b75b0 2024-07-27T03:08:18.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.655+0000 7fa45dffb640 1 -- 172.21.15.121:0/726245389 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa458041030 con 0x7fa4680b75b0 2024-07-27T03:08:18.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.655+0000 7fa45dffb640 1 -- 172.21.15.121:0/726245389 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa458043ce0 con 0x7fa4680b75b0 2024-07-27T03:08:18.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.656+0000 7fa46f564640 1 -- 172.21.15.121:0/726245389 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4680d0790 con 0x7fa4680b75b0 2024-07-27T03:08:18.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.658+0000 7fa45dffb640 1 -- 172.21.15.121:0/726245389 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7fa458004f50 con 0x7fa4680b75b0 2024-07-27T03:08:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.731+0000 7fa46f564640 1 -- 172.21.15.121:0/726245389 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2", "id": 4} v 0) -- 0x7fa4680cb4a0 con 0x7fa4680b75b0 2024-07-27T03:08:18.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.735+0000 7fa45dffb640 1 -- 172.21.15.121:0/726245389 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fa4580437d0 con 0x7fa4680b75b0 2024-07-27T03:08:18.738 INFO:teuthology.orchestra.run.smithi121.stdout:4 2024-07-27T03:08:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.736+0000 7fa46f564640 1 -- 172.21.15.121:0/726245389 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4680b75b0 msgr2=0x7fa468166490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.736+0000 7fa46f564640 1 --2- 172.21.15.121:0/726245389 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4680b75b0 0x7fa468166490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa458006010 tx=0x7fa4580038a0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.736+0000 7fa46f564640 1 -- 172.21.15.121:0/726245389 shutdown_connections 2024-07-27T03:08:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.736+0000 7fa46f564640 1 --2- 172.21.15.121:0/726245389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4680d28f0 0x7fa4680b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.736+0000 7fa46f564640 1 --2- 172.21.15.121:0/726245389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4680ced80 0x7fa4680caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.736+0000 7fa46f564640 1 --2- 172.21.15.121:0/726245389 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4680b75b0 0x7fa468166490 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.736+0000 7fa46f564640 1 -- 172.21.15.121:0/726245389 >> 172.21.15.121:0/726245389 conn(0x7fa4680d1dd0 msgr2=0x7fa4680b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.736+0000 7fa46f564640 1 -- 172.21.15.121:0/726245389 shutdown_connections 2024-07-27T03:08:18.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.736+0000 7fa46f564640 1 -- 172.21.15.121:0/726245389 wait complete. 2024-07-27T03:08:18.754 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new fe14efe2-13ba-45c3-b096-330e49ac7950 5 2024-07-27T03:08:18.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.864+0000 7faa89de0640 1 -- 172.21.15.121:0/3775985613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa84072c70 msgr2=0x7faa84073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.864+0000 7faa89de0640 1 --2- 172.21.15.121:0/3775985613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa84072c70 0x7faa84073080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa7c005fd0 tx=0x7faa7c02aa90 comp rx=0 tx=0).stop 2024-07-27T03:08:18.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.864+0000 7faa89de0640 1 -- 172.21.15.121:0/3775985613 shutdown_connections 2024-07-27T03:08:18.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.864+0000 7faa89de0640 1 --2- 172.21.15.121:0/3775985613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa84072c70 0x7faa84073080 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.864+0000 7faa89de0640 1 --2- 172.21.15.121:0/3775985613 >> v2:172.21.15.120:3300/0 conn(0x7faa840712b0 0x7faa8415c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.864+0000 7faa89de0640 1 -- 172.21.15.121:0/3775985613 >> 172.21.15.121:0/3775985613 conn(0x7faa840b2dc0 msgr2=0x7faa840d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:18.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.864+0000 7faa89de0640 1 -- 172.21.15.121:0/3775985613 shutdown_connections 2024-07-27T03:08:18.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.864+0000 7faa89de0640 1 -- 172.21.15.121:0/3775985613 wait complete. 2024-07-27T03:08:18.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.866+0000 7faa89de0640 1 Processor -- start 2024-07-27T03:08:18.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.866+0000 7faa89de0640 1 -- start start 2024-07-27T03:08:18.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.867+0000 7faa89de0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa840712b0 0x7faa841e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.867+0000 7faa89de0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa84072c70 0x7faa841e9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.867+0000 7faa89de0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa840afbb0 0x7faa8414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.867+0000 7faa89de0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7faa840cfad0 con 0x7faa840afbb0 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.867+0000 7faa89de0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa840cf950 con 0x7faa84072c70 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.867+0000 7faa89de0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7faa840cfc50 con 0x7faa840712b0 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.867+0000 7faa837fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa840712b0 0x7faa841e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.867+0000 7faa7bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa84072c70 0x7faa841e9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.867+0000 7faa837fe640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa840712b0 0x7faa841e8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:34508/0 (socket says 172.21.15.121:34508) 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.867+0000 7faa837fe640 1 -- 172.21.15.121:0/961770063 learned_addr learned my addr 172.21.15.121:0/961770063 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.867+0000 7faa83fff640 1 --2- 172.21.15.121:0/961770063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa840afbb0 0x7faa8414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa837fe640 1 -- 172.21.15.121:0/961770063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa84072c70 msgr2=0x7faa841e9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa837fe640 1 --2- 172.21.15.121:0/961770063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa84072c70 0x7faa841e9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa837fe640 1 -- 172.21.15.121:0/961770063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa840afbb0 msgr2=0x7faa8414e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa837fe640 1 --2- 172.21.15.121:0/961770063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa840afbb0 0x7faa8414e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa837fe640 1 -- 172.21.15.121:0/961770063 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa84154060 con 0x7faa840712b0 2024-07-27T03:08:18.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa7bfff640 1 --2- 172.21.15.121:0/961770063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa84072c70 0x7faa841e9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:18.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa83fff640 1 --2- 172.21.15.121:0/961770063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa840afbb0 0x7faa8414e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:18.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa837fe640 1 --2- 172.21.15.121:0/961770063 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa840712b0 0x7faa841e8e40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c3d0 tx=0x7faa7400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:18.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa80ff9640 1 -- 172.21.15.121:0/961770063 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74017070 con 0x7faa840712b0 2024-07-27T03:08:18.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa80ff9640 1 -- 172.21.15.121:0/961770063 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa740053c0 con 0x7faa840712b0 2024-07-27T03:08:18.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa80ff9640 1 -- 172.21.15.121:0/961770063 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74003850 con 0x7faa840712b0 2024-07-27T03:08:18.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa89de0640 1 -- 172.21.15.121:0/961770063 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa841f9140 con 0x7faa840712b0 2024-07-27T03:08:18.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa89de0640 1 -- 172.21.15.121:0/961770063 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8414db30 con 0x7faa840712b0 2024-07-27T03:08:18.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa80ff9640 1 -- 172.21.15.121:0/961770063 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faa7401a070 con 0x7faa840712b0 2024-07-27T03:08:18.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.868+0000 7faa80ff9640 1 -- 172.21.15.121:0/961770063 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7faa74011c20 con 0x7faa840712b0 2024-07-27T03:08:18.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.869+0000 7faa89de0640 1 -- 172.21.15.121:0/961770063 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8415c740 con 0x7faa840712b0 2024-07-27T03:08:18.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.871+0000 7faa80ff9640 1 -- 172.21.15.121:0/961770063 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7faa74021020 con 0x7faa840712b0 2024-07-27T03:08:18.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.944+0000 7faa89de0640 1 -- 172.21.15.121:0/961770063 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fe14efe2-13ba-45c3-b096-330e49ac7950", "id": 5} v 0) -- 0x7faa84156850 con 0x7faa840712b0 2024-07-27T03:08:18.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.949+0000 7faa80ff9640 1 -- 172.21.15.121:0/961770063 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe14efe2-13ba-45c3-b096-330e49ac7950", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7faa84073cf0 con 0x7faa840712b0 2024-07-27T03:08:18.952 INFO:teuthology.orchestra.run.smithi121.stdout:5 2024-07-27T03:08:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.950+0000 7faa89de0640 1 -- 172.21.15.121:0/961770063 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa840712b0 msgr2=0x7faa841e8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:18.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.950+0000 7faa89de0640 1 --2- 172.21.15.121:0/961770063 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa840712b0 0x7faa841e8e40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c3d0 tx=0x7faa7400c890 comp rx=0 tx=0).stop 2024-07-27T03:08:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.950+0000 7faa89de0640 1 -- 172.21.15.121:0/961770063 shutdown_connections 2024-07-27T03:08:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.950+0000 7faa89de0640 1 --2- 172.21.15.121:0/961770063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa840afbb0 0x7faa8414e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.950+0000 7faa89de0640 1 --2- 172.21.15.121:0/961770063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa84072c70 0x7faa841e9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.950+0000 7faa89de0640 1 --2- 172.21.15.121:0/961770063 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa840712b0 0x7faa841e8e40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.950+0000 7faa89de0640 1 -- 172.21.15.121:0/961770063 >> 172.21.15.121:0/961770063 conn(0x7faa840b2dc0 msgr2=0x7faa840b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.950+0000 7faa89de0640 1 -- 172.21.15.121:0/961770063 shutdown_connections 2024-07-27T03:08:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:18.950+0000 7faa89de0640 1 -- 172.21.15.121:0/961770063 wait complete. 2024-07-27T03:08:18.964 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 74b6f60a-8a61-4558-b09d-1360c4b7cc83 6 2024-07-27T03:08:19.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.074+0000 7ff863d27640 1 -- 172.21.15.121:0/3177134197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff85c0b4650 msgr2=0x7ff85c0b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.074+0000 7ff863d27640 1 --2- 172.21.15.121:0/3177134197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff85c0b4650 0x7ff85c0b4a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff84c005fd0 tx=0x7ff84c02a5f0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.074+0000 7ff863d27640 1 -- 172.21.15.121:0/3177134197 shutdown_connections 2024-07-27T03:08:19.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.074+0000 7ff863d27640 1 --2- 172.21.15.121:0/3177134197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff85c0b4650 0x7ff85c0b4a60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.074+0000 7ff863d27640 1 -- 172.21.15.121:0/3177134197 >> 172.21.15.121:0/3177134197 conn(0x7ff85c0b2e40 msgr2=0x7ff85c0b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:19.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.074+0000 7ff863d27640 1 -- 172.21.15.121:0/3177134197 shutdown_connections 2024-07-27T03:08:19.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.074+0000 7ff863d27640 1 -- 172.21.15.121:0/3177134197 wait complete. 2024-07-27T03:08:19.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.077+0000 7ff863d27640 1 Processor -- start 2024-07-27T03:08:19.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.077+0000 7ff863d27640 1 -- start start 2024-07-27T03:08:19.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.079+0000 7ff863d27640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff85c0add70 0x7ff85c142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:19.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff863d27640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff85c0b4650 0x7ff85c0ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff863d27640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff85c14b7e0 0x7ff85c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff863d27640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c0ae180 con 0x7ff85c14b7e0 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff863d27640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff85c074370 con 0x7ff85c0add70 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff863d27640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff85c0ae300 con 0x7ff85c0b4650 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff861ac3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff85c0add70 0x7ff85c142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff8612c2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff85c0b4650 0x7ff85c0ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff861ac3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff85c0add70 0x7ff85c142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53510/0 (socket says 172.21.15.121:53510) 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff861ac3640 1 -- 172.21.15.121:0/2677833381 learned_addr learned my addr 172.21.15.121:0/2677833381 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff8622c4640 1 --2- 172.21.15.121:0/2677833381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff85c14b7e0 0x7ff85c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff861ac3640 1 -- 172.21.15.121:0/2677833381 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff85c0b4650 msgr2=0x7ff85c0ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff861ac3640 1 --2- 172.21.15.121:0/2677833381 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff85c0b4650 0x7ff85c0ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff861ac3640 1 -- 172.21.15.121:0/2677833381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff85c14b7e0 msgr2=0x7ff85c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff861ac3640 1 --2- 172.21.15.121:0/2677833381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff85c14b7e0 0x7ff85c0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff861ac3640 1 -- 172.21.15.121:0/2677833381 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85c14c410 con 0x7ff85c0add70 2024-07-27T03:08:19.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff8612c2640 1 --2- 172.21.15.121:0/2677833381 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff85c0b4650 0x7ff85c0ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:19.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff861ac3640 1 --2- 172.21.15.121:0/2677833381 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff85c0add70 0x7ff85c142690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff85400c3a0 tx=0x7ff85400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:19.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff8527fc640 1 -- 172.21.15.121:0/2677833381 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8540052d0 con 0x7ff85c0add70 2024-07-27T03:08:19.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff8527fc640 1 -- 172.21.15.121:0/2677833381 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff854007020 con 0x7ff85c0add70 2024-07-27T03:08:19.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff8527fc640 1 -- 172.21.15.121:0/2677833381 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff854007470 con 0x7ff85c0add70 2024-07-27T03:08:19.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff863d27640 1 -- 172.21.15.121:0/2677833381 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85c1549c0 con 0x7ff85c0add70 2024-07-27T03:08:19.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.080+0000 7ff863d27640 1 -- 172.21.15.121:0/2677833381 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff85c154f80 con 0x7ff85c0add70 2024-07-27T03:08:19.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.081+0000 7ff8527fc640 1 -- 172.21.15.121:0/2677833381 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff8540067d0 con 0x7ff85c0add70 2024-07-27T03:08:19.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.081+0000 7ff8527fc640 1 -- 172.21.15.121:0/2677833381 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7ff854003b90 con 0x7ff85c0add70 2024-07-27T03:08:19.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.082+0000 7ff863d27640 1 -- 172.21.15.121:0/2677833381 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff85c152360 con 0x7ff85c0add70 2024-07-27T03:08:19.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.084+0000 7ff8527fc640 1 -- 172.21.15.121:0/2677833381 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7ff854003e00 con 0x7ff85c0add70 2024-07-27T03:08:19.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.168+0000 7ff863d27640 1 -- 172.21.15.121:0/2677833381 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "74b6f60a-8a61-4558-b09d-1360c4b7cc83", "id": 6} v 0) -- 0x7ff85c15e400 con 0x7ff85c0add70 2024-07-27T03:08:19.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.171+0000 7ff8527fc640 1 -- 172.21.15.121:0/2677833381 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74b6f60a-8a61-4558-b09d-1360c4b7cc83", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7ff854007610 con 0x7ff85c0add70 2024-07-27T03:08:19.175 INFO:teuthology.orchestra.run.smithi121.stdout:6 2024-07-27T03:08:19.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.172+0000 7ff863d27640 1 -- 172.21.15.121:0/2677833381 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff85c0add70 msgr2=0x7ff85c142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.172+0000 7ff863d27640 1 --2- 172.21.15.121:0/2677833381 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff85c0add70 0x7ff85c142690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff85400c3a0 tx=0x7ff85400c860 comp rx=0 tx=0).stop 2024-07-27T03:08:19.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.172+0000 7ff863d27640 1 -- 172.21.15.121:0/2677833381 shutdown_connections 2024-07-27T03:08:19.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.172+0000 7ff863d27640 1 --2- 172.21.15.121:0/2677833381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff85c14b7e0 0x7ff85c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.172+0000 7ff863d27640 1 --2- 172.21.15.121:0/2677833381 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff85c0b4650 0x7ff85c0ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.172+0000 7ff863d27640 1 --2- 172.21.15.121:0/2677833381 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff85c0add70 0x7ff85c142690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.172+0000 7ff863d27640 1 -- 172.21.15.121:0/2677833381 >> 172.21.15.121:0/2677833381 conn(0x7ff85c0b2e40 msgr2=0x7ff85c0b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:19.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.172+0000 7ff863d27640 1 -- 172.21.15.121:0/2677833381 shutdown_connections 2024-07-27T03:08:19.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.172+0000 7ff863d27640 1 -- 172.21.15.121:0/2677833381 wait complete. 2024-07-27T03:08:19.187 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 59f4d249-06e4-4b49-9b6b-2898a308e0d4 7 2024-07-27T03:08:19.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.297+0000 7f60eb157640 1 -- 172.21.15.121:0/1942922531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60e40b75b0 msgr2=0x7f60e40d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.297+0000 7f60eb157640 1 --2- 172.21.15.121:0/1942922531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60e40b75b0 0x7f60e40d0790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f60d8005fd0 tx=0x7f60d802a5f0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.297+0000 7f60eb157640 1 -- 172.21.15.121:0/1942922531 shutdown_connections 2024-07-27T03:08:19.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.297+0000 7f60eb157640 1 --2- 172.21.15.121:0/1942922531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60e40b75b0 0x7f60e40d0790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.297+0000 7f60eb157640 1 -- 172.21.15.121:0/1942922531 >> 172.21.15.121:0/1942922531 conn(0x7f60e40d1dd0 msgr2=0x7f60e40d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:19.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.297+0000 7f60eb157640 1 -- 172.21.15.121:0/1942922531 shutdown_connections 2024-07-27T03:08:19.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.297+0000 7f60eb157640 1 -- 172.21.15.121:0/1942922531 wait complete. 2024-07-27T03:08:19.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.299+0000 7f60eb157640 1 Processor -- start 2024-07-27T03:08:19.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.299+0000 7f60eb157640 1 -- start start 2024-07-27T03:08:19.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.300+0000 7f60eb157640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e40b75b0 0x7f60e415a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:19.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.300+0000 7f60eb157640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60e40cd940 0x7f60e40c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:19.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.300+0000 7f60eb157640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60e40d28f0 0x7f60e415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:19.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.300+0000 7f60eb157640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f60e4167ab0 con 0x7f60e40b75b0 2024-07-27T03:08:19.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.300+0000 7f60eb157640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f60e40b1fc0 con 0x7f60e40d28f0 2024-07-27T03:08:19.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.300+0000 7f60eb157640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f60e4167c30 con 0x7f60e40cd940 2024-07-27T03:08:19.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.300+0000 7f60e96f4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60e40d28f0 0x7f60e415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:19.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e3fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60e40cd940 0x7f60e40c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e96f4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60e40d28f0 0x7f60e415ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:53522/0 (socket says 172.21.15.121:53522) 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e96f4640 1 -- 172.21.15.121:0/3655370659 learned_addr learned my addr 172.21.15.121:0/3655370659 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e8ef3640 1 --2- 172.21.15.121:0/3655370659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e40b75b0 0x7f60e415a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e96f4640 1 -- 172.21.15.121:0/3655370659 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60e40cd940 msgr2=0x7f60e40c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e96f4640 1 --2- 172.21.15.121:0/3655370659 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60e40cd940 0x7f60e40c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e96f4640 1 -- 172.21.15.121:0/3655370659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e40b75b0 msgr2=0x7f60e415a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e96f4640 1 --2- 172.21.15.121:0/3655370659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e40b75b0 0x7f60e415a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e96f4640 1 -- 172.21.15.121:0/3655370659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e40cb250 con 0x7f60e40d28f0 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e8ef3640 1 --2- 172.21.15.121:0/3655370659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e40b75b0 0x7f60e415a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e3fff640 1 --2- 172.21.15.121:0/3655370659 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60e40cd940 0x7f60e40c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e96f4640 1 --2- 172.21.15.121:0/3655370659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60e40d28f0 0x7f60e415ca00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c6e0 tx=0x7f60dc00cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e17fa640 1 -- 172.21.15.121:0/3655370659 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc003b70 con 0x7f60e40d28f0 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e17fa640 1 -- 172.21.15.121:0/3655370659 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60dc003d10 con 0x7f60e40d28f0 2024-07-27T03:08:19.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60eb157640 1 -- 172.21.15.121:0/3655370659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e40cb510 con 0x7f60e40d28f0 2024-07-27T03:08:19.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e17fa640 1 -- 172.21.15.121:0/3655370659 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc005330 con 0x7f60e40d28f0 2024-07-27T03:08:19.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60eb157640 1 -- 172.21.15.121:0/3655370659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e40cbad0 con 0x7f60e40d28f0 2024-07-27T03:08:19.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.301+0000 7f60e17fa640 1 -- 172.21.15.121:0/3655370659 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f60dc0054d0 con 0x7f60e40d28f0 2024-07-27T03:08:19.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.302+0000 7f60e17fa640 1 -- 172.21.15.121:0/3655370659 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f60dc012b70 con 0x7f60e40d28f0 2024-07-27T03:08:19.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.302+0000 7f60eb157640 1 -- 172.21.15.121:0/3655370659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e40d0790 con 0x7f60e40d28f0 2024-07-27T03:08:19.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.304+0000 7f60e17fa640 1 -- 172.21.15.121:0/3655370659 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7f60dc012510 con 0x7f60e40d28f0 2024-07-27T03:08:19.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.377+0000 7f60eb157640 1 -- 172.21.15.121:0/3655370659 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "59f4d249-06e4-4b49-9b6b-2898a308e0d4", "id": 7} v 0) -- 0x7f60e40cf760 con 0x7f60e40d28f0 2024-07-27T03:08:19.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.381+0000 7f60e17fa640 1 -- 172.21.15.121:0/3655370659 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59f4d249-06e4-4b49-9b6b-2898a308e0d4", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f60dc0126f0 con 0x7f60e40d28f0 2024-07-27T03:08:19.384 INFO:teuthology.orchestra.run.smithi121.stdout:7 2024-07-27T03:08:19.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.382+0000 7f60eb157640 1 -- 172.21.15.121:0/3655370659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60e40d28f0 msgr2=0x7f60e415ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.382+0000 7f60eb157640 1 --2- 172.21.15.121:0/3655370659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60e40d28f0 0x7f60e415ca00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c6e0 tx=0x7f60dc00cba0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.382+0000 7f60eb157640 1 -- 172.21.15.121:0/3655370659 shutdown_connections 2024-07-27T03:08:19.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.382+0000 7f60eb157640 1 --2- 172.21.15.121:0/3655370659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60e40d28f0 0x7f60e415ca00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.382+0000 7f60eb157640 1 --2- 172.21.15.121:0/3655370659 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60e40cd940 0x7f60e40c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.382+0000 7f60eb157640 1 --2- 172.21.15.121:0/3655370659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e40b75b0 0x7f60e415a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.382+0000 7f60eb157640 1 -- 172.21.15.121:0/3655370659 >> 172.21.15.121:0/3655370659 conn(0x7f60e40d1dd0 msgr2=0x7f60e40b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:19.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.382+0000 7f60eb157640 1 -- 172.21.15.121:0/3655370659 shutdown_connections 2024-07-27T03:08:19.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:19.382+0000 7f60eb157640 1 -- 172.21.15.121:0/3655370659 wait complete. 2024-07-27T03:08:19.397 INFO:tasks.ceph.osd.0:Restarting daemon 2024-07-27T03:08:19.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-07-27T03:08:19.399 INFO:tasks.ceph.osd.0:Started 2024-07-27T03:08:19.400 INFO:tasks.ceph.osd.1:Restarting daemon 2024-07-27T03:08:19.400 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-07-27T03:08:19.402 INFO:tasks.ceph.osd.1:Started 2024-07-27T03:08:19.402 INFO:tasks.ceph.osd.2:Restarting daemon 2024-07-27T03:08:19.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-07-27T03:08:19.404 INFO:tasks.ceph.osd.2:Started 2024-07-27T03:08:19.404 INFO:tasks.ceph.osd.3:Restarting daemon 2024-07-27T03:08:19.404 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-07-27T03:08:19.406 INFO:tasks.ceph.osd.3:Started 2024-07-27T03:08:19.406 INFO:tasks.ceph.osd.4:Restarting daemon 2024-07-27T03:08:19.407 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-07-27T03:08:19.409 INFO:tasks.ceph.osd.4:Started 2024-07-27T03:08:19.409 INFO:tasks.ceph.osd.5:Restarting daemon 2024-07-27T03:08:19.409 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-07-27T03:08:19.411 INFO:tasks.ceph.osd.5:Started 2024-07-27T03:08:19.412 INFO:tasks.ceph.osd.6:Restarting daemon 2024-07-27T03:08:19.412 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-07-27T03:08:19.414 INFO:tasks.ceph.osd.6:Started 2024-07-27T03:08:19.415 INFO:tasks.ceph.osd.7:Restarting daemon 2024-07-27T03:08:19.415 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-07-27T03:08:19.417 INFO:tasks.ceph.osd.7:Started 2024-07-27T03:08:19.417 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:08:19.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.559+0000 7fce2f7c3640 1 -- 172.21.15.120:0/3255194515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce280b4740 msgr2=0x7fce280b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.559+0000 7fce2f7c3640 1 --2- 172.21.15.120:0/3255194515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce280b4740 0x7fce280b2c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce18009860 tx=0x7fce1802a5a0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.559+0000 7fce2f7c3640 1 -- 172.21.15.120:0/3255194515 shutdown_connections 2024-07-27T03:08:19.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.559+0000 7fce2f7c3640 1 --2- 172.21.15.120:0/3255194515 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce280b4740 0x7fce280b2c40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.559+0000 7fce2f7c3640 1 -- 172.21.15.120:0/3255194515 >> 172.21.15.120:0/3255194515 conn(0x7fce2808d690 msgr2=0x7fce2809d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:19.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.559+0000 7fce2f7c3640 1 -- 172.21.15.120:0/3255194515 shutdown_connections 2024-07-27T03:08:19.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.559+0000 7fce2f7c3640 1 -- 172.21.15.120:0/3255194515 wait complete. 2024-07-27T03:08:19.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.561+0000 7fce2f7c3640 1 Processor -- start 2024-07-27T03:08:19.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.561+0000 7fce2f7c3640 1 -- start start 2024-07-27T03:08:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.562+0000 7fce2f7c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce280b4740 0x7fce280b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.562+0000 7fce2f7c3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce280d27e0 0x7fce280cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.562+0000 7fce2f7c3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce280b5a70 0x7fce280cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.562+0000 7fce2f7c3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fce280d2f80 con 0x7fce280d27e0 2024-07-27T03:08:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.562+0000 7fce2f7c3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fce280d2e00 con 0x7fce280b4740 2024-07-27T03:08:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.562+0000 7fce2f7c3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fce280d3100 con 0x7fce280b5a70 2024-07-27T03:08:19.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.562+0000 7fce2cd5e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce280d27e0 0x7fce280cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.562+0000 7fce2cd5e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce280d27e0 0x7fce280cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46858/0 (socket says 172.21.15.120:46858) 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.562+0000 7fce2d55f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce280b4740 0x7fce280b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.562+0000 7fce2cd5e640 1 -- 172.21.15.120:0/2156690951 learned_addr learned my addr 172.21.15.120:0/2156690951 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.562+0000 7fce2dd60640 1 --2- 172.21.15.120:0/2156690951 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce280b5a70 0x7fce280cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce2d55f640 1 -- 172.21.15.120:0/2156690951 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce280b5a70 msgr2=0x7fce280cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce2d55f640 1 --2- 172.21.15.120:0/2156690951 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce280b5a70 0x7fce280cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce2d55f640 1 -- 172.21.15.120:0/2156690951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce280d27e0 msgr2=0x7fce280cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce2d55f640 1 --2- 172.21.15.120:0/2156690951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce280d27e0 0x7fce280cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce2d55f640 1 -- 172.21.15.120:0/2156690951 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce281601b0 con 0x7fce280b4740 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce2cd5e640 1 --2- 172.21.15.120:0/2156690951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce280d27e0 0x7fce280cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce2d55f640 1 --2- 172.21.15.120:0/2156690951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce280b4740 0x7fce280b5530 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fce18031000 tx=0x7fce18033c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce1dffb640 1 -- 172.21.15.120:0/2156690951 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18005c90 con 0x7fce280b4740 2024-07-27T03:08:19.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce1dffb640 1 -- 172.21.15.120:0/2156690951 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce18033e10 con 0x7fce280b4740 2024-07-27T03:08:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce1dffb640 1 -- 172.21.15.120:0/2156690951 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18005280 con 0x7fce280b4740 2024-07-27T03:08:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce2f7c3640 1 -- 172.21.15.120:0/2156690951 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce281f6550 con 0x7fce280b4740 2024-07-27T03:08:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.563+0000 7fce2f7c3640 1 -- 172.21.15.120:0/2156690951 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce28160750 con 0x7fce280b4740 2024-07-27T03:08:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.564+0000 7fce1dffb640 1 -- 172.21.15.120:0/2156690951 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fce180047a0 con 0x7fce280b4740 2024-07-27T03:08:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.564+0000 7fce1dffb640 1 -- 172.21.15.120:0/2156690951 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fce18003cc0 con 0x7fce280b4740 2024-07-27T03:08:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.564+0000 7fce2f7c3640 1 -- 172.21.15.120:0/2156690951 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce280b2c40 con 0x7fce280b4740 2024-07-27T03:08:19.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.567+0000 7fce1dffb640 1 -- 172.21.15.120:0/2156690951 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7fce1803f030 con 0x7fce280b4740 2024-07-27T03:08:19.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.628+0000 7fce2f7c3640 1 -- 172.21.15.120:0/2156690951 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce2815b2a0 con 0x7fce280b4740 2024-07-27T03:08:19.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.629+0000 7fce1dffb640 1 -- 172.21.15.120:0/2156690951 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fce18004c20 con 0x7fce280b4740 2024-07-27T03:08:19.631 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:19.631 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":10,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:19.380103+0000","last_up_change":"0.000000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:08:19.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.629+0000 7fce2f7c3640 1 -- 172.21.15.120:0/2156690951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce280b4740 msgr2=0x7fce280b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:19.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.629+0000 7fce2f7c3640 1 --2- 172.21.15.120:0/2156690951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce280b4740 0x7fce280b5530 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fce18031000 tx=0x7fce18033c20 comp rx=0 tx=0).stop 2024-07-27T03:08:19.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.630+0000 7fce2f7c3640 1 -- 172.21.15.120:0/2156690951 shutdown_connections 2024-07-27T03:08:19.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.630+0000 7fce2f7c3640 1 --2- 172.21.15.120:0/2156690951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce280d27e0 0x7fce280cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.630+0000 7fce2f7c3640 1 --2- 172.21.15.120:0/2156690951 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce280b5a70 0x7fce280cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.630+0000 7fce2f7c3640 1 --2- 172.21.15.120:0/2156690951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce280b4740 0x7fce280b5530 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:19.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.630+0000 7fce2f7c3640 1 -- 172.21.15.120:0/2156690951 >> 172.21.15.120:0/2156690951 conn(0x7fce2808d690 msgr2=0x7fce281574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:19.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.630+0000 7fce2f7c3640 1 -- 172.21.15.120:0/2156690951 shutdown_connections 2024-07-27T03:08:19.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:19.630+0000 7fce2f7c3640 1 -- 172.21.15.120:0/2156690951 wait complete. 2024-07-27T03:08:19.642 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-07-27T03:08:19.643 INFO:tasks.ceph:Waiting for OSDs to come up 2024-07-27T03:08:20.023 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-07-27T03:08:20.018+0000 7fbbf580d640 -1 Falling back to public interface 2024-07-27T03:08:20.031 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-07-27T03:08:20.027+0000 7faa4a53b640 -1 Falling back to public interface 2024-07-27T03:08:20.032 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-07-27T03:08:20.030+0000 7f30b9af0640 -1 Falling back to public interface 2024-07-27T03:08:20.042 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-07-27T03:08:20.038+0000 7f499d086640 -1 Falling back to public interface 2024-07-27T03:08:20.044 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-07-27T03:08:20.041+0000 7f62afa1b640 -1 Falling back to public interface 2024-07-27T03:08:20.047 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-07-27T03:08:20.045+0000 7f0d2480f640 -1 Falling back to public interface 2024-07-27T03:08:20.051 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-07-27T03:08:20.049+0000 7ffbe9b14640 -1 Falling back to public interface 2024-07-27T03:08:20.068 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-07-27T03:08:20.065+0000 7faef3c1c640 -1 Falling back to public interface 2024-07-27T03:08:20.449 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-07-27T03:08:20.558 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.555+0000 7fd0919c3640 1 -- 172.21.15.120:0/2173550503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08c0cca50 msgr2=0x7fd08c06eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:20.558 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.555+0000 7fd0919c3640 1 --2- 172.21.15.120:0/2173550503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08c0cca50 0x7fd08c06eca0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd08c072720 tx=0x7fd07402a560 comp rx=0 tx=0).stop 2024-07-27T03:08:20.559 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.555+0000 7fd0919c3640 1 -- 172.21.15.120:0/2173550503 shutdown_connections 2024-07-27T03:08:20.559 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.555+0000 7fd0919c3640 1 --2- 172.21.15.120:0/2173550503 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd08c06f1e0 0x7fd08c151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:20.559 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.555+0000 7fd0919c3640 1 --2- 172.21.15.120:0/2173550503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08c0cca50 0x7fd08c06eca0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:20.559 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.555+0000 7fd0919c3640 1 --2- 172.21.15.120:0/2173550503 >> v2:172.21.15.121:3300/0 conn(0x7fd08c15ec00 0x7fd08c15b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:20.559 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.555+0000 7fd0919c3640 1 -- 172.21.15.120:0/2173550503 >> 172.21.15.120:0/2173550503 conn(0x7fd08c0b2dc0 msgr2=0x7fd08c0d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:20.559 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.555+0000 7fd0919c3640 1 -- 172.21.15.120:0/2173550503 shutdown_connections 2024-07-27T03:08:20.560 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.555+0000 7fd0919c3640 1 -- 172.21.15.120:0/2173550503 wait complete. 2024-07-27T03:08:20.560 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.557+0000 7fd0919c3640 1 Processor -- start 2024-07-27T03:08:20.560 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.558+0000 7fd0919c3640 1 -- start start 2024-07-27T03:08:20.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd0919c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd08c06f1e0 0x7fd08c146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:20.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd0919c3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08c0cca50 0x7fd08c072c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:20.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd0919c3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd08c15ec00 0x7fd08c0731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:20.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd0919c3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c152030 con 0x7fd08c0cca50 2024-07-27T03:08:20.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd0919c3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c151eb0 con 0x7fd08c06f1e0 2024-07-27T03:08:20.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd0919c3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd08c1521b0 con 0x7fd08c15ec00 2024-07-27T03:08:20.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd083fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08c0cca50 0x7fd08c072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:20.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd083fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08c0cca50 0x7fd08c072c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46880/0 (socket says 172.21.15.120:46880) 2024-07-27T03:08:20.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd083fff640 1 -- 172.21.15.120:0/1749840532 learned_addr learned my addr 172.21.15.120:0/1749840532 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:20.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd08affd640 1 --2- 172.21.15.120:0/1749840532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd08c06f1e0 0x7fd08c146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:20.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd08b7fe640 1 --2- 172.21.15.120:0/1749840532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd08c15ec00 0x7fd08c0731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:20.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd083fff640 1 -- 172.21.15.120:0/1749840532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd08c15ec00 msgr2=0x7fd08c0731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:20.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd083fff640 1 --2- 172.21.15.120:0/1749840532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd08c15ec00 0x7fd08c0731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:20.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd083fff640 1 -- 172.21.15.120:0/1749840532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd08c06f1e0 msgr2=0x7fd08c146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:20.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd083fff640 1 --2- 172.21.15.120:0/1749840532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd08c06f1e0 0x7fd08c146ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:20.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd083fff640 1 -- 172.21.15.120:0/1749840532 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c154740 con 0x7fd08c0cca50 2024-07-27T03:08:20.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.559+0000 7fd083fff640 1 --2- 172.21.15.120:0/1749840532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08c0cca50 0x7fd08c072c70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd074034040 tx=0x7fd0740038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:20.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.560+0000 7fd088ff9640 1 -- 172.21.15.120:0/1749840532 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07403e030 con 0x7fd08c0cca50 2024-07-27T03:08:20.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.560+0000 7fd088ff9640 1 -- 172.21.15.120:0/1749840532 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd074003ca0 con 0x7fd08c0cca50 2024-07-27T03:08:20.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.560+0000 7fd0919c3640 1 -- 172.21.15.120:0/1749840532 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08c1f5650 con 0x7fd08c0cca50 2024-07-27T03:08:20.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.560+0000 7fd088ff9640 1 -- 172.21.15.120:0/1749840532 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074035040 con 0x7fd08c0cca50 2024-07-27T03:08:20.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.560+0000 7fd0919c3640 1 -- 172.21.15.120:0/1749840532 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08c1f5c10 con 0x7fd08c0cca50 2024-07-27T03:08:20.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.561+0000 7fd0919c3640 1 -- 172.21.15.120:0/1749840532 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd08c1f9790 con 0x7fd08c0cca50 2024-07-27T03:08:20.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.561+0000 7fd088ff9640 1 -- 172.21.15.120:0/1749840532 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 2) ==== 49591+0+0 (secure 0 0 0) 0x7fd074041030 con 0x7fd08c0cca50 2024-07-27T03:08:20.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.561+0000 7fd088ff9640 1 -- 172.21.15.120:0/1749840532 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd074071770 con 0x7fd08c0cca50 2024-07-27T03:08:20.568 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.566+0000 7fd088ff9640 1 -- 172.21.15.120:0/1749840532 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73777 (secure 0 0 0) 0x7fd074073cc0 con 0x7fd08c0cca50 2024-07-27T03:08:20.633 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.631+0000 7fd0919c3640 1 -- 172.21.15.120:0/1749840532 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd08c06eca0 con 0x7fd08c0cca50 2024-07-27T03:08:20.634 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.632+0000 7fd088ff9640 1 -- 172.21.15.120:0/1749840532 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd074004cf0 con 0x7fd08c0cca50 2024-07-27T03:08:20.634 INFO:teuthology.misc.health.smithi120.stdout: 2024-07-27T03:08:20.634 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":10,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:19.380103+0000","last_up_change":"0.000000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:08:20.635 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.632+0000 7fd0919c3640 1 -- 172.21.15.120:0/1749840532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08c0cca50 msgr2=0x7fd08c072c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:20.635 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.632+0000 7fd0919c3640 1 --2- 172.21.15.120:0/1749840532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08c0cca50 0x7fd08c072c70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd074034040 tx=0x7fd0740038a0 comp rx=0 tx=0).stop 2024-07-27T03:08:20.635 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.632+0000 7fd0919c3640 1 -- 172.21.15.120:0/1749840532 shutdown_connections 2024-07-27T03:08:20.635 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.632+0000 7fd0919c3640 1 --2- 172.21.15.120:0/1749840532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd08c0cca50 0x7fd08c072c70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:20.635 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.632+0000 7fd0919c3640 1 --2- 172.21.15.120:0/1749840532 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd08c15ec00 0x7fd08c0731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:20.635 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.632+0000 7fd0919c3640 1 --2- 172.21.15.120:0/1749840532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd08c06f1e0 0x7fd08c146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:20.635 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.632+0000 7fd0919c3640 1 -- 172.21.15.120:0/1749840532 >> 172.21.15.120:0/1749840532 conn(0x7fd08c0b2dc0 msgr2=0x7fd08c15e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:20.636 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.633+0000 7fd0919c3640 1 -- 172.21.15.120:0/1749840532 shutdown_connections 2024-07-27T03:08:20.636 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:20.633+0000 7fd0919c3640 1 -- 172.21.15.120:0/1749840532 wait complete. 2024-07-27T03:08:20.644 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-07-27T03:08:21.539 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-07-27T03:08:21.536+0000 7f61fdbd8640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-07-27T03:08:21.540 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-07-27T03:08:21.536+0000 7f61fdbd8640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-07-27T03:08:23.465 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-07-27T03:08:23.462+0000 7fbbf580d640 -1 osd.6 0 log_to_monitors true 2024-07-27T03:08:23.488 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-07-27T03:08:23.486+0000 7f30b9af0640 -1 osd.1 0 log_to_monitors true 2024-07-27T03:08:23.499 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-07-27T03:08:23.496+0000 7faa4a53b640 -1 osd.4 0 log_to_monitors true 2024-07-27T03:08:23.522 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-07-27T03:08:23.520+0000 7f0d2480f640 -1 osd.3 0 log_to_monitors true 2024-07-27T03:08:23.545 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-07-27T03:08:23.541+0000 7f499d086640 -1 osd.7 0 log_to_monitors true 2024-07-27T03:08:23.549 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-07-27T03:08:23.546+0000 7faef3c1c640 -1 osd.5 0 log_to_monitors true 2024-07-27T03:08:23.551 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-07-27T03:08:23.549+0000 7f62afa1b640 -1 osd.2 0 log_to_monitors true 2024-07-27T03:08:23.565 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-07-27T03:08:23.562+0000 7ffbe9b14640 -1 osd.0 0 log_to_monitors true 2024-07-27T03:08:25.664 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-07-27T03:08:25.662+0000 7f30b5a85640 -1 osd.1 0 waiting for initial osdmap 2024-07-27T03:08:25.702 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-07-27T03:08:25.700+0000 7f30ad87b640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-27T03:08:26.028 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-07-27T03:08:26.025+0000 7fbbf1250640 -1 osd.6 0 waiting for initial osdmap 2024-07-27T03:08:26.075 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-07-27T03:08:26.072+0000 7faa464d0640 -1 osd.4 0 waiting for initial osdmap 2024-07-27T03:08:26.192 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-07-27T03:08:26.189+0000 7fbbe9046640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-27T03:08:26.227 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-07-27T03:08:26.224+0000 7faa3e2c6640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-27T03:08:26.686 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-07-27T03:08:26.683+0000 7f0d201fe640 -1 osd.3 0 waiting for initial osdmap 2024-07-27T03:08:26.703 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-07-27T03:08:26.701+0000 7f0d17ff4640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-27T03:08:26.912 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-07-27T03:08:26.908+0000 7f499901b640 -1 osd.7 0 waiting for initial osdmap 2024-07-27T03:08:26.927 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-07-27T03:08:26.924+0000 7f4990e11640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-27T03:08:26.934 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-07-27T03:08:26.931+0000 7faeef59f640 -1 osd.5 0 waiting for initial osdmap 2024-07-27T03:08:26.948 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-07-27T03:08:26.945+0000 7faee7395640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-27T03:08:26.984 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-07-27T03:08:26.982+0000 7f62ab406640 -1 osd.2 0 waiting for initial osdmap 2024-07-27T03:08:27.003 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-07-27T03:08:27.001+0000 7f62a31fc640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-27T03:08:27.042 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-07-27T03:08:27.040+0000 7ffbe5aa9640 -1 osd.0 0 waiting for initial osdmap 2024-07-27T03:08:27.054 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-07-27T03:08:27.052+0000 7ffbdd89f640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-27T03:08:27.452 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-07-27T03:08:27.558 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.554+0000 7fbf75393640 1 -- 172.21.15.120:0/622173621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf700c68a0 msgr2=0x7fbf700733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:27.558 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.554+0000 7fbf75393640 1 --2- 172.21.15.120:0/622173621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf700c68a0 0x7fbf700733e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbf58005fd0 tx=0x7fbf5802a410 comp rx=0 tx=0).stop 2024-07-27T03:08:27.558 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.554+0000 7fbf75393640 1 -- 172.21.15.120:0/622173621 shutdown_connections 2024-07-27T03:08:27.558 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.554+0000 7fbf75393640 1 --2- 172.21.15.120:0/622173621 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbf70073920 0x7fbf7015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.559 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.554+0000 7fbf75393640 1 --2- 172.21.15.120:0/622173621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf700c68a0 0x7fbf700733e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.559 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.554+0000 7fbf75393640 1 -- 172.21.15.120:0/622173621 >> 172.21.15.120:0/622173621 conn(0x7fbf700d0df0 msgr2=0x7fbf700d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:27.559 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.554+0000 7fbf75393640 1 -- 172.21.15.120:0/622173621 shutdown_connections 2024-07-27T03:08:27.559 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.554+0000 7fbf75393640 1 -- 172.21.15.120:0/622173621 wait complete. 2024-07-27T03:08:27.564 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.556+0000 7fbf75393640 1 Processor -- start 2024-07-27T03:08:27.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.556+0000 7fbf75393640 1 -- start start 2024-07-27T03:08:27.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf75393640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbf70073920 0x7fbf7015db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:27.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf75393640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf700c68a0 0x7fbf7006c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:27.565 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf75393640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf700cd400 0x7fbf7006ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:27.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf75393640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7015f350 con 0x7fbf700cd400 2024-07-27T03:08:27.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf75393640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7015f1d0 con 0x7fbf700c68a0 2024-07-27T03:08:27.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf75393640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbf7015f4d0 con 0x7fbf70073920 2024-07-27T03:08:27.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf6f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf700cd400 0x7fbf7006ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:27.566 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf6effd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbf70073920 0x7fbf7015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:27.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf6f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf700cd400 0x7fbf7006ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56122/0 (socket says 172.21.15.120:56122) 2024-07-27T03:08:27.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf6f7fe640 1 -- 172.21.15.120:0/3819258825 learned_addr learned my addr 172.21.15.120:0/3819258825 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:27.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf6e7fc640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf700c68a0 0x7fbf7006c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:27.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf6f7fe640 1 -- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbf70073920 msgr2=0x7fbf7015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:27.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf6f7fe640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbf70073920 0x7fbf7015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.567 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf6f7fe640 1 -- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf700c68a0 msgr2=0x7fbf7006c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:27.568 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf6f7fe640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf700c68a0 0x7fbf7006c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.568 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf6f7fe640 1 -- 172.21.15.120:0/3819258825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf701465d0 con 0x7fbf700cd400 2024-07-27T03:08:27.568 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf6f7fe640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf700cd400 0x7fbf7006ccc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000d690 tx=0x7fbf6000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:27.568 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf677fe640 1 -- 172.21.15.120:0/3819258825 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf60017070 con 0x7fbf700cd400 2024-07-27T03:08:27.568 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf677fe640 1 -- 172.21.15.120:0/3819258825 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf60005310 con 0x7fbf700cd400 2024-07-27T03:08:27.569 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf677fe640 1 -- 172.21.15.120:0/3819258825 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf60009820 con 0x7fbf700cd400 2024-07-27T03:08:27.569 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf75393640 1 -- 172.21.15.120:0/3819258825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf701468b0 con 0x7fbf700cd400 2024-07-27T03:08:27.569 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.558+0000 7fbf75393640 1 -- 172.21.15.120:0/3819258825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf70146e70 con 0x7fbf700cd400 2024-07-27T03:08:27.569 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.560+0000 7fbf75393640 1 -- 172.21.15.120:0/3819258825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf700cc4f0 con 0x7fbf700cd400 2024-07-27T03:08:27.570 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.561+0000 7fbf677fe640 1 -- 172.21.15.120:0/3819258825 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7fbf600099c0 con 0x7fbf700cd400 2024-07-27T03:08:27.570 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.561+0000 7fbf677fe640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbf50076f80 0x7fbf50079490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:27.570 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.561+0000 7fbf677fe640 1 -- 172.21.15.120:0/3819258825 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3071+0+0 (secure 0 0 0) 0x7fbf60097b90 con 0x7fbf700cd400 2024-07-27T03:08:27.570 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.561+0000 7fbf6effd640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbf50076f80 0x7fbf50079490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:27.570 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.562+0000 7fbf6effd640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbf50076f80 0x7fbf50079490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800b450 tx=0x7fbf6800d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:27.571 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.568+0000 7fbf677fe640 1 -- 172.21.15.120:0/3819258825 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fbf700cc4f0 con 0x7fbf700cd400 2024-07-27T03:08:27.758 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.756+0000 7fbf75393640 1 -- 172.21.15.120:0/3819258825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf7015f9f0 con 0x7fbf700cd400 2024-07-27T03:08:27.759 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.756+0000 7fbf677fe640 1 -- 172.21.15.120:0/3819258825 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+11002 (secure 0 0 0) 0x7fbf60061390 con 0x7fbf700cd400 2024-07-27T03:08:27.759 INFO:teuthology.misc.health.smithi120.stdout: 2024-07-27T03:08:27.759 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":15,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:27.696473+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:08:27.761 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.758+0000 7fbf75393640 1 -- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbf50076f80 msgr2=0x7fbf50079490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:27.761 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.758+0000 7fbf75393640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbf50076f80 0x7fbf50079490 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800b450 tx=0x7fbf6800d040 comp rx=0 tx=0).stop 2024-07-27T03:08:27.761 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.758+0000 7fbf75393640 1 -- 172.21.15.120:0/3819258825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf700cd400 msgr2=0x7fbf7006ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:27.761 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.758+0000 7fbf75393640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf700cd400 0x7fbf7006ccc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf6000d690 tx=0x7fbf6000db50 comp rx=0 tx=0).stop 2024-07-27T03:08:27.761 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.758+0000 7fbf75393640 1 -- 172.21.15.120:0/3819258825 shutdown_connections 2024-07-27T03:08:27.761 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.758+0000 7fbf75393640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbf50076f80 0x7fbf50079490 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.761 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.758+0000 7fbf75393640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbf700cd400 0x7fbf7006ccc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.762 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.758+0000 7fbf75393640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf700c68a0 0x7fbf7006c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.762 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.758+0000 7fbf75393640 1 --2- 172.21.15.120:0/3819258825 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbf70073920 0x7fbf7015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.762 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.759+0000 7fbf75393640 1 -- 172.21.15.120:0/3819258825 >> 172.21.15.120:0/3819258825 conn(0x7fbf700d0df0 msgr2=0x7fbf7015ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:27.762 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.759+0000 7fbf75393640 1 -- 172.21.15.120:0/3819258825 shutdown_connections 2024-07-27T03:08:27.762 INFO:teuthology.misc.health.smithi120.stderr:2024-07-27T03:08:27.759+0000 7fbf75393640 1 -- 172.21.15.120:0/3819258825 wait complete. 2024-07-27T03:08:27.771 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-07-27T03:08:27.771 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-07-27T03:08:27.771 INFO:tasks.ceph.mds.a:Restarting daemon 2024-07-27T03:08:27.772 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-07-27T03:08:27.774 INFO:tasks.ceph.mds.a:Started 2024-07-27T03:08:27.774 INFO:tasks.ceph.mds.c:Restarting daemon 2024-07-27T03:08:27.774 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-07-27T03:08:27.776 INFO:tasks.ceph.mds.c:Started 2024-07-27T03:08:27.776 INFO:tasks.ceph.mds.b:Restarting daemon 2024-07-27T03:08:27.777 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-07-27T03:08:27.779 INFO:tasks.ceph.mds.b:Started 2024-07-27T03:08:27.780 INFO:tasks.ceph.mds.d:Restarting daemon 2024-07-27T03:08:27.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-07-27T03:08:27.782 INFO:tasks.ceph.mds.d:Started 2024-07-27T03:08:27.782 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-07-27T03:08:27.782 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:08:27.860 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-07-27T03:08:27.860 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-07-27T03:08:27.873 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-07-27T03:08:27.874 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-07-27T03:08:27.874 INFO:tasks.ceph.mds.d.smithi121.stderr:2024-07-27T03:08:27.869+0000 7f9b25938640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6836/0: (98) Address already in use 2024-07-27T03:08:27.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.900+0000 7ff9b43d9640 1 -- 172.21.15.120:0/721866179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9ac06c780 msgr2=0x7ff9ac06cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:27.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.900+0000 7ff9b43d9640 1 --2- 172.21.15.120:0/721866179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9ac06c780 0x7ff9ac06cb90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0098e0 tx=0x7ff99c02a5c0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.900+0000 7ff9b43d9640 1 -- 172.21.15.120:0/721866179 shutdown_connections 2024-07-27T03:08:27.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.900+0000 7ff9b43d9640 1 --2- 172.21.15.120:0/721866179 >> v2:172.21.15.121:3300/0 conn(0x7ff9ac156070 0x7ff9ac156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.900+0000 7ff9b43d9640 1 --2- 172.21.15.120:0/721866179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9ac06c780 0x7ff9ac06cb90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.900+0000 7ff9b43d9640 1 -- 172.21.15.120:0/721866179 >> 172.21.15.120:0/721866179 conn(0x7ff9ac0d0df0 msgr2=0x7ff9ac0d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:27.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.900+0000 7ff9b43d9640 1 -- 172.21.15.120:0/721866179 shutdown_connections 2024-07-27T03:08:27.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.900+0000 7ff9b43d9640 1 -- 172.21.15.120:0/721866179 wait complete. 2024-07-27T03:08:27.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.902+0000 7ff9b43d9640 1 Processor -- start 2024-07-27T03:08:27.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.902+0000 7ff9b43d9640 1 -- start start 2024-07-27T03:08:27.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b43d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9ac06c780 0x7ff9ac154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:27.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b43d9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9ac0718b0 0x7ff9ac1f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:27.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b43d9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9ac156070 0x7ff9ac1f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:27.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b43d9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0cee10 con 0x7ff9ac06c780 2024-07-27T03:08:27.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b43d9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0cec90 con 0x7ff9ac156070 2024-07-27T03:08:27.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b43d9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac1569c0 con 0x7ff9ac0718b0 2024-07-27T03:08:27.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b2175640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9ac06c780 0x7ff9ac154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:27.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b2175640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9ac06c780 0x7ff9ac154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56176/0 (socket says 172.21.15.120:56176) 2024-07-27T03:08:27.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b2175640 1 -- 172.21.15.120:0/4170678127 learned_addr learned my addr 172.21.15.120:0/4170678127 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b1974640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9ac0718b0 0x7ff9ac1f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b2976640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9ac156070 0x7ff9ac1f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b2175640 1 -- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9ac0718b0 msgr2=0x7ff9ac1f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b2175640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9ac0718b0 0x7ff9ac1f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b2175640 1 -- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9ac156070 msgr2=0x7ff9ac1f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b2175640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9ac156070 0x7ff9ac1f2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.903+0000 7ff9b2175640 1 -- 172.21.15.120:0/4170678127 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac0b59d0 con 0x7ff9ac06c780 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.904+0000 7ff9b2175640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9ac06c780 0x7ff9ac154fc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c440 tx=0x7ff9a800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.904+0000 7ff9a2ffd640 1 -- 172.21.15.120:0/4170678127 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8017070 con 0x7ff9ac06c780 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.904+0000 7ff9a2ffd640 1 -- 172.21.15.120:0/4170678127 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9a80035f0 con 0x7ff9ac06c780 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.904+0000 7ff9b43d9640 1 -- 172.21.15.120:0/4170678127 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac0b5cb0 con 0x7ff9ac06c780 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.904+0000 7ff9a2ffd640 1 -- 172.21.15.120:0/4170678127 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8003a40 con 0x7ff9ac06c780 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.904+0000 7ff9b43d9640 1 -- 172.21.15.120:0/4170678127 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac154ce0 con 0x7ff9ac06c780 2024-07-27T03:08:27.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.905+0000 7ff9b43d9640 1 -- 172.21.15.120:0/4170678127 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ac050a60 con 0x7ff9ac06c780 2024-07-27T03:08:27.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.905+0000 7ff9a2ffd640 1 -- 172.21.15.120:0/4170678127 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7ff9a801a070 con 0x7ff9ac06c780 2024-07-27T03:08:27.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.906+0000 7ff9a2ffd640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff990076f80 0x7ff990079490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:27.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.906+0000 7ff9a2ffd640 1 -- 172.21.15.120:0/4170678127 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4471+0+0 (secure 0 0 0) 0x7ff9a8097630 con 0x7ff9ac06c780 2024-07-27T03:08:27.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.906+0000 7ff9b1974640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff990076f80 0x7ff990079490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:27.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.906+0000 7ff9b1974640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff990076f80 0x7ff990079490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff99c034000 tx=0x7ff99c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:27.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:27.910+0000 7ff9a2ffd640 1 -- 172.21.15.120:0/4170678127 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff9ac050a60 con 0x7ff9ac06c780 2024-07-27T03:08:28.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.131+0000 7ff9b43d9640 1 -- 172.21.15.120:0/4170678127 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9ac06cb90 con 0x7ff9ac06c780 2024-07-27T03:08:28.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.131+0000 7ff9a2ffd640 1 -- 172.21.15.120:0/4170678127 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7ff9a80607a0 con 0x7ff9ac06c780 2024-07-27T03:08:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:28.134 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":2,"btime":"2024-07-27T03:08:27:863301+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4359,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/552629761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":552629761},{"type":"v1","addr":"172.21.15.120:6835","nonce":552629761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-07-27T03:08:28.134 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 2 2024-07-27T03:08:28.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 -- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff990076f80 msgr2=0x7ff990079490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:28.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff990076f80 0x7ff990079490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff99c034000 tx=0x7ff99c004730 comp rx=0 tx=0).stop 2024-07-27T03:08:28.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 -- 172.21.15.120:0/4170678127 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9ac06c780 msgr2=0x7ff9ac154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:28.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9ac06c780 0x7ff9ac154fc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c440 tx=0x7ff9a800c900 comp rx=0 tx=0).stop 2024-07-27T03:08:28.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 -- 172.21.15.120:0/4170678127 shutdown_connections 2024-07-27T03:08:28.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff990076f80 0x7ff990079490 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:28.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9ac156070 0x7ff9ac1f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:28.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9ac0718b0 0x7ff9ac1f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:28.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 --2- 172.21.15.120:0/4170678127 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9ac06c780 0x7ff9ac154fc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:28.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 -- 172.21.15.120:0/4170678127 >> 172.21.15.120:0/4170678127 conn(0x7ff9ac0d0df0 msgr2=0x7ff9ac0d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:28.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 -- 172.21.15.120:0/4170678127 shutdown_connections 2024-07-27T03:08:28.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:28.133+0000 7ff9b43d9640 1 -- 172.21.15.120:0/4170678127 wait complete. 2024-07-27T03:08:30.147 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:08:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.273+0000 7f130c6a7640 1 -- 172.21.15.120:0/1674459003 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1304071cf0 msgr2=0x7f1304074040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.273+0000 7f130c6a7640 1 --2- 172.21.15.120:0/1674459003 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1304071cf0 0x7f1304074040 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f12f8005fd0 tx=0x7f12f802a540 comp rx=0 tx=0).stop 2024-07-27T03:08:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.273+0000 7f130c6a7640 1 -- 172.21.15.120:0/1674459003 shutdown_connections 2024-07-27T03:08:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.273+0000 7f130c6a7640 1 --2- 172.21.15.120:0/1674459003 >> v2:172.21.15.121:3300/0 conn(0x7f13040b4d30 0x7f1304158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.273+0000 7f130c6a7640 1 --2- 172.21.15.120:0/1674459003 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1304071cf0 0x7f1304074040 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.273+0000 7f130c6a7640 1 -- 172.21.15.120:0/1674459003 >> 172.21.15.120:0/1674459003 conn(0x7f13040d0f00 msgr2=0x7f13040d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.273+0000 7f130c6a7640 1 -- 172.21.15.120:0/1674459003 shutdown_connections 2024-07-27T03:08:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.273+0000 7f130c6a7640 1 -- 172.21.15.120:0/1674459003 wait complete. 2024-07-27T03:08:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.275+0000 7f130c6a7640 1 Processor -- start 2024-07-27T03:08:30.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.275+0000 7f130c6a7640 1 -- start start 2024-07-27T03:08:30.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.276+0000 7f130c6a7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13040b4d30 0x7f13040c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.276+0000 7f130c6a7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f130415c500 0x7f1304151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.276+0000 7f130c6a7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13040cc8c0 0x7f13040cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.276+0000 7f130c6a7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f13040703e0 con 0x7f13040cc8c0 2024-07-27T03:08:30.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.276+0000 7f130c6a7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1304070260 con 0x7f130415c500 2024-07-27T03:08:30.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.276+0000 7f130c6a7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1304070560 con 0x7f13040b4d30 2024-07-27T03:08:30.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130ac44640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13040cc8c0 0x7f13040cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130ac44640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13040cc8c0 0x7f13040cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56190/0 (socket says 172.21.15.120:56190) 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130ac44640 1 -- 172.21.15.120:0/327556903 learned_addr learned my addr 172.21.15.120:0/327556903 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f1309c42640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f130415c500 0x7f1304151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130a443640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13040b4d30 0x7f13040c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130ac44640 1 -- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13040b4d30 msgr2=0x7f13040c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130ac44640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13040b4d30 0x7f13040c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130ac44640 1 -- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f130415c500 msgr2=0x7f1304151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130ac44640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f130415c500 0x7f1304151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130ac44640 1 -- 172.21.15.120:0/327556903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13040cd210 con 0x7f13040cc8c0 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130ac44640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13040cc8c0 0x7f13040cccd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00be00 tx=0x7f12fc00e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f1302ffd640 1 -- 172.21.15.120:0/327556903 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc01a030 con 0x7f13040cc8c0 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f1302ffd640 1 -- 172.21.15.120:0/327556903 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12fc00edf0 con 0x7f13040cc8c0 2024-07-27T03:08:30.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130c6a7640 1 -- 172.21.15.120:0/327556903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13040c6940 con 0x7f13040cc8c0 2024-07-27T03:08:30.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f1302ffd640 1 -- 172.21.15.120:0/327556903 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc003bd0 con 0x7f13040cc8c0 2024-07-27T03:08:30.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.277+0000 7f130c6a7640 1 -- 172.21.15.120:0/327556903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1304159730 con 0x7f13040cc8c0 2024-07-27T03:08:30.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.278+0000 7f130c6a7640 1 -- 172.21.15.120:0/327556903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f130415d590 con 0x7f13040cc8c0 2024-07-27T03:08:30.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.279+0000 7f1302ffd640 1 -- 172.21.15.120:0/327556903 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7f12fc01d070 con 0x7f13040cc8c0 2024-07-27T03:08:30.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.280+0000 7f1302ffd640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f12f0076fb0 0x7f12f00794c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.280+0000 7f1302ffd640 1 -- 172.21.15.120:0/327556903 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f12fc09aa80 con 0x7f13040cc8c0 2024-07-27T03:08:30.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.280+0000 7f130a443640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f12f0076fb0 0x7f12f00794c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.280+0000 7f130a443640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f12f0076fb0 0x7f12f00794c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f12f4001720 tx=0x7f12f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:30.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.284+0000 7f1302ffd640 1 -- 172.21.15.120:0/327556903 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f130415d590 con 0x7f13040cc8c0 2024-07-27T03:08:30.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.503+0000 7f130c6a7640 1 -- 172.21.15.120:0/327556903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1304154cb0 con 0x7f13040cc8c0 2024-07-27T03:08:30.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.503+0000 7f1302ffd640 1 -- 172.21.15.120:0/327556903 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7f12fc09ae20 con 0x7f13040cc8c0 2024-07-27T03:08:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:30.507 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":3,"btime":"2024-07-27T03:08:28:864331+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/4223514676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4223514676},{"type":"v1","addr":"172.21.15.120:6834","nonce":4223514676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1736241961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1736241961},{"type":"v1","addr":"172.21.15.121:6837","nonce":1736241961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/625386978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":625386978},{"type":"v1","addr":"172.21.15.121:6836","nonce":625386978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4359,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/552629761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":552629761},{"type":"v1","addr":"172.21.15.120:6835","nonce":552629761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-07-27T03:08:30.507 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 3 2024-07-27T03:08:30.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.505+0000 7f130c6a7640 1 -- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f12f0076fb0 msgr2=0x7f12f00794c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.505+0000 7f130c6a7640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f12f0076fb0 0x7f12f00794c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f12f4001720 tx=0x7f12f4009040 comp rx=0 tx=0).stop 2024-07-27T03:08:30.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.505+0000 7f130c6a7640 1 -- 172.21.15.120:0/327556903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13040cc8c0 msgr2=0x7f13040cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.505+0000 7f130c6a7640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13040cc8c0 0x7f13040cccd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00be00 tx=0x7f12fc00e490 comp rx=0 tx=0).stop 2024-07-27T03:08:30.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.505+0000 7f130c6a7640 1 -- 172.21.15.120:0/327556903 shutdown_connections 2024-07-27T03:08:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.505+0000 7f130c6a7640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f12f0076fb0 0x7f12f00794c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.505+0000 7f130c6a7640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13040cc8c0 0x7f13040cccd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.505+0000 7f130c6a7640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f130415c500 0x7f1304151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.505+0000 7f130c6a7640 1 --2- 172.21.15.120:0/327556903 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13040b4d30 0x7f13040c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.505+0000 7f130c6a7640 1 -- 172.21.15.120:0/327556903 >> 172.21.15.120:0/327556903 conn(0x7f13040d0f00 msgr2=0x7f130406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.506+0000 7f130c6a7640 1 -- 172.21.15.120:0/327556903 shutdown_connections 2024-07-27T03:08:30.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.506+0000 7f130c6a7640 1 -- 172.21.15.120:0/327556903 wait complete. 2024-07-27T03:08:30.520 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-07-27T03:08:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.634+0000 7f5caa7ab640 1 -- 172.21.15.120:0/474182522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ca40d28f0 msgr2=0x7f5ca40cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.634+0000 7f5caa7ab640 1 --2- 172.21.15.120:0/474182522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ca40d28f0 0x7f5ca40cd940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c98005fd0 tx=0x7f5c9802a5f0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.634+0000 7f5caa7ab640 1 -- 172.21.15.120:0/474182522 shutdown_connections 2024-07-27T03:08:30.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.634+0000 7f5caa7ab640 1 --2- 172.21.15.120:0/474182522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ca40d28f0 0x7f5ca40cd940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.634+0000 7f5caa7ab640 1 -- 172.21.15.120:0/474182522 >> 172.21.15.120:0/474182522 conn(0x7f5ca40d1dd0 msgr2=0x7f5ca40d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:30.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.634+0000 7f5caa7ab640 1 -- 172.21.15.120:0/474182522 shutdown_connections 2024-07-27T03:08:30.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.634+0000 7f5caa7ab640 1 -- 172.21.15.120:0/474182522 wait complete. 2024-07-27T03:08:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.635+0000 7f5caa7ab640 1 Processor -- start 2024-07-27T03:08:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.636+0000 7f5caa7ab640 1 -- start start 2024-07-27T03:08:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5caa7ab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ca40b75b0 0x7f5ca40cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5caa7ab640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ca40ce840 0x7f5ca415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5caa7ab640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ca40d28f0 0x7f5ca41645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5caa7ab640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4167ab0 con 0x7f5ca40d28f0 2024-07-27T03:08:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5caa7ab640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca40b1fc0 con 0x7f5ca40b75b0 2024-07-27T03:08:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5caa7ab640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca4167c30 con 0x7f5ca40ce840 2024-07-27T03:08:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5ca8d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ca40d28f0 0x7f5ca41645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5ca8d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ca40d28f0 0x7f5ca41645d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56208/0 (socket says 172.21.15.120:56208) 2024-07-27T03:08:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5ca8d48640 1 -- 172.21.15.120:0/2597468833 learned_addr learned my addr 172.21.15.120:0/2597468833 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5ca3fff640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ca40b75b0 0x7f5ca40cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5ca37fe640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ca40ce840 0x7f5ca415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5ca8d48640 1 -- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ca40ce840 msgr2=0x7f5ca415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5ca8d48640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ca40ce840 0x7f5ca415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5ca8d48640 1 -- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ca40b75b0 msgr2=0x7f5ca40cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5ca8d48640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ca40b75b0 0x7f5ca40cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.637+0000 7f5ca8d48640 1 -- 172.21.15.120:0/2597468833 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca40cbc70 con 0x7f5ca40d28f0 2024-07-27T03:08:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.638+0000 7f5ca8d48640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ca40d28f0 0x7f5ca41645d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c6e0 tx=0x7f5c9c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.638+0000 7f5ca0ff9640 1 -- 172.21.15.120:0/2597468833 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c003b70 con 0x7f5ca40d28f0 2024-07-27T03:08:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.638+0000 7f5ca0ff9640 1 -- 172.21.15.120:0/2597468833 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c9c003d10 con 0x7f5ca40d28f0 2024-07-27T03:08:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.638+0000 7f5ca0ff9640 1 -- 172.21.15.120:0/2597468833 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c005330 con 0x7f5ca40d28f0 2024-07-27T03:08:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.638+0000 7f5caa7ab640 1 -- 172.21.15.120:0/2597468833 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca41f3930 con 0x7f5ca40d28f0 2024-07-27T03:08:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.638+0000 7f5caa7ab640 1 -- 172.21.15.120:0/2597468833 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca41f46b0 con 0x7f5ca40d28f0 2024-07-27T03:08:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.639+0000 7f5caa7ab640 1 -- 172.21.15.120:0/2597468833 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca40cb9e0 con 0x7f5ca40d28f0 2024-07-27T03:08:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.640+0000 7f5ca0ff9640 1 -- 172.21.15.120:0/2597468833 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7f5c9c0054d0 con 0x7f5ca40d28f0 2024-07-27T03:08:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.640+0000 7f5ca0ff9640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c90076fb0 0x7f5c900794c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.640+0000 7f5ca0ff9640 1 -- 172.21.15.120:0/2597468833 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5c9c098200 con 0x7f5ca40d28f0 2024-07-27T03:08:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.640+0000 7f5ca3fff640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c90076fb0 0x7f5c900794c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.641+0000 7f5ca3fff640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c90076fb0 0x7f5c900794c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c94000f60 tx=0x7f5c94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.645+0000 7f5ca0ff9640 1 -- 172.21.15.120:0/2597468833 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5c9c0611f0 con 0x7f5ca40d28f0 2024-07-27T03:08:30.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.842+0000 7f5caa7ab640 1 -- 172.21.15.120:0/2597468833 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5ca40d0790 con 0x7f5ca40d28f0 2024-07-27T03:08:30.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.843+0000 7f5ca0ff9640 1 -- 172.21.15.120:0/2597468833 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f5c9c065740 con 0x7f5ca40d28f0 2024-07-27T03:08:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:30.847 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-07-27T03:08:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:08:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2024-07-27T03:08:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2024-07-27T03:08:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:08:30.847 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-07-27T03:08:30.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 -- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c90076fb0 msgr2=0x7f5c900794c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c90076fb0 0x7f5c900794c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c94000f60 tx=0x7f5c94009040 comp rx=0 tx=0).stop 2024-07-27T03:08:30.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 -- 172.21.15.120:0/2597468833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ca40d28f0 msgr2=0x7f5ca41645d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ca40d28f0 0x7f5ca41645d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c6e0 tx=0x7f5c9c00cba0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 -- 172.21.15.120:0/2597468833 shutdown_connections 2024-07-27T03:08:30.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c90076fb0 0x7f5c900794c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ca40d28f0 0x7f5ca41645d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ca40ce840 0x7f5ca415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 --2- 172.21.15.120:0/2597468833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ca40b75b0 0x7f5ca40cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 -- 172.21.15.120:0/2597468833 >> 172.21.15.120:0/2597468833 conn(0x7f5ca40d1dd0 msgr2=0x7f5ca40d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:30.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 -- 172.21.15.120:0/2597468833 shutdown_connections 2024-07-27T03:08:30.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.845+0000 7f5caa7ab640 1 -- 172.21.15.120:0/2597468833 wait complete. 2024-07-27T03:08:30.859 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-07-27T03:08:30.859 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-07-27T03:08:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.979+0000 7f145d59a640 1 -- 172.21.15.120:0/1526320509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1458071aa0 msgr2=0x7f145815fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.979+0000 7f145d59a640 1 --2- 172.21.15.120:0/1526320509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1458071aa0 0x7f145815fc70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1448009860 tx=0x7f144802a530 comp rx=0 tx=0).stop 2024-07-27T03:08:30.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.980+0000 7f145d59a640 1 -- 172.21.15.120:0/1526320509 shutdown_connections 2024-07-27T03:08:30.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.980+0000 7f145d59a640 1 --2- 172.21.15.120:0/1526320509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1458071aa0 0x7f145815fc70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.980+0000 7f145d59a640 1 -- 172.21.15.120:0/1526320509 >> 172.21.15.120:0/1526320509 conn(0x7f14580b2c00 msgr2=0x7f14580b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:30.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.980+0000 7f145d59a640 1 -- 172.21.15.120:0/1526320509 shutdown_connections 2024-07-27T03:08:30.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.980+0000 7f145d59a640 1 -- 172.21.15.120:0/1526320509 wait complete. 2024-07-27T03:08:30.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.981+0000 7f145d59a640 1 Processor -- start 2024-07-27T03:08:30.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.981+0000 7f145d59a640 1 -- start start 2024-07-27T03:08:30.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f145d59a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1458071aa0 0x7f14581e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f145d59a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14581601b0 0x7f14581f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f145d59a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1458150e50 0x7f14581e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f145d59a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f145815de70 con 0x7f1458150e50 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f145d59a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f145815dcf0 con 0x7f14581601b0 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f145d59a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f145815dff0 con 0x7f1458071aa0 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f14577fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1458150e50 0x7f14581e59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f1456ffd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1458071aa0 0x7f14581e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f14577fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1458150e50 0x7f14581e59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56212/0 (socket says 172.21.15.120:56212) 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f14577fe640 1 -- 172.21.15.120:0/3048951956 learned_addr learned my addr 172.21.15.120:0/3048951956 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f144ffff640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14581601b0 0x7f14581f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f14577fe640 1 -- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1458071aa0 msgr2=0x7f14581e6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f14577fe640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1458071aa0 0x7f14581e6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f14577fe640 1 -- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14581601b0 msgr2=0x7f14581f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f14577fe640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14581601b0 0x7f14581f37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f14577fe640 1 -- 172.21.15.120:0/3048951956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14581e7350 con 0x7f1458150e50 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f1456ffd640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1458071aa0 0x7f14581e6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:30.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f14577fe640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1458150e50 0x7f14581e59e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f145000cb70 tx=0x7f145000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:30.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f144f7fe640 1 -- 172.21.15.120:0/3048951956 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145000ad40 con 0x7f1458150e50 2024-07-27T03:08:30.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f144f7fe640 1 -- 172.21.15.120:0/3048951956 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1450017070 con 0x7f1458150e50 2024-07-27T03:08:30.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f145d59a640 1 -- 172.21.15.120:0/3048951956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14581f3ce0 con 0x7f1458150e50 2024-07-27T03:08:30.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f144f7fe640 1 -- 172.21.15.120:0/3048951956 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450012660 con 0x7f1458150e50 2024-07-27T03:08:30.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.983+0000 7f145d59a640 1 -- 172.21.15.120:0/3048951956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1458150090 con 0x7f1458150e50 2024-07-27T03:08:30.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.985+0000 7f145d59a640 1 -- 172.21.15.120:0/3048951956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f145815fc70 con 0x7f1458150e50 2024-07-27T03:08:30.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.985+0000 7f144f7fe640 1 -- 172.21.15.120:0/3048951956 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7f1450012800 con 0x7f1458150e50 2024-07-27T03:08:30.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.986+0000 7f144f7fe640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1438076fb0 0x7f14380794c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:30.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.986+0000 7f144f7fe640 1 -- 172.21.15.120:0/3048951956 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f14500987f0 con 0x7f1458150e50 2024-07-27T03:08:30.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.986+0000 7f1456ffd640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1438076fb0 0x7f14380794c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:30.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.986+0000 7f1456ffd640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1438076fb0 0x7f14380794c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1448034000 tx=0x7f1448004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:30.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:30.990+0000 7f144f7fe640 1 -- 172.21.15.120:0/3048951956 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f14581f3ce0 con 0x7f1458150e50 2024-07-27T03:08:31.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.180+0000 7f145d59a640 1 -- 172.21.15.120:0/3048951956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f145814fb10 con 0x7f1458150e50 2024-07-27T03:08:31.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.915+0000 7f144f7fe640 1 -- 172.21.15.120:0/3048951956 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f14500618f0 con 0x7f1458150e50 2024-07-27T03:08:31.919 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2024-07-27T03:08:31.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.918+0000 7f145d59a640 1 -- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1438076fb0 msgr2=0x7f14380794c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:31.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.918+0000 7f145d59a640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1438076fb0 0x7f14380794c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1448034000 tx=0x7f1448004730 comp rx=0 tx=0).stop 2024-07-27T03:08:31.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.918+0000 7f145d59a640 1 -- 172.21.15.120:0/3048951956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1458150e50 msgr2=0x7f14581e59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:31.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.918+0000 7f145d59a640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1458150e50 0x7f14581e59e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f145000cb70 tx=0x7f145000a430 comp rx=0 tx=0).stop 2024-07-27T03:08:31.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.918+0000 7f145d59a640 1 -- 172.21.15.120:0/3048951956 shutdown_connections 2024-07-27T03:08:31.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.918+0000 7f145d59a640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1438076fb0 0x7f14380794c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:31.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.918+0000 7f145d59a640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1458150e50 0x7f14581e59e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:31.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.918+0000 7f145d59a640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14581601b0 0x7f14581f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:31.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.918+0000 7f145d59a640 1 --2- 172.21.15.120:0/3048951956 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1458071aa0 0x7f14581e6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:31.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.918+0000 7f145d59a640 1 -- 172.21.15.120:0/3048951956 >> 172.21.15.120:0/3048951956 conn(0x7f14580b2c00 msgr2=0x7f14580d16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:31.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.919+0000 7f145d59a640 1 -- 172.21.15.120:0/3048951956 shutdown_connections 2024-07-27T03:08:31.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:31.919+0000 7f145d59a640 1 -- 172.21.15.120:0/3048951956 wait complete. 2024-07-27T03:08:31.941 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-07-27T03:08:32.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.064+0000 7fc17a2e9640 1 -- 172.21.15.120:0/1593863453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1740b4740 msgr2=0x7fc1740b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:32.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.064+0000 7fc17a2e9640 1 --2- 172.21.15.120:0/1593863453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1740b4740 0x7fc1740b2c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc164005fd0 tx=0x7fc16402a5d0 comp rx=0 tx=0).stop 2024-07-27T03:08:32.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.064+0000 7fc17a2e9640 1 -- 172.21.15.120:0/1593863453 shutdown_connections 2024-07-27T03:08:32.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.064+0000 7fc17a2e9640 1 --2- 172.21.15.120:0/1593863453 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1740d27e0 0x7fc1740d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:32.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.064+0000 7fc17a2e9640 1 --2- 172.21.15.120:0/1593863453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1740b4740 0x7fc1740b2c40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:32.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.064+0000 7fc17a2e9640 1 -- 172.21.15.120:0/1593863453 >> 172.21.15.120:0/1593863453 conn(0x7fc17408d690 msgr2=0x7fc17409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:32.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.064+0000 7fc17a2e9640 1 -- 172.21.15.120:0/1593863453 shutdown_connections 2024-07-27T03:08:32.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.064+0000 7fc17a2e9640 1 -- 172.21.15.120:0/1593863453 wait complete. 2024-07-27T03:08:32.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.066+0000 7fc17a2e9640 1 Processor -- start 2024-07-27T03:08:32.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.066+0000 7fc17a2e9640 1 -- start start 2024-07-27T03:08:32.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc17a2e9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740b4740 0x7fc1741525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:32.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc17a2e9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1740d09c0 0x7fc1740cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:32.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc17a2e9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1740d27e0 0x7fc1740cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:32.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc17a2e9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc1740cef70 con 0x7fc1740b4740 2024-07-27T03:08:32.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc17a2e9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc1740cedf0 con 0x7fc1740d27e0 2024-07-27T03:08:32.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc17a2e9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc1740cf0f0 con 0x7fc1740d09c0 2024-07-27T03:08:32.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc173fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740b4740 0x7fc1741525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc173fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740b4740 0x7fc1741525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40710/0 (socket says 172.21.15.120:40710) 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc173fff640 1 -- 172.21.15.120:0/2444921514 learned_addr learned my addr 172.21.15.120:0/2444921514 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc1737fe640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1740d09c0 0x7fc1740cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc178886640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1740d27e0 0x7fc1740cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc173fff640 1 -- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1740d09c0 msgr2=0x7fc1740cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc173fff640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1740d09c0 0x7fc1740cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc173fff640 1 -- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1740d27e0 msgr2=0x7fc1740cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc173fff640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1740d27e0 0x7fc1740cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc173fff640 1 -- 172.21.15.120:0/2444921514 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1740ce050 con 0x7fc1740b4740 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc173fff640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740b4740 0x7fc1741525c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc164000c00 tx=0x7fc1640035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc170ff9640 1 -- 172.21.15.120:0/2444921514 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16403e030 con 0x7fc1740b4740 2024-07-27T03:08:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc170ff9640 1 -- 172.21.15.120:0/2444921514 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc164003ae0 con 0x7fc1740b4740 2024-07-27T03:08:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc170ff9640 1 -- 172.21.15.120:0/2444921514 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164035040 con 0x7fc1740b4740 2024-07-27T03:08:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.068+0000 7fc17a2e9640 1 -- 172.21.15.120:0/2444921514 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1740caff0 con 0x7fc1740b4740 2024-07-27T03:08:32.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.069+0000 7fc17a2e9640 1 -- 172.21.15.120:0/2444921514 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1740cb5b0 con 0x7fc1740b4740 2024-07-27T03:08:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.069+0000 7fc17a2e9640 1 -- 172.21.15.120:0/2444921514 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1740d2bf0 con 0x7fc1740b4740 2024-07-27T03:08:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.070+0000 7fc170ff9640 1 -- 172.21.15.120:0/2444921514 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7fc164041030 con 0x7fc1740b4740 2024-07-27T03:08:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.071+0000 7fc170ff9640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc154076fb0 0x7fc1540794c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.071+0000 7fc170ff9640 1 -- 172.21.15.120:0/2444921514 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7fc1640b8d70 con 0x7fc1740b4740 2024-07-27T03:08:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.071+0000 7fc1737fe640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc154076fb0 0x7fc1540794c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:32.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.071+0000 7fc1737fe640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc154076fb0 0x7fc1540794c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1740b4490 tx=0x7fc15c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:32.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.075+0000 7fc170ff9640 1 -- 172.21.15.120:0/2444921514 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc164081cc0 con 0x7fc1740b4740 2024-07-27T03:08:32.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.257+0000 7fc17a2e9640 1 -- 172.21.15.120:0/2444921514 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc17408e050 con 0x7fc1740b4740 2024-07-27T03:08:32.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.923+0000 7fc170ff9640 1 -- 172.21.15.120:0/2444921514 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7fc164086210 con 0x7fc1740b4740 2024-07-27T03:08:32.927 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2024-07-27T03:08:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.925+0000 7fc17a2e9640 1 -- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc154076fb0 msgr2=0x7fc1540794c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:32.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.925+0000 7fc17a2e9640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc154076fb0 0x7fc1540794c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1740b4490 tx=0x7fc15c005f90 comp rx=0 tx=0).stop 2024-07-27T03:08:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.925+0000 7fc17a2e9640 1 -- 172.21.15.120:0/2444921514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740b4740 msgr2=0x7fc1741525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.925+0000 7fc17a2e9640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740b4740 0x7fc1741525c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc164000c00 tx=0x7fc1640035f0 comp rx=0 tx=0).stop 2024-07-27T03:08:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.926+0000 7fc17a2e9640 1 -- 172.21.15.120:0/2444921514 shutdown_connections 2024-07-27T03:08:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.926+0000 7fc17a2e9640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc154076fb0 0x7fc1540794c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.926+0000 7fc17a2e9640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1740d27e0 0x7fc1740cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.926+0000 7fc17a2e9640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc1740d09c0 0x7fc1740cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.926+0000 7fc17a2e9640 1 --2- 172.21.15.120:0/2444921514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1740b4740 0x7fc1741525c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.926+0000 7fc17a2e9640 1 -- 172.21.15.120:0/2444921514 >> 172.21.15.120:0/2444921514 conn(0x7fc17408d690 msgr2=0x7fc1740b8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.926+0000 7fc17a2e9640 1 -- 172.21.15.120:0/2444921514 shutdown_connections 2024-07-27T03:08:32.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:32.926+0000 7fc17a2e9640 1 -- 172.21.15.120:0/2444921514 wait complete. 2024-07-27T03:08:32.951 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-07-27T03:08:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.066+0000 7eff04691640 1 -- 172.21.15.120:0/1329725928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efefc0b7050 msgr2=0x7efefc0cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.066+0000 7eff04691640 1 --2- 172.21.15.120:0/1329725928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efefc0b7050 0x7efefc0cc9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efefc0699d0 tx=0x7efeec02a8b0 comp rx=0 tx=0).stop 2024-07-27T03:08:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.066+0000 7eff04691640 1 -- 172.21.15.120:0/1329725928 shutdown_connections 2024-07-27T03:08:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.066+0000 7eff04691640 1 --2- 172.21.15.120:0/1329725928 >> v2:172.21.15.121:3300/0 conn(0x7efefc0cee40 0x7efefc0cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.066+0000 7eff04691640 1 --2- 172.21.15.120:0/1329725928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efefc0b7050 0x7efefc0cc9c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.066+0000 7eff04691640 1 -- 172.21.15.120:0/1329725928 >> 172.21.15.120:0/1329725928 conn(0x7efefc0d1e40 msgr2=0x7efefc0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:33.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.066+0000 7eff04691640 1 -- 172.21.15.120:0/1329725928 shutdown_connections 2024-07-27T03:08:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.066+0000 7eff04691640 1 -- 172.21.15.120:0/1329725928 wait complete. 2024-07-27T03:08:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.068+0000 7eff04691640 1 Processor -- start 2024-07-27T03:08:33.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.068+0000 7eff04691640 1 -- start start 2024-07-27T03:08:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.069+0000 7eff04691640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efefc0b7050 0x7efefc06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.069+0000 7eff04691640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efefc0cea30 0x7efefc0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.069+0000 7eff04691640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efefc0cee40 0x7efefc0b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.069+0000 7eff04691640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efefc070d40 con 0x7efefc0cea30 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.069+0000 7eff04691640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efefc070bc0 con 0x7efefc0b7050 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.069+0000 7eff04691640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efefc0d1990 con 0x7efefc0cee40 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.069+0000 7eff01c2c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efefc0cea30 0x7efefc0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.069+0000 7eff01c2c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efefc0cea30 0x7efefc0b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40726/0 (socket says 172.21.15.120:40726) 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.069+0000 7eff01c2c640 1 -- 172.21.15.120:0/3653892609 learned_addr learned my addr 172.21.15.120:0/3653892609 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.069+0000 7eff0242d640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efefc0b7050 0x7efefc06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7eff02c2e640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efefc0cee40 0x7efefc0b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7eff01c2c640 1 -- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efefc0cee40 msgr2=0x7efefc0b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7eff01c2c640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efefc0cee40 0x7efefc0b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7eff01c2c640 1 -- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efefc0b7050 msgr2=0x7efefc06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7eff01c2c640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efefc0b7050 0x7efefc06eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:33.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7eff01c2c640 1 -- 172.21.15.120:0/3653892609 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc06de50 con 0x7efefc0cea30 2024-07-27T03:08:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7eff0242d640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efefc0b7050 0x7efefc06eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7eff01c2c640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efefc0cea30 0x7efefc0b0ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efef000c370 tx=0x7efef000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7efefaffd640 1 -- 172.21.15.120:0/3653892609 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef0017070 con 0x7efefc0cea30 2024-07-27T03:08:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7efefaffd640 1 -- 172.21.15.120:0/3653892609 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efef00035f0 con 0x7efefc0cea30 2024-07-27T03:08:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7eff04691640 1 -- 172.21.15.120:0/3653892609 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efefc06e130 con 0x7efefc0cea30 2024-07-27T03:08:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7efefaffd640 1 -- 172.21.15.120:0/3653892609 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef0003a40 con 0x7efefc0cea30 2024-07-27T03:08:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.070+0000 7eff04691640 1 -- 172.21.15.120:0/3653892609 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efefc06e6f0 con 0x7efefc0cea30 2024-07-27T03:08:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.071+0000 7eff04691640 1 -- 172.21.15.120:0/3653892609 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efefc0cfd40 con 0x7efefc0cea30 2024-07-27T03:08:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.072+0000 7efefaffd640 1 -- 172.21.15.120:0/3653892609 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7efef001a070 con 0x7efefc0cea30 2024-07-27T03:08:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.072+0000 7efefaffd640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efee8077010 0x7efee8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.072+0000 7efefaffd640 1 -- 172.21.15.120:0/3653892609 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7efef0097ba0 con 0x7efefc0cea30 2024-07-27T03:08:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.072+0000 7eff0242d640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efee8077010 0x7efee8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.073+0000 7eff0242d640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efee8077010 0x7efee8079520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efeec034000 tx=0x7efeec004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.077+0000 7efefaffd640 1 -- 172.21.15.120:0/3653892609 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7efef0060e90 con 0x7efefc0cea30 2024-07-27T03:08:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.297+0000 7eff04691640 1 -- 172.21.15.120:0/3653892609 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7efefc0b2ad0 con 0x7efefc0cea30 2024-07-27T03:08:33.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.925+0000 7efefaffd640 1 -- 172.21.15.120:0/3653892609 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7efef00690d0 con 0x7efefc0cea30 2024-07-27T03:08:33.928 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 2 and data pool 3 2024-07-27T03:08:33.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.929+0000 7eff04691640 1 -- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efee8077010 msgr2=0x7efee8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:33.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.929+0000 7eff04691640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efee8077010 0x7efee8079520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efeec034000 tx=0x7efeec004ab0 comp rx=0 tx=0).stop 2024-07-27T03:08:33.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.929+0000 7eff04691640 1 -- 172.21.15.120:0/3653892609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efefc0cea30 msgr2=0x7efefc0b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:33.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.929+0000 7eff04691640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efefc0cea30 0x7efefc0b0ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efef000c370 tx=0x7efef000c830 comp rx=0 tx=0).stop 2024-07-27T03:08:33.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.930+0000 7eff04691640 1 -- 172.21.15.120:0/3653892609 shutdown_connections 2024-07-27T03:08:33.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.930+0000 7eff04691640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efee8077010 0x7efee8079520 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:33.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.930+0000 7eff04691640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efefc0cea30 0x7efefc0b0ab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:33.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.930+0000 7eff04691640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efefc0cee40 0x7efefc0b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:33.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.930+0000 7eff04691640 1 --2- 172.21.15.120:0/3653892609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efefc0b7050 0x7efefc06eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:33.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.930+0000 7eff04691640 1 -- 172.21.15.120:0/3653892609 >> 172.21.15.120:0/3653892609 conn(0x7efefc0d1e40 msgr2=0x7efefc0b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:33.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.931+0000 7eff04691640 1 -- 172.21.15.120:0/3653892609 shutdown_connections 2024-07-27T03:08:33.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:33.933+0000 7eff04691640 1 -- 172.21.15.120:0/3653892609 wait complete. 2024-07-27T03:08:33.965 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:08:34.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.076+0000 7fce77f6f640 1 -- 172.21.15.120:0/1609530682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce7009b640 msgr2=0x7fce700b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.076+0000 7fce77f6f640 1 --2- 172.21.15.120:0/1609530682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce7009b640 0x7fce700b7110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0098e0 tx=0x7fce6c02a5d0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.076+0000 7fce77f6f640 1 -- 172.21.15.120:0/1609530682 shutdown_connections 2024-07-27T03:08:34.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.076+0000 7fce77f6f640 1 --2- 172.21.15.120:0/1609530682 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce7009b140 0x7fce700b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.076+0000 7fce77f6f640 1 --2- 172.21.15.120:0/1609530682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce7009b640 0x7fce700b7110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.076+0000 7fce77f6f640 1 -- 172.21.15.120:0/1609530682 >> 172.21.15.120:0/1609530682 conn(0x7fce700d20a0 msgr2=0x7fce700d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:34.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.076+0000 7fce77f6f640 1 -- 172.21.15.120:0/1609530682 shutdown_connections 2024-07-27T03:08:34.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.076+0000 7fce77f6f640 1 -- 172.21.15.120:0/1609530682 wait complete. 2024-07-27T03:08:34.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.077+0000 7fce77f6f640 1 Processor -- start 2024-07-27T03:08:34.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.078+0000 7fce77f6f640 1 -- start start 2024-07-27T03:08:34.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce77f6f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce7009b640 0x7fce7015d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce77f6f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce700cf4e0 0x7fce701f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce77f6f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce70158dc0 0x7fce7014ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce77f6f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fce700b5ab0 con 0x7fce700cf4e0 2024-07-27T03:08:34.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce77f6f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fce700b5930 con 0x7fce70158dc0 2024-07-27T03:08:34.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce77f6f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fce700b5c30 con 0x7fce7009b640 2024-07-27T03:08:34.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce7550a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce700cf4e0 0x7fce701f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce7550a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce700cf4e0 0x7fce701f2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40736/0 (socket says 172.21.15.120:40736) 2024-07-27T03:08:34.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce7550a640 1 -- 172.21.15.120:0/46749934 learned_addr learned my addr 172.21.15.120:0/46749934 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:34.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce7650c640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce70158dc0 0x7fce7014ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce75d0b640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce7009b640 0x7fce7015d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce7550a640 1 -- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce7009b640 msgr2=0x7fce7015d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce7550a640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce7009b640 0x7fce7015d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce7550a640 1 -- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce70158dc0 msgr2=0x7fce7014ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce7550a640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce70158dc0 0x7fce7014ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce7550a640 1 -- 172.21.15.120:0/46749934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce70159530 con 0x7fce700cf4e0 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce7550a640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce700cf4e0 0x7fce701f2fa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fce6000c3a0 tx=0x7fce6000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.079+0000 7fce667fc640 1 -- 172.21.15.120:0/46749934 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60017070 con 0x7fce700cf4e0 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.080+0000 7fce667fc640 1 -- 172.21.15.120:0/46749934 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce600053c0 con 0x7fce700cf4e0 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.080+0000 7fce667fc640 1 -- 172.21.15.120:0/46749934 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60003850 con 0x7fce700cf4e0 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.080+0000 7fce77f6f640 1 -- 172.21.15.120:0/46749934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce70159810 con 0x7fce700cf4e0 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.080+0000 7fce77f6f640 1 -- 172.21.15.120:0/46749934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce70159dd0 con 0x7fce700cf4e0 2024-07-27T03:08:34.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.080+0000 7fce77f6f640 1 -- 172.21.15.120:0/46749934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce700b60e0 con 0x7fce700cf4e0 2024-07-27T03:08:34.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.081+0000 7fce667fc640 1 -- 172.21.15.120:0/46749934 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fce6001a070 con 0x7fce700cf4e0 2024-07-27T03:08:34.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.082+0000 7fce667fc640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fce54077040 0x7fce54079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.082+0000 7fce667fc640 1 -- 172.21.15.120:0/46749934 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce60097c10 con 0x7fce700cf4e0 2024-07-27T03:08:34.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.082+0000 7fce75d0b640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fce54077040 0x7fce54079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.082+0000 7fce75d0b640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fce54077040 0x7fce54079550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce6c034000 tx=0x7fce6c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:34.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.086+0000 7fce667fc640 1 -- 172.21.15.120:0/46749934 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fce600607d0 con 0x7fce700cf4e0 2024-07-27T03:08:34.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.272+0000 7fce77f6f640 1 -- 172.21.15.120:0/46749934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce701592c0 con 0x7fce700cf4e0 2024-07-27T03:08:34.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.273+0000 7fce667fc640 1 -- 172.21.15.120:0/46749934 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16642 (secure 0 0 0) 0x7fce60069060 con 0x7fce700cf4e0 2024-07-27T03:08:34.277 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:34.277 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":21,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:33.299541+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:08:31.185623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-27T03:08:32.262408+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:08:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.275+0000 7fce77f6f640 1 -- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fce54077040 msgr2=0x7fce54079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.275+0000 7fce77f6f640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fce54077040 0x7fce54079550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fce6c034000 tx=0x7fce6c004730 comp rx=0 tx=0).stop 2024-07-27T03:08:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.275+0000 7fce77f6f640 1 -- 172.21.15.120:0/46749934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce700cf4e0 msgr2=0x7fce701f2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.275+0000 7fce77f6f640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce700cf4e0 0x7fce701f2fa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fce6000c3a0 tx=0x7fce6000c860 comp rx=0 tx=0).stop 2024-07-27T03:08:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.275+0000 7fce77f6f640 1 -- 172.21.15.120:0/46749934 shutdown_connections 2024-07-27T03:08:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.275+0000 7fce77f6f640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fce54077040 0x7fce54079550 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.275+0000 7fce77f6f640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce700cf4e0 0x7fce701f2fa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.275+0000 7fce77f6f640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce70158dc0 0x7fce7014ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.275+0000 7fce77f6f640 1 --2- 172.21.15.120:0/46749934 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fce7009b640 0x7fce7015d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.275+0000 7fce77f6f640 1 -- 172.21.15.120:0/46749934 >> 172.21.15.120:0/46749934 conn(0x7fce700d20a0 msgr2=0x7fce7009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.275+0000 7fce77f6f640 1 -- 172.21.15.120:0/46749934 shutdown_connections 2024-07-27T03:08:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.276+0000 7fce77f6f640 1 -- 172.21.15.120:0/46749934 wait complete. 2024-07-27T03:08:34.290 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:08:34.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.400+0000 7ff2959b9640 1 -- 172.21.15.120:0/1833176774 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2900b2c40 msgr2=0x7ff2900d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.400+0000 7ff2959b9640 1 --2- 172.21.15.120:0/1833176774 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2900b2c40 0x7ff2900d09c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff2900d24d0 tx=0x7ff27802a5f0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.400+0000 7ff2959b9640 1 -- 172.21.15.120:0/1833176774 shutdown_connections 2024-07-27T03:08:34.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.400+0000 7ff2959b9640 1 --2- 172.21.15.120:0/1833176774 >> v2:172.21.15.121:3300/0 conn(0x7ff2900d0f00 0x7ff2900cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.400+0000 7ff2959b9640 1 --2- 172.21.15.120:0/1833176774 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2900b2c40 0x7ff2900d09c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.400+0000 7ff2959b9640 1 -- 172.21.15.120:0/1833176774 >> 172.21.15.120:0/1833176774 conn(0x7ff29008d690 msgr2=0x7ff29009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:34.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.400+0000 7ff2959b9640 1 -- 172.21.15.120:0/1833176774 shutdown_connections 2024-07-27T03:08:34.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.400+0000 7ff2959b9640 1 -- 172.21.15.120:0/1833176774 wait complete. 2024-07-27T03:08:34.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.402+0000 7ff2959b9640 1 Processor -- start 2024-07-27T03:08:34.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.402+0000 7ff2959b9640 1 -- start start 2024-07-27T03:08:34.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.403+0000 7ff2959b9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2900b2c40 0x7ff29015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.403+0000 7ff2959b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2900b4740 0x7ff2900c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.403+0000 7ff2959b9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2900d0f00 0x7ff2900c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.403+0000 7ff2959b9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff2900b33c0 con 0x7ff2900b4740 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.403+0000 7ff2959b9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2900d3100 con 0x7ff2900d0f00 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.403+0000 7ff2959b9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff2900cf120 con 0x7ff2900b2c40 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.403+0000 7ff2867fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2900b4740 0x7ff2900c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff2867fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2900b4740 0x7ff2900c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40748/0 (socket says 172.21.15.120:40748) 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff2867fc640 1 -- 172.21.15.120:0/3060356780 learned_addr learned my addr 172.21.15.120:0/3060356780 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff28f7fe640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2900d0f00 0x7ff2900c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff28effd640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2900b2c40 0x7ff29015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff2867fc640 1 -- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2900b2c40 msgr2=0x7ff29015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff2867fc640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2900b2c40 0x7ff29015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff2867fc640 1 -- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2900d0f00 msgr2=0x7ff2900c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff2867fc640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2900d0f00 0x7ff2900c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff2867fc640 1 -- 172.21.15.120:0/3060356780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2900b80d0 con 0x7ff2900b4740 2024-07-27T03:08:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff28f7fe640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2900d0f00 0x7ff2900c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff2867fc640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2900b4740 0x7ff2900c8e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff278034040 tx=0x7ff2780039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff28cff9640 1 -- 172.21.15.120:0/3060356780 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27803e030 con 0x7ff2900b4740 2024-07-27T03:08:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff28cff9640 1 -- 172.21.15.120:0/3060356780 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2780047a0 con 0x7ff2900b4740 2024-07-27T03:08:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff2959b9640 1 -- 172.21.15.120:0/3060356780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2900b83b0 con 0x7ff2900b4740 2024-07-27T03:08:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff28cff9640 1 -- 172.21.15.120:0/3060356780 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278035040 con 0x7ff2900b4740 2024-07-27T03:08:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.404+0000 7ff2959b9640 1 -- 172.21.15.120:0/3060356780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2900c8640 con 0x7ff2900b4740 2024-07-27T03:08:34.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.405+0000 7ff2959b9640 1 -- 172.21.15.120:0/3060356780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2900d09c0 con 0x7ff2900b4740 2024-07-27T03:08:34.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.406+0000 7ff28cff9640 1 -- 172.21.15.120:0/3060356780 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff278041030 con 0x7ff2900b4740 2024-07-27T03:08:34.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.406+0000 7ff28cff9640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff270077070 0x7ff270079580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.406+0000 7ff28cff9640 1 -- 172.21.15.120:0/3060356780 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff2780b9090 con 0x7ff2900b4740 2024-07-27T03:08:34.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.406+0000 7ff28effd640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff270077070 0x7ff270079580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.407+0000 7ff28effd640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff270077070 0x7ff270079580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2800015e0 tx=0x7ff280009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:34.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.411+0000 7ff28cff9640 1 -- 172.21.15.120:0/3060356780 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff278082290 con 0x7ff2900b4740 2024-07-27T03:08:34.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.597+0000 7ff2959b9640 1 -- 172.21.15.120:0/3060356780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff29015dcb0 con 0x7ff2900b4740 2024-07-27T03:08:34.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.598+0000 7ff28cff9640 1 -- 172.21.15.120:0/3060356780 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16642 (secure 0 0 0) 0x7ff278081b90 con 0x7ff2900b4740 2024-07-27T03:08:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:34.602 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":21,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:33.299541+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:08:31.185623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-27T03:08:32.262408+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:08:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 -- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff270077070 msgr2=0x7ff270079580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff270077070 0x7ff270079580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2800015e0 tx=0x7ff280009040 comp rx=0 tx=0).stop 2024-07-27T03:08:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 -- 172.21.15.120:0/3060356780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2900b4740 msgr2=0x7ff2900c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2900b4740 0x7ff2900c8e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff278034040 tx=0x7ff2780039e0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 -- 172.21.15.120:0/3060356780 shutdown_connections 2024-07-27T03:08:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff270077070 0x7ff270079580 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2900b4740 0x7ff2900c8e40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2900d0f00 0x7ff2900c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 --2- 172.21.15.120:0/3060356780 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2900b2c40 0x7ff29015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 -- 172.21.15.120:0/3060356780 >> 172.21.15.120:0/3060356780 conn(0x7ff29008d690 msgr2=0x7ff29015d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 -- 172.21.15.120:0/3060356780 shutdown_connections 2024-07-27T03:08:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.600+0000 7ff2959b9640 1 -- 172.21.15.120:0/3060356780 wait complete. 2024-07-27T03:08:34.617 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-07-27T03:08:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.731+0000 7fe8fcdea640 1 -- 172.21.15.120:0/188296445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e4003a00 msgr2=0x7fe8e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.731+0000 7fe8fcdea640 1 --2- 172.21.15.120:0/188296445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e4003a00 0x7fe8e4003e70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800baf0 tx=0x7fe8e4005830 comp rx=0 tx=0).stop 2024-07-27T03:08:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.731+0000 7fe8f6d9d640 1 -- 172.21.15.120:0/188296445 reap_dead start 2024-07-27T03:08:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.731+0000 7fe8fcdea640 1 -- 172.21.15.120:0/188296445 shutdown_connections 2024-07-27T03:08:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.731+0000 7fe8fcdea640 1 -- 172.21.15.120:0/188296445 >> 172.21.15.120:0/188296445 conn(0x7fe8f80d20a0 msgr2=0x7fe8f80d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.731+0000 7fe8fcdea640 1 -- 172.21.15.120:0/188296445 shutdown_connections 2024-07-27T03:08:34.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.731+0000 7fe8fcdea640 1 -- 172.21.15.120:0/188296445 wait complete. 2024-07-27T03:08:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.733+0000 7fe8fcdea640 1 Processor -- start 2024-07-27T03:08:34.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.733+0000 7fe8fcdea640 1 -- start start 2024-07-27T03:08:34.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8fcdea640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8e4003a00 0x7fe8f8151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8fcdea640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8f814ed20 0x7fe8f80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8fcdea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80cbcb0 0x7fe8f814e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8fcdea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80b7240 con 0x7fe8f80cbcb0 2024-07-27T03:08:34.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8fcdea640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80b70c0 con 0x7fe8e4003a00 2024-07-27T03:08:34.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8fcdea640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f80b73c0 con 0x7fe8f814ed20 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8f6d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80cbcb0 0x7fe8f814e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8f659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8e4003a00 0x7fe8f8151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8f6d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80cbcb0 0x7fe8f814e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40766/0 (socket says 172.21.15.120:40766) 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8f6d9d640 1 -- 172.21.15.120:0/888907579 learned_addr learned my addr 172.21.15.120:0/888907579 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8edd9b640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8f814ed20 0x7fe8f80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8f6d9d640 1 -- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8f814ed20 msgr2=0x7fe8f80cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8f6d9d640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8f814ed20 0x7fe8f80cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8f6d9d640 1 -- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8e4003a00 msgr2=0x7fe8f8151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8f6d9d640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8e4003a00 0x7fe8f8151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8f6d9d640 1 -- 172.21.15.120:0/888907579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f80c8fd0 con 0x7fe8f80cbcb0 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8f6d9d640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80cbcb0 0x7fe8f814e0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80747c0 tx=0x7fe8f0006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8ef7fe640 1 -- 172.21.15.120:0/888907579 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0011900 con 0x7fe8f80cbcb0 2024-07-27T03:08:34.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8ef7fe640 1 -- 172.21.15.120:0/888907579 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8f0018070 con 0x7fe8f80cbcb0 2024-07-27T03:08:34.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8fcdea640 1 -- 172.21.15.120:0/888907579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f80c92b0 con 0x7fe8f80cbcb0 2024-07-27T03:08:34.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8ef7fe640 1 -- 172.21.15.120:0/888907579 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0011d20 con 0x7fe8f80cbcb0 2024-07-27T03:08:34.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.735+0000 7fe8fcdea640 1 -- 172.21.15.120:0/888907579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f80c9870 con 0x7fe8f80cbcb0 2024-07-27T03:08:34.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.737+0000 7fe8fcdea640 1 -- 172.21.15.120:0/888907579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f809ae40 con 0x7fe8f80cbcb0 2024-07-27T03:08:34.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.737+0000 7fe8ef7fe640 1 -- 172.21.15.120:0/888907579 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe8f001d460 con 0x7fe8f80cbcb0 2024-07-27T03:08:34.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.738+0000 7fe8ef7fe640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe8d8077040 0x7fe8d8079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:34.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.738+0000 7fe8ef7fe640 1 -- 172.21.15.120:0/888907579 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe8f0098fd0 con 0x7fe8f80cbcb0 2024-07-27T03:08:34.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.738+0000 7fe8f659c640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe8d8077040 0x7fe8d8079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:34.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.738+0000 7fe8f659c640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe8d8077040 0x7fe8d8079550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8036000 tx=0x7fe8e803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:34.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.742+0000 7fe8ef7fe640 1 -- 172.21.15.120:0/888907579 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fe8f00621d0 con 0x7fe8f80cbcb0 2024-07-27T03:08:34.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:34.964+0000 7fe8fcdea640 1 -- 172.21.15.120:0/888907579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe8f80cf960 con 0x7fe8f80cbcb0 2024-07-27T03:08:35.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.961+0000 7fe8ef7fe640 1 -- 172.21.15.120:0/888907579 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fe8f0061ad0 con 0x7fe8f80cbcb0 2024-07-27T03:08:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 -- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe8d8077040 msgr2=0x7fe8d8079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe8d8077040 0x7fe8d8079550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8036000 tx=0x7fe8e803c040 comp rx=0 tx=0).stop 2024-07-27T03:08:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 -- 172.21.15.120:0/888907579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80cbcb0 msgr2=0x7fe8f814e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80cbcb0 0x7fe8f814e0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80747c0 tx=0x7fe8f0006660 comp rx=0 tx=0).stop 2024-07-27T03:08:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 -- 172.21.15.120:0/888907579 shutdown_connections 2024-07-27T03:08:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe8d8077040 0x7fe8d8079550 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8f80cbcb0 0x7fe8f814e0d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8f814ed20 0x7fe8f80cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 --2- 172.21.15.120:0/888907579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8e4003a00 0x7fe8f8151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:35.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 -- 172.21.15.120:0/888907579 >> 172.21.15.120:0/888907579 conn(0x7fe8f80d20a0 msgr2=0x7fe8f80b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:35.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 -- 172.21.15.120:0/888907579 shutdown_connections 2024-07-27T03:08:35.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:35.964+0000 7fe8fcdea640 1 -- 172.21.15.120:0/888907579 wait complete. 2024-07-27T03:08:35.981 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-07-27T03:08:35.981 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-07-27T03:08:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.099+0000 7efd6bb38640 1 -- 172.21.15.120:0/2809404569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd640b75b0 msgr2=0x7efd640d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.099+0000 7efd6bb38640 1 --2- 172.21.15.120:0/2809404569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd640b75b0 0x7efd640d0790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd6409fd70 tx=0x7efd6002a980 comp rx=0 tx=0).stop 2024-07-27T03:08:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.099+0000 7efd6bb38640 1 -- 172.21.15.120:0/2809404569 shutdown_connections 2024-07-27T03:08:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.099+0000 7efd6bb38640 1 --2- 172.21.15.120:0/2809404569 >> v2:172.21.15.121:3300/0 conn(0x7efd640d28f0 0x7efd640ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:36.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.099+0000 7efd6bb38640 1 --2- 172.21.15.120:0/2809404569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd640b75b0 0x7efd640d0790 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.099+0000 7efd6bb38640 1 -- 172.21.15.120:0/2809404569 >> 172.21.15.120:0/2809404569 conn(0x7efd640d1dd0 msgr2=0x7efd640d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.099+0000 7efd6bb38640 1 -- 172.21.15.120:0/2809404569 shutdown_connections 2024-07-27T03:08:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.099+0000 7efd6bb38640 1 -- 172.21.15.120:0/2809404569 wait complete. 2024-07-27T03:08:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.101+0000 7efd6bb38640 1 Processor -- start 2024-07-27T03:08:36.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.101+0000 7efd6bb38640 1 -- start start 2024-07-27T03:08:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.102+0000 7efd6bb38640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd640b75b0 0x7efd6406ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.102+0000 7efd6bb38640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd640ced80 0x7efd640c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:36.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.102+0000 7efd6bb38640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd640d28f0 0x7efd641f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.102+0000 7efd6bb38640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efd640b1f80 con 0x7efd640d28f0 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.102+0000 7efd6bb38640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efd640b1e00 con 0x7efd640b75b0 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.102+0000 7efd6bb38640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efd64166aa0 con 0x7efd640ced80 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd6a0d5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd640d28f0 0x7efd641f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd6a0d5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd640d28f0 0x7efd641f8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40784/0 (socket says 172.21.15.120:40784) 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd6a0d5640 1 -- 172.21.15.120:0/52039583 learned_addr learned my addr 172.21.15.120:0/52039583 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd698d4640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd640b75b0 0x7efd6406ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd690d3640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd640ced80 0x7efd640c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd6a0d5640 1 -- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd640ced80 msgr2=0x7efd640c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd6a0d5640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd640ced80 0x7efd640c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd6a0d5640 1 -- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd640b75b0 msgr2=0x7efd6406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd6a0d5640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd640b75b0 0x7efd6406ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:36.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd6a0d5640 1 -- 172.21.15.120:0/52039583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6415f180 con 0x7efd640d28f0 2024-07-27T03:08:36.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd698d4640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd640b75b0 0x7efd6406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:36.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd6a0d5640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd640d28f0 0x7efd641f8da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00b410 tx=0x7efd5c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:36.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd5a7fc640 1 -- 172.21.15.120:0/52039583 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c015020 con 0x7efd640d28f0 2024-07-27T03:08:36.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd5a7fc640 1 -- 172.21.15.120:0/52039583 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd5c011940 con 0x7efd640d28f0 2024-07-27T03:08:36.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd6bb38640 1 -- 172.21.15.120:0/52039583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd6415f410 con 0x7efd640d28f0 2024-07-27T03:08:36.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd5a7fc640 1 -- 172.21.15.120:0/52039583 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c011d90 con 0x7efd640d28f0 2024-07-27T03:08:36.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.103+0000 7efd6bb38640 1 -- 172.21.15.120:0/52039583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd6415f9d0 con 0x7efd640d28f0 2024-07-27T03:08:36.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.104+0000 7efd6bb38640 1 -- 172.21.15.120:0/52039583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd640d0790 con 0x7efd640d28f0 2024-07-27T03:08:36.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.105+0000 7efd5a7fc640 1 -- 172.21.15.120:0/52039583 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7efd5c018020 con 0x7efd640d28f0 2024-07-27T03:08:36.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.105+0000 7efd5a7fc640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efd48077040 0x7efd48079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:36.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.105+0000 7efd5a7fc640 1 -- 172.21.15.120:0/52039583 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efd5c098780 con 0x7efd640d28f0 2024-07-27T03:08:36.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.106+0000 7efd698d4640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efd48077040 0x7efd48079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:36.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.106+0000 7efd698d4640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efd48077040 0x7efd48079550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd60035000 tx=0x7efd60004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:36.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.110+0000 7efd5a7fc640 1 -- 172.21.15.120:0/52039583 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7efd5c01f020 con 0x7efd640d28f0 2024-07-27T03:08:36.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.328+0000 7efd6bb38640 1 -- 172.21.15.120:0/52039583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7efd640cf760 con 0x7efd640d28f0 2024-07-27T03:08:36.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.966+0000 7efd5a7fc640 1 -- 172.21.15.120:0/52039583 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7efd5c061980 con 0x7efd640d28f0 2024-07-27T03:08:36.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 -- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efd48077040 msgr2=0x7efd48079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:36.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efd48077040 0x7efd48079550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd60035000 tx=0x7efd60004ab0 comp rx=0 tx=0).stop 2024-07-27T03:08:36.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 -- 172.21.15.120:0/52039583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd640d28f0 msgr2=0x7efd641f8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:36.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd640d28f0 0x7efd641f8da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00b410 tx=0x7efd5c00b8d0 comp rx=0 tx=0).stop 2024-07-27T03:08:36.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 -- 172.21.15.120:0/52039583 shutdown_connections 2024-07-27T03:08:36.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efd48077040 0x7efd48079550 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:36.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd640d28f0 0x7efd641f8da0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:36.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd640ced80 0x7efd640c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:36.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 --2- 172.21.15.120:0/52039583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd640b75b0 0x7efd6406ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:36.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 -- 172.21.15.120:0/52039583 >> 172.21.15.120:0/52039583 conn(0x7efd640d1dd0 msgr2=0x7efd6415d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:36.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 -- 172.21.15.120:0/52039583 shutdown_connections 2024-07-27T03:08:36.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:36.968+0000 7efd6bb38640 1 -- 172.21.15.120:0/52039583 wait complete. 2024-07-27T03:08:36.984 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-07-27T03:08:36.984 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:08:37.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.096+0000 7f3019a4a640 1 -- 172.21.15.120:0/2959224401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc004d40 msgr2=0x7f2ffc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.096+0000 7f3019a4a640 1 --2- 172.21.15.120:0/2959224401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ffc004d40 0x7f2ffc005150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f300c005fd0 tx=0x7f2ffc005830 comp rx=0 tx=0).stop 2024-07-27T03:08:37.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.096+0000 7f30137fe640 1 -- 172.21.15.120:0/2959224401 reap_dead start 2024-07-27T03:08:37.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.096+0000 7f3019a4a640 1 -- 172.21.15.120:0/2959224401 shutdown_connections 2024-07-27T03:08:37.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.096+0000 7f3019a4a640 1 -- 172.21.15.120:0/2959224401 >> 172.21.15.120:0/2959224401 conn(0x7f30140d0e00 msgr2=0x7f30140d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:37.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.096+0000 7f3019a4a640 1 -- 172.21.15.120:0/2959224401 shutdown_connections 2024-07-27T03:08:37.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.096+0000 7f3019a4a640 1 -- 172.21.15.120:0/2959224401 wait complete. 2024-07-27T03:08:37.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.098+0000 7f3019a4a640 1 Processor -- start 2024-07-27T03:08:37.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.098+0000 7f3019a4a640 1 -- start start 2024-07-27T03:08:37.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.099+0000 7f3019a4a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ffc004d40 0x7f30141f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.099+0000 7f3019a4a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30141541d0 0x7f30141f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.099+0000 7f3019a4a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30140b3c90 0x7f30140b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.099+0000 7f3019a4a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f30140ceb50 con 0x7f30141541d0 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.099+0000 7f3019a4a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f30140ce9d0 con 0x7f2ffc004d40 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.099+0000 7f3019a4a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f30140cecd0 con 0x7f30140b3c90 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.099+0000 7f30127fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30141541d0 0x7f30141f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.099+0000 7f30127fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30141541d0 0x7f30141f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40806/0 (socket says 172.21.15.120:40806) 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.099+0000 7f30127fc640 1 -- 172.21.15.120:0/4123526444 learned_addr learned my addr 172.21.15.120:0/4123526444 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.099+0000 7f3012ffd640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ffc004d40 0x7f30141f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f30137fe640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30140b3c90 0x7f30140b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f30127fc640 1 -- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30140b3c90 msgr2=0x7f30140b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f30127fc640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30140b3c90 0x7f30140b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f30127fc640 1 -- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ffc004d40 msgr2=0x7f30141f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f30127fc640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ffc004d40 0x7f30141f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f30127fc640 1 -- 172.21.15.120:0/4123526444 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30141f62e0 con 0x7f30141541d0 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f3012ffd640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ffc004d40 0x7f30141f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f30137fe640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30140b3c90 0x7f30140b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f30127fc640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30141541d0 0x7f30141f5700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3008006660 tx=0x7f3008003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f2ffbfff640 1 -- 172.21.15.120:0/4123526444 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300800f7e0 con 0x7f30141541d0 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f2ffbfff640 1 -- 172.21.15.120:0/4123526444 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3008016020 con 0x7f30141541d0 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f3019a4a640 1 -- 172.21.15.120:0/4123526444 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30141f65c0 con 0x7f30141541d0 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f2ffbfff640 1 -- 172.21.15.120:0/4123526444 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300800fc20 con 0x7f30141541d0 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.100+0000 7f3019a4a640 1 -- 172.21.15.120:0/4123526444 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30141f2500 con 0x7f30141541d0 2024-07-27T03:08:37.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.101+0000 7f3019a4a640 1 -- 172.21.15.120:0/4123526444 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3014071e90 con 0x7f30141541d0 2024-07-27T03:08:37.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.102+0000 7f2ffbfff640 1 -- 172.21.15.120:0/4123526444 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f3008011430 con 0x7f30141541d0 2024-07-27T03:08:37.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.102+0000 7f2ffbfff640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000077040 0x7f3000079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.102+0000 7f2ffbfff640 1 -- 172.21.15.120:0/4123526444 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3008099430 con 0x7f30141541d0 2024-07-27T03:08:37.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.103+0000 7f3012ffd640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000077040 0x7f3000079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.103+0000 7f3012ffd640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000077040 0x7f3000079550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3004009bd0 tx=0x7f3004005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:37.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.107+0000 7f2ffbfff640 1 -- 172.21.15.120:0/4123526444 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f3014071e90 con 0x7f30141541d0 2024-07-27T03:08:37.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.326+0000 7f3019a4a640 1 -- 172.21.15.120:0/4123526444 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30141f6070 con 0x7f30141541d0 2024-07-27T03:08:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.326+0000 7f2ffbfff640 1 -- 172.21.15.120:0/4123526444 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7f3008020020 con 0x7f30141541d0 2024-07-27T03:08:37.330 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:37.330 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":8,"btime":"2024-07-27T03:08:36:963563+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/4223514676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4223514676},{"type":"v1","addr":"172.21.15.120:6834","nonce":4223514676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1736241961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1736241961},{"type":"v1","addr":"172.21.15.121:6837","nonce":1736241961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/625386978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":625386978},{"type":"v1","addr":"172.21.15.121:6836","nonce":625386978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:08:33.299496+0000","modified":"2024-07-27T03:08:36.330563+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/552629761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":552629761},{"type":"v1","addr":"172.21.15.120:6835","nonce":552629761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4359,"qdb_cluster":[4359]},"id":1}]} 2024-07-27T03:08:37.330 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 8 2024-07-27T03:08:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 -- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000077040 msgr2=0x7f3000079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000077040 0x7f3000079550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3004009bd0 tx=0x7f3004005f90 comp rx=0 tx=0).stop 2024-07-27T03:08:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 -- 172.21.15.120:0/4123526444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30141541d0 msgr2=0x7f30141f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30141541d0 0x7f30141f5700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3008006660 tx=0x7f3008003a80 comp rx=0 tx=0).stop 2024-07-27T03:08:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 -- 172.21.15.120:0/4123526444 shutdown_connections 2024-07-27T03:08:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000077040 0x7f3000079550 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30141541d0 0x7f30141f5700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30140b3c90 0x7f30140b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 --2- 172.21.15.120:0/4123526444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ffc004d40 0x7f30141f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 -- 172.21.15.120:0/4123526444 >> 172.21.15.120:0/4123526444 conn(0x7f30140d0e00 msgr2=0x7f3014159720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 -- 172.21.15.120:0/4123526444 shutdown_connections 2024-07-27T03:08:37.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.328+0000 7f3019a4a640 1 -- 172.21.15.120:0/4123526444 wait complete. 2024-07-27T03:08:37.343 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:08:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.453+0000 7f84495e7640 1 -- 172.21.15.120:0/4029829355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844409b140 msgr2=0x7f84440b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.453+0000 7f84495e7640 1 --2- 172.21.15.120:0/4029829355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844409b140 0x7f84440b4ef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f843c005fd0 tx=0x7f843c02a5d0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.453+0000 7f84495e7640 1 -- 172.21.15.120:0/4029829355 shutdown_connections 2024-07-27T03:08:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.453+0000 7f84495e7640 1 --2- 172.21.15.120:0/4029829355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844409b140 0x7f84440b4ef0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.453+0000 7f84495e7640 1 --2- 172.21.15.120:0/4029829355 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f844409b640 0x7f84440b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.453+0000 7f84495e7640 1 -- 172.21.15.120:0/4029829355 >> 172.21.15.120:0/4029829355 conn(0x7f84440d20a0 msgr2=0x7f84440d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.453+0000 7f84495e7640 1 -- 172.21.15.120:0/4029829355 shutdown_connections 2024-07-27T03:08:37.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.453+0000 7f84495e7640 1 -- 172.21.15.120:0/4029829355 wait complete. 2024-07-27T03:08:37.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.455+0000 7f84495e7640 1 Processor -- start 2024-07-27T03:08:37.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.455+0000 7f84495e7640 1 -- start start 2024-07-27T03:08:37.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.456+0000 7f84495e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844409b640 0x7f84441e5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.456+0000 7f84495e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84440cf4e0 0x7f844414d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.456+0000 7f84495e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f844409f290 0x7f844409f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.456+0000 7f84495e7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f84440b5a80 con 0x7f84440cf4e0 2024-07-27T03:08:37.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.456+0000 7f84495e7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f84440b5900 con 0x7f844409b640 2024-07-27T03:08:37.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.456+0000 7f84495e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f84440b5c00 con 0x7f844409f290 2024-07-27T03:08:37.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.456+0000 7f84427fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84440cf4e0 0x7f844414d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.456+0000 7f84427fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84440cf4e0 0x7f844414d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40820/0 (socket says 172.21.15.120:40820) 2024-07-27T03:08:37.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.456+0000 7f84427fc640 1 -- 172.21.15.120:0/233032200 learned_addr learned my addr 172.21.15.120:0/233032200 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:37.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f8442ffd640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844409b640 0x7f84441e5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f84437fe640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f844409f290 0x7f844409f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f84427fc640 1 -- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f844409f290 msgr2=0x7f844409f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f84427fc640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f844409f290 0x7f844409f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f84427fc640 1 -- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844409b640 msgr2=0x7f84441e5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f84427fc640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844409b640 0x7f84441e5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f84427fc640 1 -- 172.21.15.120:0/233032200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844414da10 con 0x7f84440cf4e0 2024-07-27T03:08:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f84437fe640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f844409f290 0x7f844409f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f84427fc640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84440cf4e0 0x7f844414d4d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f843800c3d0 tx=0x7f843800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f842b7fe640 1 -- 172.21.15.120:0/233032200 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438017070 con 0x7f84440cf4e0 2024-07-27T03:08:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f842b7fe640 1 -- 172.21.15.120:0/233032200 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84380053c0 con 0x7f84440cf4e0 2024-07-27T03:08:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f84495e7640 1 -- 172.21.15.120:0/233032200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84441e4b50 con 0x7f84440cf4e0 2024-07-27T03:08:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f842b7fe640 1 -- 172.21.15.120:0/233032200 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438003850 con 0x7f84440cf4e0 2024-07-27T03:08:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.457+0000 7f84495e7640 1 -- 172.21.15.120:0/233032200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84441e5110 con 0x7f84440cf4e0 2024-07-27T03:08:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.458+0000 7f84495e7640 1 -- 172.21.15.120:0/233032200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84440b60b0 con 0x7f84440cf4e0 2024-07-27T03:08:37.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.459+0000 7f842b7fe640 1 -- 172.21.15.120:0/233032200 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f843801a070 con 0x7f84440cf4e0 2024-07-27T03:08:37.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.459+0000 7f842b7fe640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8430077010 0x7f8430079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.460+0000 7f842b7fe640 1 -- 172.21.15.120:0/233032200 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8438097c60 con 0x7f84440cf4e0 2024-07-27T03:08:37.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.460+0000 7f8442ffd640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8430077010 0x7f8430079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.460+0000 7f8442ffd640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8430077010 0x7f8430079520 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8434009920 tx=0x7f84340094a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:37.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.464+0000 7f842b7fe640 1 -- 172.21.15.120:0/233032200 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f84380608a0 con 0x7f84440cf4e0 2024-07-27T03:08:37.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.646+0000 7f84495e7640 1 -- 172.21.15.120:0/233032200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f844409fd10 con 0x7f84440cf4e0 2024-07-27T03:08:37.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.647+0000 7f842b7fe640 1 -- 172.21.15.120:0/233032200 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16629 (secure 0 0 0) 0x7f8438069130 con 0x7f84440cf4e0 2024-07-27T03:08:37.651 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:37.652 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:34.926699+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:08:31.185623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-27T03:08:32.262408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:08:37.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.649+0000 7f84495e7640 1 -- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8430077010 msgr2=0x7f8430079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.649+0000 7f84495e7640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8430077010 0x7f8430079520 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8434009920 tx=0x7f84340094a0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.649+0000 7f84495e7640 1 -- 172.21.15.120:0/233032200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84440cf4e0 msgr2=0x7f844414d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.649+0000 7f84495e7640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84440cf4e0 0x7f844414d4d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f843800c3d0 tx=0x7f843800c890 comp rx=0 tx=0).stop 2024-07-27T03:08:37.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.649+0000 7f84495e7640 1 -- 172.21.15.120:0/233032200 shutdown_connections 2024-07-27T03:08:37.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.650+0000 7f84495e7640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8430077010 0x7f8430079520 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.650+0000 7f84495e7640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84440cf4e0 0x7f844414d4d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.650+0000 7f84495e7640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f844409f290 0x7f844409f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.650+0000 7f84495e7640 1 --2- 172.21.15.120:0/233032200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f844409b640 0x7f84441e5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.650+0000 7f84495e7640 1 -- 172.21.15.120:0/233032200 >> 172.21.15.120:0/233032200 conn(0x7f84440d20a0 msgr2=0x7f84440cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:37.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.650+0000 7f84495e7640 1 -- 172.21.15.120:0/233032200 shutdown_connections 2024-07-27T03:08:37.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.650+0000 7f84495e7640 1 -- 172.21.15.120:0/233032200 wait complete. 2024-07-27T03:08:37.664 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-27T03:08:37.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:08:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.774+0000 7f42fd624640 1 -- 172.21.15.120:0/4037335498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42f80cd940 msgr2=0x7f42f80b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.774+0000 7f42fd624640 1 --2- 172.21.15.120:0/4037335498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42f80cd940 0x7f42f80b14e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009830 tx=0x7f42f002a530 comp rx=0 tx=0).stop 2024-07-27T03:08:37.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.774+0000 7f42fd624640 1 -- 172.21.15.120:0/4037335498 shutdown_connections 2024-07-27T03:08:37.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.774+0000 7f42fd624640 1 --2- 172.21.15.120:0/4037335498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42f80cd940 0x7f42f80b14e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.774+0000 7f42fd624640 1 -- 172.21.15.120:0/4037335498 >> 172.21.15.120:0/4037335498 conn(0x7f42f80d1dd0 msgr2=0x7f42f80d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:37.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.774+0000 7f42fd624640 1 -- 172.21.15.120:0/4037335498 shutdown_connections 2024-07-27T03:08:37.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.774+0000 7f42fd624640 1 -- 172.21.15.120:0/4037335498 wait complete. 2024-07-27T03:08:37.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.776+0000 7f42fd624640 1 Processor -- start 2024-07-27T03:08:37.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.776+0000 7f42fd624640 1 -- start start 2024-07-27T03:08:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.777+0000 7f42fd624640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f80b75b0 0x7f42f809f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.777+0000 7f42fd624640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42f80cd940 0x7f42f81649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.777+0000 7f42fd624640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f42f80d28f0 0x7f42f8070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.777+0000 7f42fd624640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8167ab0 con 0x7f42f80cd940 2024-07-27T03:08:37.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.777+0000 7f42fd624640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42f80b1fa0 con 0x7f42f80b75b0 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.777+0000 7f42fd624640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f42f8167c30 con 0x7f42f80d28f0 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.777+0000 7f42f67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42f80cd940 0x7f42f81649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.777+0000 7f42f67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42f80cd940 0x7f42f81649c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40846/0 (socket says 172.21.15.120:40846) 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.777+0000 7f42f67fc640 1 -- 172.21.15.120:0/3668913677 learned_addr learned my addr 172.21.15.120:0/3668913677 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.777+0000 7f42f6ffd640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f80b75b0 0x7f42f809f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.777+0000 7f42f77fe640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f42f80d28f0 0x7f42f8070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42f67fc640 1 -- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f42f80d28f0 msgr2=0x7f42f8070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42f67fc640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f42f80d28f0 0x7f42f8070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42f67fc640 1 -- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f80b75b0 msgr2=0x7f42f809f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42f67fc640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f80b75b0 0x7f42f809f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42f67fc640 1 -- 172.21.15.120:0/3668913677 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f815d6b0 con 0x7f42f80cd940 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42f77fe640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f42f80d28f0 0x7f42f8070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42f67fc640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42f80cd940 0x7f42f81649c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c430 tx=0x7f42ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:37.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42df7fe640 1 -- 172.21.15.120:0/3668913677 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec017070 con 0x7f42f80cd940 2024-07-27T03:08:37.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42df7fe640 1 -- 172.21.15.120:0/3668913677 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42ec0053c0 con 0x7f42f80cd940 2024-07-27T03:08:37.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42fd624640 1 -- 172.21.15.120:0/3668913677 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f8167520 con 0x7f42f80cd940 2024-07-27T03:08:37.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42df7fe640 1 -- 172.21.15.120:0/3668913677 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec003850 con 0x7f42f80cd940 2024-07-27T03:08:37.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.778+0000 7f42fd624640 1 -- 172.21.15.120:0/3668913677 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f8166f60 con 0x7f42f80cd940 2024-07-27T03:08:37.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.779+0000 7f42fd624640 1 -- 172.21.15.120:0/3668913677 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f80b14e0 con 0x7f42f80cd940 2024-07-27T03:08:37.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.780+0000 7f42df7fe640 1 -- 172.21.15.120:0/3668913677 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f42ec01a070 con 0x7f42f80cd940 2024-07-27T03:08:37.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.780+0000 7f42df7fe640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42e4077010 0x7f42e4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:37.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.780+0000 7f42df7fe640 1 -- 172.21.15.120:0/3668913677 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f42ec097b90 con 0x7f42f80cd940 2024-07-27T03:08:37.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.780+0000 7f42f6ffd640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42e4077010 0x7f42e4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:37.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.781+0000 7f42f6ffd640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42e4077010 0x7f42e4079520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42e80012e0 tx=0x7f42e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:37.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.785+0000 7f42df7fe640 1 -- 172.21.15.120:0/3668913677 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f42f815d6b0 con 0x7f42f80cd940 2024-07-27T03:08:37.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.960+0000 7f42fd624640 1 -- 172.21.15.120:0/3668913677 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42f806cbe0 con 0x7f42e4077010 2024-07-27T03:08:37.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.965+0000 7f42df7fe640 1 -- 172.21.15.120:0/3668913677 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244377 (secure 0 0 0) 0x7f42f806cbe0 con 0x7f42e4077010 2024-07-27T03:08:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:37.973 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:08:37.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 -- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42e4077010 msgr2=0x7f42e4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42e4077010 0x7f42e4079520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42e80012e0 tx=0x7f42e8009040 comp rx=0 tx=0).stop 2024-07-27T03:08:37.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 -- 172.21.15.120:0/3668913677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42f80cd940 msgr2=0x7f42f81649c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:37.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42f80cd940 0x7f42f81649c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c430 tx=0x7f42ec00c8f0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 -- 172.21.15.120:0/3668913677 shutdown_connections 2024-07-27T03:08:37.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42e4077010 0x7f42e4079520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42f80cd940 0x7f42f81649c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f42f80d28f0 0x7f42f8070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 --2- 172.21.15.120:0/3668913677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42f80b75b0 0x7f42f809f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:37.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 -- 172.21.15.120:0/3668913677 >> 172.21.15.120:0/3668913677 conn(0x7f42f80d1dd0 msgr2=0x7f42f80ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:37.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 -- 172.21.15.120:0/3668913677 shutdown_connections 2024-07-27T03:08:37.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:37.968+0000 7f42fd624640 1 -- 172.21.15.120:0/3668913677 wait complete. 2024-07-27T03:08:37.983 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-07-27T03:08:36.531791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219300,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755420,"statfs":{"total":773094113280,"available":772869550080,"internally_reserved":0,"allocated":2686976,"data_stored":1656774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.603791"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.945279+0000","last_change":"2024-07-27T03:08:32.945279+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.945279+0000","last_undegraded":"2024-07-27T03:08:32.945279+0000","last_fullsized":"2024-07-27T03:08:32.945279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.946181+0000","last_change":"2024-07-27T03:08:32.946181+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.946181+0000","last_undegraded":"2024-07-27T03:08:32.946181+0000","last_fullsized":"2024-07-27T03:08:32.946181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.933499+0000","last_change":"2024-07-27T03:08:32.933499+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.933499+0000","last_undegraded":"2024-07-27T03:08:32.933499+0000","last_fullsized":"2024-07-27T03:08:32.933499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943108+0000","last_change":"2024-07-27T03:08:32.943108+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943108+0000","last_undegraded":"2024-07-27T03:08:32.943108+0000","last_fullsized":"2024-07-27T03:08:32.943108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936828+0000","last_change":"2024-07-27T03:08:32.936828+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936828+0000","last_undegraded":"2024-07-27T03:08:32.936828+0000","last_fullsized":"2024-07-27T03:08:32.936828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944159+0000","last_change":"2024-07-27T03:08:32.944159+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944159+0000","last_undegraded":"2024-07-27T03:08:32.944159+0000","last_fullsized":"2024-07-27T03:08:32.944159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941576+0000","last_change":"2024-07-27T03:08:32.941576+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941576+0000","last_undegraded":"2024-07-27T03:08:32.941576+0000","last_fullsized":"2024-07-27T03:08:32.941576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944810+0000","last_change":"2024-07-27T03:08:32.944810+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944810+0000","last_undegraded":"2024-07-27T03:08:32.944810+0000","last_fullsized":"2024-07-27T03:08:32.944810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942291+0000","last_change":"2024-07-27T03:08:32.942291+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942291+0000","last_undegraded":"2024-07-27T03:08:32.942291+0000","last_fullsized":"2024-07-27T03:08:32.942291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943758+0000","last_change":"2024-07-27T03:08:32.943758+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943758+0000","last_undegraded":"2024-07-27T03:08:32.943758+0000","last_fullsized":"2024-07-27T03:08:32.943758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932754+0000","last_change":"2024-07-27T03:08:32.932754+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932754+0000","last_undegraded":"2024-07-27T03:08:32.932754+0000","last_fullsized":"2024-07-27T03:08:32.932754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930214+0000","last_change":"2024-07-27T03:08:32.930214+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930214+0000","last_undegraded":"2024-07-27T03:08:32.930214+0000","last_fullsized":"2024-07-27T03:08:32.930214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.940671+0000","last_change":"2024-07-27T03:08:32.940671+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.940671+0000","last_undegraded":"2024-07-27T03:08:32.940671+0000","last_fullsized":"2024-07-27T03:08:32.940671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942651+0000","last_change":"2024-07-27T03:08:32.942651+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942651+0000","last_undegraded":"2024-07-27T03:08:32.942651+0000","last_fullsized":"2024-07-27T03:08:32.942651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943747+0000","last_change":"2024-07-27T03:08:32.943747+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943747+0000","last_undegraded":"2024-07-27T03:08:32.943747+0000","last_fullsized":"2024-07-27T03:08:32.943747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936307+0000","last_change":"2024-07-27T03:08:32.936307+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936307+0000","last_undegraded":"2024-07-27T03:08:32.936307+0000","last_fullsized":"2024-07-27T03:08:32.936307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943211+0000","last_change":"2024-07-27T03:08:32.943211+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943211+0000","last_undegraded":"2024-07-27T03:08:32.943211+0000","last_fullsized":"2024-07-27T03:08:32.943211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.931016+0000","last_change":"2024-07-27T03:08:32.931016+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.931016+0000","last_undegraded":"2024-07-27T03:08:32.931016+0000","last_fullsized":"2024-07-27T03:08:32.931016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941812+0000","last_change":"2024-07-27T03:08:32.941812+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941812+0000","last_undegraded":"2024-07-27T03:08:32.941812+0000","last_fullsized":"2024-07-27T03:08:32.941812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937480+0000","last_change":"2024-07-27T03:08:32.937480+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937480+0000","last_undegraded":"2024-07-27T03:08:32.937480+0000","last_fullsized":"2024-07-27T03:08:32.937480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942257+0000","last_change":"2024-07-27T03:08:32.942257+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942257+0000","last_undegraded":"2024-07-27T03:08:32.942257+0000","last_fullsized":"2024-07-27T03:08:32.942257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932921+0000","last_change":"2024-07-27T03:08:32.932921+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932921+0000","last_undegraded":"2024-07-27T03:08:32.932921+0000","last_fullsized":"2024-07-27T03:08:32.932921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939520+0000","last_change":"2024-07-27T03:08:32.939520+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939520+0000","last_undegraded":"2024-07-27T03:08:32.939520+0000","last_fullsized":"2024-07-27T03:08:32.939520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954389+0000","last_change":"2024-07-27T03:08:32.950534+0000","last_active":"2024-07-27T03:08:32.954389+0000","last_peered":"2024-07-27T03:08:32.954389+0000","last_clean":"2024-07-27T03:08:32.954389+0000","last_became_active":"2024-07-27T03:08:32.949394+0000","last_became_peered":"2024-07-27T03:08:32.949394+0000","last_unstale":"2024-07-27T03:08:32.954389+0000","last_undegraded":"2024-07-27T03:08:32.954389+0000","last_fullsized":"2024-07-27T03:08:32.954389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:38:40.192147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941689+0000","last_change":"2024-07-27T03:08:32.941689+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941689+0000","last_undegraded":"2024-07-27T03:08:32.941689+0000","last_fullsized":"2024-07-27T03:08:32.941689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.931718+0000","last_change":"2024-07-27T03:08:31.931718+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.931718+0000","last_undegraded":"2024-07-27T03:08:31.931718+0000","last_fullsized":"2024-07-27T03:08:31.931718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955155+0000","last_change":"2024-07-27T03:08:32.951105+0000","last_active":"2024-07-27T03:08:32.955155+0000","last_peered":"2024-07-27T03:08:32.955155+0000","last_clean":"2024-07-27T03:08:32.955155+0000","last_became_active":"2024-07-27T03:08:32.950768+0000","last_became_peered":"2024-07-27T03:08:32.950768+0000","last_unstale":"2024-07-27T03:08:32.955155+0000","last_undegraded":"2024-07-27T03:08:32.955155+0000","last_fullsized":"2024-07-27T03:08:32.955155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:46:37.612264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938068+0000","last_change":"2024-07-27T03:08:32.938068+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938068+0000","last_undegraded":"2024-07-27T03:08:32.938068+0000","last_fullsized":"2024-07-27T03:08:32.938068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.953967+0000","last_change":"2024-07-27T03:08:32.951650+0000","last_active":"2024-07-27T03:08:32.953967+0000","last_peered":"2024-07-27T03:08:32.953967+0000","last_clean":"2024-07-27T03:08:32.953967+0000","last_became_active":"2024-07-27T03:08:32.950807+0000","last_became_peered":"2024-07-27T03:08:32.950807+0000","last_unstale":"2024-07-27T03:08:32.953967+0000","last_undegraded":"2024-07-27T03:08:32.953967+0000","last_fullsized":"2024-07-27T03:08:32.953967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.936966+0000","last_change":"2024-07-27T03:08:31.936966+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.936966+0000","last_undegraded":"2024-07-27T03:08:31.936966+0000","last_fullsized":"2024-07-27T03:08:31.936966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.931277+0000","last_change":"2024-07-27T03:08:32.931277+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.931277+0000","last_undegraded":"2024-07-27T03:08:32.931277+0000","last_fullsized":"2024-07-27T03:08:32.931277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952980+0000","last_change":"2024-07-27T03:08:32.948775+0000","last_active":"2024-07-27T03:08:32.952980+0000","last_peered":"2024-07-27T03:08:32.952980+0000","last_clean":"2024-07-27T03:08:32.952980+0000","last_became_active":"2024-07-27T03:08:32.948396+0000","last_became_peered":"2024-07-27T03:08:32.948396+0000","last_unstale":"2024-07-27T03:08:32.952980+0000","last_undegraded":"2024-07-27T03:08:32.952980+0000","last_fullsized":"2024-07-27T03:08:32.952980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:47:24.675277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939533+0000","last_change":"2024-07-27T03:08:32.939533+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939533+0000","last_undegraded":"2024-07-27T03:08:32.939533+0000","last_fullsized":"2024-07-27T03:08:32.939533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.933571+0000","last_change":"2024-07-27T03:08:31.933571+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.933571+0000","last_undegraded":"2024-07-27T03:08:31.933571+0000","last_fullsized":"2024-07-27T03:08:31.933571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.932379+0000","last_change":"2024-07-27T03:08:31.932379+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.932379+0000","last_undegraded":"2024-07-27T03:08:31.932379+0000","last_fullsized":"2024-07-27T03:08:31.932379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.946040+0000","last_change":"2024-07-27T03:08:32.946040+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.946040+0000","last_undegraded":"2024-07-27T03:08:32.946040+0000","last_fullsized":"2024-07-27T03:08:32.946040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.948106+0000","last_change":"2024-07-27T03:08:32.944499+0000","last_active":"2024-07-27T03:08:32.948106+0000","last_peered":"2024-07-27T03:08:32.948106+0000","last_clean":"2024-07-27T03:08:32.948106+0000","last_became_active":"2024-07-27T03:08:32.943866+0000","last_became_peered":"2024-07-27T03:08:32.943866+0000","last_unstale":"2024-07-27T03:08:32.948106+0000","last_undegraded":"2024-07-27T03:08:32.948106+0000","last_fullsized":"2024-07-27T03:08:32.948106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938893+0000","last_change":"2024-07-27T03:08:32.938893+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938893+0000","last_undegraded":"2024-07-27T03:08:32.938893+0000","last_fullsized":"2024-07-27T03:08:32.938893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952978+0000","last_change":"2024-07-27T03:08:32.949082+0000","last_active":"2024-07-27T03:08:32.952978+0000","last_peered":"2024-07-27T03:08:32.952978+0000","last_clean":"2024-07-27T03:08:32.952978+0000","last_became_active":"2024-07-27T03:08:32.948684+0000","last_became_peered":"2024-07-27T03:08:32.948684+0000","last_unstale":"2024-07-27T03:08:32.952978+0000","last_undegraded":"2024-07-27T03:08:32.952978+0000","last_fullsized":"2024-07-27T03:08:32.952978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942562+0000","last_change":"2024-07-27T03:08:32.942562+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942562+0000","last_undegraded":"2024-07-27T03:08:32.942562+0000","last_fullsized":"2024-07-27T03:08:32.942562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.933007+0000","last_change":"2024-07-27T03:08:31.933007+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.933007+0000","last_undegraded":"2024-07-27T03:08:31.933007+0000","last_fullsized":"2024-07-27T03:08:31.933007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954927+0000","last_change":"2024-07-27T03:08:32.946673+0000","last_active":"2024-07-27T03:08:32.954927+0000","last_peered":"2024-07-27T03:08:32.954927+0000","last_clean":"2024-07-27T03:08:32.954927+0000","last_became_active":"2024-07-27T03:08:32.946188+0000","last_became_peered":"2024-07-27T03:08:32.946188+0000","last_unstale":"2024-07-27T03:08:32.954927+0000","last_undegraded":"2024-07-27T03:08:32.954927+0000","last_fullsized":"2024-07-27T03:08:32.954927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943653+0000","last_change":"2024-07-27T03:08:32.943653+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943653+0000","last_undegraded":"2024-07-27T03:08:32.943653+0000","last_fullsized":"2024-07-27T03:08:32.943653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.923288+0000","last_change":"2024-07-27T03:08:31.923288+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.923288+0000","last_undegraded":"2024-07-27T03:08:31.923288+0000","last_fullsized":"2024-07-27T03:08:31.923288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942348+0000","last_change":"2024-07-27T03:08:32.942348+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942348+0000","last_undegraded":"2024-07-27T03:08:32.942348+0000","last_fullsized":"2024-07-27T03:08:32.942348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955378+0000","last_change":"2024-07-27T03:08:32.952496+0000","last_active":"2024-07-27T03:08:32.955378+0000","last_peered":"2024-07-27T03:08:32.955378+0000","last_clean":"2024-07-27T03:08:32.955378+0000","last_became_active":"2024-07-27T03:08:32.952196+0000","last_became_peered":"2024-07-27T03:08:32.952196+0000","last_unstale":"2024-07-27T03:08:32.955378+0000","last_undegraded":"2024-07-27T03:08:32.955378+0000","last_fullsized":"2024-07-27T03:08:32.955378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944346+0000","last_change":"2024-07-27T03:08:32.944346+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944346+0000","last_undegraded":"2024-07-27T03:08:32.944346+0000","last_fullsized":"2024-07-27T03:08:32.944346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.927623+0000","last_change":"2024-07-27T03:08:31.927623+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.927623+0000","last_undegraded":"2024-07-27T03:08:31.927623+0000","last_fullsized":"2024-07-27T03:08:31.927623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930629+0000","last_change":"2024-07-27T03:08:32.930629+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930629+0000","last_undegraded":"2024-07-27T03:08:32.930629+0000","last_fullsized":"2024-07-27T03:08:32.930629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955415+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:32.955415+0000","last_peered":"2024-07-27T03:08:32.955415+0000","last_clean":"2024-07-27T03:08:32.955415+0000","last_became_active":"2024-07-27T03:08:32.950533+0000","last_became_peered":"2024-07-27T03:08:32.950533+0000","last_unstale":"2024-07-27T03:08:32.955415+0000","last_undegraded":"2024-07-27T03:08:32.955415+0000","last_fullsized":"2024-07-27T03:08:32.955415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.945555+0000","last_change":"2024-07-27T03:08:32.945555+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.945555+0000","last_undegraded":"2024-07-27T03:08:32.945555+0000","last_fullsized":"2024-07-27T03:08:32.945555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.945496+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:08:32.945496+0000","last_peered":"2024-07-27T03:08:32.945496+0000","last_clean":"2024-07-27T03:08:32.945496+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:08:32.945496+0000","last_undegraded":"2024-07-27T03:08:32.945496+0000","last_fullsized":"2024-07-27T03:08:32.945496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952753+0000","last_change":"2024-07-27T03:08:32.948243+0000","last_active":"2024-07-27T03:08:32.952753+0000","last_peered":"2024-07-27T03:08:32.952753+0000","last_clean":"2024-07-27T03:08:32.952753+0000","last_became_active":"2024-07-27T03:08:32.947945+0000","last_became_peered":"2024-07-27T03:08:32.947945+0000","last_unstale":"2024-07-27T03:08:32.952753+0000","last_undegraded":"2024-07-27T03:08:32.952753+0000","last_fullsized":"2024-07-27T03:08:32.952753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:11.565566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936654+0000","last_change":"2024-07-27T03:08:32.936654+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936654+0000","last_undegraded":"2024-07-27T03:08:32.936654+0000","last_fullsized":"2024-07-27T03:08:32.936654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957294+0000","last_change":"2024-07-27T03:08:32.955404+0000","last_active":"2024-07-27T03:08:32.957294+0000","last_peered":"2024-07-27T03:08:32.957294+0000","last_clean":"2024-07-27T03:08:32.957294+0000","last_became_active":"2024-07-27T03:08:32.955120+0000","last_became_peered":"2024-07-27T03:08:32.955120+0000","last_unstale":"2024-07-27T03:08:32.957294+0000","last_undegraded":"2024-07-27T03:08:32.957294+0000","last_fullsized":"2024-07-27T03:08:32.957294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:16:05.521168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939804+0000","last_change":"2024-07-27T03:08:32.939804+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939804+0000","last_undegraded":"2024-07-27T03:08:32.939804+0000","last_fullsized":"2024-07-27T03:08:32.939804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955294+0000","last_change":"2024-07-27T03:08:32.951299+0000","last_active":"2024-07-27T03:08:32.955294+0000","last_peered":"2024-07-27T03:08:32.955294+0000","last_clean":"2024-07-27T03:08:32.955294+0000","last_became_active":"2024-07-27T03:08:32.950946+0000","last_became_peered":"2024-07-27T03:08:32.950946+0000","last_unstale":"2024-07-27T03:08:32.955294+0000","last_undegraded":"2024-07-27T03:08:32.955294+0000","last_fullsized":"2024-07-27T03:08:32.955294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:09.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.948881+0000","last_change":"2024-07-27T03:08:32.943293+0000","last_active":"2024-07-27T03:08:32.948881+0000","last_peered":"2024-07-27T03:08:32.948881+0000","last_clean":"2024-07-27T03:08:32.948881+0000","last_became_active":"2024-07-27T03:08:32.942974+0000","last_became_peered":"2024-07-27T03:08:32.942974+0000","last_unstale":"2024-07-27T03:08:32.948881+0000","last_undegraded":"2024-07-27T03:08:32.948881+0000","last_fullsized":"2024-07-27T03:08:32.948881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:41:35.306112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.926970+0000","last_change":"2024-07-27T03:08:31.926970+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.926970+0000","last_undegraded":"2024-07-27T03:08:31.926970+0000","last_fullsized":"2024-07-27T03:08:31.926970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930264+0000","last_change":"2024-07-27T03:08:32.930264+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930264+0000","last_undegraded":"2024-07-27T03:08:32.930264+0000","last_fullsized":"2024-07-27T03:08:32.930264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957073+0000","last_change":"2024-07-27T03:08:32.955213+0000","last_active":"2024-07-27T03:08:32.957073+0000","last_peered":"2024-07-27T03:08:32.957073+0000","last_clean":"2024-07-27T03:08:32.957073+0000","last_became_active":"2024-07-27T03:08:32.954883+0000","last_became_peered":"2024-07-27T03:08:32.954883+0000","last_unstale":"2024-07-27T03:08:32.957073+0000","last_undegraded":"2024-07-27T03:08:32.957073+0000","last_fullsized":"2024-07-27T03:08:32.957073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:02:35.203630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.926430+0000","last_change":"2024-07-27T03:08:31.926430+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.926430+0000","last_undegraded":"2024-07-27T03:08:31.926430+0000","last_fullsized":"2024-07-27T03:08:31.926430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937005+0000","last_change":"2024-07-27T03:08:32.937005+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937005+0000","last_undegraded":"2024-07-27T03:08:32.937005+0000","last_fullsized":"2024-07-27T03:08:32.937005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.931955+0000","last_change":"2024-07-27T03:08:31.931955+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.931955+0000","last_undegraded":"2024-07-27T03:08:31.931955+0000","last_fullsized":"2024-07-27T03:08:31.931955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938880+0000","last_change":"2024-07-27T03:08:32.938880+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938880+0000","last_undegraded":"2024-07-27T03:08:32.938880+0000","last_fullsized":"2024-07-27T03:08:32.938880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957075+0000","last_change":"2024-07-27T03:08:32.955144+0000","last_active":"2024-07-27T03:08:32.957075+0000","last_peered":"2024-07-27T03:08:32.957075+0000","last_clean":"2024-07-27T03:08:32.957075+0000","last_became_active":"2024-07-27T03:08:32.954645+0000","last_became_peered":"2024-07-27T03:08:32.954645+0000","last_unstale":"2024-07-27T03:08:32.957075+0000","last_undegraded":"2024-07-27T03:08:32.957075+0000","last_fullsized":"2024-07-27T03:08:32.957075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.925683+0000","last_change":"2024-07-27T03:08:31.925683+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.925683+0000","last_undegraded":"2024-07-27T03:08:31.925683+0000","last_fullsized":"2024-07-27T03:08:31.925683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937564+0000","last_change":"2024-07-27T03:08:32.937564+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937564+0000","last_undegraded":"2024-07-27T03:08:32.937564+0000","last_fullsized":"2024-07-27T03:08:32.937564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.927110+0000","last_change":"2024-07-27T03:08:31.927110+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.927110+0000","last_undegraded":"2024-07-27T03:08:31.927110+0000","last_fullsized":"2024-07-27T03:08:31.927110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939020+0000","last_change":"2024-07-27T03:08:32.939020+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939020+0000","last_undegraded":"2024-07-27T03:08:32.939020+0000","last_fullsized":"2024-07-27T03:08:32.939020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954983+0000","last_change":"2024-07-27T03:08:32.952714+0000","last_active":"2024-07-27T03:08:32.954983+0000","last_peered":"2024-07-27T03:08:32.954983+0000","last_clean":"2024-07-27T03:08:32.954983+0000","last_became_active":"2024-07-27T03:08:32.952425+0000","last_became_peered":"2024-07-27T03:08:32.952425+0000","last_unstale":"2024-07-27T03:08:32.954983+0000","last_undegraded":"2024-07-27T03:08:32.954983+0000","last_fullsized":"2024-07-27T03:08:32.954983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.934157+0000","last_change":"2024-07-27T03:08:32.934157+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.934157+0000","last_undegraded":"2024-07-27T03:08:32.934157+0000","last_fullsized":"2024-07-27T03:08:32.934157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955022+0000","last_change":"2024-07-27T03:08:32.953454+0000","last_active":"2024-07-27T03:08:32.955022+0000","last_peered":"2024-07-27T03:08:32.955022+0000","last_clean":"2024-07-27T03:08:32.955022+0000","last_became_active":"2024-07-27T03:08:32.953065+0000","last_became_peered":"2024-07-27T03:08:32.953065+0000","last_unstale":"2024-07-27T03:08:32.955022+0000","last_undegraded":"2024-07-27T03:08:32.955022+0000","last_fullsized":"2024-07-27T03:08:32.955022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:09.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932374+0000","last_change":"2024-07-27T03:08:32.932374+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932374+0000","last_undegraded":"2024-07-27T03:08:32.932374+0000","last_fullsized":"2024-07-27T03:08:32.932374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955390+0000","last_change":"2024-07-27T03:08:32.951809+0000","last_active":"2024-07-27T03:08:32.955390+0000","last_peered":"2024-07-27T03:08:32.955390+0000","last_clean":"2024-07-27T03:08:32.955390+0000","last_became_active":"2024-07-27T03:08:32.951495+0000","last_became_peered":"2024-07-27T03:08:32.951495+0000","last_unstale":"2024-07-27T03:08:32.955390+0000","last_undegraded":"2024-07-27T03:08:32.955390+0000","last_fullsized":"2024-07-27T03:08:32.955390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942235+0000","last_change":"2024-07-27T03:08:32.942235+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942235+0000","last_undegraded":"2024-07-27T03:08:32.942235+0000","last_fullsized":"2024-07-27T03:08:32.942235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955199+0000","last_change":"2024-07-27T03:08:32.951332+0000","last_active":"2024-07-27T03:08:32.955199+0000","last_peered":"2024-07-27T03:08:32.955199+0000","last_clean":"2024-07-27T03:08:32.955199+0000","last_became_active":"2024-07-27T03:08:32.949369+0000","last_became_peered":"2024-07-27T03:08:32.949369+0000","last_unstale":"2024-07-27T03:08:32.955199+0000","last_undegraded":"2024-07-27T03:08:32.955199+0000","last_fullsized":"2024-07-27T03:08:32.955199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:56:08.696748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937647+0000","last_change":"2024-07-27T03:08:32.937647+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937647+0000","last_undegraded":"2024-07-27T03:08:32.937647+0000","last_fullsized":"2024-07-27T03:08:32.937647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954743+0000","last_change":"2024-07-27T03:08:32.949235+0000","last_active":"2024-07-27T03:08:32.954743+0000","last_peered":"2024-07-27T03:08:32.954743+0000","last_clean":"2024-07-27T03:08:32.954743+0000","last_became_active":"2024-07-27T03:08:32.948934+0000","last_became_peered":"2024-07-27T03:08:32.948934+0000","last_unstale":"2024-07-27T03:08:32.954743+0000","last_undegraded":"2024-07-27T03:08:32.954743+0000","last_fullsized":"2024-07-27T03:08:32.954743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":5},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":778240,"data_stored":648304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":778240,"data_stored":648304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":57936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":57936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":57936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:08:37.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:08:38.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.134+0000 7f5db6893640 1 -- 172.21.15.120:0/3017916807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d98004d40 msgr2=0x7f5d980051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.134+0000 7f5db6893640 1 --2- 172.21.15.120:0/3017916807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d98004d40 0x7f5d980051f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5da8005fd0 tx=0x7f5d98005830 comp rx=0 tx=0).stop 2024-07-27T03:08:38.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.134+0000 7f5db4e30640 1 -- 172.21.15.120:0/3017916807 reap_dead start 2024-07-27T03:08:38.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.134+0000 7f5db6893640 1 -- 172.21.15.120:0/3017916807 shutdown_connections 2024-07-27T03:08:38.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.134+0000 7f5db6893640 1 -- 172.21.15.120:0/3017916807 >> 172.21.15.120:0/3017916807 conn(0x7f5db006cba0 msgr2=0x7f5db006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:38.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.134+0000 7f5db6893640 1 -- 172.21.15.120:0/3017916807 shutdown_connections 2024-07-27T03:08:38.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.134+0000 7f5db6893640 1 -- 172.21.15.120:0/3017916807 wait complete. 2024-07-27T03:08:38.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.135+0000 7f5db6893640 1 Processor -- start 2024-07-27T03:08:38.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.136+0000 7f5db6893640 1 -- start start 2024-07-27T03:08:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5db6893640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d98004d40 0x7f5db01451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5db6893640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db0159250 0x7f5db01f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5db6893640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5db01565e0 0x7f5db01569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5db6893640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5db00cd920 con 0x7f5db0159250 2024-07-27T03:08:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5db6893640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5db00cd7a0 con 0x7f5d98004d40 2024-07-27T03:08:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5db6893640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5db00cdaa0 con 0x7f5db01565e0 2024-07-27T03:08:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5daf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db0159250 0x7f5db01f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5daf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db0159250 0x7f5db01f34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40862/0 (socket says 172.21.15.120:40862) 2024-07-27T03:08:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5daf7fe640 1 -- 172.21.15.120:0/3720658013 learned_addr learned my addr 172.21.15.120:0/3720658013 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5daffff640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d98004d40 0x7f5db01451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5db4e30640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5db01565e0 0x7f5db01569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5daf7fe640 1 -- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5db01565e0 msgr2=0x7f5db01569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5daf7fe640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5db01565e0 0x7f5db01569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5daf7fe640 1 -- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d98004d40 msgr2=0x7f5db01451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5daf7fe640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d98004d40 0x7f5db01451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5daf7fe640 1 -- 172.21.15.120:0/3720658013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db0157440 con 0x7f5db0159250 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5daffff640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d98004d40 0x7f5db01451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5db4e30640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5db01565e0 0x7f5db01569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.137+0000 7f5daf7fe640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db0159250 0x7f5db01f34f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5da4003f50 tx=0x7f5da40016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.138+0000 7f5dacff9640 1 -- 172.21.15.120:0/3720658013 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da4011640 con 0x7f5db0159250 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.138+0000 7f5dacff9640 1 -- 172.21.15.120:0/3720658013 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5da4016020 con 0x7f5db0159250 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.138+0000 7f5dacff9640 1 -- 172.21.15.120:0/3720658013 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da4011a60 con 0x7f5db0159250 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.138+0000 7f5db6893640 1 -- 172.21.15.120:0/3720658013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db01f3a30 con 0x7f5db0159250 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.138+0000 7f5db6893640 1 -- 172.21.15.120:0/3720658013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db00b3dd0 con 0x7f5db0159250 2024-07-27T03:08:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.139+0000 7f5db6893640 1 -- 172.21.15.120:0/3720658013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db00ce000 con 0x7f5db0159250 2024-07-27T03:08:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.139+0000 7f5dacff9640 1 -- 172.21.15.120:0/3720658013 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5da4011c00 con 0x7f5db0159250 2024-07-27T03:08:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.140+0000 7f5dacff9640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d9c077040 0x7f5d9c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.140+0000 7f5dacff9640 1 -- 172.21.15.120:0/3720658013 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5da40995a0 con 0x7f5db0159250 2024-07-27T03:08:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.140+0000 7f5daffff640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d9c077040 0x7f5d9c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.141+0000 7f5daffff640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d9c077040 0x7f5d9c079550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5db0159220 tx=0x7f5da00067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:38.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.145+0000 7f5dacff9640 1 -- 172.21.15.120:0/3720658013 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5da4020020 con 0x7f5db0159250 2024-07-27T03:08:38.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.323+0000 7f5db6893640 1 -- 172.21.15.120:0/3720658013 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5db0158ac0 con 0x7f5d9c077040 2024-07-27T03:08:38.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.327+0000 7f5dacff9640 1 -- 172.21.15.120:0/3720658013 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244377 (secure 0 0 0) 0x7f5da00016d0 con 0x7f5d9c077040 2024-07-27T03:08:38.335 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:38.336 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:08:38.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 -- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d9c077040 msgr2=0x7f5d9c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d9c077040 0x7f5d9c079550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5db0159220 tx=0x7f5da00067a0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 -- 172.21.15.120:0/3720658013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db0159250 msgr2=0x7f5db01f34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db0159250 0x7f5db01f34f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5da4003f50 tx=0x7f5da40016f0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 -- 172.21.15.120:0/3720658013 shutdown_connections 2024-07-27T03:08:38.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d9c077040 0x7f5d9c079550 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5db0159250 0x7f5db01f34f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5db01565e0 0x7f5db01569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 --2- 172.21.15.120:0/3720658013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d98004d40 0x7f5db01451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 -- 172.21.15.120:0/3720658013 >> 172.21.15.120:0/3720658013 conn(0x7f5db006cba0 msgr2=0x7f5db0147ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:38.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 -- 172.21.15.120:0/3720658013 shutdown_connections 2024-07-27T03:08:38.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.330+0000 7f5db6893640 1 -- 172.21.15.120:0/3720658013 wait complete. 2024-07-27T03:08:38.344 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-07-27T03:08:36.531791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219300,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755420,"statfs":{"total":773094113280,"available":772869550080,"internally_reserved":0,"allocated":2686976,"data_stored":1656774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.603791"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.945279+0000","last_change":"2024-07-27T03:08:32.945279+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.945279+0000","last_undegraded":"2024-07-27T03:08:32.945279+0000","last_fullsized":"2024-07-27T03:08:32.945279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.946181+0000","last_change":"2024-07-27T03:08:32.946181+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.946181+0000","last_undegraded":"2024-07-27T03:08:32.946181+0000","last_fullsized":"2024-07-27T03:08:32.946181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.933499+0000","last_change":"2024-07-27T03:08:32.933499+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.933499+0000","last_undegraded":"2024-07-27T03:08:32.933499+0000","last_fullsized":"2024-07-27T03:08:32.933499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943108+0000","last_change":"2024-07-27T03:08:32.943108+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943108+0000","last_undegraded":"2024-07-27T03:08:32.943108+0000","last_fullsized":"2024-07-27T03:08:32.943108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936828+0000","last_change":"2024-07-27T03:08:32.936828+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936828+0000","last_undegraded":"2024-07-27T03:08:32.936828+0000","last_fullsized":"2024-07-27T03:08:32.936828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944159+0000","last_change":"2024-07-27T03:08:32.944159+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944159+0000","last_undegraded":"2024-07-27T03:08:32.944159+0000","last_fullsized":"2024-07-27T03:08:32.944159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941576+0000","last_change":"2024-07-27T03:08:32.941576+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941576+0000","last_undegraded":"2024-07-27T03:08:32.941576+0000","last_fullsized":"2024-07-27T03:08:32.941576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944810+0000","last_change":"2024-07-27T03:08:32.944810+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944810+0000","last_undegraded":"2024-07-27T03:08:32.944810+0000","last_fullsized":"2024-07-27T03:08:32.944810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942291+0000","last_change":"2024-07-27T03:08:32.942291+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942291+0000","last_undegraded":"2024-07-27T03:08:32.942291+0000","last_fullsized":"2024-07-27T03:08:32.942291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943758+0000","last_change":"2024-07-27T03:08:32.943758+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943758+0000","last_undegraded":"2024-07-27T03:08:32.943758+0000","last_fullsized":"2024-07-27T03:08:32.943758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932754+0000","last_change":"2024-07-27T03:08:32.932754+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932754+0000","last_undegraded":"2024-07-27T03:08:32.932754+0000","last_fullsized":"2024-07-27T03:08:32.932754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930214+0000","last_change":"2024-07-27T03:08:32.930214+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930214+0000","last_undegraded":"2024-07-27T03:08:32.930214+0000","last_fullsized":"2024-07-27T03:08:32.930214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.940671+0000","last_change":"2024-07-27T03:08:32.940671+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.940671+0000","last_undegraded":"2024-07-27T03:08:32.940671+0000","last_fullsized":"2024-07-27T03:08:32.940671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942651+0000","last_change":"2024-07-27T03:08:32.942651+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942651+0000","last_undegraded":"2024-07-27T03:08:32.942651+0000","last_fullsized":"2024-07-27T03:08:32.942651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943747+0000","last_change":"2024-07-27T03:08:32.943747+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943747+0000","last_undegraded":"2024-07-27T03:08:32.943747+0000","last_fullsized":"2024-07-27T03:08:32.943747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936307+0000","last_change":"2024-07-27T03:08:32.936307+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936307+0000","last_undegraded":"2024-07-27T03:08:32.936307+0000","last_fullsized":"2024-07-27T03:08:32.936307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943211+0000","last_change":"2024-07-27T03:08:32.943211+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943211+0000","last_undegraded":"2024-07-27T03:08:32.943211+0000","last_fullsized":"2024-07-27T03:08:32.943211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.931016+0000","last_change":"2024-07-27T03:08:32.931016+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.931016+0000","last_undegraded":"2024-07-27T03:08:32.931016+0000","last_fullsized":"2024-07-27T03:08:32.931016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941812+0000","last_change":"2024-07-27T03:08:32.941812+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941812+0000","last_undegraded":"2024-07-27T03:08:32.941812+0000","last_fullsized":"2024-07-27T03:08:32.941812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937480+0000","last_change":"2024-07-27T03:08:32.937480+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937480+0000","last_undegraded":"2024-07-27T03:08:32.937480+0000","last_fullsized":"2024-07-27T03:08:32.937480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942257+0000","last_change":"2024-07-27T03:08:32.942257+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942257+0000","last_undegraded":"2024-07-27T03:08:32.942257+0000","last_fullsized":"2024-07-27T03:08:32.942257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932921+0000","last_change":"2024-07-27T03:08:32.932921+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932921+0000","last_undegraded":"2024-07-27T03:08:32.932921+0000","last_fullsized":"2024-07-27T03:08:32.932921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939520+0000","last_change":"2024-07-27T03:08:32.939520+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939520+0000","last_undegraded":"2024-07-27T03:08:32.939520+0000","last_fullsized":"2024-07-27T03:08:32.939520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954389+0000","last_change":"2024-07-27T03:08:32.950534+0000","last_active":"2024-07-27T03:08:32.954389+0000","last_peered":"2024-07-27T03:08:32.954389+0000","last_clean":"2024-07-27T03:08:32.954389+0000","last_became_active":"2024-07-27T03:08:32.949394+0000","last_became_peered":"2024-07-27T03:08:32.949394+0000","last_unstale":"2024-07-27T03:08:32.954389+0000","last_undegraded":"2024-07-27T03:08:32.954389+0000","last_fullsized":"2024-07-27T03:08:32.954389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:38:40.192147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941689+0000","last_change":"2024-07-27T03:08:32.941689+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941689+0000","last_undegraded":"2024-07-27T03:08:32.941689+0000","last_fullsized":"2024-07-27T03:08:32.941689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.931718+0000","last_change":"2024-07-27T03:08:31.931718+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.931718+0000","last_undegraded":"2024-07-27T03:08:31.931718+0000","last_fullsized":"2024-07-27T03:08:31.931718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955155+0000","last_change":"2024-07-27T03:08:32.951105+0000","last_active":"2024-07-27T03:08:32.955155+0000","last_peered":"2024-07-27T03:08:32.955155+0000","last_clean":"2024-07-27T03:08:32.955155+0000","last_became_active":"2024-07-27T03:08:32.950768+0000","last_became_peered":"2024-07-27T03:08:32.950768+0000","last_unstale":"2024-07-27T03:08:32.955155+0000","last_undegraded":"2024-07-27T03:08:32.955155+0000","last_fullsized":"2024-07-27T03:08:32.955155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:46:37.612264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938068+0000","last_change":"2024-07-27T03:08:32.938068+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938068+0000","last_undegraded":"2024-07-27T03:08:32.938068+0000","last_fullsized":"2024-07-27T03:08:32.938068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.953967+0000","last_change":"2024-07-27T03:08:32.951650+0000","last_active":"2024-07-27T03:08:32.953967+0000","last_peered":"2024-07-27T03:08:32.953967+0000","last_clean":"2024-07-27T03:08:32.953967+0000","last_became_active":"2024-07-27T03:08:32.950807+0000","last_became_peered":"2024-07-27T03:08:32.950807+0000","last_unstale":"2024-07-27T03:08:32.953967+0000","last_undegraded":"2024-07-27T03:08:32.953967+0000","last_fullsized":"2024-07-27T03:08:32.953967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.936966+0000","last_change":"2024-07-27T03:08:31.936966+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.936966+0000","last_undegraded":"2024-07-27T03:08:31.936966+0000","last_fullsized":"2024-07-27T03:08:31.936966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.931277+0000","last_change":"2024-07-27T03:08:32.931277+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.931277+0000","last_undegraded":"2024-07-27T03:08:32.931277+0000","last_fullsized":"2024-07-27T03:08:32.931277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952980+0000","last_change":"2024-07-27T03:08:32.948775+0000","last_active":"2024-07-27T03:08:32.952980+0000","last_peered":"2024-07-27T03:08:32.952980+0000","last_clean":"2024-07-27T03:08:32.952980+0000","last_became_active":"2024-07-27T03:08:32.948396+0000","last_became_peered":"2024-07-27T03:08:32.948396+0000","last_unstale":"2024-07-27T03:08:32.952980+0000","last_undegraded":"2024-07-27T03:08:32.952980+0000","last_fullsized":"2024-07-27T03:08:32.952980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:47:24.675277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939533+0000","last_change":"2024-07-27T03:08:32.939533+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939533+0000","last_undegraded":"2024-07-27T03:08:32.939533+0000","last_fullsized":"2024-07-27T03:08:32.939533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.933571+0000","last_change":"2024-07-27T03:08:31.933571+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.933571+0000","last_undegraded":"2024-07-27T03:08:31.933571+0000","last_fullsized":"2024-07-27T03:08:31.933571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.932379+0000","last_change":"2024-07-27T03:08:31.932379+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.932379+0000","last_undegraded":"2024-07-27T03:08:31.932379+0000","last_fullsized":"2024-07-27T03:08:31.932379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.946040+0000","last_change":"2024-07-27T03:08:32.946040+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.946040+0000","last_undegraded":"2024-07-27T03:08:32.946040+0000","last_fullsized":"2024-07-27T03:08:32.946040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.948106+0000","last_change":"2024-07-27T03:08:32.944499+0000","last_active":"2024-07-27T03:08:32.948106+0000","last_peered":"2024-07-27T03:08:32.948106+0000","last_clean":"2024-07-27T03:08:32.948106+0000","last_became_active":"2024-07-27T03:08:32.943866+0000","last_became_peered":"2024-07-27T03:08:32.943866+0000","last_unstale":"2024-07-27T03:08:32.948106+0000","last_undegraded":"2024-07-27T03:08:32.948106+0000","last_fullsized":"2024-07-27T03:08:32.948106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938893+0000","last_change":"2024-07-27T03:08:32.938893+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938893+0000","last_undegraded":"2024-07-27T03:08:32.938893+0000","last_fullsized":"2024-07-27T03:08:32.938893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952978+0000","last_change":"2024-07-27T03:08:32.949082+0000","last_active":"2024-07-27T03:08:32.952978+0000","last_peered":"2024-07-27T03:08:32.952978+0000","last_clean":"2024-07-27T03:08:32.952978+0000","last_became_active":"2024-07-27T03:08:32.948684+0000","last_became_peered":"2024-07-27T03:08:32.948684+0000","last_unstale":"2024-07-27T03:08:32.952978+0000","last_undegraded":"2024-07-27T03:08:32.952978+0000","last_fullsized":"2024-07-27T03:08:32.952978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942562+0000","last_change":"2024-07-27T03:08:32.942562+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942562+0000","last_undegraded":"2024-07-27T03:08:32.942562+0000","last_fullsized":"2024-07-27T03:08:32.942562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.933007+0000","last_change":"2024-07-27T03:08:31.933007+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.933007+0000","last_undegraded":"2024-07-27T03:08:31.933007+0000","last_fullsized":"2024-07-27T03:08:31.933007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954927+0000","last_change":"2024-07-27T03:08:32.946673+0000","last_active":"2024-07-27T03:08:32.954927+0000","last_peered":"2024-07-27T03:08:32.954927+0000","last_clean":"2024-07-27T03:08:32.954927+0000","last_became_active":"2024-07-27T03:08:32.946188+0000","last_became_peered":"2024-07-27T03:08:32.946188+0000","last_unstale":"2024-07-27T03:08:32.954927+0000","last_undegraded":"2024-07-27T03:08:32.954927+0000","last_fullsized":"2024-07-27T03:08:32.954927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943653+0000","last_change":"2024-07-27T03:08:32.943653+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943653+0000","last_undegraded":"2024-07-27T03:08:32.943653+0000","last_fullsized":"2024-07-27T03:08:32.943653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.923288+0000","last_change":"2024-07-27T03:08:31.923288+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.923288+0000","last_undegraded":"2024-07-27T03:08:31.923288+0000","last_fullsized":"2024-07-27T03:08:31.923288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942348+0000","last_change":"2024-07-27T03:08:32.942348+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942348+0000","last_undegraded":"2024-07-27T03:08:32.942348+0000","last_fullsized":"2024-07-27T03:08:32.942348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955378+0000","last_change":"2024-07-27T03:08:32.952496+0000","last_active":"2024-07-27T03:08:32.955378+0000","last_peered":"2024-07-27T03:08:32.955378+0000","last_clean":"2024-07-27T03:08:32.955378+0000","last_became_active":"2024-07-27T03:08:32.952196+0000","last_became_peered":"2024-07-27T03:08:32.952196+0000","last_unstale":"2024-07-27T03:08:32.955378+0000","last_undegraded":"2024-07-27T03:08:32.955378+0000","last_fullsized":"2024-07-27T03:08:32.955378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944346+0000","last_change":"2024-07-27T03:08:32.944346+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944346+0000","last_undegraded":"2024-07-27T03:08:32.944346+0000","last_fullsized":"2024-07-27T03:08:32.944346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.927623+0000","last_change":"2024-07-27T03:08:31.927623+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.927623+0000","last_undegraded":"2024-07-27T03:08:31.927623+0000","last_fullsized":"2024-07-27T03:08:31.927623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930629+0000","last_change":"2024-07-27T03:08:32.930629+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930629+0000","last_undegraded":"2024-07-27T03:08:32.930629+0000","last_fullsized":"2024-07-27T03:08:32.930629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955415+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:32.955415+0000","last_peered":"2024-07-27T03:08:32.955415+0000","last_clean":"2024-07-27T03:08:32.955415+0000","last_became_active":"2024-07-27T03:08:32.950533+0000","last_became_peered":"2024-07-27T03:08:32.950533+0000","last_unstale":"2024-07-27T03:08:32.955415+0000","last_undegraded":"2024-07-27T03:08:32.955415+0000","last_fullsized":"2024-07-27T03:08:32.955415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.945555+0000","last_change":"2024-07-27T03:08:32.945555+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.945555+0000","last_undegraded":"2024-07-27T03:08:32.945555+0000","last_fullsized":"2024-07-27T03:08:32.945555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.945496+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:08:32.945496+0000","last_peered":"2024-07-27T03:08:32.945496+0000","last_clean":"2024-07-27T03:08:32.945496+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:08:32.945496+0000","last_undegraded":"2024-07-27T03:08:32.945496+0000","last_fullsized":"2024-07-27T03:08:32.945496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952753+0000","last_change":"2024-07-27T03:08:32.948243+0000","last_active":"2024-07-27T03:08:32.952753+0000","last_peered":"2024-07-27T03:08:32.952753+0000","last_clean":"2024-07-27T03:08:32.952753+0000","last_became_active":"2024-07-27T03:08:32.947945+0000","last_became_peered":"2024-07-27T03:08:32.947945+0000","last_unstale":"2024-07-27T03:08:32.952753+0000","last_undegraded":"2024-07-27T03:08:32.952753+0000","last_fullsized":"2024-07-27T03:08:32.952753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:11.565566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936654+0000","last_change":"2024-07-27T03:08:32.936654+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936654+0000","last_undegraded":"2024-07-27T03:08:32.936654+0000","last_fullsized":"2024-07-27T03:08:32.936654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957294+0000","last_change":"2024-07-27T03:08:32.955404+0000","last_active":"2024-07-27T03:08:32.957294+0000","last_peered":"2024-07-27T03:08:32.957294+0000","last_clean":"2024-07-27T03:08:32.957294+0000","last_became_active":"2024-07-27T03:08:32.955120+0000","last_became_peered":"2024-07-27T03:08:32.955120+0000","last_unstale":"2024-07-27T03:08:32.957294+0000","last_undegraded":"2024-07-27T03:08:32.957294+0000","last_fullsized":"2024-07-27T03:08:32.957294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:16:05.521168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939804+0000","last_change":"2024-07-27T03:08:32.939804+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939804+0000","last_undegraded":"2024-07-27T03:08:32.939804+0000","last_fullsized":"2024-07-27T03:08:32.939804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955294+0000","last_change":"2024-07-27T03:08:32.951299+0000","last_active":"2024-07-27T03:08:32.955294+0000","last_peered":"2024-07-27T03:08:32.955294+0000","last_clean":"2024-07-27T03:08:32.955294+0000","last_became_active":"2024-07-27T03:08:32.950946+0000","last_became_peered":"2024-07-27T03:08:32.950946+0000","last_unstale":"2024-07-27T03:08:32.955294+0000","last_undegraded":"2024-07-27T03:08:32.955294+0000","last_fullsized":"2024-07-27T03:08:32.955294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:09.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.948881+0000","last_change":"2024-07-27T03:08:32.943293+0000","last_active":"2024-07-27T03:08:32.948881+0000","last_peered":"2024-07-27T03:08:32.948881+0000","last_clean":"2024-07-27T03:08:32.948881+0000","last_became_active":"2024-07-27T03:08:32.942974+0000","last_became_peered":"2024-07-27T03:08:32.942974+0000","last_unstale":"2024-07-27T03:08:32.948881+0000","last_undegraded":"2024-07-27T03:08:32.948881+0000","last_fullsized":"2024-07-27T03:08:32.948881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:41:35.306112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.926970+0000","last_change":"2024-07-27T03:08:31.926970+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.926970+0000","last_undegraded":"2024-07-27T03:08:31.926970+0000","last_fullsized":"2024-07-27T03:08:31.926970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930264+0000","last_change":"2024-07-27T03:08:32.930264+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930264+0000","last_undegraded":"2024-07-27T03:08:32.930264+0000","last_fullsized":"2024-07-27T03:08:32.930264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957073+0000","last_change":"2024-07-27T03:08:32.955213+0000","last_active":"2024-07-27T03:08:32.957073+0000","last_peered":"2024-07-27T03:08:32.957073+0000","last_clean":"2024-07-27T03:08:32.957073+0000","last_became_active":"2024-07-27T03:08:32.954883+0000","last_became_peered":"2024-07-27T03:08:32.954883+0000","last_unstale":"2024-07-27T03:08:32.957073+0000","last_undegraded":"2024-07-27T03:08:32.957073+0000","last_fullsized":"2024-07-27T03:08:32.957073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:02:35.203630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.926430+0000","last_change":"2024-07-27T03:08:31.926430+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.926430+0000","last_undegraded":"2024-07-27T03:08:31.926430+0000","last_fullsized":"2024-07-27T03:08:31.926430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937005+0000","last_change":"2024-07-27T03:08:32.937005+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937005+0000","last_undegraded":"2024-07-27T03:08:32.937005+0000","last_fullsized":"2024-07-27T03:08:32.937005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.931955+0000","last_change":"2024-07-27T03:08:31.931955+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.931955+0000","last_undegraded":"2024-07-27T03:08:31.931955+0000","last_fullsized":"2024-07-27T03:08:31.931955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938880+0000","last_change":"2024-07-27T03:08:32.938880+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938880+0000","last_undegraded":"2024-07-27T03:08:32.938880+0000","last_fullsized":"2024-07-27T03:08:32.938880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957075+0000","last_change":"2024-07-27T03:08:32.955144+0000","last_active":"2024-07-27T03:08:32.957075+0000","last_peered":"2024-07-27T03:08:32.957075+0000","last_clean":"2024-07-27T03:08:32.957075+0000","last_became_active":"2024-07-27T03:08:32.954645+0000","last_became_peered":"2024-07-27T03:08:32.954645+0000","last_unstale":"2024-07-27T03:08:32.957075+0000","last_undegraded":"2024-07-27T03:08:32.957075+0000","last_fullsized":"2024-07-27T03:08:32.957075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.925683+0000","last_change":"2024-07-27T03:08:31.925683+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.925683+0000","last_undegraded":"2024-07-27T03:08:31.925683+0000","last_fullsized":"2024-07-27T03:08:31.925683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937564+0000","last_change":"2024-07-27T03:08:32.937564+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937564+0000","last_undegraded":"2024-07-27T03:08:32.937564+0000","last_fullsized":"2024-07-27T03:08:32.937564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-07-27T03:08:31.927110+0000","last_change":"2024-07-27T03:08:31.927110+0000","last_active":"2024-07-27T03:08:31.915638+0000","last_peered":"2024-07-27T03:08:31.915638+0000","last_clean":"2024-07-27T03:08:31.915638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:31.927110+0000","last_undegraded":"2024-07-27T03:08:31.927110+0000","last_fullsized":"2024-07-27T03:08:31.927110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939020+0000","last_change":"2024-07-27T03:08:32.939020+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939020+0000","last_undegraded":"2024-07-27T03:08:32.939020+0000","last_fullsized":"2024-07-27T03:08:32.939020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954983+0000","last_change":"2024-07-27T03:08:32.952714+0000","last_active":"2024-07-27T03:08:32.954983+0000","last_peered":"2024-07-27T03:08:32.954983+0000","last_clean":"2024-07-27T03:08:32.954983+0000","last_became_active":"2024-07-27T03:08:32.952425+0000","last_became_peered":"2024-07-27T03:08:32.952425+0000","last_unstale":"2024-07-27T03:08:32.954983+0000","last_undegraded":"2024-07-27T03:08:32.954983+0000","last_fullsized":"2024-07-27T03:08:32.954983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:08:32.918223+0000","last_change":"2024-07-27T03:08:32.918223+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.918223+0000","last_undegraded":"2024-07-27T03:08:32.918223+0000","last_fullsized":"2024-07-27T03:08:32.918223+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.934157+0000","last_change":"2024-07-27T03:08:32.934157+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.934157+0000","last_undegraded":"2024-07-27T03:08:32.934157+0000","last_fullsized":"2024-07-27T03:08:32.934157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955022+0000","last_change":"2024-07-27T03:08:32.953454+0000","last_active":"2024-07-27T03:08:32.955022+0000","last_peered":"2024-07-27T03:08:32.955022+0000","last_clean":"2024-07-27T03:08:32.955022+0000","last_became_active":"2024-07-27T03:08:32.953065+0000","last_became_peered":"2024-07-27T03:08:32.953065+0000","last_unstale":"2024-07-27T03:08:32.955022+0000","last_undegraded":"2024-07-27T03:08:32.955022+0000","last_fullsized":"2024-07-27T03:08:32.955022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:09.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932374+0000","last_change":"2024-07-27T03:08:32.932374+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932374+0000","last_undegraded":"2024-07-27T03:08:32.932374+0000","last_fullsized":"2024-07-27T03:08:32.932374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955390+0000","last_change":"2024-07-27T03:08:32.951809+0000","last_active":"2024-07-27T03:08:32.955390+0000","last_peered":"2024-07-27T03:08:32.955390+0000","last_clean":"2024-07-27T03:08:32.955390+0000","last_became_active":"2024-07-27T03:08:32.951495+0000","last_became_peered":"2024-07-27T03:08:32.951495+0000","last_unstale":"2024-07-27T03:08:32.955390+0000","last_undegraded":"2024-07-27T03:08:32.955390+0000","last_fullsized":"2024-07-27T03:08:32.955390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942235+0000","last_change":"2024-07-27T03:08:32.942235+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942235+0000","last_undegraded":"2024-07-27T03:08:32.942235+0000","last_fullsized":"2024-07-27T03:08:32.942235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955199+0000","last_change":"2024-07-27T03:08:32.951332+0000","last_active":"2024-07-27T03:08:32.955199+0000","last_peered":"2024-07-27T03:08:32.955199+0000","last_clean":"2024-07-27T03:08:32.955199+0000","last_became_active":"2024-07-27T03:08:32.949369+0000","last_became_peered":"2024-07-27T03:08:32.949369+0000","last_unstale":"2024-07-27T03:08:32.955199+0000","last_undegraded":"2024-07-27T03:08:32.955199+0000","last_fullsized":"2024-07-27T03:08:32.955199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:56:08.696748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937647+0000","last_change":"2024-07-27T03:08:32.937647+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937647+0000","last_undegraded":"2024-07-27T03:08:32.937647+0000","last_fullsized":"2024-07-27T03:08:32.937647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954743+0000","last_change":"2024-07-27T03:08:32.949235+0000","last_active":"2024-07-27T03:08:32.954743+0000","last_peered":"2024-07-27T03:08:32.954743+0000","last_clean":"2024-07-27T03:08:32.954743+0000","last_became_active":"2024-07-27T03:08:32.948934+0000","last_became_peered":"2024-07-27T03:08:32.948934+0000","last_unstale":"2024-07-27T03:08:32.954743+0000","last_undegraded":"2024-07-27T03:08:32.954743+0000","last_fullsized":"2024-07-27T03:08:32.954743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":5},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":778240,"data_stored":648304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":778240,"data_stored":648304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":57936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":57936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":57936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:08:38.348 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:08:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.494+0000 7fd5566f9640 1 -- 172.21.15.120:0/2179342076 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5500d0500 msgr2=0x7fd5500d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.494+0000 7fd5566f9640 1 --2- 172.21.15.120:0/2179342076 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5500d0500 0x7fd5500d0910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd544009830 tx=0x7fd54402a480 comp rx=0 tx=0).stop 2024-07-27T03:08:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.494+0000 7fd5566f9640 1 -- 172.21.15.120:0/2179342076 shutdown_connections 2024-07-27T03:08:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.494+0000 7fd5566f9640 1 --2- 172.21.15.120:0/2179342076 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5500d0500 0x7fd5500d0910 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.494+0000 7fd5566f9640 1 --2- 172.21.15.120:0/2179342076 >> v2:172.21.15.121:3300/0 conn(0x7fd5500b2110 0x7fd5500b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.494+0000 7fd5566f9640 1 -- 172.21.15.120:0/2179342076 >> 172.21.15.120:0/2179342076 conn(0x7fd5500b3920 msgr2=0x7fd5500b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:38.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.494+0000 7fd5566f9640 1 -- 172.21.15.120:0/2179342076 shutdown_connections 2024-07-27T03:08:38.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.494+0000 7fd5566f9640 1 -- 172.21.15.120:0/2179342076 wait complete. 2024-07-27T03:08:38.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.496+0000 7fd5566f9640 1 Processor -- start 2024-07-27T03:08:38.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.496+0000 7fd5566f9640 1 -- start start 2024-07-27T03:08:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.497+0000 7fd5566f9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5500b2110 0x7fd5500c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.497+0000 7fd5566f9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5500b4fd0 0x7fd55015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.497+0000 7fd5566f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5500d0500 0x7fd55015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.497+0000 7fd5566f9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd5500b5af0 con 0x7fd5500b4fd0 2024-07-27T03:08:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.497+0000 7fd5566f9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd55015fd80 con 0x7fd5500b2110 2024-07-27T03:08:38.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.497+0000 7fd5566f9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd5500b5c70 con 0x7fd5500d0500 2024-07-27T03:08:38.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5500b4fd0 0x7fd55015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5500b4fd0 0x7fd55015a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40864/0 (socket says 172.21.15.120:40864) 2024-07-27T03:08:38.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54f7fe640 1 -- 172.21.15.120:0/3096475412 learned_addr learned my addr 172.21.15.120:0/3096475412 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:38.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54ffff640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5500b2110 0x7fd5500c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd554c96640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5500d0500 0x7fd55015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54f7fe640 1 -- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5500d0500 msgr2=0x7fd55015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54f7fe640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5500d0500 0x7fd55015aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54f7fe640 1 -- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5500b2110 msgr2=0x7fd5500c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54f7fe640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5500b2110 0x7fd5500c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54f7fe640 1 -- 172.21.15.120:0/3096475412 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5500b19c0 con 0x7fd5500b4fd0 2024-07-27T03:08:38.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54ffff640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5500b2110 0x7fd5500c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:38.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd554c96640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5500d0500 0x7fd55015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:38.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54f7fe640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5500b4fd0 0x7fd55015a5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd54402aa70 tx=0x7fd544033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:38.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54cff9640 1 -- 172.21.15.120:0/3096475412 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544031d60 con 0x7fd5500b4fd0 2024-07-27T03:08:38.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54cff9640 1 -- 172.21.15.120:0/3096475412 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd544033e10 con 0x7fd5500b4fd0 2024-07-27T03:08:38.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd54cff9640 1 -- 172.21.15.120:0/3096475412 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544005260 con 0x7fd5500b4fd0 2024-07-27T03:08:38.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd5566f9640 1 -- 172.21.15.120:0/3096475412 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5500c9060 con 0x7fd5500b4fd0 2024-07-27T03:08:38.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.498+0000 7fd5566f9640 1 -- 172.21.15.120:0/3096475412 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5500c9620 con 0x7fd5500b4fd0 2024-07-27T03:08:38.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.500+0000 7fd5566f9640 1 -- 172.21.15.120:0/3096475412 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5500b6190 con 0x7fd5500b4fd0 2024-07-27T03:08:38.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.500+0000 7fd54cff9640 1 -- 172.21.15.120:0/3096475412 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd544005400 con 0x7fd5500b4fd0 2024-07-27T03:08:38.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.500+0000 7fd54cff9640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd53c077040 0x7fd53c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.501+0000 7fd54cff9640 1 -- 172.21.15.120:0/3096475412 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd5440b98a0 con 0x7fd5500b4fd0 2024-07-27T03:08:38.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.501+0000 7fd54ffff640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd53c077040 0x7fd53c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.501+0000 7fd54ffff640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd53c077040 0x7fd53c079550 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5400097a0 tx=0x7fd540009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:38.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.505+0000 7fd54cff9640 1 -- 172.21.15.120:0/3096475412 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd54403f030 con 0x7fd5500b4fd0 2024-07-27T03:08:38.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.684+0000 7fd5566f9640 1 -- 172.21.15.120:0/3096475412 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5500cf160 con 0x7fd53c077040 2024-07-27T03:08:38.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.689+0000 7fd54cff9640 1 -- 172.21.15.120:0/3096475412 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248164 (secure 0 0 0) 0x7fd5500cf160 con 0x7fd53c077040 2024-07-27T03:08:38.695 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:38.696 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:08:38.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 -- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd53c077040 msgr2=0x7fd53c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd53c077040 0x7fd53c079550 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5400097a0 tx=0x7fd540009260 comp rx=0 tx=0).stop 2024-07-27T03:08:38.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 -- 172.21.15.120:0/3096475412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5500b4fd0 msgr2=0x7fd55015a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5500b4fd0 0x7fd55015a5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd54402aa70 tx=0x7fd544033c20 comp rx=0 tx=0).stop 2024-07-27T03:08:38.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 -- 172.21.15.120:0/3096475412 shutdown_connections 2024-07-27T03:08:38.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd53c077040 0x7fd53c079550 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5500b4fd0 0x7fd55015a5a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5500d0500 0x7fd55015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 --2- 172.21.15.120:0/3096475412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5500b2110 0x7fd5500c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 -- 172.21.15.120:0/3096475412 >> 172.21.15.120:0/3096475412 conn(0x7fd5500b3920 msgr2=0x7fd5501e8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:38.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 -- 172.21.15.120:0/3096475412 shutdown_connections 2024-07-27T03:08:38.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.692+0000 7fd5566f9640 1 -- 172.21.15.120:0/3096475412 wait complete. 2024-07-27T03:08:38.707 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-07-27T03:08:38.532195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":117,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":2830336,"data_stored":1716722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.604194"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.945279+0000","last_change":"2024-07-27T03:08:32.945279+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.945279+0000","last_undegraded":"2024-07-27T03:08:32.945279+0000","last_fullsized":"2024-07-27T03:08:32.945279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930553+0000","last_change":"2024-07-27T03:08:33.951685+0000","last_active":"2024-07-27T03:08:34.930553+0000","last_peered":"2024-07-27T03:08:34.930553+0000","last_clean":"2024-07-27T03:08:34.930553+0000","last_became_active":"2024-07-27T03:08:33.951388+0000","last_became_peered":"2024-07-27T03:08:33.951388+0000","last_unstale":"2024-07-27T03:08:34.930553+0000","last_undegraded":"2024-07-27T03:08:34.930553+0000","last_fullsized":"2024-07-27T03:08:34.930553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.946181+0000","last_change":"2024-07-27T03:08:32.946181+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.946181+0000","last_undegraded":"2024-07-27T03:08:32.946181+0000","last_fullsized":"2024-07-27T03:08:32.946181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.933499+0000","last_change":"2024-07-27T03:08:32.933499+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.933499+0000","last_undegraded":"2024-07-27T03:08:32.933499+0000","last_fullsized":"2024-07-27T03:08:32.933499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943108+0000","last_change":"2024-07-27T03:08:32.943108+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943108+0000","last_undegraded":"2024-07-27T03:08:32.943108+0000","last_fullsized":"2024-07-27T03:08:32.943108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936828+0000","last_change":"2024-07-27T03:08:32.936828+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936828+0000","last_undegraded":"2024-07-27T03:08:32.936828+0000","last_fullsized":"2024-07-27T03:08:32.936828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944159+0000","last_change":"2024-07-27T03:08:32.944159+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944159+0000","last_undegraded":"2024-07-27T03:08:32.944159+0000","last_fullsized":"2024-07-27T03:08:32.944159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941576+0000","last_change":"2024-07-27T03:08:32.941576+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941576+0000","last_undegraded":"2024-07-27T03:08:32.941576+0000","last_fullsized":"2024-07-27T03:08:32.941576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944810+0000","last_change":"2024-07-27T03:08:32.944810+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944810+0000","last_undegraded":"2024-07-27T03:08:32.944810+0000","last_fullsized":"2024-07-27T03:08:32.944810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934161+0000","last_change":"2024-07-27T03:08:33.952605+0000","last_active":"2024-07-27T03:08:35.934161+0000","last_peered":"2024-07-27T03:08:35.934161+0000","last_clean":"2024-07-27T03:08:35.934161+0000","last_became_active":"2024-07-27T03:08:33.952198+0000","last_became_peered":"2024-07-27T03:08:33.952198+0000","last_unstale":"2024-07-27T03:08:35.934161+0000","last_undegraded":"2024-07-27T03:08:35.934161+0000","last_fullsized":"2024-07-27T03:08:35.934161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934003+0000","last_change":"2024-07-27T03:08:33.960066+0000","last_active":"2024-07-27T03:08:35.934003+0000","last_peered":"2024-07-27T03:08:35.934003+0000","last_clean":"2024-07-27T03:08:35.934003+0000","last_became_active":"2024-07-27T03:08:33.959677+0000","last_became_peered":"2024-07-27T03:08:33.959677+0000","last_unstale":"2024-07-27T03:08:35.934003+0000","last_undegraded":"2024-07-27T03:08:35.934003+0000","last_fullsized":"2024-07-27T03:08:35.934003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:24:20.622662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932043+0000","last_change":"2024-07-27T03:08:33.951057+0000","last_active":"2024-07-27T03:08:34.932043+0000","last_peered":"2024-07-27T03:08:34.932043+0000","last_clean":"2024-07-27T03:08:34.932043+0000","last_became_active":"2024-07-27T03:08:33.950764+0000","last_became_peered":"2024-07-27T03:08:33.950764+0000","last_unstale":"2024-07-27T03:08:34.932043+0000","last_undegraded":"2024-07-27T03:08:34.932043+0000","last_fullsized":"2024-07-27T03:08:34.932043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:25.800481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942291+0000","last_change":"2024-07-27T03:08:32.942291+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942291+0000","last_undegraded":"2024-07-27T03:08:32.942291+0000","last_fullsized":"2024-07-27T03:08:32.942291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943758+0000","last_change":"2024-07-27T03:08:32.943758+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943758+0000","last_undegraded":"2024-07-27T03:08:32.943758+0000","last_fullsized":"2024-07-27T03:08:32.943758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930265+0000","last_change":"2024-07-27T03:08:33.933362+0000","last_active":"2024-07-27T03:08:34.930265+0000","last_peered":"2024-07-27T03:08:34.930265+0000","last_clean":"2024-07-27T03:08:34.930265+0000","last_became_active":"2024-07-27T03:08:33.933038+0000","last_became_peered":"2024-07-27T03:08:33.933038+0000","last_unstale":"2024-07-27T03:08:34.930265+0000","last_undegraded":"2024-07-27T03:08:34.930265+0000","last_fullsized":"2024-07-27T03:08:34.930265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932754+0000","last_change":"2024-07-27T03:08:32.932754+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932754+0000","last_undegraded":"2024-07-27T03:08:32.932754+0000","last_fullsized":"2024-07-27T03:08:32.932754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930214+0000","last_change":"2024-07-27T03:08:32.930214+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930214+0000","last_undegraded":"2024-07-27T03:08:32.930214+0000","last_fullsized":"2024-07-27T03:08:32.930214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.940671+0000","last_change":"2024-07-27T03:08:32.940671+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.940671+0000","last_undegraded":"2024-07-27T03:08:32.940671+0000","last_fullsized":"2024-07-27T03:08:32.940671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942651+0000","last_change":"2024-07-27T03:08:32.942651+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942651+0000","last_undegraded":"2024-07-27T03:08:32.942651+0000","last_fullsized":"2024-07-27T03:08:32.942651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934076+0000","last_change":"2024-07-27T03:08:33.957419+0000","last_active":"2024-07-27T03:08:35.934076+0000","last_peered":"2024-07-27T03:08:35.934076+0000","last_clean":"2024-07-27T03:08:35.934076+0000","last_became_active":"2024-07-27T03:08:33.957075+0000","last_became_peered":"2024-07-27T03:08:33.957075+0000","last_unstale":"2024-07-27T03:08:35.934076+0000","last_undegraded":"2024-07-27T03:08:35.934076+0000","last_fullsized":"2024-07-27T03:08:35.934076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943747+0000","last_change":"2024-07-27T03:08:32.943747+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943747+0000","last_undegraded":"2024-07-27T03:08:32.943747+0000","last_fullsized":"2024-07-27T03:08:32.943747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936307+0000","last_change":"2024-07-27T03:08:32.936307+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936307+0000","last_undegraded":"2024-07-27T03:08:32.936307+0000","last_fullsized":"2024-07-27T03:08:32.936307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943211+0000","last_change":"2024-07-27T03:08:32.943211+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943211+0000","last_undegraded":"2024-07-27T03:08:32.943211+0000","last_fullsized":"2024-07-27T03:08:32.943211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.931016+0000","last_change":"2024-07-27T03:08:32.931016+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.931016+0000","last_undegraded":"2024-07-27T03:08:32.931016+0000","last_fullsized":"2024-07-27T03:08:32.931016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941812+0000","last_change":"2024-07-27T03:08:32.941812+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941812+0000","last_undegraded":"2024-07-27T03:08:32.941812+0000","last_fullsized":"2024-07-27T03:08:32.941812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934267+0000","last_change":"2024-07-27T03:08:33.947980+0000","last_active":"2024-07-27T03:08:35.934267+0000","last_peered":"2024-07-27T03:08:35.934267+0000","last_clean":"2024-07-27T03:08:35.934267+0000","last_became_active":"2024-07-27T03:08:33.947719+0000","last_became_peered":"2024-07-27T03:08:33.947719+0000","last_unstale":"2024-07-27T03:08:35.934267+0000","last_undegraded":"2024-07-27T03:08:35.934267+0000","last_fullsized":"2024-07-27T03:08:35.934267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930564+0000","last_change":"2024-07-27T03:08:33.948063+0000","last_active":"2024-07-27T03:08:34.930564+0000","last_peered":"2024-07-27T03:08:34.930564+0000","last_clean":"2024-07-27T03:08:34.930564+0000","last_became_active":"2024-07-27T03:08:33.947778+0000","last_became_peered":"2024-07-27T03:08:33.947778+0000","last_unstale":"2024-07-27T03:08:34.930564+0000","last_undegraded":"2024-07-27T03:08:34.930564+0000","last_fullsized":"2024-07-27T03:08:34.930564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:13:24.620410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937480+0000","last_change":"2024-07-27T03:08:32.937480+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937480+0000","last_undegraded":"2024-07-27T03:08:32.937480+0000","last_fullsized":"2024-07-27T03:08:32.937480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942257+0000","last_change":"2024-07-27T03:08:32.942257+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942257+0000","last_undegraded":"2024-07-27T03:08:32.942257+0000","last_fullsized":"2024-07-27T03:08:32.942257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932921+0000","last_change":"2024-07-27T03:08:32.932921+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932921+0000","last_undegraded":"2024-07-27T03:08:32.932921+0000","last_fullsized":"2024-07-27T03:08:32.932921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939520+0000","last_change":"2024-07-27T03:08:32.939520+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939520+0000","last_undegraded":"2024-07-27T03:08:32.939520+0000","last_fullsized":"2024-07-27T03:08:32.939520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933962+0000","last_change":"2024-07-27T03:08:33.957896+0000","last_active":"2024-07-27T03:08:35.933962+0000","last_peered":"2024-07-27T03:08:35.933962+0000","last_clean":"2024-07-27T03:08:35.933962+0000","last_became_active":"2024-07-27T03:08:33.957571+0000","last_became_peered":"2024-07-27T03:08:33.957571+0000","last_unstale":"2024-07-27T03:08:35.933962+0000","last_undegraded":"2024-07-27T03:08:35.933962+0000","last_fullsized":"2024-07-27T03:08:35.933962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:02:10.905040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931554+0000","last_change":"2024-07-27T03:08:33.933266+0000","last_active":"2024-07-27T03:08:34.931554+0000","last_peered":"2024-07-27T03:08:34.931554+0000","last_clean":"2024-07-27T03:08:34.931554+0000","last_became_active":"2024-07-27T03:08:33.932884+0000","last_became_peered":"2024-07-27T03:08:33.932884+0000","last_unstale":"2024-07-27T03:08:34.931554+0000","last_undegraded":"2024-07-27T03:08:34.931554+0000","last_fullsized":"2024-07-27T03:08:34.931554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:39.773288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954389+0000","last_change":"2024-07-27T03:08:32.950534+0000","last_active":"2024-07-27T03:08:32.954389+0000","last_peered":"2024-07-27T03:08:32.954389+0000","last_clean":"2024-07-27T03:08:32.954389+0000","last_became_active":"2024-07-27T03:08:32.949394+0000","last_became_peered":"2024-07-27T03:08:32.949394+0000","last_unstale":"2024-07-27T03:08:32.954389+0000","last_undegraded":"2024-07-27T03:08:32.954389+0000","last_fullsized":"2024-07-27T03:08:32.954389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:38:40.192147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941689+0000","last_change":"2024-07-27T03:08:32.941689+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941689+0000","last_undegraded":"2024-07-27T03:08:32.941689+0000","last_fullsized":"2024-07-27T03:08:32.941689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933676+0000","last_change":"2024-07-27T03:08:32.946959+0000","last_active":"2024-07-27T03:08:35.933676+0000","last_peered":"2024-07-27T03:08:35.933676+0000","last_clean":"2024-07-27T03:08:35.933676+0000","last_became_active":"2024-07-27T03:08:32.946603+0000","last_became_peered":"2024-07-27T03:08:32.946603+0000","last_unstale":"2024-07-27T03:08:35.933676+0000","last_undegraded":"2024-07-27T03:08:35.933676+0000","last_fullsized":"2024-07-27T03:08:35.933676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:24:33.462183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955155+0000","last_change":"2024-07-27T03:08:32.951105+0000","last_active":"2024-07-27T03:08:32.955155+0000","last_peered":"2024-07-27T03:08:32.955155+0000","last_clean":"2024-07-27T03:08:32.955155+0000","last_became_active":"2024-07-27T03:08:32.950768+0000","last_became_peered":"2024-07-27T03:08:32.950768+0000","last_unstale":"2024-07-27T03:08:32.955155+0000","last_undegraded":"2024-07-27T03:08:32.955155+0000","last_fullsized":"2024-07-27T03:08:32.955155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:46:37.612264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938068+0000","last_change":"2024-07-27T03:08:32.938068+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938068+0000","last_undegraded":"2024-07-27T03:08:32.938068+0000","last_fullsized":"2024-07-27T03:08:32.938068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.953967+0000","last_change":"2024-07-27T03:08:32.951650+0000","last_active":"2024-07-27T03:08:32.953967+0000","last_peered":"2024-07-27T03:08:32.953967+0000","last_clean":"2024-07-27T03:08:32.953967+0000","last_became_active":"2024-07-27T03:08:32.950807+0000","last_became_peered":"2024-07-27T03:08:32.950807+0000","last_unstale":"2024-07-27T03:08:32.953967+0000","last_undegraded":"2024-07-27T03:08:32.953967+0000","last_fullsized":"2024-07-27T03:08:32.953967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930234+0000","last_change":"2024-07-27T03:08:33.955840+0000","last_active":"2024-07-27T03:08:34.930234+0000","last_peered":"2024-07-27T03:08:34.930234+0000","last_clean":"2024-07-27T03:08:34.930234+0000","last_became_active":"2024-07-27T03:08:33.955515+0000","last_became_peered":"2024-07-27T03:08:33.955515+0000","last_unstale":"2024-07-27T03:08:34.930234+0000","last_undegraded":"2024-07-27T03:08:34.930234+0000","last_fullsized":"2024-07-27T03:08:34.930234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933924+0000","last_change":"2024-07-27T03:08:32.952580+0000","last_active":"2024-07-27T03:08:35.933924+0000","last_peered":"2024-07-27T03:08:35.933924+0000","last_clean":"2024-07-27T03:08:35.933924+0000","last_became_active":"2024-07-27T03:08:32.951849+0000","last_became_peered":"2024-07-27T03:08:32.951849+0000","last_unstale":"2024-07-27T03:08:35.933924+0000","last_undegraded":"2024-07-27T03:08:35.933924+0000","last_fullsized":"2024-07-27T03:08:35.933924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:24.797895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.931277+0000","last_change":"2024-07-27T03:08:32.931277+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.931277+0000","last_undegraded":"2024-07-27T03:08:32.931277+0000","last_fullsized":"2024-07-27T03:08:32.931277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952980+0000","last_change":"2024-07-27T03:08:32.948775+0000","last_active":"2024-07-27T03:08:32.952980+0000","last_peered":"2024-07-27T03:08:32.952980+0000","last_clean":"2024-07-27T03:08:32.952980+0000","last_became_active":"2024-07-27T03:08:32.948396+0000","last_became_peered":"2024-07-27T03:08:32.948396+0000","last_unstale":"2024-07-27T03:08:32.952980+0000","last_undegraded":"2024-07-27T03:08:32.952980+0000","last_fullsized":"2024-07-27T03:08:32.952980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:47:24.675277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939533+0000","last_change":"2024-07-27T03:08:32.939533+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939533+0000","last_undegraded":"2024-07-27T03:08:32.939533+0000","last_fullsized":"2024-07-27T03:08:32.939533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930431+0000","last_change":"2024-07-27T03:08:32.950138+0000","last_active":"2024-07-27T03:08:34.930431+0000","last_peered":"2024-07-27T03:08:34.930431+0000","last_clean":"2024-07-27T03:08:34.930431+0000","last_became_active":"2024-07-27T03:08:32.949805+0000","last_became_peered":"2024-07-27T03:08:32.949805+0000","last_unstale":"2024-07-27T03:08:34.930431+0000","last_undegraded":"2024-07-27T03:08:34.930431+0000","last_fullsized":"2024-07-27T03:08:34.930431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:54:05.204464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932119+0000","last_change":"2024-07-27T03:08:33.949864+0000","last_active":"2024-07-27T03:08:34.932119+0000","last_peered":"2024-07-27T03:08:34.932119+0000","last_clean":"2024-07-27T03:08:34.932119+0000","last_became_active":"2024-07-27T03:08:33.949559+0000","last_became_peered":"2024-07-27T03:08:33.949559+0000","last_unstale":"2024-07-27T03:08:34.932119+0000","last_undegraded":"2024-07-27T03:08:34.932119+0000","last_fullsized":"2024-07-27T03:08:34.932119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:54:06.207049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933893+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:35.933893+0000","last_peered":"2024-07-27T03:08:35.933893+0000","last_clean":"2024-07-27T03:08:35.933893+0000","last_became_active":"2024-07-27T03:08:32.950507+0000","last_became_peered":"2024-07-27T03:08:32.950507+0000","last_unstale":"2024-07-27T03:08:35.933893+0000","last_undegraded":"2024-07-27T03:08:35.933893+0000","last_fullsized":"2024-07-27T03:08:35.933893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:38.770703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.946040+0000","last_change":"2024-07-27T03:08:32.946040+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.946040+0000","last_undegraded":"2024-07-27T03:08:32.946040+0000","last_fullsized":"2024-07-27T03:08:32.946040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.948106+0000","last_change":"2024-07-27T03:08:32.944499+0000","last_active":"2024-07-27T03:08:32.948106+0000","last_peered":"2024-07-27T03:08:32.948106+0000","last_clean":"2024-07-27T03:08:32.948106+0000","last_became_active":"2024-07-27T03:08:32.943866+0000","last_became_peered":"2024-07-27T03:08:32.943866+0000","last_unstale":"2024-07-27T03:08:32.948106+0000","last_undegraded":"2024-07-27T03:08:32.948106+0000","last_fullsized":"2024-07-27T03:08:32.948106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938893+0000","last_change":"2024-07-27T03:08:32.938893+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938893+0000","last_undegraded":"2024-07-27T03:08:32.938893+0000","last_fullsized":"2024-07-27T03:08:32.938893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952978+0000","last_change":"2024-07-27T03:08:32.949082+0000","last_active":"2024-07-27T03:08:32.952978+0000","last_peered":"2024-07-27T03:08:32.952978+0000","last_clean":"2024-07-27T03:08:32.952978+0000","last_became_active":"2024-07-27T03:08:32.948684+0000","last_became_peered":"2024-07-27T03:08:32.948684+0000","last_unstale":"2024-07-27T03:08:32.952978+0000","last_undegraded":"2024-07-27T03:08:32.952978+0000","last_fullsized":"2024-07-27T03:08:32.952978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942562+0000","last_change":"2024-07-27T03:08:32.942562+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942562+0000","last_undegraded":"2024-07-27T03:08:32.942562+0000","last_fullsized":"2024-07-27T03:08:32.942562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933743+0000","last_change":"2024-07-27T03:08:32.952599+0000","last_active":"2024-07-27T03:08:35.933743+0000","last_peered":"2024-07-27T03:08:35.933743+0000","last_clean":"2024-07-27T03:08:35.933743+0000","last_became_active":"2024-07-27T03:08:32.952293+0000","last_became_peered":"2024-07-27T03:08:32.952293+0000","last_unstale":"2024-07-27T03:08:35.933743+0000","last_undegraded":"2024-07-27T03:08:35.933743+0000","last_fullsized":"2024-07-27T03:08:35.933743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:01:24.017164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934003+0000","last_change":"2024-07-27T03:08:33.957887+0000","last_active":"2024-07-27T03:08:35.934003+0000","last_peered":"2024-07-27T03:08:35.934003+0000","last_clean":"2024-07-27T03:08:35.934003+0000","last_became_active":"2024-07-27T03:08:33.957528+0000","last_became_peered":"2024-07-27T03:08:33.957528+0000","last_unstale":"2024-07-27T03:08:35.934003+0000","last_undegraded":"2024-07-27T03:08:35.934003+0000","last_fullsized":"2024-07-27T03:08:35.934003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:52:05.096628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954927+0000","last_change":"2024-07-27T03:08:32.946673+0000","last_active":"2024-07-27T03:08:32.954927+0000","last_peered":"2024-07-27T03:08:32.954927+0000","last_clean":"2024-07-27T03:08:32.954927+0000","last_became_active":"2024-07-27T03:08:32.946188+0000","last_became_peered":"2024-07-27T03:08:32.946188+0000","last_unstale":"2024-07-27T03:08:32.954927+0000","last_undegraded":"2024-07-27T03:08:32.954927+0000","last_fullsized":"2024-07-27T03:08:32.954927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943653+0000","last_change":"2024-07-27T03:08:32.943653+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943653+0000","last_undegraded":"2024-07-27T03:08:32.943653+0000","last_fullsized":"2024-07-27T03:08:32.943653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931892+0000","last_change":"2024-07-27T03:08:32.943381+0000","last_active":"2024-07-27T03:08:34.931892+0000","last_peered":"2024-07-27T03:08:34.931892+0000","last_clean":"2024-07-27T03:08:34.931892+0000","last_became_active":"2024-07-27T03:08:32.943077+0000","last_became_peered":"2024-07-27T03:08:32.943077+0000","last_unstale":"2024-07-27T03:08:34.931892+0000","last_undegraded":"2024-07-27T03:08:34.931892+0000","last_fullsized":"2024-07-27T03:08:34.931892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:56:08.696748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942348+0000","last_change":"2024-07-27T03:08:32.942348+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942348+0000","last_undegraded":"2024-07-27T03:08:32.942348+0000","last_fullsized":"2024-07-27T03:08:32.942348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955378+0000","last_change":"2024-07-27T03:08:32.952496+0000","last_active":"2024-07-27T03:08:32.955378+0000","last_peered":"2024-07-27T03:08:32.955378+0000","last_clean":"2024-07-27T03:08:32.955378+0000","last_became_active":"2024-07-27T03:08:32.952196+0000","last_became_peered":"2024-07-27T03:08:32.952196+0000","last_unstale":"2024-07-27T03:08:32.955378+0000","last_undegraded":"2024-07-27T03:08:32.955378+0000","last_fullsized":"2024-07-27T03:08:32.955378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944346+0000","last_change":"2024-07-27T03:08:32.944346+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944346+0000","last_undegraded":"2024-07-27T03:08:32.944346+0000","last_fullsized":"2024-07-27T03:08:32.944346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930593+0000","last_change":"2024-07-27T03:08:32.941336+0000","last_active":"2024-07-27T03:08:34.930593+0000","last_peered":"2024-07-27T03:08:34.930593+0000","last_clean":"2024-07-27T03:08:34.930593+0000","last_became_active":"2024-07-27T03:08:32.940512+0000","last_became_peered":"2024-07-27T03:08:32.940512+0000","last_unstale":"2024-07-27T03:08:34.930593+0000","last_undegraded":"2024-07-27T03:08:34.930593+0000","last_fullsized":"2024-07-27T03:08:34.930593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:28:24.786534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930629+0000","last_change":"2024-07-27T03:08:32.930629+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930629+0000","last_undegraded":"2024-07-27T03:08:32.930629+0000","last_fullsized":"2024-07-27T03:08:32.930629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955415+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:32.955415+0000","last_peered":"2024-07-27T03:08:32.955415+0000","last_clean":"2024-07-27T03:08:32.955415+0000","last_became_active":"2024-07-27T03:08:32.950533+0000","last_became_peered":"2024-07-27T03:08:32.950533+0000","last_unstale":"2024-07-27T03:08:32.955415+0000","last_undegraded":"2024-07-27T03:08:32.955415+0000","last_fullsized":"2024-07-27T03:08:32.955415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.945555+0000","last_change":"2024-07-27T03:08:32.945555+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.945555+0000","last_undegraded":"2024-07-27T03:08:32.945555+0000","last_fullsized":"2024-07-27T03:08:32.945555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.945496+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:08:32.945496+0000","last_peered":"2024-07-27T03:08:32.945496+0000","last_clean":"2024-07-27T03:08:32.945496+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:08:32.945496+0000","last_undegraded":"2024-07-27T03:08:32.945496+0000","last_fullsized":"2024-07-27T03:08:32.945496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952753+0000","last_change":"2024-07-27T03:08:32.948243+0000","last_active":"2024-07-27T03:08:32.952753+0000","last_peered":"2024-07-27T03:08:32.952753+0000","last_clean":"2024-07-27T03:08:32.952753+0000","last_became_active":"2024-07-27T03:08:32.947945+0000","last_became_peered":"2024-07-27T03:08:32.947945+0000","last_unstale":"2024-07-27T03:08:32.952753+0000","last_undegraded":"2024-07-27T03:08:32.952753+0000","last_fullsized":"2024-07-27T03:08:32.952753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:11.565566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936654+0000","last_change":"2024-07-27T03:08:32.936654+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936654+0000","last_undegraded":"2024-07-27T03:08:32.936654+0000","last_fullsized":"2024-07-27T03:08:32.936654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957294+0000","last_change":"2024-07-27T03:08:32.955404+0000","last_active":"2024-07-27T03:08:32.957294+0000","last_peered":"2024-07-27T03:08:32.957294+0000","last_clean":"2024-07-27T03:08:32.957294+0000","last_became_active":"2024-07-27T03:08:32.955120+0000","last_became_peered":"2024-07-27T03:08:32.955120+0000","last_unstale":"2024-07-27T03:08:32.957294+0000","last_undegraded":"2024-07-27T03:08:32.957294+0000","last_fullsized":"2024-07-27T03:08:32.957294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:16:05.521168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939804+0000","last_change":"2024-07-27T03:08:32.939804+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939804+0000","last_undegraded":"2024-07-27T03:08:32.939804+0000","last_fullsized":"2024-07-27T03:08:32.939804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955294+0000","last_change":"2024-07-27T03:08:32.951299+0000","last_active":"2024-07-27T03:08:32.955294+0000","last_peered":"2024-07-27T03:08:32.955294+0000","last_clean":"2024-07-27T03:08:32.955294+0000","last_became_active":"2024-07-27T03:08:32.950946+0000","last_became_peered":"2024-07-27T03:08:32.950946+0000","last_unstale":"2024-07-27T03:08:32.955294+0000","last_undegraded":"2024-07-27T03:08:32.955294+0000","last_fullsized":"2024-07-27T03:08:32.955294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:09.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930286+0000","last_change":"2024-07-27T03:08:33.937577+0000","last_active":"2024-07-27T03:08:34.930286+0000","last_peered":"2024-07-27T03:08:34.930286+0000","last_clean":"2024-07-27T03:08:34.930286+0000","last_became_active":"2024-07-27T03:08:33.937262+0000","last_became_peered":"2024-07-27T03:08:33.937262+0000","last_unstale":"2024-07-27T03:08:34.930286+0000","last_undegraded":"2024-07-27T03:08:34.930286+0000","last_fullsized":"2024-07-27T03:08:34.930286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.948881+0000","last_change":"2024-07-27T03:08:32.943293+0000","last_active":"2024-07-27T03:08:32.948881+0000","last_peered":"2024-07-27T03:08:32.948881+0000","last_clean":"2024-07-27T03:08:32.948881+0000","last_became_active":"2024-07-27T03:08:32.942974+0000","last_became_peered":"2024-07-27T03:08:32.942974+0000","last_unstale":"2024-07-27T03:08:32.948881+0000","last_undegraded":"2024-07-27T03:08:32.948881+0000","last_fullsized":"2024-07-27T03:08:32.948881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:41:35.306112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932094+0000","last_change":"2024-07-27T03:08:33.954605+0000","last_active":"2024-07-27T03:08:34.932094+0000","last_peered":"2024-07-27T03:08:34.932094+0000","last_clean":"2024-07-27T03:08:34.932094+0000","last_became_active":"2024-07-27T03:08:33.954160+0000","last_became_peered":"2024-07-27T03:08:33.954160+0000","last_unstale":"2024-07-27T03:08:34.932094+0000","last_undegraded":"2024-07-27T03:08:34.932094+0000","last_fullsized":"2024-07-27T03:08:34.932094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:32.582766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930412+0000","last_change":"2024-07-27T03:08:32.938940+0000","last_active":"2024-07-27T03:08:34.930412+0000","last_peered":"2024-07-27T03:08:34.930412+0000","last_clean":"2024-07-27T03:08:34.930412+0000","last_became_active":"2024-07-27T03:08:32.938639+0000","last_became_peered":"2024-07-27T03:08:32.938639+0000","last_unstale":"2024-07-27T03:08:34.930412+0000","last_undegraded":"2024-07-27T03:08:34.930412+0000","last_fullsized":"2024-07-27T03:08:34.930412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:24.797895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930264+0000","last_change":"2024-07-27T03:08:32.930264+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930264+0000","last_undegraded":"2024-07-27T03:08:32.930264+0000","last_fullsized":"2024-07-27T03:08:32.930264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957073+0000","last_change":"2024-07-27T03:08:32.955213+0000","last_active":"2024-07-27T03:08:32.957073+0000","last_peered":"2024-07-27T03:08:32.957073+0000","last_clean":"2024-07-27T03:08:32.957073+0000","last_became_active":"2024-07-27T03:08:32.954883+0000","last_became_peered":"2024-07-27T03:08:32.954883+0000","last_unstale":"2024-07-27T03:08:32.957073+0000","last_undegraded":"2024-07-27T03:08:32.957073+0000","last_fullsized":"2024-07-27T03:08:32.957073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:02:35.203630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930594+0000","last_change":"2024-07-27T03:08:33.941170+0000","last_active":"2024-07-27T03:08:34.930594+0000","last_peered":"2024-07-27T03:08:34.930594+0000","last_clean":"2024-07-27T03:08:34.930594+0000","last_became_active":"2024-07-27T03:08:33.940792+0000","last_became_peered":"2024-07-27T03:08:33.940792+0000","last_unstale":"2024-07-27T03:08:34.930594+0000","last_undegraded":"2024-07-27T03:08:34.930594+0000","last_fullsized":"2024-07-27T03:08:34.930594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:35:01.175302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930630+0000","last_change":"2024-07-27T03:08:32.945506+0000","last_active":"2024-07-27T03:08:34.930630+0000","last_peered":"2024-07-27T03:08:34.930630+0000","last_clean":"2024-07-27T03:08:34.930630+0000","last_became_active":"2024-07-27T03:08:32.945201+0000","last_became_peered":"2024-07-27T03:08:32.945201+0000","last_unstale":"2024-07-27T03:08:34.930630+0000","last_undegraded":"2024-07-27T03:08:34.930630+0000","last_fullsized":"2024-07-27T03:08:34.930630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:58:54.316561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937005+0000","last_change":"2024-07-27T03:08:32.937005+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937005+0000","last_undegraded":"2024-07-27T03:08:32.937005+0000","last_fullsized":"2024-07-27T03:08:32.937005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934062+0000","last_change":"2024-07-27T03:08:32.949210+0000","last_active":"2024-07-27T03:08:35.934062+0000","last_peered":"2024-07-27T03:08:35.934062+0000","last_clean":"2024-07-27T03:08:35.934062+0000","last_became_active":"2024-07-27T03:08:32.948858+0000","last_became_peered":"2024-07-27T03:08:32.948858+0000","last_unstale":"2024-07-27T03:08:35.934062+0000","last_undegraded":"2024-07-27T03:08:35.934062+0000","last_fullsized":"2024-07-27T03:08:35.934062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:31.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938880+0000","last_change":"2024-07-27T03:08:32.938880+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938880+0000","last_undegraded":"2024-07-27T03:08:32.938880+0000","last_fullsized":"2024-07-27T03:08:32.938880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957075+0000","last_change":"2024-07-27T03:08:32.955144+0000","last_active":"2024-07-27T03:08:32.957075+0000","last_peered":"2024-07-27T03:08:32.957075+0000","last_clean":"2024-07-27T03:08:32.957075+0000","last_became_active":"2024-07-27T03:08:32.954645+0000","last_became_peered":"2024-07-27T03:08:32.954645+0000","last_unstale":"2024-07-27T03:08:32.957075+0000","last_undegraded":"2024-07-27T03:08:32.957075+0000","last_fullsized":"2024-07-27T03:08:32.957075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932211+0000","last_change":"2024-07-27T03:08:33.941376+0000","last_active":"2024-07-27T03:08:34.932211+0000","last_peered":"2024-07-27T03:08:34.932211+0000","last_clean":"2024-07-27T03:08:34.932211+0000","last_became_active":"2024-07-27T03:08:33.940032+0000","last_became_peered":"2024-07-27T03:08:33.940032+0000","last_unstale":"2024-07-27T03:08:34.932211+0000","last_undegraded":"2024-07-27T03:08:34.932211+0000","last_fullsized":"2024-07-27T03:08:34.932211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:28:25.789119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930293+0000","last_change":"2024-07-27T03:08:32.947719+0000","last_active":"2024-07-27T03:08:34.930293+0000","last_peered":"2024-07-27T03:08:34.930293+0000","last_clean":"2024-07-27T03:08:34.930293+0000","last_became_active":"2024-07-27T03:08:32.947422+0000","last_became_peered":"2024-07-27T03:08:32.947422+0000","last_unstale":"2024-07-27T03:08:34.930293+0000","last_undegraded":"2024-07-27T03:08:34.930293+0000","last_fullsized":"2024-07-27T03:08:34.930293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:31.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937564+0000","last_change":"2024-07-27T03:08:32.937564+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937564+0000","last_undegraded":"2024-07-27T03:08:32.937564+0000","last_fullsized":"2024-07-27T03:08:32.937564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930426+0000","last_change":"2024-07-27T03:08:32.950885+0000","last_active":"2024-07-27T03:08:34.930426+0000","last_peered":"2024-07-27T03:08:34.930426+0000","last_clean":"2024-07-27T03:08:34.930426+0000","last_became_active":"2024-07-27T03:08:32.950569+0000","last_became_peered":"2024-07-27T03:08:32.950569+0000","last_unstale":"2024-07-27T03:08:34.930426+0000","last_undegraded":"2024-07-27T03:08:34.930426+0000","last_fullsized":"2024-07-27T03:08:34.930426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:38.770703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939020+0000","last_change":"2024-07-27T03:08:32.939020+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939020+0000","last_undegraded":"2024-07-27T03:08:32.939020+0000","last_fullsized":"2024-07-27T03:08:32.939020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954983+0000","last_change":"2024-07-27T03:08:32.952714+0000","last_active":"2024-07-27T03:08:32.954983+0000","last_peered":"2024-07-27T03:08:32.954983+0000","last_clean":"2024-07-27T03:08:32.954983+0000","last_became_active":"2024-07-27T03:08:32.952425+0000","last_became_peered":"2024-07-27T03:08:32.952425+0000","last_unstale":"2024-07-27T03:08:32.954983+0000","last_undegraded":"2024-07-27T03:08:32.954983+0000","last_fullsized":"2024-07-27T03:08:32.954983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934081+0000","last_change":"2024-07-27T03:08:33.957221+0000","last_active":"2024-07-27T03:08:35.934081+0000","last_peered":"2024-07-27T03:08:35.934081+0000","last_clean":"2024-07-27T03:08:35.934081+0000","last_became_active":"2024-07-27T03:08:33.956847+0000","last_became_peered":"2024-07-27T03:08:33.956847+0000","last_unstale":"2024-07-27T03:08:35.934081+0000","last_undegraded":"2024-07-27T03:08:35.934081+0000","last_fullsized":"2024-07-27T03:08:35.934081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.934157+0000","last_change":"2024-07-27T03:08:32.934157+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.934157+0000","last_undegraded":"2024-07-27T03:08:32.934157+0000","last_fullsized":"2024-07-27T03:08:32.934157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955022+0000","last_change":"2024-07-27T03:08:32.953454+0000","last_active":"2024-07-27T03:08:32.955022+0000","last_peered":"2024-07-27T03:08:32.955022+0000","last_clean":"2024-07-27T03:08:32.955022+0000","last_became_active":"2024-07-27T03:08:32.953065+0000","last_became_peered":"2024-07-27T03:08:32.953065+0000","last_unstale":"2024-07-27T03:08:32.955022+0000","last_undegraded":"2024-07-27T03:08:32.955022+0000","last_fullsized":"2024-07-27T03:08:32.955022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:09.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932374+0000","last_change":"2024-07-27T03:08:32.932374+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932374+0000","last_undegraded":"2024-07-27T03:08:32.932374+0000","last_fullsized":"2024-07-27T03:08:32.932374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955390+0000","last_change":"2024-07-27T03:08:32.951809+0000","last_active":"2024-07-27T03:08:32.955390+0000","last_peered":"2024-07-27T03:08:32.955390+0000","last_clean":"2024-07-27T03:08:32.955390+0000","last_became_active":"2024-07-27T03:08:32.951495+0000","last_became_peered":"2024-07-27T03:08:32.951495+0000","last_unstale":"2024-07-27T03:08:32.955390+0000","last_undegraded":"2024-07-27T03:08:32.955390+0000","last_fullsized":"2024-07-27T03:08:32.955390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942235+0000","last_change":"2024-07-27T03:08:32.942235+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942235+0000","last_undegraded":"2024-07-27T03:08:32.942235+0000","last_fullsized":"2024-07-27T03:08:32.942235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955199+0000","last_change":"2024-07-27T03:08:32.951332+0000","last_active":"2024-07-27T03:08:32.955199+0000","last_peered":"2024-07-27T03:08:32.955199+0000","last_clean":"2024-07-27T03:08:32.955199+0000","last_became_active":"2024-07-27T03:08:32.949369+0000","last_became_peered":"2024-07-27T03:08:32.949369+0000","last_unstale":"2024-07-27T03:08:32.955199+0000","last_undegraded":"2024-07-27T03:08:32.955199+0000","last_fullsized":"2024-07-27T03:08:32.955199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:56:08.696748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937647+0000","last_change":"2024-07-27T03:08:32.937647+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937647+0000","last_undegraded":"2024-07-27T03:08:32.937647+0000","last_fullsized":"2024-07-27T03:08:32.937647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954743+0000","last_change":"2024-07-27T03:08:32.949235+0000","last_active":"2024-07-27T03:08:32.954743+0000","last_peered":"2024-07-27T03:08:32.954743+0000","last_clean":"2024-07-27T03:08:32.954743+0000","last_became_active":"2024-07-27T03:08:32.948934+0000","last_became_peered":"2024-07-27T03:08:32.948934+0000","last_unstale":"2024-07-27T03:08:32.954743+0000","last_undegraded":"2024-07-27T03:08:32.954743+0000","last_fullsized":"2024-07-27T03:08:32.954743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":778240,"data_stored":648304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":778240,"data_stored":648304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:08:38.710 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-07-27T03:08:38.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.945279+0000', 'last_change': '2024-07-27T03:08:32.945279+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.945279+0000', 'last_undegraded': '2024-07-27T03:08:32.945279+0000', 'last_fullsized': '2024-07-27T03:08:32.945279+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:08:38.711 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-07-27T03:08:38.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.946181+0000', 'last_change': '2024-07-27T03:08:32.946181+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.946181+0000', 'last_undegraded': '2024-07-27T03:08:32.946181+0000', 'last_fullsized': '2024-07-27T03:08:32.946181+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:08:38.711 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-07-27T03:08:38.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.933499+0000', 'last_change': '2024-07-27T03:08:32.933499+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.933499+0000', 'last_undegraded': '2024-07-27T03:08:32.933499+0000', 'last_fullsized': '2024-07-27T03:08:32.933499+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.711 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-07-27T03:08:38.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.943108+0000', 'last_change': '2024-07-27T03:08:32.943108+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.943108+0000', 'last_undegraded': '2024-07-27T03:08:32.943108+0000', 'last_fullsized': '2024-07-27T03:08:32.943108+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:08:38.711 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-07-27T03:08:38.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.936828+0000', 'last_change': '2024-07-27T03:08:32.936828+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.936828+0000', 'last_undegraded': '2024-07-27T03:08:32.936828+0000', 'last_fullsized': '2024-07-27T03:08:32.936828+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.711 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-07-27T03:08:38.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.944159+0000', 'last_change': '2024-07-27T03:08:32.944159+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.944159+0000', 'last_undegraded': '2024-07-27T03:08:32.944159+0000', 'last_fullsized': '2024-07-27T03:08:32.944159+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:08:38.712 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-07-27T03:08:38.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.941576+0000', 'last_change': '2024-07-27T03:08:32.941576+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.941576+0000', 'last_undegraded': '2024-07-27T03:08:32.941576+0000', 'last_fullsized': '2024-07-27T03:08:32.941576+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:08:38.712 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-07-27T03:08:38.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.944810+0000', 'last_change': '2024-07-27T03:08:32.944810+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.944810+0000', 'last_undegraded': '2024-07-27T03:08:32.944810+0000', 'last_fullsized': '2024-07-27T03:08:32.944810+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:08:38.712 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-07-27T03:08:38.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.942291+0000', 'last_change': '2024-07-27T03:08:32.942291+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.942291+0000', 'last_undegraded': '2024-07-27T03:08:32.942291+0000', 'last_fullsized': '2024-07-27T03:08:32.942291+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:08:38.712 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-07-27T03:08:38.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.943758+0000', 'last_change': '2024-07-27T03:08:32.943758+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.943758+0000', 'last_undegraded': '2024-07-27T03:08:32.943758+0000', 'last_fullsized': '2024-07-27T03:08:32.943758+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:08:38.712 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-07-27T03:08:38.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.932754+0000', 'last_change': '2024-07-27T03:08:32.932754+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.932754+0000', 'last_undegraded': '2024-07-27T03:08:32.932754+0000', 'last_fullsized': '2024-07-27T03:08:32.932754+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.930214+0000', 'last_change': '2024-07-27T03:08:32.930214+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.930214+0000', 'last_undegraded': '2024-07-27T03:08:32.930214+0000', 'last_fullsized': '2024-07-27T03:08:32.930214+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.940671+0000', 'last_change': '2024-07-27T03:08:32.940671+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.940671+0000', 'last_undegraded': '2024-07-27T03:08:32.940671+0000', 'last_fullsized': '2024-07-27T03:08:32.940671+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.942651+0000', 'last_change': '2024-07-27T03:08:32.942651+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.942651+0000', 'last_undegraded': '2024-07-27T03:08:32.942651+0000', 'last_fullsized': '2024-07-27T03:08:32.942651+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.943747+0000', 'last_change': '2024-07-27T03:08:32.943747+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.943747+0000', 'last_undegraded': '2024-07-27T03:08:32.943747+0000', 'last_fullsized': '2024-07-27T03:08:32.943747+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.936307+0000', 'last_change': '2024-07-27T03:08:32.936307+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.936307+0000', 'last_undegraded': '2024-07-27T03:08:32.936307+0000', 'last_fullsized': '2024-07-27T03:08:32.936307+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-07-27T03:08:38.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.943211+0000', 'last_change': '2024-07-27T03:08:32.943211+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.943211+0000', 'last_undegraded': '2024-07-27T03:08:32.943211+0000', 'last_fullsized': '2024-07-27T03:08:32.943211+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:08:38.714 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-07-27T03:08:38.714 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.931016+0000', 'last_change': '2024-07-27T03:08:32.931016+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.931016+0000', 'last_undegraded': '2024-07-27T03:08:32.931016+0000', 'last_fullsized': '2024-07-27T03:08:32.931016+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.714 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-07-27T03:08:38.714 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.941812+0000', 'last_change': '2024-07-27T03:08:32.941812+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.941812+0000', 'last_undegraded': '2024-07-27T03:08:32.941812+0000', 'last_fullsized': '2024-07-27T03:08:32.941812+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:08:38.714 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-07-27T03:08:38.714 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.937480+0000', 'last_change': '2024-07-27T03:08:32.937480+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.937480+0000', 'last_undegraded': '2024-07-27T03:08:32.937480+0000', 'last_fullsized': '2024-07-27T03:08:32.937480+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:08:38.714 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-07-27T03:08:38.714 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.942257+0000', 'last_change': '2024-07-27T03:08:32.942257+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.942257+0000', 'last_undegraded': '2024-07-27T03:08:32.942257+0000', 'last_fullsized': '2024-07-27T03:08:32.942257+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:08:38.714 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-07-27T03:08:38.714 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.932921+0000', 'last_change': '2024-07-27T03:08:32.932921+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.932921+0000', 'last_undegraded': '2024-07-27T03:08:32.932921+0000', 'last_fullsized': '2024-07-27T03:08:32.932921+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.715 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-07-27T03:08:38.715 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.939520+0000', 'last_change': '2024-07-27T03:08:32.939520+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.939520+0000', 'last_undegraded': '2024-07-27T03:08:32.939520+0000', 'last_fullsized': '2024-07-27T03:08:32.939520+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-27T03:08:38.715 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-07-27T03:08:38.715 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.941689+0000', 'last_change': '2024-07-27T03:08:32.941689+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.941689+0000', 'last_undegraded': '2024-07-27T03:08:32.941689+0000', 'last_fullsized': '2024-07-27T03:08:32.941689+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:08:38.715 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-07-27T03:08:38.715 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.938068+0000', 'last_change': '2024-07-27T03:08:32.938068+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.938068+0000', 'last_undegraded': '2024-07-27T03:08:32.938068+0000', 'last_fullsized': '2024-07-27T03:08:32.938068+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:08:38.715 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-07-27T03:08:38.715 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.931277+0000', 'last_change': '2024-07-27T03:08:32.931277+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.931277+0000', 'last_undegraded': '2024-07-27T03:08:32.931277+0000', 'last_fullsized': '2024-07-27T03:08:32.931277+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.715 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-07-27T03:08:38.715 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.939533+0000', 'last_change': '2024-07-27T03:08:32.939533+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.939533+0000', 'last_undegraded': '2024-07-27T03:08:32.939533+0000', 'last_fullsized': '2024-07-27T03:08:32.939533+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:08:38.715 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-07-27T03:08:38.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.946040+0000', 'last_change': '2024-07-27T03:08:32.946040+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.946040+0000', 'last_undegraded': '2024-07-27T03:08:32.946040+0000', 'last_fullsized': '2024-07-27T03:08:32.946040+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:08:38.716 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-07-27T03:08:38.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.938893+0000', 'last_change': '2024-07-27T03:08:32.938893+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.938893+0000', 'last_undegraded': '2024-07-27T03:08:32.938893+0000', 'last_fullsized': '2024-07-27T03:08:32.938893+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:08:38.716 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-07-27T03:08:38.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.942562+0000', 'last_change': '2024-07-27T03:08:32.942562+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.942562+0000', 'last_undegraded': '2024-07-27T03:08:32.942562+0000', 'last_fullsized': '2024-07-27T03:08:32.942562+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:08:38.716 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-07-27T03:08:38.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.943653+0000', 'last_change': '2024-07-27T03:08:32.943653+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.943653+0000', 'last_undegraded': '2024-07-27T03:08:32.943653+0000', 'last_fullsized': '2024-07-27T03:08:32.943653+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:08:38.716 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-07-27T03:08:38.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.942348+0000', 'last_change': '2024-07-27T03:08:32.942348+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.942348+0000', 'last_undegraded': '2024-07-27T03:08:32.942348+0000', 'last_fullsized': '2024-07-27T03:08:32.942348+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:08:38.716 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-07-27T03:08:38.716 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.944346+0000', 'last_change': '2024-07-27T03:08:32.944346+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.944346+0000', 'last_undegraded': '2024-07-27T03:08:32.944346+0000', 'last_fullsized': '2024-07-27T03:08:32.944346+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:08:38.717 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-07-27T03:08:38.717 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.930629+0000', 'last_change': '2024-07-27T03:08:32.930629+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.930629+0000', 'last_undegraded': '2024-07-27T03:08:32.930629+0000', 'last_fullsized': '2024-07-27T03:08:32.930629+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.717 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-07-27T03:08:38.717 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.945555+0000', 'last_change': '2024-07-27T03:08:32.945555+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.945555+0000', 'last_undegraded': '2024-07-27T03:08:32.945555+0000', 'last_fullsized': '2024-07-27T03:08:32.945555+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:08:38.717 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-07-27T03:08:38.717 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.936654+0000', 'last_change': '2024-07-27T03:08:32.936654+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.936654+0000', 'last_undegraded': '2024-07-27T03:08:32.936654+0000', 'last_fullsized': '2024-07-27T03:08:32.936654+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:08:38.717 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-07-27T03:08:38.717 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.939804+0000', 'last_change': '2024-07-27T03:08:32.939804+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.939804+0000', 'last_undegraded': '2024-07-27T03:08:32.939804+0000', 'last_fullsized': '2024-07-27T03:08:32.939804+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:08:38.717 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-07-27T03:08:38.717 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.930264+0000', 'last_change': '2024-07-27T03:08:32.930264+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.930264+0000', 'last_undegraded': '2024-07-27T03:08:32.930264+0000', 'last_fullsized': '2024-07-27T03:08:32.930264+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.717 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-07-27T03:08:38.718 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.937005+0000', 'last_change': '2024-07-27T03:08:32.937005+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.937005+0000', 'last_undegraded': '2024-07-27T03:08:32.937005+0000', 'last_fullsized': '2024-07-27T03:08:32.937005+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:08:38.718 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-07-27T03:08:38.718 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.938880+0000', 'last_change': '2024-07-27T03:08:32.938880+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.938880+0000', 'last_undegraded': '2024-07-27T03:08:32.938880+0000', 'last_fullsized': '2024-07-27T03:08:32.938880+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:08:38.718 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-07-27T03:08:38.718 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.937564+0000', 'last_change': '2024-07-27T03:08:32.937564+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.937564+0000', 'last_undegraded': '2024-07-27T03:08:32.937564+0000', 'last_fullsized': '2024-07-27T03:08:32.937564+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:08:38.718 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-07-27T03:08:38.718 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.939020+0000', 'last_change': '2024-07-27T03:08:32.939020+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.939020+0000', 'last_undegraded': '2024-07-27T03:08:32.939020+0000', 'last_fullsized': '2024-07-27T03:08:32.939020+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:08:38.718 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-07-27T03:08:38.718 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.934157+0000', 'last_change': '2024-07-27T03:08:32.934157+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.934157+0000', 'last_undegraded': '2024-07-27T03:08:32.934157+0000', 'last_fullsized': '2024-07-27T03:08:32.934157+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.718 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-07-27T03:08:38.718 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.932374+0000', 'last_change': '2024-07-27T03:08:32.932374+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.932374+0000', 'last_undegraded': '2024-07-27T03:08:32.932374+0000', 'last_fullsized': '2024-07-27T03:08:32.932374+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:08:38.719 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-07-27T03:08:38.719 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.942235+0000', 'last_change': '2024-07-27T03:08:32.942235+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.942235+0000', 'last_undegraded': '2024-07-27T03:08:32.942235+0000', 'last_fullsized': '2024-07-27T03:08:32.942235+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:08:38.719 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-07-27T03:08:38.719 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:08:32.937647+0000', 'last_change': '2024-07-27T03:08:32.937647+0000', 'last_active': '2024-07-27T03:08:32.918223+0000', 'last_peered': '2024-07-27T03:08:32.918223+0000', 'last_clean': '2024-07-27T03:08:32.918223+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:08:32.937647+0000', 'last_undegraded': '2024-07-27T03:08:32.937647+0000', 'last_fullsized': '2024-07-27T03:08:32.937647+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'last_clean_scrub_stamp': '2024-07-27T03:08:32.918223+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:08:38.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-07-27T03:08:38.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.856+0000 7fa1da405640 1 -- 172.21.15.120:0/3380401063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1c0003a30 msgr2=0x7fa1c0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.856+0000 7fa1da405640 1 --2- 172.21.15.120:0/3380401063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1c0003a30 0x7fa1c0003ea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4159220 tx=0x7fa1c0005830 comp rx=0 tx=0).stop 2024-07-27T03:08:38.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.856+0000 7fa1d89a2640 1 -- 172.21.15.120:0/3380401063 reap_dead start 2024-07-27T03:08:38.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.856+0000 7fa1da405640 1 -- 172.21.15.120:0/3380401063 shutdown_connections 2024-07-27T03:08:38.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.856+0000 7fa1da405640 1 -- 172.21.15.120:0/3380401063 >> 172.21.15.120:0/3380401063 conn(0x7fa1d406cba0 msgr2=0x7fa1d406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:38.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.856+0000 7fa1da405640 1 -- 172.21.15.120:0/3380401063 shutdown_connections 2024-07-27T03:08:38.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.856+0000 7fa1da405640 1 -- 172.21.15.120:0/3380401063 wait complete. 2024-07-27T03:08:38.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.858+0000 7fa1da405640 1 Processor -- start 2024-07-27T03:08:38.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.858+0000 7fa1da405640 1 -- start start 2024-07-27T03:08:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.859+0000 7fa1da405640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1c0003a30 0x7fa1d413b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.859+0000 7fa1da405640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa1d41f2540 0x7fa1d4072d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.859+0000 7fa1da405640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1d4073240 0x7fa1d4149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.859+0000 7fa1da405640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d41524f0 con 0x7fa1d4073240 2024-07-27T03:08:38.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.859+0000 7fa1da405640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4152370 con 0x7fa1c0003a30 2024-07-27T03:08:38.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.859+0000 7fa1da405640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d40cd590 con 0x7fa1d41f2540 2024-07-27T03:08:38.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.859+0000 7fa1d89a2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1d4073240 0x7fa1d4149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.859+0000 7fa1d89a2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1d4073240 0x7fa1d4149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40882/0 (socket says 172.21.15.120:40882) 2024-07-27T03:08:38.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.859+0000 7fa1d89a2640 1 -- 172.21.15.120:0/1670899705 learned_addr learned my addr 172.21.15.120:0/1670899705 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:38.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.859+0000 7fa1d3fff640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1c0003a30 0x7fa1d413b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.859+0000 7fa1d37fe640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa1d41f2540 0x7fa1d4072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.860+0000 7fa1d89a2640 1 -- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa1d41f2540 msgr2=0x7fa1d4072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.860+0000 7fa1d89a2640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa1d41f2540 0x7fa1d4072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.860+0000 7fa1d89a2640 1 -- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1c0003a30 msgr2=0x7fa1d413b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:38.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.860+0000 7fa1d89a2640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1c0003a30 0x7fa1d413b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:38.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.860+0000 7fa1d89a2640 1 -- 172.21.15.120:0/1670899705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d413bc30 con 0x7fa1d4073240 2024-07-27T03:08:38.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.860+0000 7fa1d89a2640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1d4073240 0x7fa1d4149c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40c5a20 tx=0x7fa1cc0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:38.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.860+0000 7fa1d0ff9640 1 -- 172.21.15.120:0/1670899705 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc017070 con 0x7fa1d4073240 2024-07-27T03:08:38.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.860+0000 7fa1d0ff9640 1 -- 172.21.15.120:0/1670899705 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1cc0108c0 con 0x7fa1d4073240 2024-07-27T03:08:38.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.860+0000 7fa1da405640 1 -- 172.21.15.120:0/1670899705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d4073650 con 0x7fa1d4073240 2024-07-27T03:08:38.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.860+0000 7fa1d0ff9640 1 -- 172.21.15.120:0/1670899705 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc010d10 con 0x7fa1d4073240 2024-07-27T03:08:38.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.860+0000 7fa1da405640 1 -- 172.21.15.120:0/1670899705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d41f2fa0 con 0x7fa1d4073240 2024-07-27T03:08:38.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.861+0000 7fa1da405640 1 -- 172.21.15.120:0/1670899705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d40b5cd0 con 0x7fa1d4073240 2024-07-27T03:08:38.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.862+0000 7fa1d0ff9640 1 -- 172.21.15.120:0/1670899705 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fa1cc01a070 con 0x7fa1d4073240 2024-07-27T03:08:38.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.862+0000 7fa1d0ff9640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa1b4077010 0x7fa1b4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:38.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.862+0000 7fa1d0ff9640 1 -- 172.21.15.120:0/1670899705 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa1cc0985d0 con 0x7fa1d4073240 2024-07-27T03:08:38.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.862+0000 7fa1d3fff640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa1b4077010 0x7fa1b4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:38.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.863+0000 7fa1d3fff640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa1b4077010 0x7fa1b4079520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4033000 tx=0x7fa1c4038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:38.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:38.866+0000 7fa1d0ff9640 1 -- 172.21.15.120:0/1670899705 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fa1d4073650 con 0x7fa1d4073240 2024-07-27T03:08:38.871 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-07-27T03:08:38.868+0000 7fda9f862640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-27T03:08:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.121+0000 7fa1da405640 1 -- 172.21.15.120:0/1670899705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa1d4138c50 con 0x7fa1d4073240 2024-07-27T03:08:39.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.122+0000 7fa1d0ff9640 1 -- 172.21.15.120:0/1670899705 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1139 (secure 0 0 0) 0x7fa1d413bc30 con 0x7fa1d4073240 2024-07-27T03:08:39.126 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:39.126 INFO:teuthology.orchestra.run.smithi120.stdout:{"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":22,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1722049707,"num_in_osds":8,"osd_in_since":1722049699,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":51},{"state_name":"creating+peering","count":46}],"num_pgs":97,"num_pools":3,"num_objects":12,"data_bytes":592162,"bytes_used":224698368,"bytes_avail":772869414912,"bytes_total":773094113280,"inactive_pgs_ratio":0.47422680258750916,"write_bytes_sec":1334,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":8,"btime":"2024-07-27T03:08:36:963563+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4359}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-07-27T03:08:16.131301+0000","services":{}},"progress_events":{}} 2024-07-27T03:08:39.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 -- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa1b4077010 msgr2=0x7fa1b4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:39.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa1b4077010 0x7fa1b4079520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4033000 tx=0x7fa1c4038040 comp rx=0 tx=0).stop 2024-07-27T03:08:39.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 -- 172.21.15.120:0/1670899705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1d4073240 msgr2=0x7fa1d4149c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:39.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1d4073240 0x7fa1d4149c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa1d40c5a20 tx=0x7fa1cc0019b0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 -- 172.21.15.120:0/1670899705 shutdown_connections 2024-07-27T03:08:39.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa1b4077010 0x7fa1b4079520 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1d4073240 0x7fa1d4149c20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa1d41f2540 0x7fa1d4072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 --2- 172.21.15.120:0/1670899705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1c0003a30 0x7fa1d413b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 -- 172.21.15.120:0/1670899705 >> 172.21.15.120:0/1670899705 conn(0x7fa1d406cba0 msgr2=0x7fa1d40b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:39.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 -- 172.21.15.120:0/1670899705 shutdown_connections 2024-07-27T03:08:39.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.124+0000 7fa1da405640 1 -- 172.21.15.120:0/1670899705 wait complete. 2024-07-27T03:08:39.139 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-07-27T03:08:39.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:08:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.249+0000 7fd650606640 1 -- 172.21.15.120:0/936739190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd64806ce90 msgr2=0x7fd6480745a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.249+0000 7fd650606640 1 --2- 172.21.15.120:0/936739190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd64806ce90 0x7fd6480745a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd640005fd0 tx=0x7fd64002a8b0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.249+0000 7fd650606640 1 -- 172.21.15.120:0/936739190 shutdown_connections 2024-07-27T03:08:39.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.249+0000 7fd650606640 1 --2- 172.21.15.120:0/936739190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd64806ce90 0x7fd6480745a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.249+0000 7fd650606640 1 --2- 172.21.15.120:0/936739190 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd64815c8f0 0x7fd648145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.249+0000 7fd650606640 1 -- 172.21.15.120:0/936739190 >> 172.21.15.120:0/936739190 conn(0x7fd6480d0f00 msgr2=0x7fd6480d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:39.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.249+0000 7fd650606640 1 -- 172.21.15.120:0/936739190 shutdown_connections 2024-07-27T03:08:39.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.249+0000 7fd650606640 1 -- 172.21.15.120:0/936739190 wait complete. 2024-07-27T03:08:39.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.251+0000 7fd650606640 1 Processor -- start 2024-07-27T03:08:39.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.251+0000 7fd650606640 1 -- start start 2024-07-27T03:08:39.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.252+0000 7fd650606640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd648073680 0x7fd648155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:39.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.252+0000 7fd650606640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd64815c8f0 0x7fd64812e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:39.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.252+0000 7fd650606640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd648130ac0 0x7fd64812e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:39.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.252+0000 7fd650606640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd6480d03f0 con 0x7fd64815c8f0 2024-07-27T03:08:39.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.252+0000 7fd650606640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd6480d0270 con 0x7fd648073680 2024-07-27T03:08:39.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.252+0000 7fd650606640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd6480d0570 con 0x7fd648130ac0 2024-07-27T03:08:39.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.252+0000 7fd64dba1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd64815c8f0 0x7fd64812e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:39.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.252+0000 7fd64dba1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd64815c8f0 0x7fd64812e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40894/0 (socket says 172.21.15.120:40894) 2024-07-27T03:08:39.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.252+0000 7fd64dba1640 1 -- 172.21.15.120:0/4212189969 learned_addr learned my addr 172.21.15.120:0/4212189969 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:39.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.252+0000 7fd64e3a2640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd648073680 0x7fd648155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:39.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd64eba3640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd648130ac0 0x7fd64812e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:39.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd64dba1640 1 -- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd648130ac0 msgr2=0x7fd64812e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:39.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd64dba1640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd648130ac0 0x7fd64812e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd64dba1640 1 -- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd648073680 msgr2=0x7fd648155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:39.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd64dba1640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd648073680 0x7fd648155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd64dba1640 1 -- 172.21.15.120:0/4212189969 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64813edc0 con 0x7fd64815c8f0 2024-07-27T03:08:39.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd64e3a2640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd648073680 0x7fd648155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:39.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd64dba1640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd64815c8f0 0x7fd64812e460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd63800c410 tx=0x7fd63800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:39.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd63effd640 1 -- 172.21.15.120:0/4212189969 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd638011790 con 0x7fd64815c8f0 2024-07-27T03:08:39.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd650606640 1 -- 172.21.15.120:0/4212189969 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64813f0a0 con 0x7fd64815c8f0 2024-07-27T03:08:39.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd63effd640 1 -- 172.21.15.120:0/4212189969 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd638017070 con 0x7fd64815c8f0 2024-07-27T03:08:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd63effd640 1 -- 172.21.15.120:0/4212189969 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd638011ce0 con 0x7fd64815c8f0 2024-07-27T03:08:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.253+0000 7fd650606640 1 -- 172.21.15.120:0/4212189969 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64813f660 con 0x7fd64815c8f0 2024-07-27T03:08:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.254+0000 7fd650606640 1 -- 172.21.15.120:0/4212189969 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6480d0a90 con 0x7fd64815c8f0 2024-07-27T03:08:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.255+0000 7fd63effd640 1 -- 172.21.15.120:0/4212189969 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd63801c460 con 0x7fd64815c8f0 2024-07-27T03:08:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.255+0000 7fd63effd640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd62c077040 0x7fd62c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:39.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.255+0000 7fd63effd640 1 -- 172.21.15.120:0/4212189969 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd638098670 con 0x7fd64815c8f0 2024-07-27T03:08:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.256+0000 7fd64e3a2640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd62c077040 0x7fd62c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.256+0000 7fd64e3a2640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd62c077040 0x7fd62c079550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd6440095f0 tx=0x7fd644005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:39.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.260+0000 7fd63effd640 1 -- 172.21.15.120:0/4212189969 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd638061260 con 0x7fd64815c8f0 2024-07-27T03:08:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.438+0000 7fd650606640 1 -- 172.21.15.120:0/4212189969 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd648142f40 con 0x7fd62c077040 2024-07-27T03:08:39.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.443+0000 7fd63effd640 1 -- 172.21.15.120:0/4212189969 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248164 (secure 0 0 0) 0x7fd648142f40 con 0x7fd62c077040 2024-07-27T03:08:39.448 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:39.450 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:08:39.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 -- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd62c077040 msgr2=0x7fd62c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:39.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd62c077040 0x7fd62c079550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd6440095f0 tx=0x7fd644005f90 comp rx=0 tx=0).stop 2024-07-27T03:08:39.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 -- 172.21.15.120:0/4212189969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd64815c8f0 msgr2=0x7fd64812e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:39.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd64815c8f0 0x7fd64812e460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd63800c410 tx=0x7fd63800c8d0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 -- 172.21.15.120:0/4212189969 shutdown_connections 2024-07-27T03:08:39.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd62c077040 0x7fd62c079550 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd64815c8f0 0x7fd64812e460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd648130ac0 0x7fd64812e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 --2- 172.21.15.120:0/4212189969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd648073680 0x7fd648155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:39.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 -- 172.21.15.120:0/4212189969 >> 172.21.15.120:0/4212189969 conn(0x7fd6480d0f00 msgr2=0x7fd64813d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:39.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 -- 172.21.15.120:0/4212189969 shutdown_connections 2024-07-27T03:08:39.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:39.446+0000 7fd650606640 1 -- 172.21.15.120:0/4212189969 wait complete. 2024-07-27T03:08:39.460 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-07-27T03:08:38.532195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":117,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":2830336,"data_stored":1716722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.604194"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.945279+0000","last_change":"2024-07-27T03:08:32.945279+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.945279+0000","last_undegraded":"2024-07-27T03:08:32.945279+0000","last_fullsized":"2024-07-27T03:08:32.945279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930553+0000","last_change":"2024-07-27T03:08:33.951685+0000","last_active":"2024-07-27T03:08:34.930553+0000","last_peered":"2024-07-27T03:08:34.930553+0000","last_clean":"2024-07-27T03:08:34.930553+0000","last_became_active":"2024-07-27T03:08:33.951388+0000","last_became_peered":"2024-07-27T03:08:33.951388+0000","last_unstale":"2024-07-27T03:08:34.930553+0000","last_undegraded":"2024-07-27T03:08:34.930553+0000","last_fullsized":"2024-07-27T03:08:34.930553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.946181+0000","last_change":"2024-07-27T03:08:32.946181+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.946181+0000","last_undegraded":"2024-07-27T03:08:32.946181+0000","last_fullsized":"2024-07-27T03:08:32.946181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.933499+0000","last_change":"2024-07-27T03:08:32.933499+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.933499+0000","last_undegraded":"2024-07-27T03:08:32.933499+0000","last_fullsized":"2024-07-27T03:08:32.933499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943108+0000","last_change":"2024-07-27T03:08:32.943108+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943108+0000","last_undegraded":"2024-07-27T03:08:32.943108+0000","last_fullsized":"2024-07-27T03:08:32.943108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936828+0000","last_change":"2024-07-27T03:08:32.936828+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936828+0000","last_undegraded":"2024-07-27T03:08:32.936828+0000","last_fullsized":"2024-07-27T03:08:32.936828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944159+0000","last_change":"2024-07-27T03:08:32.944159+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944159+0000","last_undegraded":"2024-07-27T03:08:32.944159+0000","last_fullsized":"2024-07-27T03:08:32.944159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941576+0000","last_change":"2024-07-27T03:08:32.941576+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941576+0000","last_undegraded":"2024-07-27T03:08:32.941576+0000","last_fullsized":"2024-07-27T03:08:32.941576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944810+0000","last_change":"2024-07-27T03:08:32.944810+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944810+0000","last_undegraded":"2024-07-27T03:08:32.944810+0000","last_fullsized":"2024-07-27T03:08:32.944810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934161+0000","last_change":"2024-07-27T03:08:33.952605+0000","last_active":"2024-07-27T03:08:35.934161+0000","last_peered":"2024-07-27T03:08:35.934161+0000","last_clean":"2024-07-27T03:08:35.934161+0000","last_became_active":"2024-07-27T03:08:33.952198+0000","last_became_peered":"2024-07-27T03:08:33.952198+0000","last_unstale":"2024-07-27T03:08:35.934161+0000","last_undegraded":"2024-07-27T03:08:35.934161+0000","last_fullsized":"2024-07-27T03:08:35.934161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934003+0000","last_change":"2024-07-27T03:08:33.960066+0000","last_active":"2024-07-27T03:08:35.934003+0000","last_peered":"2024-07-27T03:08:35.934003+0000","last_clean":"2024-07-27T03:08:35.934003+0000","last_became_active":"2024-07-27T03:08:33.959677+0000","last_became_peered":"2024-07-27T03:08:33.959677+0000","last_unstale":"2024-07-27T03:08:35.934003+0000","last_undegraded":"2024-07-27T03:08:35.934003+0000","last_fullsized":"2024-07-27T03:08:35.934003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:24:20.622662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932043+0000","last_change":"2024-07-27T03:08:33.951057+0000","last_active":"2024-07-27T03:08:34.932043+0000","last_peered":"2024-07-27T03:08:34.932043+0000","last_clean":"2024-07-27T03:08:34.932043+0000","last_became_active":"2024-07-27T03:08:33.950764+0000","last_became_peered":"2024-07-27T03:08:33.950764+0000","last_unstale":"2024-07-27T03:08:34.932043+0000","last_undegraded":"2024-07-27T03:08:34.932043+0000","last_fullsized":"2024-07-27T03:08:34.932043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:25.800481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942291+0000","last_change":"2024-07-27T03:08:32.942291+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942291+0000","last_undegraded":"2024-07-27T03:08:32.942291+0000","last_fullsized":"2024-07-27T03:08:32.942291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943758+0000","last_change":"2024-07-27T03:08:32.943758+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943758+0000","last_undegraded":"2024-07-27T03:08:32.943758+0000","last_fullsized":"2024-07-27T03:08:32.943758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930265+0000","last_change":"2024-07-27T03:08:33.933362+0000","last_active":"2024-07-27T03:08:34.930265+0000","last_peered":"2024-07-27T03:08:34.930265+0000","last_clean":"2024-07-27T03:08:34.930265+0000","last_became_active":"2024-07-27T03:08:33.933038+0000","last_became_peered":"2024-07-27T03:08:33.933038+0000","last_unstale":"2024-07-27T03:08:34.930265+0000","last_undegraded":"2024-07-27T03:08:34.930265+0000","last_fullsized":"2024-07-27T03:08:34.930265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932754+0000","last_change":"2024-07-27T03:08:32.932754+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932754+0000","last_undegraded":"2024-07-27T03:08:32.932754+0000","last_fullsized":"2024-07-27T03:08:32.932754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930214+0000","last_change":"2024-07-27T03:08:32.930214+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930214+0000","last_undegraded":"2024-07-27T03:08:32.930214+0000","last_fullsized":"2024-07-27T03:08:32.930214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.940671+0000","last_change":"2024-07-27T03:08:32.940671+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.940671+0000","last_undegraded":"2024-07-27T03:08:32.940671+0000","last_fullsized":"2024-07-27T03:08:32.940671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942651+0000","last_change":"2024-07-27T03:08:32.942651+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942651+0000","last_undegraded":"2024-07-27T03:08:32.942651+0000","last_fullsized":"2024-07-27T03:08:32.942651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934076+0000","last_change":"2024-07-27T03:08:33.957419+0000","last_active":"2024-07-27T03:08:35.934076+0000","last_peered":"2024-07-27T03:08:35.934076+0000","last_clean":"2024-07-27T03:08:35.934076+0000","last_became_active":"2024-07-27T03:08:33.957075+0000","last_became_peered":"2024-07-27T03:08:33.957075+0000","last_unstale":"2024-07-27T03:08:35.934076+0000","last_undegraded":"2024-07-27T03:08:35.934076+0000","last_fullsized":"2024-07-27T03:08:35.934076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943747+0000","last_change":"2024-07-27T03:08:32.943747+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943747+0000","last_undegraded":"2024-07-27T03:08:32.943747+0000","last_fullsized":"2024-07-27T03:08:32.943747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936307+0000","last_change":"2024-07-27T03:08:32.936307+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936307+0000","last_undegraded":"2024-07-27T03:08:32.936307+0000","last_fullsized":"2024-07-27T03:08:32.936307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943211+0000","last_change":"2024-07-27T03:08:32.943211+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943211+0000","last_undegraded":"2024-07-27T03:08:32.943211+0000","last_fullsized":"2024-07-27T03:08:32.943211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.931016+0000","last_change":"2024-07-27T03:08:32.931016+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.931016+0000","last_undegraded":"2024-07-27T03:08:32.931016+0000","last_fullsized":"2024-07-27T03:08:32.931016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941812+0000","last_change":"2024-07-27T03:08:32.941812+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941812+0000","last_undegraded":"2024-07-27T03:08:32.941812+0000","last_fullsized":"2024-07-27T03:08:32.941812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934267+0000","last_change":"2024-07-27T03:08:33.947980+0000","last_active":"2024-07-27T03:08:35.934267+0000","last_peered":"2024-07-27T03:08:35.934267+0000","last_clean":"2024-07-27T03:08:35.934267+0000","last_became_active":"2024-07-27T03:08:33.947719+0000","last_became_peered":"2024-07-27T03:08:33.947719+0000","last_unstale":"2024-07-27T03:08:35.934267+0000","last_undegraded":"2024-07-27T03:08:35.934267+0000","last_fullsized":"2024-07-27T03:08:35.934267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930564+0000","last_change":"2024-07-27T03:08:33.948063+0000","last_active":"2024-07-27T03:08:34.930564+0000","last_peered":"2024-07-27T03:08:34.930564+0000","last_clean":"2024-07-27T03:08:34.930564+0000","last_became_active":"2024-07-27T03:08:33.947778+0000","last_became_peered":"2024-07-27T03:08:33.947778+0000","last_unstale":"2024-07-27T03:08:34.930564+0000","last_undegraded":"2024-07-27T03:08:34.930564+0000","last_fullsized":"2024-07-27T03:08:34.930564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:13:24.620410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937480+0000","last_change":"2024-07-27T03:08:32.937480+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937480+0000","last_undegraded":"2024-07-27T03:08:32.937480+0000","last_fullsized":"2024-07-27T03:08:32.937480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942257+0000","last_change":"2024-07-27T03:08:32.942257+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942257+0000","last_undegraded":"2024-07-27T03:08:32.942257+0000","last_fullsized":"2024-07-27T03:08:32.942257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932921+0000","last_change":"2024-07-27T03:08:32.932921+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932921+0000","last_undegraded":"2024-07-27T03:08:32.932921+0000","last_fullsized":"2024-07-27T03:08:32.932921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939520+0000","last_change":"2024-07-27T03:08:32.939520+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939520+0000","last_undegraded":"2024-07-27T03:08:32.939520+0000","last_fullsized":"2024-07-27T03:08:32.939520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933962+0000","last_change":"2024-07-27T03:08:33.957896+0000","last_active":"2024-07-27T03:08:35.933962+0000","last_peered":"2024-07-27T03:08:35.933962+0000","last_clean":"2024-07-27T03:08:35.933962+0000","last_became_active":"2024-07-27T03:08:33.957571+0000","last_became_peered":"2024-07-27T03:08:33.957571+0000","last_unstale":"2024-07-27T03:08:35.933962+0000","last_undegraded":"2024-07-27T03:08:35.933962+0000","last_fullsized":"2024-07-27T03:08:35.933962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:02:10.905040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931554+0000","last_change":"2024-07-27T03:08:33.933266+0000","last_active":"2024-07-27T03:08:34.931554+0000","last_peered":"2024-07-27T03:08:34.931554+0000","last_clean":"2024-07-27T03:08:34.931554+0000","last_became_active":"2024-07-27T03:08:33.932884+0000","last_became_peered":"2024-07-27T03:08:33.932884+0000","last_unstale":"2024-07-27T03:08:34.931554+0000","last_undegraded":"2024-07-27T03:08:34.931554+0000","last_fullsized":"2024-07-27T03:08:34.931554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:39.773288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954389+0000","last_change":"2024-07-27T03:08:32.950534+0000","last_active":"2024-07-27T03:08:32.954389+0000","last_peered":"2024-07-27T03:08:32.954389+0000","last_clean":"2024-07-27T03:08:32.954389+0000","last_became_active":"2024-07-27T03:08:32.949394+0000","last_became_peered":"2024-07-27T03:08:32.949394+0000","last_unstale":"2024-07-27T03:08:32.954389+0000","last_undegraded":"2024-07-27T03:08:32.954389+0000","last_fullsized":"2024-07-27T03:08:32.954389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:38:40.192147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.941689+0000","last_change":"2024-07-27T03:08:32.941689+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.941689+0000","last_undegraded":"2024-07-27T03:08:32.941689+0000","last_fullsized":"2024-07-27T03:08:32.941689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933676+0000","last_change":"2024-07-27T03:08:32.946959+0000","last_active":"2024-07-27T03:08:35.933676+0000","last_peered":"2024-07-27T03:08:35.933676+0000","last_clean":"2024-07-27T03:08:35.933676+0000","last_became_active":"2024-07-27T03:08:32.946603+0000","last_became_peered":"2024-07-27T03:08:32.946603+0000","last_unstale":"2024-07-27T03:08:35.933676+0000","last_undegraded":"2024-07-27T03:08:35.933676+0000","last_fullsized":"2024-07-27T03:08:35.933676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:24:33.462183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955155+0000","last_change":"2024-07-27T03:08:32.951105+0000","last_active":"2024-07-27T03:08:32.955155+0000","last_peered":"2024-07-27T03:08:32.955155+0000","last_clean":"2024-07-27T03:08:32.955155+0000","last_became_active":"2024-07-27T03:08:32.950768+0000","last_became_peered":"2024-07-27T03:08:32.950768+0000","last_unstale":"2024-07-27T03:08:32.955155+0000","last_undegraded":"2024-07-27T03:08:32.955155+0000","last_fullsized":"2024-07-27T03:08:32.955155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:46:37.612264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938068+0000","last_change":"2024-07-27T03:08:32.938068+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938068+0000","last_undegraded":"2024-07-27T03:08:32.938068+0000","last_fullsized":"2024-07-27T03:08:32.938068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.953967+0000","last_change":"2024-07-27T03:08:32.951650+0000","last_active":"2024-07-27T03:08:32.953967+0000","last_peered":"2024-07-27T03:08:32.953967+0000","last_clean":"2024-07-27T03:08:32.953967+0000","last_became_active":"2024-07-27T03:08:32.950807+0000","last_became_peered":"2024-07-27T03:08:32.950807+0000","last_unstale":"2024-07-27T03:08:32.953967+0000","last_undegraded":"2024-07-27T03:08:32.953967+0000","last_fullsized":"2024-07-27T03:08:32.953967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930234+0000","last_change":"2024-07-27T03:08:33.955840+0000","last_active":"2024-07-27T03:08:34.930234+0000","last_peered":"2024-07-27T03:08:34.930234+0000","last_clean":"2024-07-27T03:08:34.930234+0000","last_became_active":"2024-07-27T03:08:33.955515+0000","last_became_peered":"2024-07-27T03:08:33.955515+0000","last_unstale":"2024-07-27T03:08:34.930234+0000","last_undegraded":"2024-07-27T03:08:34.930234+0000","last_fullsized":"2024-07-27T03:08:34.930234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933924+0000","last_change":"2024-07-27T03:08:32.952580+0000","last_active":"2024-07-27T03:08:35.933924+0000","last_peered":"2024-07-27T03:08:35.933924+0000","last_clean":"2024-07-27T03:08:35.933924+0000","last_became_active":"2024-07-27T03:08:32.951849+0000","last_became_peered":"2024-07-27T03:08:32.951849+0000","last_unstale":"2024-07-27T03:08:35.933924+0000","last_undegraded":"2024-07-27T03:08:35.933924+0000","last_fullsized":"2024-07-27T03:08:35.933924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:24.797895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.931277+0000","last_change":"2024-07-27T03:08:32.931277+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.931277+0000","last_undegraded":"2024-07-27T03:08:32.931277+0000","last_fullsized":"2024-07-27T03:08:32.931277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952980+0000","last_change":"2024-07-27T03:08:32.948775+0000","last_active":"2024-07-27T03:08:32.952980+0000","last_peered":"2024-07-27T03:08:32.952980+0000","last_clean":"2024-07-27T03:08:32.952980+0000","last_became_active":"2024-07-27T03:08:32.948396+0000","last_became_peered":"2024-07-27T03:08:32.948396+0000","last_unstale":"2024-07-27T03:08:32.952980+0000","last_undegraded":"2024-07-27T03:08:32.952980+0000","last_fullsized":"2024-07-27T03:08:32.952980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:47:24.675277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939533+0000","last_change":"2024-07-27T03:08:32.939533+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939533+0000","last_undegraded":"2024-07-27T03:08:32.939533+0000","last_fullsized":"2024-07-27T03:08:32.939533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930431+0000","last_change":"2024-07-27T03:08:32.950138+0000","last_active":"2024-07-27T03:08:34.930431+0000","last_peered":"2024-07-27T03:08:34.930431+0000","last_clean":"2024-07-27T03:08:34.930431+0000","last_became_active":"2024-07-27T03:08:32.949805+0000","last_became_peered":"2024-07-27T03:08:32.949805+0000","last_unstale":"2024-07-27T03:08:34.930431+0000","last_undegraded":"2024-07-27T03:08:34.930431+0000","last_fullsized":"2024-07-27T03:08:34.930431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:54:05.204464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932119+0000","last_change":"2024-07-27T03:08:33.949864+0000","last_active":"2024-07-27T03:08:34.932119+0000","last_peered":"2024-07-27T03:08:34.932119+0000","last_clean":"2024-07-27T03:08:34.932119+0000","last_became_active":"2024-07-27T03:08:33.949559+0000","last_became_peered":"2024-07-27T03:08:33.949559+0000","last_unstale":"2024-07-27T03:08:34.932119+0000","last_undegraded":"2024-07-27T03:08:34.932119+0000","last_fullsized":"2024-07-27T03:08:34.932119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:54:06.207049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933893+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:35.933893+0000","last_peered":"2024-07-27T03:08:35.933893+0000","last_clean":"2024-07-27T03:08:35.933893+0000","last_became_active":"2024-07-27T03:08:32.950507+0000","last_became_peered":"2024-07-27T03:08:32.950507+0000","last_unstale":"2024-07-27T03:08:35.933893+0000","last_undegraded":"2024-07-27T03:08:35.933893+0000","last_fullsized":"2024-07-27T03:08:35.933893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:38.770703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.946040+0000","last_change":"2024-07-27T03:08:32.946040+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.946040+0000","last_undegraded":"2024-07-27T03:08:32.946040+0000","last_fullsized":"2024-07-27T03:08:32.946040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.948106+0000","last_change":"2024-07-27T03:08:32.944499+0000","last_active":"2024-07-27T03:08:32.948106+0000","last_peered":"2024-07-27T03:08:32.948106+0000","last_clean":"2024-07-27T03:08:32.948106+0000","last_became_active":"2024-07-27T03:08:32.943866+0000","last_became_peered":"2024-07-27T03:08:32.943866+0000","last_unstale":"2024-07-27T03:08:32.948106+0000","last_undegraded":"2024-07-27T03:08:32.948106+0000","last_fullsized":"2024-07-27T03:08:32.948106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938893+0000","last_change":"2024-07-27T03:08:32.938893+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938893+0000","last_undegraded":"2024-07-27T03:08:32.938893+0000","last_fullsized":"2024-07-27T03:08:32.938893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952978+0000","last_change":"2024-07-27T03:08:32.949082+0000","last_active":"2024-07-27T03:08:32.952978+0000","last_peered":"2024-07-27T03:08:32.952978+0000","last_clean":"2024-07-27T03:08:32.952978+0000","last_became_active":"2024-07-27T03:08:32.948684+0000","last_became_peered":"2024-07-27T03:08:32.948684+0000","last_unstale":"2024-07-27T03:08:32.952978+0000","last_undegraded":"2024-07-27T03:08:32.952978+0000","last_fullsized":"2024-07-27T03:08:32.952978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942562+0000","last_change":"2024-07-27T03:08:32.942562+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942562+0000","last_undegraded":"2024-07-27T03:08:32.942562+0000","last_fullsized":"2024-07-27T03:08:32.942562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933743+0000","last_change":"2024-07-27T03:08:32.952599+0000","last_active":"2024-07-27T03:08:35.933743+0000","last_peered":"2024-07-27T03:08:35.933743+0000","last_clean":"2024-07-27T03:08:35.933743+0000","last_became_active":"2024-07-27T03:08:32.952293+0000","last_became_peered":"2024-07-27T03:08:32.952293+0000","last_unstale":"2024-07-27T03:08:35.933743+0000","last_undegraded":"2024-07-27T03:08:35.933743+0000","last_fullsized":"2024-07-27T03:08:35.933743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:01:24.017164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934003+0000","last_change":"2024-07-27T03:08:33.957887+0000","last_active":"2024-07-27T03:08:35.934003+0000","last_peered":"2024-07-27T03:08:35.934003+0000","last_clean":"2024-07-27T03:08:35.934003+0000","last_became_active":"2024-07-27T03:08:33.957528+0000","last_became_peered":"2024-07-27T03:08:33.957528+0000","last_unstale":"2024-07-27T03:08:35.934003+0000","last_undegraded":"2024-07-27T03:08:35.934003+0000","last_fullsized":"2024-07-27T03:08:35.934003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:52:05.096628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954927+0000","last_change":"2024-07-27T03:08:32.946673+0000","last_active":"2024-07-27T03:08:32.954927+0000","last_peered":"2024-07-27T03:08:32.954927+0000","last_clean":"2024-07-27T03:08:32.954927+0000","last_became_active":"2024-07-27T03:08:32.946188+0000","last_became_peered":"2024-07-27T03:08:32.946188+0000","last_unstale":"2024-07-27T03:08:32.954927+0000","last_undegraded":"2024-07-27T03:08:32.954927+0000","last_fullsized":"2024-07-27T03:08:32.954927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.943653+0000","last_change":"2024-07-27T03:08:32.943653+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.943653+0000","last_undegraded":"2024-07-27T03:08:32.943653+0000","last_fullsized":"2024-07-27T03:08:32.943653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931892+0000","last_change":"2024-07-27T03:08:32.943381+0000","last_active":"2024-07-27T03:08:34.931892+0000","last_peered":"2024-07-27T03:08:34.931892+0000","last_clean":"2024-07-27T03:08:34.931892+0000","last_became_active":"2024-07-27T03:08:32.943077+0000","last_became_peered":"2024-07-27T03:08:32.943077+0000","last_unstale":"2024-07-27T03:08:34.931892+0000","last_undegraded":"2024-07-27T03:08:34.931892+0000","last_fullsized":"2024-07-27T03:08:34.931892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:56:08.696748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942348+0000","last_change":"2024-07-27T03:08:32.942348+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942348+0000","last_undegraded":"2024-07-27T03:08:32.942348+0000","last_fullsized":"2024-07-27T03:08:32.942348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955378+0000","last_change":"2024-07-27T03:08:32.952496+0000","last_active":"2024-07-27T03:08:32.955378+0000","last_peered":"2024-07-27T03:08:32.955378+0000","last_clean":"2024-07-27T03:08:32.955378+0000","last_became_active":"2024-07-27T03:08:32.952196+0000","last_became_peered":"2024-07-27T03:08:32.952196+0000","last_unstale":"2024-07-27T03:08:32.955378+0000","last_undegraded":"2024-07-27T03:08:32.955378+0000","last_fullsized":"2024-07-27T03:08:32.955378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.944346+0000","last_change":"2024-07-27T03:08:32.944346+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.944346+0000","last_undegraded":"2024-07-27T03:08:32.944346+0000","last_fullsized":"2024-07-27T03:08:32.944346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930593+0000","last_change":"2024-07-27T03:08:32.941336+0000","last_active":"2024-07-27T03:08:34.930593+0000","last_peered":"2024-07-27T03:08:34.930593+0000","last_clean":"2024-07-27T03:08:34.930593+0000","last_became_active":"2024-07-27T03:08:32.940512+0000","last_became_peered":"2024-07-27T03:08:32.940512+0000","last_unstale":"2024-07-27T03:08:34.930593+0000","last_undegraded":"2024-07-27T03:08:34.930593+0000","last_fullsized":"2024-07-27T03:08:34.930593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:28:24.786534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930629+0000","last_change":"2024-07-27T03:08:32.930629+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930629+0000","last_undegraded":"2024-07-27T03:08:32.930629+0000","last_fullsized":"2024-07-27T03:08:32.930629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955415+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:32.955415+0000","last_peered":"2024-07-27T03:08:32.955415+0000","last_clean":"2024-07-27T03:08:32.955415+0000","last_became_active":"2024-07-27T03:08:32.950533+0000","last_became_peered":"2024-07-27T03:08:32.950533+0000","last_unstale":"2024-07-27T03:08:32.955415+0000","last_undegraded":"2024-07-27T03:08:32.955415+0000","last_fullsized":"2024-07-27T03:08:32.955415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.945555+0000","last_change":"2024-07-27T03:08:32.945555+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.945555+0000","last_undegraded":"2024-07-27T03:08:32.945555+0000","last_fullsized":"2024-07-27T03:08:32.945555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.945496+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:08:32.945496+0000","last_peered":"2024-07-27T03:08:32.945496+0000","last_clean":"2024-07-27T03:08:32.945496+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:08:32.945496+0000","last_undegraded":"2024-07-27T03:08:32.945496+0000","last_fullsized":"2024-07-27T03:08:32.945496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.952753+0000","last_change":"2024-07-27T03:08:32.948243+0000","last_active":"2024-07-27T03:08:32.952753+0000","last_peered":"2024-07-27T03:08:32.952753+0000","last_clean":"2024-07-27T03:08:32.952753+0000","last_became_active":"2024-07-27T03:08:32.947945+0000","last_became_peered":"2024-07-27T03:08:32.947945+0000","last_unstale":"2024-07-27T03:08:32.952753+0000","last_undegraded":"2024-07-27T03:08:32.952753+0000","last_fullsized":"2024-07-27T03:08:32.952753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:11.565566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.936654+0000","last_change":"2024-07-27T03:08:32.936654+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.936654+0000","last_undegraded":"2024-07-27T03:08:32.936654+0000","last_fullsized":"2024-07-27T03:08:32.936654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957294+0000","last_change":"2024-07-27T03:08:32.955404+0000","last_active":"2024-07-27T03:08:32.957294+0000","last_peered":"2024-07-27T03:08:32.957294+0000","last_clean":"2024-07-27T03:08:32.957294+0000","last_became_active":"2024-07-27T03:08:32.955120+0000","last_became_peered":"2024-07-27T03:08:32.955120+0000","last_unstale":"2024-07-27T03:08:32.957294+0000","last_undegraded":"2024-07-27T03:08:32.957294+0000","last_fullsized":"2024-07-27T03:08:32.957294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:16:05.521168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939804+0000","last_change":"2024-07-27T03:08:32.939804+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939804+0000","last_undegraded":"2024-07-27T03:08:32.939804+0000","last_fullsized":"2024-07-27T03:08:32.939804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955294+0000","last_change":"2024-07-27T03:08:32.951299+0000","last_active":"2024-07-27T03:08:32.955294+0000","last_peered":"2024-07-27T03:08:32.955294+0000","last_clean":"2024-07-27T03:08:32.955294+0000","last_became_active":"2024-07-27T03:08:32.950946+0000","last_became_peered":"2024-07-27T03:08:32.950946+0000","last_unstale":"2024-07-27T03:08:32.955294+0000","last_undegraded":"2024-07-27T03:08:32.955294+0000","last_fullsized":"2024-07-27T03:08:32.955294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:09.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930286+0000","last_change":"2024-07-27T03:08:33.937577+0000","last_active":"2024-07-27T03:08:34.930286+0000","last_peered":"2024-07-27T03:08:34.930286+0000","last_clean":"2024-07-27T03:08:34.930286+0000","last_became_active":"2024-07-27T03:08:33.937262+0000","last_became_peered":"2024-07-27T03:08:33.937262+0000","last_unstale":"2024-07-27T03:08:34.930286+0000","last_undegraded":"2024-07-27T03:08:34.930286+0000","last_fullsized":"2024-07-27T03:08:34.930286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.948881+0000","last_change":"2024-07-27T03:08:32.943293+0000","last_active":"2024-07-27T03:08:32.948881+0000","last_peered":"2024-07-27T03:08:32.948881+0000","last_clean":"2024-07-27T03:08:32.948881+0000","last_became_active":"2024-07-27T03:08:32.942974+0000","last_became_peered":"2024-07-27T03:08:32.942974+0000","last_unstale":"2024-07-27T03:08:32.948881+0000","last_undegraded":"2024-07-27T03:08:32.948881+0000","last_fullsized":"2024-07-27T03:08:32.948881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:41:35.306112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932094+0000","last_change":"2024-07-27T03:08:33.954605+0000","last_active":"2024-07-27T03:08:34.932094+0000","last_peered":"2024-07-27T03:08:34.932094+0000","last_clean":"2024-07-27T03:08:34.932094+0000","last_became_active":"2024-07-27T03:08:33.954160+0000","last_became_peered":"2024-07-27T03:08:33.954160+0000","last_unstale":"2024-07-27T03:08:34.932094+0000","last_undegraded":"2024-07-27T03:08:34.932094+0000","last_fullsized":"2024-07-27T03:08:34.932094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:32.582766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930412+0000","last_change":"2024-07-27T03:08:32.938940+0000","last_active":"2024-07-27T03:08:34.930412+0000","last_peered":"2024-07-27T03:08:34.930412+0000","last_clean":"2024-07-27T03:08:34.930412+0000","last_became_active":"2024-07-27T03:08:32.938639+0000","last_became_peered":"2024-07-27T03:08:32.938639+0000","last_unstale":"2024-07-27T03:08:34.930412+0000","last_undegraded":"2024-07-27T03:08:34.930412+0000","last_fullsized":"2024-07-27T03:08:34.930412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:24.797895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.930264+0000","last_change":"2024-07-27T03:08:32.930264+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.930264+0000","last_undegraded":"2024-07-27T03:08:32.930264+0000","last_fullsized":"2024-07-27T03:08:32.930264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957073+0000","last_change":"2024-07-27T03:08:32.955213+0000","last_active":"2024-07-27T03:08:32.957073+0000","last_peered":"2024-07-27T03:08:32.957073+0000","last_clean":"2024-07-27T03:08:32.957073+0000","last_became_active":"2024-07-27T03:08:32.954883+0000","last_became_peered":"2024-07-27T03:08:32.954883+0000","last_unstale":"2024-07-27T03:08:32.957073+0000","last_undegraded":"2024-07-27T03:08:32.957073+0000","last_fullsized":"2024-07-27T03:08:32.957073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:02:35.203630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930594+0000","last_change":"2024-07-27T03:08:33.941170+0000","last_active":"2024-07-27T03:08:34.930594+0000","last_peered":"2024-07-27T03:08:34.930594+0000","last_clean":"2024-07-27T03:08:34.930594+0000","last_became_active":"2024-07-27T03:08:33.940792+0000","last_became_peered":"2024-07-27T03:08:33.940792+0000","last_unstale":"2024-07-27T03:08:34.930594+0000","last_undegraded":"2024-07-27T03:08:34.930594+0000","last_fullsized":"2024-07-27T03:08:34.930594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:35:01.175302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930630+0000","last_change":"2024-07-27T03:08:32.945506+0000","last_active":"2024-07-27T03:08:34.930630+0000","last_peered":"2024-07-27T03:08:34.930630+0000","last_clean":"2024-07-27T03:08:34.930630+0000","last_became_active":"2024-07-27T03:08:32.945201+0000","last_became_peered":"2024-07-27T03:08:32.945201+0000","last_unstale":"2024-07-27T03:08:34.930630+0000","last_undegraded":"2024-07-27T03:08:34.930630+0000","last_fullsized":"2024-07-27T03:08:34.930630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:58:54.316561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937005+0000","last_change":"2024-07-27T03:08:32.937005+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937005+0000","last_undegraded":"2024-07-27T03:08:32.937005+0000","last_fullsized":"2024-07-27T03:08:32.937005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934062+0000","last_change":"2024-07-27T03:08:32.949210+0000","last_active":"2024-07-27T03:08:35.934062+0000","last_peered":"2024-07-27T03:08:35.934062+0000","last_clean":"2024-07-27T03:08:35.934062+0000","last_became_active":"2024-07-27T03:08:32.948858+0000","last_became_peered":"2024-07-27T03:08:32.948858+0000","last_unstale":"2024-07-27T03:08:35.934062+0000","last_undegraded":"2024-07-27T03:08:35.934062+0000","last_fullsized":"2024-07-27T03:08:35.934062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:31.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.938880+0000","last_change":"2024-07-27T03:08:32.938880+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.938880+0000","last_undegraded":"2024-07-27T03:08:32.938880+0000","last_fullsized":"2024-07-27T03:08:32.938880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.957075+0000","last_change":"2024-07-27T03:08:32.955144+0000","last_active":"2024-07-27T03:08:32.957075+0000","last_peered":"2024-07-27T03:08:32.957075+0000","last_clean":"2024-07-27T03:08:32.957075+0000","last_became_active":"2024-07-27T03:08:32.954645+0000","last_became_peered":"2024-07-27T03:08:32.954645+0000","last_unstale":"2024-07-27T03:08:32.957075+0000","last_undegraded":"2024-07-27T03:08:32.957075+0000","last_fullsized":"2024-07-27T03:08:32.957075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932211+0000","last_change":"2024-07-27T03:08:33.941376+0000","last_active":"2024-07-27T03:08:34.932211+0000","last_peered":"2024-07-27T03:08:34.932211+0000","last_clean":"2024-07-27T03:08:34.932211+0000","last_became_active":"2024-07-27T03:08:33.940032+0000","last_became_peered":"2024-07-27T03:08:33.940032+0000","last_unstale":"2024-07-27T03:08:34.932211+0000","last_undegraded":"2024-07-27T03:08:34.932211+0000","last_fullsized":"2024-07-27T03:08:34.932211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:28:25.789119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930293+0000","last_change":"2024-07-27T03:08:32.947719+0000","last_active":"2024-07-27T03:08:34.930293+0000","last_peered":"2024-07-27T03:08:34.930293+0000","last_clean":"2024-07-27T03:08:34.930293+0000","last_became_active":"2024-07-27T03:08:32.947422+0000","last_became_peered":"2024-07-27T03:08:32.947422+0000","last_unstale":"2024-07-27T03:08:34.930293+0000","last_undegraded":"2024-07-27T03:08:34.930293+0000","last_fullsized":"2024-07-27T03:08:34.930293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:31.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937564+0000","last_change":"2024-07-27T03:08:32.937564+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937564+0000","last_undegraded":"2024-07-27T03:08:32.937564+0000","last_fullsized":"2024-07-27T03:08:32.937564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930426+0000","last_change":"2024-07-27T03:08:32.950885+0000","last_active":"2024-07-27T03:08:34.930426+0000","last_peered":"2024-07-27T03:08:34.930426+0000","last_clean":"2024-07-27T03:08:34.930426+0000","last_became_active":"2024-07-27T03:08:32.950569+0000","last_became_peered":"2024-07-27T03:08:32.950569+0000","last_unstale":"2024-07-27T03:08:34.930426+0000","last_undegraded":"2024-07-27T03:08:34.930426+0000","last_fullsized":"2024-07-27T03:08:34.930426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:38.770703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.939020+0000","last_change":"2024-07-27T03:08:32.939020+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.939020+0000","last_undegraded":"2024-07-27T03:08:32.939020+0000","last_fullsized":"2024-07-27T03:08:32.939020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954983+0000","last_change":"2024-07-27T03:08:32.952714+0000","last_active":"2024-07-27T03:08:32.954983+0000","last_peered":"2024-07-27T03:08:32.954983+0000","last_clean":"2024-07-27T03:08:32.954983+0000","last_became_active":"2024-07-27T03:08:32.952425+0000","last_became_peered":"2024-07-27T03:08:32.952425+0000","last_unstale":"2024-07-27T03:08:32.954983+0000","last_undegraded":"2024-07-27T03:08:32.954983+0000","last_fullsized":"2024-07-27T03:08:32.954983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934081+0000","last_change":"2024-07-27T03:08:33.957221+0000","last_active":"2024-07-27T03:08:35.934081+0000","last_peered":"2024-07-27T03:08:35.934081+0000","last_clean":"2024-07-27T03:08:35.934081+0000","last_became_active":"2024-07-27T03:08:33.956847+0000","last_became_peered":"2024-07-27T03:08:33.956847+0000","last_unstale":"2024-07-27T03:08:35.934081+0000","last_undegraded":"2024-07-27T03:08:35.934081+0000","last_fullsized":"2024-07-27T03:08:35.934081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.934157+0000","last_change":"2024-07-27T03:08:32.934157+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.934157+0000","last_undegraded":"2024-07-27T03:08:32.934157+0000","last_fullsized":"2024-07-27T03:08:32.934157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955022+0000","last_change":"2024-07-27T03:08:32.953454+0000","last_active":"2024-07-27T03:08:32.955022+0000","last_peered":"2024-07-27T03:08:32.955022+0000","last_clean":"2024-07-27T03:08:32.955022+0000","last_became_active":"2024-07-27T03:08:32.953065+0000","last_became_peered":"2024-07-27T03:08:32.953065+0000","last_unstale":"2024-07-27T03:08:32.955022+0000","last_undegraded":"2024-07-27T03:08:32.955022+0000","last_fullsized":"2024-07-27T03:08:32.955022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:09.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.932374+0000","last_change":"2024-07-27T03:08:32.932374+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.932374+0000","last_undegraded":"2024-07-27T03:08:32.932374+0000","last_fullsized":"2024-07-27T03:08:32.932374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955390+0000","last_change":"2024-07-27T03:08:32.951809+0000","last_active":"2024-07-27T03:08:32.955390+0000","last_peered":"2024-07-27T03:08:32.955390+0000","last_clean":"2024-07-27T03:08:32.955390+0000","last_became_active":"2024-07-27T03:08:32.951495+0000","last_became_peered":"2024-07-27T03:08:32.951495+0000","last_unstale":"2024-07-27T03:08:32.955390+0000","last_undegraded":"2024-07-27T03:08:32.955390+0000","last_fullsized":"2024-07-27T03:08:32.955390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:26:05.520281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.942235+0000","last_change":"2024-07-27T03:08:32.942235+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.942235+0000","last_undegraded":"2024-07-27T03:08:32.942235+0000","last_fullsized":"2024-07-27T03:08:32.942235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.955199+0000","last_change":"2024-07-27T03:08:32.951332+0000","last_active":"2024-07-27T03:08:32.955199+0000","last_peered":"2024-07-27T03:08:32.955199+0000","last_clean":"2024-07-27T03:08:32.955199+0000","last_became_active":"2024-07-27T03:08:32.949369+0000","last_became_peered":"2024-07-27T03:08:32.949369+0000","last_unstale":"2024-07-27T03:08:32.955199+0000","last_undegraded":"2024-07-27T03:08:32.955199+0000","last_fullsized":"2024-07-27T03:08:32.955199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:56:08.696748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-07-27T03:08:32.937647+0000","last_change":"2024-07-27T03:08:32.937647+0000","last_active":"2024-07-27T03:08:32.918223+0000","last_peered":"2024-07-27T03:08:32.918223+0000","last_clean":"2024-07-27T03:08:32.918223+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:08:32.937647+0000","last_undegraded":"2024-07-27T03:08:32.937647+0000","last_fullsized":"2024-07-27T03:08:32.937647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-07-27T03:08:32.954743+0000","last_change":"2024-07-27T03:08:32.949235+0000","last_active":"2024-07-27T03:08:32.954743+0000","last_peered":"2024-07-27T03:08:32.954743+0000","last_clean":"2024-07-27T03:08:32.954743+0000","last_became_active":"2024-07-27T03:08:32.948934+0000","last_became_peered":"2024-07-27T03:08:32.948934+0000","last_unstale":"2024-07-27T03:08:32.954743+0000","last_undegraded":"2024-07-27T03:08:32.954743+0000","last_fullsized":"2024-07-27T03:08:32.954743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:40:26.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":778240,"data_stored":648304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":778240,"data_stored":648304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:08:39.948 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:08:39.950 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:08:42.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:08:42.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.589+0000 7f34afc1c640 1 -- 172.21.15.120:0/1507337255 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34940041c0 msgr2=0x7f3494004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:42.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.589+0000 7f34afc1c640 1 --2- 172.21.15.120:0/1507337255 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34940041c0 0x7f3494004800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3498006f60 tx=0x7f3494005830 comp rx=0 tx=0).stop 2024-07-27T03:08:42.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.589+0000 7f34ae1b9640 1 -- 172.21.15.120:0/1507337255 reap_dead start 2024-07-27T03:08:42.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.589+0000 7f34afc1c640 1 -- 172.21.15.120:0/1507337255 shutdown_connections 2024-07-27T03:08:42.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.589+0000 7f34afc1c640 1 -- 172.21.15.120:0/1507337255 >> 172.21.15.120:0/1507337255 conn(0x7f34a806cba0 msgr2=0x7f34a806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:42.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.590+0000 7f34afc1c640 1 -- 172.21.15.120:0/1507337255 shutdown_connections 2024-07-27T03:08:42.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.590+0000 7f34afc1c640 1 -- 172.21.15.120:0/1507337255 wait complete. 2024-07-27T03:08:42.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.591+0000 7f34afc1c640 1 Processor -- start 2024-07-27T03:08:42.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.591+0000 7f34afc1c640 1 -- start start 2024-07-27T03:08:42.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34afc1c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34940041c0 0x7f34a814cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:42.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34afc1c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34a814acc0 0x7f34a81f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:42.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34afc1c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34a81f68d0 0x7f34a81efac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:42.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34afc1c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f34a80cd920 con 0x7f34940041c0 2024-07-27T03:08:42.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34afc1c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f34a80cd7a0 con 0x7f34a814acc0 2024-07-27T03:08:42.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34afc1c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f34a80cdaa0 con 0x7f34a81f68d0 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34ad9b8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34940041c0 0x7f34a814cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34ad9b8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34940041c0 0x7f34a814cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46564/0 (socket says 172.21.15.120:46564) 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34ad9b8640 1 -- 172.21.15.120:0/4099961641 learned_addr learned my addr 172.21.15.120:0/4099961641 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34ad1b7640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34a814acc0 0x7f34a81f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34ae1b9640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34a81f68d0 0x7f34a81efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34ad9b8640 1 -- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34a81f68d0 msgr2=0x7f34a81efac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34ad9b8640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34a81f68d0 0x7f34a81efac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34ad9b8640 1 -- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34a814acc0 msgr2=0x7f34a81f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34ad9b8640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34a814acc0 0x7f34a81f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34ad9b8640 1 -- 172.21.15.120:0/4099961641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a814d4e0 con 0x7f34940041c0 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34ad9b8640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34940041c0 0x7f34a814cd00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34a4011ae0 tx=0x7f34a4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:42.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f349e7fc640 1 -- 172.21.15.120:0/4099961641 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a401e070 con 0x7f34940041c0 2024-07-27T03:08:42.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f349e7fc640 1 -- 172.21.15.120:0/4099961641 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34a400fc10 con 0x7f34940041c0 2024-07-27T03:08:42.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34afc1c640 1 -- 172.21.15.120:0/4099961641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a814d7c0 con 0x7f34940041c0 2024-07-27T03:08:42.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f349e7fc640 1 -- 172.21.15.120:0/4099961641 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4019410 con 0x7f34940041c0 2024-07-27T03:08:42.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.593+0000 7f34afc1c640 1 -- 172.21.15.120:0/4099961641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a814dd80 con 0x7f34940041c0 2024-07-27T03:08:42.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.594+0000 7f34afc1c640 1 -- 172.21.15.120:0/4099961641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34a80ce030 con 0x7f34940041c0 2024-07-27T03:08:42.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.595+0000 7f349e7fc640 1 -- 172.21.15.120:0/4099961641 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f34a4021070 con 0x7f34940041c0 2024-07-27T03:08:42.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.596+0000 7f349e7fc640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f348c077010 0x7f348c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:42.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.596+0000 7f349e7fc640 1 -- 172.21.15.120:0/4099961641 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f34a4098fd0 con 0x7f34940041c0 2024-07-27T03:08:42.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.596+0000 7f34ad1b7640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f348c077010 0x7f348c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:42.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.596+0000 7f34ad1b7640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f348c077010 0x7f348c079520 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3498033000 tx=0x7f349803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:42.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.600+0000 7f349e7fc640 1 -- 172.21.15.120:0/4099961641 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f34a4061b80 con 0x7f34940041c0 2024-07-27T03:08:42.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.781+0000 7f34afc1c640 1 -- 172.21.15.120:0/4099961641 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34a8069c10 con 0x7f348c077010 2024-07-27T03:08:42.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.786+0000 7f349e7fc640 1 -- 172.21.15.120:0/4099961641 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251935 (secure 0 0 0) 0x7f34980016c0 con 0x7f348c077010 2024-07-27T03:08:42.791 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:42.792 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:08:42.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 -- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f348c077010 msgr2=0x7f348c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:42.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f348c077010 0x7f348c079520 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3498033000 tx=0x7f349803b040 comp rx=0 tx=0).stop 2024-07-27T03:08:42.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 -- 172.21.15.120:0/4099961641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34940041c0 msgr2=0x7f34a814cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:42.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34940041c0 0x7f34a814cd00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f34a4011ae0 tx=0x7f34a4009e60 comp rx=0 tx=0).stop 2024-07-27T03:08:42.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 -- 172.21.15.120:0/4099961641 shutdown_connections 2024-07-27T03:08:42.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f348c077010 0x7f348c079520 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:42.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f34a81f68d0 0x7f34a81efac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:42.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34a814acc0 0x7f34a81f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:42.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 --2- 172.21.15.120:0/4099961641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34940041c0 0x7f34a814cd00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:42.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 -- 172.21.15.120:0/4099961641 >> 172.21.15.120:0/4099961641 conn(0x7f34a806cba0 msgr2=0x7f34a815d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:42.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 -- 172.21.15.120:0/4099961641 shutdown_connections 2024-07-27T03:08:42.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.789+0000 7f34afc1c640 1 -- 172.21.15.120:0/4099961641 wait complete. 2024-07-27T03:08:42.802 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-07-27T03:08:42.533426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219120,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755600,"statfs":{"total":773094113280,"available":772869734400,"internally_reserved":0,"allocated":3022848,"data_stored":1803844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.605426"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650035+0000","last_change":"2024-07-27T03:08:33.948286+0000","last_active":"2024-07-27T03:08:37.650035+0000","last_peered":"2024-07-27T03:08:37.650035+0000","last_clean":"2024-07-27T03:08:37.650035+0000","last_became_active":"2024-07-27T03:08:33.947946+0000","last_became_peered":"2024-07-27T03:08:33.947946+0000","last_unstale":"2024-07-27T03:08:37.650035+0000","last_undegraded":"2024-07-27T03:08:37.650035+0000","last_fullsized":"2024-07-27T03:08:37.650035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:51.758397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930553+0000","last_change":"2024-07-27T03:08:33.951685+0000","last_active":"2024-07-27T03:08:34.930553+0000","last_peered":"2024-07-27T03:08:34.930553+0000","last_clean":"2024-07-27T03:08:34.930553+0000","last_became_active":"2024-07-27T03:08:33.951388+0000","last_became_peered":"2024-07-27T03:08:33.951388+0000","last_unstale":"2024-07-27T03:08:34.930553+0000","last_undegraded":"2024-07-27T03:08:34.930553+0000","last_fullsized":"2024-07-27T03:08:34.930553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868470+0000","last_change":"2024-07-27T03:08:33.949530+0000","last_active":"2024-07-27T03:08:36.868470+0000","last_peered":"2024-07-27T03:08:36.868470+0000","last_clean":"2024-07-27T03:08:36.868470+0000","last_became_active":"2024-07-27T03:08:33.948989+0000","last_became_peered":"2024-07-27T03:08:33.948989+0000","last_unstale":"2024-07-27T03:08:36.868470+0000","last_undegraded":"2024-07-27T03:08:36.868470+0000","last_fullsized":"2024-07-27T03:08:36.868470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:14.764441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932869+0000","last_change":"2024-07-27T03:08:33.957256+0000","last_active":"2024-07-27T03:08:34.932869+0000","last_peered":"2024-07-27T03:08:34.932869+0000","last_clean":"2024-07-27T03:08:34.932869+0000","last_became_active":"2024-07-27T03:08:33.956922+0000","last_became_peered":"2024-07-27T03:08:33.956922+0000","last_unstale":"2024-07-27T03:08:34.932869+0000","last_undegraded":"2024-07-27T03:08:34.932869+0000","last_fullsized":"2024-07-27T03:08:34.932869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:58.998778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649852+0000","last_change":"2024-07-27T03:08:33.947489+0000","last_active":"2024-07-27T03:08:37.649852+0000","last_peered":"2024-07-27T03:08:37.649852+0000","last_clean":"2024-07-27T03:08:37.649852+0000","last_became_active":"2024-07-27T03:08:33.947123+0000","last_became_peered":"2024-07-27T03:08:33.947123+0000","last_unstale":"2024-07-27T03:08:37.649852+0000","last_undegraded":"2024-07-27T03:08:37.649852+0000","last_fullsized":"2024-07-27T03:08:37.649852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:02:56.479634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932061+0000","last_change":"2024-07-27T03:08:33.960086+0000","last_active":"2024-07-27T03:08:34.932061+0000","last_peered":"2024-07-27T03:08:34.932061+0000","last_clean":"2024-07-27T03:08:34.932061+0000","last_became_active":"2024-07-27T03:08:33.956547+0000","last_became_peered":"2024-07-27T03:08:33.956547+0000","last_unstale":"2024-07-27T03:08:34.932061+0000","last_undegraded":"2024-07-27T03:08:34.932061+0000","last_fullsized":"2024-07-27T03:08:34.932061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:53:39.837754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649542+0000","last_change":"2024-07-27T03:08:33.958341+0000","last_active":"2024-07-27T03:08:37.649542+0000","last_peered":"2024-07-27T03:08:37.649542+0000","last_clean":"2024-07-27T03:08:37.649542+0000","last_became_active":"2024-07-27T03:08:33.958024+0000","last_became_peered":"2024-07-27T03:08:33.958024+0000","last_unstale":"2024-07-27T03:08:37.649542+0000","last_undegraded":"2024-07-27T03:08:37.649542+0000","last_fullsized":"2024-07-27T03:08:37.649542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:22.536071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825730+0000","last_change":"2024-07-27T03:08:33.959349+0000","last_active":"2024-07-27T03:08:35.825730+0000","last_peered":"2024-07-27T03:08:35.825730+0000","last_clean":"2024-07-27T03:08:35.825730+0000","last_became_active":"2024-07-27T03:08:33.959108+0000","last_became_peered":"2024-07-27T03:08:33.959108+0000","last_unstale":"2024-07-27T03:08:35.825730+0000","last_undegraded":"2024-07-27T03:08:35.825730+0000","last_fullsized":"2024-07-27T03:08:35.825730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:24:20.622662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650213+0000","last_change":"2024-07-27T03:08:33.959480+0000","last_active":"2024-07-27T03:08:37.650213+0000","last_peered":"2024-07-27T03:08:37.650213+0000","last_clean":"2024-07-27T03:08:37.650213+0000","last_became_active":"2024-07-27T03:08:33.959108+0000","last_became_peered":"2024-07-27T03:08:33.959108+0000","last_unstale":"2024-07-27T03:08:37.650213+0000","last_undegraded":"2024-07-27T03:08:37.650213+0000","last_fullsized":"2024-07-27T03:08:37.650213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:34:51.510109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934161+0000","last_change":"2024-07-27T03:08:33.952605+0000","last_active":"2024-07-27T03:08:35.934161+0000","last_peered":"2024-07-27T03:08:35.934161+0000","last_clean":"2024-07-27T03:08:35.934161+0000","last_became_active":"2024-07-27T03:08:33.952198+0000","last_became_peered":"2024-07-27T03:08:33.952198+0000","last_unstale":"2024-07-27T03:08:35.934161+0000","last_undegraded":"2024-07-27T03:08:35.934161+0000","last_fullsized":"2024-07-27T03:08:35.934161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934003+0000","last_change":"2024-07-27T03:08:33.960066+0000","last_active":"2024-07-27T03:08:35.934003+0000","last_peered":"2024-07-27T03:08:35.934003+0000","last_clean":"2024-07-27T03:08:35.934003+0000","last_became_active":"2024-07-27T03:08:33.959677+0000","last_became_peered":"2024-07-27T03:08:33.959677+0000","last_unstale":"2024-07-27T03:08:35.934003+0000","last_undegraded":"2024-07-27T03:08:35.934003+0000","last_fullsized":"2024-07-27T03:08:35.934003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:24:20.622662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932043+0000","last_change":"2024-07-27T03:08:33.951057+0000","last_active":"2024-07-27T03:08:34.932043+0000","last_peered":"2024-07-27T03:08:34.932043+0000","last_clean":"2024-07-27T03:08:34.932043+0000","last_became_active":"2024-07-27T03:08:33.950764+0000","last_became_peered":"2024-07-27T03:08:33.950764+0000","last_unstale":"2024-07-27T03:08:34.932043+0000","last_undegraded":"2024-07-27T03:08:34.932043+0000","last_fullsized":"2024-07-27T03:08:34.932043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:25.800481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825997+0000","last_change":"2024-07-27T03:08:33.954641+0000","last_active":"2024-07-27T03:08:35.825997+0000","last_peered":"2024-07-27T03:08:35.825997+0000","last_clean":"2024-07-27T03:08:35.825997+0000","last_became_active":"2024-07-27T03:08:33.953618+0000","last_became_peered":"2024-07-27T03:08:33.953618+0000","last_unstale":"2024-07-27T03:08:35.825997+0000","last_undegraded":"2024-07-27T03:08:35.825997+0000","last_fullsized":"2024-07-27T03:08:35.825997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.867964+0000","last_change":"2024-07-27T03:08:33.949632+0000","last_active":"2024-07-27T03:08:36.867964+0000","last_peered":"2024-07-27T03:08:36.867964+0000","last_clean":"2024-07-27T03:08:36.867964+0000","last_became_active":"2024-07-27T03:08:33.949329+0000","last_became_peered":"2024-07-27T03:08:33.949329+0000","last_unstale":"2024-07-27T03:08:36.867964+0000","last_undegraded":"2024-07-27T03:08:36.867964+0000","last_fullsized":"2024-07-27T03:08:36.867964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:14:24.431954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930265+0000","last_change":"2024-07-27T03:08:33.933362+0000","last_active":"2024-07-27T03:08:34.930265+0000","last_peered":"2024-07-27T03:08:34.930265+0000","last_clean":"2024-07-27T03:08:34.930265+0000","last_became_active":"2024-07-27T03:08:33.933038+0000","last_became_peered":"2024-07-27T03:08:33.933038+0000","last_unstale":"2024-07-27T03:08:34.930265+0000","last_undegraded":"2024-07-27T03:08:34.930265+0000","last_fullsized":"2024-07-27T03:08:34.930265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931188+0000","last_change":"2024-07-27T03:08:33.959089+0000","last_active":"2024-07-27T03:08:34.931188+0000","last_peered":"2024-07-27T03:08:34.931188+0000","last_clean":"2024-07-27T03:08:34.931188+0000","last_became_active":"2024-07-27T03:08:33.957410+0000","last_became_peered":"2024-07-27T03:08:33.957410+0000","last_unstale":"2024-07-27T03:08:34.931188+0000","last_undegraded":"2024-07-27T03:08:34.931188+0000","last_fullsized":"2024-07-27T03:08:34.931188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:43:46.381317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932620+0000","last_change":"2024-07-27T03:08:33.950566+0000","last_active":"2024-07-27T03:08:34.932620+0000","last_peered":"2024-07-27T03:08:34.932620+0000","last_clean":"2024-07-27T03:08:34.932620+0000","last_became_active":"2024-07-27T03:08:33.950143+0000","last_became_peered":"2024-07-27T03:08:33.950143+0000","last_unstale":"2024-07-27T03:08:34.932620+0000","last_undegraded":"2024-07-27T03:08:34.932620+0000","last_fullsized":"2024-07-27T03:08:34.932620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:01:16.829706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755294+0000","last_change":"2024-07-27T03:08:33.942989+0000","last_active":"2024-07-27T03:08:36.755294+0000","last_peered":"2024-07-27T03:08:36.755294+0000","last_clean":"2024-07-27T03:08:36.755294+0000","last_became_active":"2024-07-27T03:08:33.942703+0000","last_became_peered":"2024-07-27T03:08:33.942703+0000","last_unstale":"2024-07-27T03:08:36.755294+0000","last_undegraded":"2024-07-27T03:08:36.755294+0000","last_fullsized":"2024-07-27T03:08:36.755294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:08:51.055336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650174+0000","last_change":"2024-07-27T03:08:33.953473+0000","last_active":"2024-07-27T03:08:37.650174+0000","last_peered":"2024-07-27T03:08:37.650174+0000","last_clean":"2024-07-27T03:08:37.650174+0000","last_became_active":"2024-07-27T03:08:33.950631+0000","last_became_peered":"2024-07-27T03:08:33.950631+0000","last_unstale":"2024-07-27T03:08:37.650174+0000","last_undegraded":"2024-07-27T03:08:37.650174+0000","last_fullsized":"2024-07-27T03:08:37.650174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:42:29.401799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934076+0000","last_change":"2024-07-27T03:08:33.957419+0000","last_active":"2024-07-27T03:08:35.934076+0000","last_peered":"2024-07-27T03:08:35.934076+0000","last_clean":"2024-07-27T03:08:35.934076+0000","last_became_active":"2024-07-27T03:08:33.957075+0000","last_became_peered":"2024-07-27T03:08:33.957075+0000","last_unstale":"2024-07-27T03:08:35.934076+0000","last_undegraded":"2024-07-27T03:08:35.934076+0000","last_fullsized":"2024-07-27T03:08:35.934076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868036+0000","last_change":"2024-07-27T03:08:33.950713+0000","last_active":"2024-07-27T03:08:36.868036+0000","last_peered":"2024-07-27T03:08:36.868036+0000","last_clean":"2024-07-27T03:08:36.868036+0000","last_became_active":"2024-07-27T03:08:33.950427+0000","last_became_peered":"2024-07-27T03:08:33.950427+0000","last_unstale":"2024-07-27T03:08:36.868036+0000","last_undegraded":"2024-07-27T03:08:36.868036+0000","last_fullsized":"2024-07-27T03:08:36.868036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:42:22.203747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932247+0000","last_change":"2024-07-27T03:08:33.943108+0000","last_active":"2024-07-27T03:08:34.932247+0000","last_peered":"2024-07-27T03:08:34.932247+0000","last_clean":"2024-07-27T03:08:34.932247+0000","last_became_active":"2024-07-27T03:08:33.942757+0000","last_became_peered":"2024-07-27T03:08:33.942757+0000","last_unstale":"2024-07-27T03:08:34.932247+0000","last_undegraded":"2024-07-27T03:08:34.932247+0000","last_fullsized":"2024-07-27T03:08:34.932247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:24:42.625083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825841+0000","last_change":"2024-07-27T03:08:33.952481+0000","last_active":"2024-07-27T03:08:35.825841+0000","last_peered":"2024-07-27T03:08:35.825841+0000","last_clean":"2024-07-27T03:08:35.825841+0000","last_became_active":"2024-07-27T03:08:33.950017+0000","last_became_peered":"2024-07-27T03:08:33.950017+0000","last_unstale":"2024-07-27T03:08:35.825841+0000","last_undegraded":"2024-07-27T03:08:35.825841+0000","last_fullsized":"2024-07-27T03:08:35.825841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931255+0000","last_change":"2024-07-27T03:08:33.955109+0000","last_active":"2024-07-27T03:08:34.931255+0000","last_peered":"2024-07-27T03:08:34.931255+0000","last_clean":"2024-07-27T03:08:34.931255+0000","last_became_active":"2024-07-27T03:08:33.954787+0000","last_became_peered":"2024-07-27T03:08:33.954787+0000","last_unstale":"2024-07-27T03:08:34.931255+0000","last_undegraded":"2024-07-27T03:08:34.931255+0000","last_fullsized":"2024-07-27T03:08:34.931255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:14.764441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826467+0000","last_change":"2024-07-27T03:08:33.954526+0000","last_active":"2024-07-27T03:08:35.826467+0000","last_peered":"2024-07-27T03:08:35.826467+0000","last_clean":"2024-07-27T03:08:35.826467+0000","last_became_active":"2024-07-27T03:08:33.953792+0000","last_became_peered":"2024-07-27T03:08:33.953792+0000","last_unstale":"2024-07-27T03:08:35.826467+0000","last_undegraded":"2024-07-27T03:08:35.826467+0000","last_fullsized":"2024-07-27T03:08:35.826467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:37:57.039727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934267+0000","last_change":"2024-07-27T03:08:33.947980+0000","last_active":"2024-07-27T03:08:35.934267+0000","last_peered":"2024-07-27T03:08:35.934267+0000","last_clean":"2024-07-27T03:08:35.934267+0000","last_became_active":"2024-07-27T03:08:33.947719+0000","last_became_peered":"2024-07-27T03:08:33.947719+0000","last_unstale":"2024-07-27T03:08:35.934267+0000","last_undegraded":"2024-07-27T03:08:35.934267+0000","last_fullsized":"2024-07-27T03:08:35.934267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930564+0000","last_change":"2024-07-27T03:08:33.948063+0000","last_active":"2024-07-27T03:08:34.930564+0000","last_peered":"2024-07-27T03:08:34.930564+0000","last_clean":"2024-07-27T03:08:34.930564+0000","last_became_active":"2024-07-27T03:08:33.947778+0000","last_became_peered":"2024-07-27T03:08:33.947778+0000","last_unstale":"2024-07-27T03:08:34.930564+0000","last_undegraded":"2024-07-27T03:08:34.930564+0000","last_fullsized":"2024-07-27T03:08:34.930564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:13:24.620410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826274+0000","last_change":"2024-07-27T03:08:33.954136+0000","last_active":"2024-07-27T03:08:35.826274+0000","last_peered":"2024-07-27T03:08:35.826274+0000","last_clean":"2024-07-27T03:08:35.826274+0000","last_became_active":"2024-07-27T03:08:33.953381+0000","last_became_peered":"2024-07-27T03:08:33.953381+0000","last_unstale":"2024-07-27T03:08:35.826274+0000","last_undegraded":"2024-07-27T03:08:35.826274+0000","last_fullsized":"2024-07-27T03:08:35.826274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:13:24.620410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868169+0000","last_change":"2024-07-27T03:08:33.954554+0000","last_active":"2024-07-27T03:08:36.868169+0000","last_peered":"2024-07-27T03:08:36.868169+0000","last_clean":"2024-07-27T03:08:36.868169+0000","last_became_active":"2024-07-27T03:08:33.954226+0000","last_became_peered":"2024-07-27T03:08:33.954226+0000","last_unstale":"2024-07-27T03:08:36.868169+0000","last_undegraded":"2024-07-27T03:08:36.868169+0000","last_fullsized":"2024-07-27T03:08:36.868169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:43:46.381317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932443+0000","last_change":"2024-07-27T03:08:33.949720+0000","last_active":"2024-07-27T03:08:34.932443+0000","last_peered":"2024-07-27T03:08:34.932443+0000","last_clean":"2024-07-27T03:08:34.932443+0000","last_became_active":"2024-07-27T03:08:33.949300+0000","last_became_peered":"2024-07-27T03:08:33.949300+0000","last_unstale":"2024-07-27T03:08:34.932443+0000","last_undegraded":"2024-07-27T03:08:34.932443+0000","last_fullsized":"2024-07-27T03:08:34.932443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:22.536071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755128+0000","last_change":"2024-07-27T03:08:33.939020+0000","last_active":"2024-07-27T03:08:36.755128+0000","last_peered":"2024-07-27T03:08:36.755128+0000","last_clean":"2024-07-27T03:08:36.755128+0000","last_became_active":"2024-07-27T03:08:33.938648+0000","last_became_peered":"2024-07-27T03:08:33.938648+0000","last_unstale":"2024-07-27T03:08:36.755128+0000","last_undegraded":"2024-07-27T03:08:36.755128+0000","last_fullsized":"2024-07-27T03:08:36.755128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:15:40.187027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933962+0000","last_change":"2024-07-27T03:08:33.957896+0000","last_active":"2024-07-27T03:08:35.933962+0000","last_peered":"2024-07-27T03:08:35.933962+0000","last_clean":"2024-07-27T03:08:35.933962+0000","last_became_active":"2024-07-27T03:08:33.957571+0000","last_became_peered":"2024-07-27T03:08:33.957571+0000","last_unstale":"2024-07-27T03:08:35.933962+0000","last_undegraded":"2024-07-27T03:08:35.933962+0000","last_fullsized":"2024-07-27T03:08:35.933962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:02:10.905040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931554+0000","last_change":"2024-07-27T03:08:33.933266+0000","last_active":"2024-07-27T03:08:34.931554+0000","last_peered":"2024-07-27T03:08:34.931554+0000","last_clean":"2024-07-27T03:08:34.931554+0000","last_became_active":"2024-07-27T03:08:33.932884+0000","last_became_peered":"2024-07-27T03:08:33.932884+0000","last_unstale":"2024-07-27T03:08:34.931554+0000","last_undegraded":"2024-07-27T03:08:34.931554+0000","last_fullsized":"2024-07-27T03:08:34.931554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:39.773288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826178+0000","last_change":"2024-07-27T03:08:32.950534+0000","last_active":"2024-07-27T03:08:35.826178+0000","last_peered":"2024-07-27T03:08:35.826178+0000","last_clean":"2024-07-27T03:08:35.826178+0000","last_became_active":"2024-07-27T03:08:32.949394+0000","last_became_peered":"2024-07-27T03:08:32.949394+0000","last_unstale":"2024-07-27T03:08:35.826178+0000","last_undegraded":"2024-07-27T03:08:35.826178+0000","last_fullsized":"2024-07-27T03:08:35.826178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:53:04.632649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868190+0000","last_change":"2024-07-27T03:08:33.953285+0000","last_active":"2024-07-27T03:08:36.868190+0000","last_peered":"2024-07-27T03:08:36.868190+0000","last_clean":"2024-07-27T03:08:36.868190+0000","last_became_active":"2024-07-27T03:08:33.952303+0000","last_became_peered":"2024-07-27T03:08:33.952303+0000","last_unstale":"2024-07-27T03:08:36.868190+0000","last_undegraded":"2024-07-27T03:08:36.868190+0000","last_fullsized":"2024-07-27T03:08:36.868190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:48:47.476886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933676+0000","last_change":"2024-07-27T03:08:32.946959+0000","last_active":"2024-07-27T03:08:35.933676+0000","last_peered":"2024-07-27T03:08:35.933676+0000","last_clean":"2024-07-27T03:08:35.933676+0000","last_became_active":"2024-07-27T03:08:32.946603+0000","last_became_peered":"2024-07-27T03:08:32.946603+0000","last_unstale":"2024-07-27T03:08:35.933676+0000","last_undegraded":"2024-07-27T03:08:35.933676+0000","last_fullsized":"2024-07-27T03:08:35.933676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:24:33.462183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826062+0000","last_change":"2024-07-27T03:08:32.951105+0000","last_active":"2024-07-27T03:08:35.826062+0000","last_peered":"2024-07-27T03:08:35.826062+0000","last_clean":"2024-07-27T03:08:35.826062+0000","last_became_active":"2024-07-27T03:08:32.950768+0000","last_became_peered":"2024-07-27T03:08:32.950768+0000","last_unstale":"2024-07-27T03:08:35.826062+0000","last_undegraded":"2024-07-27T03:08:35.826062+0000","last_fullsized":"2024-07-27T03:08:35.826062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:08:45.268483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825827+0000","last_change":"2024-07-27T03:08:33.956827+0000","last_active":"2024-07-27T03:08:35.825827+0000","last_peered":"2024-07-27T03:08:35.825827+0000","last_clean":"2024-07-27T03:08:35.825827+0000","last_became_active":"2024-07-27T03:08:33.956528+0000","last_became_peered":"2024-07-27T03:08:33.956528+0000","last_unstale":"2024-07-27T03:08:35.825827+0000","last_undegraded":"2024-07-27T03:08:35.825827+0000","last_fullsized":"2024-07-27T03:08:35.825827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:52:05.096628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931459+0000","last_change":"2024-07-27T03:08:32.951650+0000","last_active":"2024-07-27T03:08:34.931459+0000","last_peered":"2024-07-27T03:08:34.931459+0000","last_clean":"2024-07-27T03:08:34.931459+0000","last_became_active":"2024-07-27T03:08:32.950807+0000","last_became_peered":"2024-07-27T03:08:32.950807+0000","last_unstale":"2024-07-27T03:08:34.931459+0000","last_undegraded":"2024-07-27T03:08:34.931459+0000","last_fullsized":"2024-07-27T03:08:34.931459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:16:05.521168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930234+0000","last_change":"2024-07-27T03:08:33.955840+0000","last_active":"2024-07-27T03:08:34.930234+0000","last_peered":"2024-07-27T03:08:34.930234+0000","last_clean":"2024-07-27T03:08:34.930234+0000","last_became_active":"2024-07-27T03:08:33.955515+0000","last_became_peered":"2024-07-27T03:08:33.955515+0000","last_unstale":"2024-07-27T03:08:34.930234+0000","last_undegraded":"2024-07-27T03:08:34.930234+0000","last_fullsized":"2024-07-27T03:08:34.930234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933924+0000","last_change":"2024-07-27T03:08:32.952580+0000","last_active":"2024-07-27T03:08:35.933924+0000","last_peered":"2024-07-27T03:08:35.933924+0000","last_clean":"2024-07-27T03:08:35.933924+0000","last_became_active":"2024-07-27T03:08:32.951849+0000","last_became_peered":"2024-07-27T03:08:32.951849+0000","last_unstale":"2024-07-27T03:08:35.933924+0000","last_undegraded":"2024-07-27T03:08:35.933924+0000","last_fullsized":"2024-07-27T03:08:35.933924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:24.797895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931964+0000","last_change":"2024-07-27T03:08:33.947195+0000","last_active":"2024-07-27T03:08:34.931964+0000","last_peered":"2024-07-27T03:08:34.931964+0000","last_clean":"2024-07-27T03:08:34.931964+0000","last_became_active":"2024-07-27T03:08:33.946831+0000","last_became_peered":"2024-07-27T03:08:33.946831+0000","last_unstale":"2024-07-27T03:08:34.931964+0000","last_undegraded":"2024-07-27T03:08:34.931964+0000","last_fullsized":"2024-07-27T03:08:34.931964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:35:20.173378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932094+0000","last_change":"2024-07-27T03:08:32.948775+0000","last_active":"2024-07-27T03:08:34.932094+0000","last_peered":"2024-07-27T03:08:34.932094+0000","last_clean":"2024-07-27T03:08:34.932094+0000","last_became_active":"2024-07-27T03:08:32.948396+0000","last_became_peered":"2024-07-27T03:08:32.948396+0000","last_unstale":"2024-07-27T03:08:34.932094+0000","last_undegraded":"2024-07-27T03:08:34.932094+0000","last_fullsized":"2024-07-27T03:08:34.932094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:02:35.203630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868581+0000","last_change":"2024-07-27T03:08:33.951343+0000","last_active":"2024-07-27T03:08:36.868581+0000","last_peered":"2024-07-27T03:08:36.868581+0000","last_clean":"2024-07-27T03:08:36.868581+0000","last_became_active":"2024-07-27T03:08:33.950827+0000","last_became_peered":"2024-07-27T03:08:33.950827+0000","last_unstale":"2024-07-27T03:08:36.868581+0000","last_undegraded":"2024-07-27T03:08:36.868581+0000","last_fullsized":"2024-07-27T03:08:36.868581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:24:42.625083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930431+0000","last_change":"2024-07-27T03:08:32.950138+0000","last_active":"2024-07-27T03:08:34.930431+0000","last_peered":"2024-07-27T03:08:34.930431+0000","last_clean":"2024-07-27T03:08:34.930431+0000","last_became_active":"2024-07-27T03:08:32.949805+0000","last_became_peered":"2024-07-27T03:08:32.949805+0000","last_unstale":"2024-07-27T03:08:34.930431+0000","last_undegraded":"2024-07-27T03:08:34.930431+0000","last_fullsized":"2024-07-27T03:08:34.930431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:54:05.204464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932119+0000","last_change":"2024-07-27T03:08:33.949864+0000","last_active":"2024-07-27T03:08:34.932119+0000","last_peered":"2024-07-27T03:08:34.932119+0000","last_clean":"2024-07-27T03:08:34.932119+0000","last_became_active":"2024-07-27T03:08:33.949559+0000","last_became_peered":"2024-07-27T03:08:33.949559+0000","last_unstale":"2024-07-27T03:08:34.932119+0000","last_undegraded":"2024-07-27T03:08:34.932119+0000","last_fullsized":"2024-07-27T03:08:34.932119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:54:06.207049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933893+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:35.933893+0000","last_peered":"2024-07-27T03:08:35.933893+0000","last_clean":"2024-07-27T03:08:35.933893+0000","last_became_active":"2024-07-27T03:08:32.950507+0000","last_became_peered":"2024-07-27T03:08:32.950507+0000","last_unstale":"2024-07-27T03:08:35.933893+0000","last_undegraded":"2024-07-27T03:08:35.933893+0000","last_fullsized":"2024-07-27T03:08:35.933893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:38.770703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649938+0000","last_change":"2024-07-27T03:08:33.956829+0000","last_active":"2024-07-27T03:08:37.649938+0000","last_peered":"2024-07-27T03:08:37.649938+0000","last_clean":"2024-07-27T03:08:37.649938+0000","last_became_active":"2024-07-27T03:08:33.951501+0000","last_became_peered":"2024-07-27T03:08:33.951501+0000","last_unstale":"2024-07-27T03:08:37.649938+0000","last_undegraded":"2024-07-27T03:08:37.649938+0000","last_fullsized":"2024-07-27T03:08:37.649938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:09:25.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868296+0000","last_change":"2024-07-27T03:08:32.944499+0000","last_active":"2024-07-27T03:08:36.868296+0000","last_peered":"2024-07-27T03:08:36.868296+0000","last_clean":"2024-07-27T03:08:36.868296+0000","last_became_active":"2024-07-27T03:08:32.943866+0000","last_became_peered":"2024-07-27T03:08:32.943866+0000","last_unstale":"2024-07-27T03:08:36.868296+0000","last_undegraded":"2024-07-27T03:08:36.868296+0000","last_fullsized":"2024-07-27T03:08:36.868296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:09.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868050+0000","last_change":"2024-07-27T03:08:33.949435+0000","last_active":"2024-07-27T03:08:36.868050+0000","last_peered":"2024-07-27T03:08:36.868050+0000","last_clean":"2024-07-27T03:08:36.868050+0000","last_became_active":"2024-07-27T03:08:33.949090+0000","last_became_peered":"2024-07-27T03:08:33.949090+0000","last_unstale":"2024-07-27T03:08:36.868050+0000","last_undegraded":"2024-07-27T03:08:36.868050+0000","last_fullsized":"2024-07-27T03:08:36.868050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:35:51.827596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932564+0000","last_change":"2024-07-27T03:08:32.949082+0000","last_active":"2024-07-27T03:08:34.932564+0000","last_peered":"2024-07-27T03:08:34.932564+0000","last_clean":"2024-07-27T03:08:34.932564+0000","last_became_active":"2024-07-27T03:08:32.948684+0000","last_became_peered":"2024-07-27T03:08:32.948684+0000","last_unstale":"2024-07-27T03:08:34.932564+0000","last_undegraded":"2024-07-27T03:08:34.932564+0000","last_fullsized":"2024-07-27T03:08:34.932564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:00:08.849358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649859+0000","last_change":"2024-07-27T03:08:33.953574+0000","last_active":"2024-07-27T03:08:37.649859+0000","last_peered":"2024-07-27T03:08:37.649859+0000","last_clean":"2024-07-27T03:08:37.649859+0000","last_became_active":"2024-07-27T03:08:33.953247+0000","last_became_peered":"2024-07-27T03:08:33.953247+0000","last_unstale":"2024-07-27T03:08:37.649859+0000","last_undegraded":"2024-07-27T03:08:37.649859+0000","last_fullsized":"2024-07-27T03:08:37.649859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:58.998778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933743+0000","last_change":"2024-07-27T03:08:32.952599+0000","last_active":"2024-07-27T03:08:35.933743+0000","last_peered":"2024-07-27T03:08:35.933743+0000","last_clean":"2024-07-27T03:08:35.933743+0000","last_became_active":"2024-07-27T03:08:32.952293+0000","last_became_peered":"2024-07-27T03:08:32.952293+0000","last_unstale":"2024-07-27T03:08:35.933743+0000","last_undegraded":"2024-07-27T03:08:35.933743+0000","last_fullsized":"2024-07-27T03:08:35.933743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:01:24.017164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934003+0000","last_change":"2024-07-27T03:08:33.957887+0000","last_active":"2024-07-27T03:08:35.934003+0000","last_peered":"2024-07-27T03:08:35.934003+0000","last_clean":"2024-07-27T03:08:35.934003+0000","last_became_active":"2024-07-27T03:08:33.957528+0000","last_became_peered":"2024-07-27T03:08:33.957528+0000","last_unstale":"2024-07-27T03:08:35.934003+0000","last_undegraded":"2024-07-27T03:08:35.934003+0000","last_fullsized":"2024-07-27T03:08:35.934003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:52:05.096628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755038+0000","last_change":"2024-07-27T03:08:32.946673+0000","last_active":"2024-07-27T03:08:36.755038+0000","last_peered":"2024-07-27T03:08:36.755038+0000","last_clean":"2024-07-27T03:08:36.755038+0000","last_became_active":"2024-07-27T03:08:32.946188+0000","last_became_peered":"2024-07-27T03:08:32.946188+0000","last_unstale":"2024-07-27T03:08:36.755038+0000","last_undegraded":"2024-07-27T03:08:36.755038+0000","last_fullsized":"2024-07-27T03:08:36.755038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:16:05.521168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649536+0000","last_change":"2024-07-27T03:08:33.952508+0000","last_active":"2024-07-27T03:08:37.649536+0000","last_peered":"2024-07-27T03:08:37.649536+0000","last_clean":"2024-07-27T03:08:37.649536+0000","last_became_active":"2024-07-27T03:08:33.952215+0000","last_became_peered":"2024-07-27T03:08:33.952215+0000","last_unstale":"2024-07-27T03:08:37.649536+0000","last_undegraded":"2024-07-27T03:08:37.649536+0000","last_fullsized":"2024-07-27T03:08:37.649536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:24:42.625083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931892+0000","last_change":"2024-07-27T03:08:32.943381+0000","last_active":"2024-07-27T03:08:34.931892+0000","last_peered":"2024-07-27T03:08:34.931892+0000","last_clean":"2024-07-27T03:08:34.931892+0000","last_became_active":"2024-07-27T03:08:32.943077+0000","last_became_peered":"2024-07-27T03:08:32.943077+0000","last_unstale":"2024-07-27T03:08:34.931892+0000","last_undegraded":"2024-07-27T03:08:34.931892+0000","last_fullsized":"2024-07-27T03:08:34.931892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:56:08.696748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650043+0000","last_change":"2024-07-27T03:08:33.952835+0000","last_active":"2024-07-27T03:08:37.650043+0000","last_peered":"2024-07-27T03:08:37.650043+0000","last_clean":"2024-07-27T03:08:37.650043+0000","last_became_active":"2024-07-27T03:08:33.952454+0000","last_became_peered":"2024-07-27T03:08:33.952454+0000","last_unstale":"2024-07-27T03:08:37.650043+0000","last_undegraded":"2024-07-27T03:08:37.650043+0000","last_fullsized":"2024-07-27T03:08:37.650043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:59.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755311+0000","last_change":"2024-07-27T03:08:32.952496+0000","last_active":"2024-07-27T03:08:36.755311+0000","last_peered":"2024-07-27T03:08:36.755311+0000","last_clean":"2024-07-27T03:08:36.755311+0000","last_became_active":"2024-07-27T03:08:32.952196+0000","last_became_peered":"2024-07-27T03:08:32.952196+0000","last_unstale":"2024-07-27T03:08:36.755311+0000","last_undegraded":"2024-07-27T03:08:36.755311+0000","last_fullsized":"2024-07-27T03:08:36.755311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:37:28.835075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650316+0000","last_change":"2024-07-27T03:08:33.954543+0000","last_active":"2024-07-27T03:08:37.650316+0000","last_peered":"2024-07-27T03:08:37.650316+0000","last_clean":"2024-07-27T03:08:37.650316+0000","last_became_active":"2024-07-27T03:08:33.954185+0000","last_became_peered":"2024-07-27T03:08:33.954185+0000","last_unstale":"2024-07-27T03:08:37.650316+0000","last_undegraded":"2024-07-27T03:08:37.650316+0000","last_fullsized":"2024-07-27T03:08:37.650316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:25:33.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930593+0000","last_change":"2024-07-27T03:08:32.941336+0000","last_active":"2024-07-27T03:08:34.930593+0000","last_peered":"2024-07-27T03:08:34.930593+0000","last_clean":"2024-07-27T03:08:34.930593+0000","last_became_active":"2024-07-27T03:08:32.940512+0000","last_became_peered":"2024-07-27T03:08:32.940512+0000","last_unstale":"2024-07-27T03:08:34.930593+0000","last_undegraded":"2024-07-27T03:08:34.930593+0000","last_fullsized":"2024-07-27T03:08:34.930593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:28:24.786534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933070+0000","last_change":"2024-07-27T03:08:33.959413+0000","last_active":"2024-07-27T03:08:34.933070+0000","last_peered":"2024-07-27T03:08:34.933070+0000","last_clean":"2024-07-27T03:08:34.933070+0000","last_became_active":"2024-07-27T03:08:33.956911+0000","last_became_peered":"2024-07-27T03:08:33.956911+0000","last_unstale":"2024-07-27T03:08:34.933070+0000","last_undegraded":"2024-07-27T03:08:34.933070+0000","last_fullsized":"2024-07-27T03:08:34.933070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:02:56.479634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755189+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:36.755189+0000","last_peered":"2024-07-27T03:08:36.755189+0000","last_clean":"2024-07-27T03:08:36.755189+0000","last_became_active":"2024-07-27T03:08:32.950533+0000","last_became_peered":"2024-07-27T03:08:32.950533+0000","last_unstale":"2024-07-27T03:08:36.755189+0000","last_undegraded":"2024-07-27T03:08:36.755189+0000","last_fullsized":"2024-07-27T03:08:36.755189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:00:08.849358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649904+0000","last_change":"2024-07-27T03:08:33.954154+0000","last_active":"2024-07-27T03:08:37.649904+0000","last_peered":"2024-07-27T03:08:37.649904+0000","last_clean":"2024-07-27T03:08:37.649904+0000","last_became_active":"2024-07-27T03:08:33.953132+0000","last_became_peered":"2024-07-27T03:08:33.953132+0000","last_unstale":"2024-07-27T03:08:37.649904+0000","last_undegraded":"2024-07-27T03:08:37.649904+0000","last_fullsized":"2024-07-27T03:08:37.649904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:01:16.829706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649547+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:08:37.649547+0000","last_peered":"2024-07-27T03:08:37.649547+0000","last_clean":"2024-07-27T03:08:37.649547+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:08:37.649547+0000","last_undegraded":"2024-07-27T03:08:37.649547+0000","last_fullsized":"2024-07-27T03:08:37.649547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931659+0000","last_change":"2024-07-27T03:08:32.948243+0000","last_active":"2024-07-27T03:08:34.931659+0000","last_peered":"2024-07-27T03:08:34.931659+0000","last_clean":"2024-07-27T03:08:34.931659+0000","last_became_active":"2024-07-27T03:08:32.947945+0000","last_became_peered":"2024-07-27T03:08:32.947945+0000","last_unstale":"2024-07-27T03:08:34.931659+0000","last_undegraded":"2024-07-27T03:08:34.931659+0000","last_fullsized":"2024-07-27T03:08:34.931659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825946+0000","last_change":"2024-07-27T03:08:33.948128+0000","last_active":"2024-07-27T03:08:35.825946+0000","last_peered":"2024-07-27T03:08:35.825946+0000","last_clean":"2024-07-27T03:08:35.825946+0000","last_became_active":"2024-07-27T03:08:33.947486+0000","last_became_peered":"2024-07-27T03:08:33.947486+0000","last_unstale":"2024-07-27T03:08:35.825946+0000","last_undegraded":"2024-07-27T03:08:35.825946+0000","last_fullsized":"2024-07-27T03:08:35.825946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649403+0000","last_change":"2024-07-27T03:08:32.955404+0000","last_active":"2024-07-27T03:08:37.649403+0000","last_peered":"2024-07-27T03:08:37.649403+0000","last_clean":"2024-07-27T03:08:37.649403+0000","last_became_active":"2024-07-27T03:08:32.955120+0000","last_became_peered":"2024-07-27T03:08:32.955120+0000","last_unstale":"2024-07-27T03:08:37.649403+0000","last_undegraded":"2024-07-27T03:08:37.649403+0000","last_fullsized":"2024-07-27T03:08:37.649403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:02:16.712233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.867978+0000","last_change":"2024-07-27T03:08:33.953727+0000","last_active":"2024-07-27T03:08:36.867978+0000","last_peered":"2024-07-27T03:08:36.867978+0000","last_clean":"2024-07-27T03:08:36.867978+0000","last_became_active":"2024-07-27T03:08:33.952917+0000","last_became_peered":"2024-07-27T03:08:33.952917+0000","last_unstale":"2024-07-27T03:08:36.867978+0000","last_undegraded":"2024-07-27T03:08:36.867978+0000","last_fullsized":"2024-07-27T03:08:36.867978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:11:19.253618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755186+0000","last_change":"2024-07-27T03:08:32.951299+0000","last_active":"2024-07-27T03:08:36.755186+0000","last_peered":"2024-07-27T03:08:36.755186+0000","last_clean":"2024-07-27T03:08:36.755186+0000","last_became_active":"2024-07-27T03:08:32.950946+0000","last_became_peered":"2024-07-27T03:08:32.950946+0000","last_unstale":"2024-07-27T03:08:36.755186+0000","last_undegraded":"2024-07-27T03:08:36.755186+0000","last_fullsized":"2024-07-27T03:08:36.755186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:19:16.481538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930286+0000","last_change":"2024-07-27T03:08:33.937577+0000","last_active":"2024-07-27T03:08:34.930286+0000","last_peered":"2024-07-27T03:08:34.930286+0000","last_clean":"2024-07-27T03:08:34.930286+0000","last_became_active":"2024-07-27T03:08:33.937262+0000","last_became_peered":"2024-07-27T03:08:33.937262+0000","last_unstale":"2024-07-27T03:08:34.930286+0000","last_undegraded":"2024-07-27T03:08:34.930286+0000","last_fullsized":"2024-07-27T03:08:34.930286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932797+0000","last_change":"2024-07-27T03:08:32.943293+0000","last_active":"2024-07-27T03:08:34.932797+0000","last_peered":"2024-07-27T03:08:34.932797+0000","last_clean":"2024-07-27T03:08:34.932797+0000","last_became_active":"2024-07-27T03:08:32.942974+0000","last_became_peered":"2024-07-27T03:08:32.942974+0000","last_unstale":"2024-07-27T03:08:34.932797+0000","last_undegraded":"2024-07-27T03:08:34.932797+0000","last_fullsized":"2024-07-27T03:08:34.932797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:19:16.481538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932094+0000","last_change":"2024-07-27T03:08:33.954605+0000","last_active":"2024-07-27T03:08:34.932094+0000","last_peered":"2024-07-27T03:08:34.932094+0000","last_clean":"2024-07-27T03:08:34.932094+0000","last_became_active":"2024-07-27T03:08:33.954160+0000","last_became_peered":"2024-07-27T03:08:33.954160+0000","last_unstale":"2024-07-27T03:08:34.932094+0000","last_undegraded":"2024-07-27T03:08:34.932094+0000","last_fullsized":"2024-07-27T03:08:34.932094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:32.582766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930412+0000","last_change":"2024-07-27T03:08:32.938940+0000","last_active":"2024-07-27T03:08:34.930412+0000","last_peered":"2024-07-27T03:08:34.930412+0000","last_clean":"2024-07-27T03:08:34.930412+0000","last_became_active":"2024-07-27T03:08:32.938639+0000","last_became_peered":"2024-07-27T03:08:32.938639+0000","last_unstale":"2024-07-27T03:08:34.930412+0000","last_undegraded":"2024-07-27T03:08:34.930412+0000","last_fullsized":"2024-07-27T03:08:34.930412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:24.797895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933291+0000","last_change":"2024-07-27T03:08:33.948481+0000","last_active":"2024-07-27T03:08:34.933291+0000","last_peered":"2024-07-27T03:08:34.933291+0000","last_clean":"2024-07-27T03:08:34.933291+0000","last_became_active":"2024-07-27T03:08:33.948155+0000","last_became_peered":"2024-07-27T03:08:33.948155+0000","last_unstale":"2024-07-27T03:08:34.933291+0000","last_undegraded":"2024-07-27T03:08:34.933291+0000","last_fullsized":"2024-07-27T03:08:34.933291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:59.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650236+0000","last_change":"2024-07-27T03:08:32.955213+0000","last_active":"2024-07-27T03:08:37.650236+0000","last_peered":"2024-07-27T03:08:37.650236+0000","last_clean":"2024-07-27T03:08:37.650236+0000","last_became_active":"2024-07-27T03:08:32.954883+0000","last_became_peered":"2024-07-27T03:08:32.954883+0000","last_unstale":"2024-07-27T03:08:37.650236+0000","last_undegraded":"2024-07-27T03:08:37.650236+0000","last_fullsized":"2024-07-27T03:08:37.650236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:53:17.583725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930594+0000","last_change":"2024-07-27T03:08:33.941170+0000","last_active":"2024-07-27T03:08:34.930594+0000","last_peered":"2024-07-27T03:08:34.930594+0000","last_clean":"2024-07-27T03:08:34.930594+0000","last_became_active":"2024-07-27T03:08:33.940792+0000","last_became_peered":"2024-07-27T03:08:33.940792+0000","last_unstale":"2024-07-27T03:08:34.930594+0000","last_undegraded":"2024-07-27T03:08:34.930594+0000","last_fullsized":"2024-07-27T03:08:34.930594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:35:01.175302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930630+0000","last_change":"2024-07-27T03:08:32.945506+0000","last_active":"2024-07-27T03:08:34.930630+0000","last_peered":"2024-07-27T03:08:34.930630+0000","last_clean":"2024-07-27T03:08:34.930630+0000","last_became_active":"2024-07-27T03:08:32.945201+0000","last_became_peered":"2024-07-27T03:08:32.945201+0000","last_unstale":"2024-07-27T03:08:34.930630+0000","last_undegraded":"2024-07-27T03:08:34.930630+0000","last_fullsized":"2024-07-27T03:08:34.930630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:58:54.316561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826477+0000","last_change":"2024-07-27T03:08:33.956128+0000","last_active":"2024-07-27T03:08:35.826477+0000","last_peered":"2024-07-27T03:08:35.826477+0000","last_clean":"2024-07-27T03:08:35.826477+0000","last_became_active":"2024-07-27T03:08:33.955341+0000","last_became_peered":"2024-07-27T03:08:33.955341+0000","last_unstale":"2024-07-27T03:08:35.826477+0000","last_undegraded":"2024-07-27T03:08:35.826477+0000","last_fullsized":"2024-07-27T03:08:35.826477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:04:25.906455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934062+0000","last_change":"2024-07-27T03:08:32.949210+0000","last_active":"2024-07-27T03:08:35.934062+0000","last_peered":"2024-07-27T03:08:35.934062+0000","last_clean":"2024-07-27T03:08:35.934062+0000","last_became_active":"2024-07-27T03:08:32.948858+0000","last_became_peered":"2024-07-27T03:08:32.948858+0000","last_unstale":"2024-07-27T03:08:35.934062+0000","last_undegraded":"2024-07-27T03:08:35.934062+0000","last_fullsized":"2024-07-27T03:08:35.934062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:31.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868515+0000","last_change":"2024-07-27T03:08:33.952497+0000","last_active":"2024-07-27T03:08:36.868515+0000","last_peered":"2024-07-27T03:08:36.868515+0000","last_clean":"2024-07-27T03:08:36.868515+0000","last_became_active":"2024-07-27T03:08:33.952113+0000","last_became_peered":"2024-07-27T03:08:33.952113+0000","last_unstale":"2024-07-27T03:08:36.868515+0000","last_undegraded":"2024-07-27T03:08:36.868515+0000","last_fullsized":"2024-07-27T03:08:36.868515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:35:20.173378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649390+0000","last_change":"2024-07-27T03:08:32.955144+0000","last_active":"2024-07-27T03:08:37.649390+0000","last_peered":"2024-07-27T03:08:37.649390+0000","last_clean":"2024-07-27T03:08:37.649390+0000","last_became_active":"2024-07-27T03:08:32.954645+0000","last_became_peered":"2024-07-27T03:08:32.954645+0000","last_unstale":"2024-07-27T03:08:37.649390+0000","last_undegraded":"2024-07-27T03:08:37.649390+0000","last_fullsized":"2024-07-27T03:08:37.649390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:19:16.481538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932211+0000","last_change":"2024-07-27T03:08:33.941376+0000","last_active":"2024-07-27T03:08:34.932211+0000","last_peered":"2024-07-27T03:08:34.932211+0000","last_clean":"2024-07-27T03:08:34.932211+0000","last_became_active":"2024-07-27T03:08:33.940032+0000","last_became_peered":"2024-07-27T03:08:33.940032+0000","last_unstale":"2024-07-27T03:08:34.932211+0000","last_undegraded":"2024-07-27T03:08:34.932211+0000","last_fullsized":"2024-07-27T03:08:34.932211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:28:25.789119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930293+0000","last_change":"2024-07-27T03:08:32.947719+0000","last_active":"2024-07-27T03:08:34.930293+0000","last_peered":"2024-07-27T03:08:34.930293+0000","last_clean":"2024-07-27T03:08:34.930293+0000","last_became_active":"2024-07-27T03:08:32.947422+0000","last_became_peered":"2024-07-27T03:08:32.947422+0000","last_unstale":"2024-07-27T03:08:34.930293+0000","last_undegraded":"2024-07-27T03:08:34.930293+0000","last_fullsized":"2024-07-27T03:08:34.930293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:31.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826037+0000","last_change":"2024-07-27T03:08:33.944591+0000","last_active":"2024-07-27T03:08:35.826037+0000","last_peered":"2024-07-27T03:08:35.826037+0000","last_clean":"2024-07-27T03:08:35.826037+0000","last_became_active":"2024-07-27T03:08:33.944286+0000","last_became_peered":"2024-07-27T03:08:33.944286+0000","last_unstale":"2024-07-27T03:08:35.826037+0000","last_undegraded":"2024-07-27T03:08:35.826037+0000","last_fullsized":"2024-07-27T03:08:35.826037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930426+0000","last_change":"2024-07-27T03:08:32.950885+0000","last_active":"2024-07-27T03:08:34.930426+0000","last_peered":"2024-07-27T03:08:34.930426+0000","last_clean":"2024-07-27T03:08:34.930426+0000","last_became_active":"2024-07-27T03:08:32.950569+0000","last_became_peered":"2024-07-27T03:08:32.950569+0000","last_unstale":"2024-07-27T03:08:34.930426+0000","last_undegraded":"2024-07-27T03:08:34.930426+0000","last_fullsized":"2024-07-27T03:08:34.930426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:38.770703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826274+0000","last_change":"2024-07-27T03:08:33.954837+0000","last_active":"2024-07-27T03:08:35.826274+0000","last_peered":"2024-07-27T03:08:35.826274+0000","last_clean":"2024-07-27T03:08:35.826274+0000","last_became_active":"2024-07-27T03:08:33.953709+0000","last_became_peered":"2024-07-27T03:08:33.953709+0000","last_unstale":"2024-07-27T03:08:35.826274+0000","last_undegraded":"2024-07-27T03:08:35.826274+0000","last_fullsized":"2024-07-27T03:08:35.826274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:35:01.175302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650106+0000","last_change":"2024-07-27T03:08:32.952714+0000","last_active":"2024-07-27T03:08:37.650106+0000","last_peered":"2024-07-27T03:08:37.650106+0000","last_clean":"2024-07-27T03:08:37.650106+0000","last_became_active":"2024-07-27T03:08:32.952425+0000","last_became_peered":"2024-07-27T03:08:32.952425+0000","last_unstale":"2024-07-27T03:08:37.650106+0000","last_undegraded":"2024-07-27T03:08:37.650106+0000","last_fullsized":"2024-07-27T03:08:37.650106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:00:08.849358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934081+0000","last_change":"2024-07-27T03:08:33.957221+0000","last_active":"2024-07-27T03:08:35.934081+0000","last_peered":"2024-07-27T03:08:35.934081+0000","last_clean":"2024-07-27T03:08:35.934081+0000","last_became_active":"2024-07-27T03:08:33.956847+0000","last_became_peered":"2024-07-27T03:08:33.956847+0000","last_unstale":"2024-07-27T03:08:35.934081+0000","last_undegraded":"2024-07-27T03:08:35.934081+0000","last_fullsized":"2024-07-27T03:08:35.934081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933249+0000","last_change":"2024-07-27T03:08:33.941040+0000","last_active":"2024-07-27T03:08:34.933249+0000","last_peered":"2024-07-27T03:08:34.933249+0000","last_clean":"2024-07-27T03:08:34.933249+0000","last_became_active":"2024-07-27T03:08:33.940723+0000","last_became_peered":"2024-07-27T03:08:33.940723+0000","last_unstale":"2024-07-27T03:08:34.933249+0000","last_undegraded":"2024-07-27T03:08:34.933249+0000","last_fullsized":"2024-07-27T03:08:34.933249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:51.758397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649790+0000","last_change":"2024-07-27T03:08:32.953454+0000","last_active":"2024-07-27T03:08:37.649790+0000","last_peered":"2024-07-27T03:08:37.649790+0000","last_clean":"2024-07-27T03:08:37.649790+0000","last_became_active":"2024-07-27T03:08:32.953065+0000","last_became_peered":"2024-07-27T03:08:32.953065+0000","last_unstale":"2024-07-27T03:08:37.649790+0000","last_undegraded":"2024-07-27T03:08:37.649790+0000","last_fullsized":"2024-07-27T03:08:37.649790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:32:44.100894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933070+0000","last_change":"2024-07-27T03:08:33.945495+0000","last_active":"2024-07-27T03:08:34.933070+0000","last_peered":"2024-07-27T03:08:34.933070+0000","last_clean":"2024-07-27T03:08:34.933070+0000","last_became_active":"2024-07-27T03:08:33.945151+0000","last_became_peered":"2024-07-27T03:08:33.945151+0000","last_unstale":"2024-07-27T03:08:34.933070+0000","last_undegraded":"2024-07-27T03:08:34.933070+0000","last_fullsized":"2024-07-27T03:08:34.933070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:09:25.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650078+0000","last_change":"2024-07-27T03:08:32.951809+0000","last_active":"2024-07-27T03:08:37.650078+0000","last_peered":"2024-07-27T03:08:37.650078+0000","last_clean":"2024-07-27T03:08:37.650078+0000","last_became_active":"2024-07-27T03:08:32.951495+0000","last_became_peered":"2024-07-27T03:08:32.951495+0000","last_unstale":"2024-07-27T03:08:37.650078+0000","last_undegraded":"2024-07-27T03:08:37.650078+0000","last_fullsized":"2024-07-27T03:08:37.650078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:37:28.835075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868576+0000","last_change":"2024-07-27T03:08:33.960311+0000","last_active":"2024-07-27T03:08:36.868576+0000","last_peered":"2024-07-27T03:08:36.868576+0000","last_clean":"2024-07-27T03:08:36.868576+0000","last_became_active":"2024-07-27T03:08:33.960017+0000","last_became_peered":"2024-07-27T03:08:33.960017+0000","last_unstale":"2024-07-27T03:08:36.868576+0000","last_undegraded":"2024-07-27T03:08:36.868576+0000","last_fullsized":"2024-07-27T03:08:36.868576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:53:39.837754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826447+0000","last_change":"2024-07-27T03:08:32.951332+0000","last_active":"2024-07-27T03:08:35.826447+0000","last_peered":"2024-07-27T03:08:35.826447+0000","last_clean":"2024-07-27T03:08:35.826447+0000","last_became_active":"2024-07-27T03:08:32.949369+0000","last_became_peered":"2024-07-27T03:08:32.949369+0000","last_unstale":"2024-07-27T03:08:35.826447+0000","last_undegraded":"2024-07-27T03:08:35.826447+0000","last_fullsized":"2024-07-27T03:08:35.826447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:01:24.017164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826448+0000","last_change":"2024-07-27T03:08:33.952852+0000","last_active":"2024-07-27T03:08:35.826448+0000","last_peered":"2024-07-27T03:08:35.826448+0000","last_clean":"2024-07-27T03:08:35.826448+0000","last_became_active":"2024-07-27T03:08:33.952541+0000","last_became_peered":"2024-07-27T03:08:33.952541+0000","last_unstale":"2024-07-27T03:08:35.826448+0000","last_undegraded":"2024-07-27T03:08:35.826448+0000","last_fullsized":"2024-07-27T03:08:35.826448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:00:35.656920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868665+0000","last_change":"2024-07-27T03:08:32.949235+0000","last_active":"2024-07-27T03:08:36.868665+0000","last_peered":"2024-07-27T03:08:36.868665+0000","last_clean":"2024-07-27T03:08:36.868665+0000","last_became_active":"2024-07-27T03:08:32.948934+0000","last_became_peered":"2024-07-27T03:08:32.948934+0000","last_unstale":"2024-07-27T03:08:36.868665+0000","last_undegraded":"2024-07-27T03:08:36.868665+0000","last_fullsized":"2024-07-27T03:08:36.868665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":668236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":77376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":77286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":668292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:08:42.806 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-27T03:08:42.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-07-27T03:08:42.807 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-07-27T03:08:42.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.955+0000 7fb22fbbd640 1 -- 172.21.15.120:0/892992469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb228162c40 msgr2=0x7fb2280b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:42.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.955+0000 7fb22fbbd640 1 --2- 172.21.15.120:0/892992469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb228162c40 0x7fb2280b7170 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb2280ba010 tx=0x7fb22002a790 comp rx=0 tx=0).stop 2024-07-27T03:08:42.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.955+0000 7fb22fbbd640 1 -- 172.21.15.120:0/892992469 shutdown_connections 2024-07-27T03:08:42.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.955+0000 7fb22fbbd640 1 --2- 172.21.15.120:0/892992469 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb228162c40 0x7fb2280b7170 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:42.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.955+0000 7fb22fbbd640 1 --2- 172.21.15.120:0/892992469 >> v2:172.21.15.121:3300/0 conn(0x7fb2281622f0 0x7fb228162700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:42.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.955+0000 7fb22fbbd640 1 -- 172.21.15.120:0/892992469 >> 172.21.15.120:0/892992469 conn(0x7fb2280d3fb0 msgr2=0x7fb2280d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:42.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.955+0000 7fb22fbbd640 1 -- 172.21.15.120:0/892992469 shutdown_connections 2024-07-27T03:08:42.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.955+0000 7fb22fbbd640 1 -- 172.21.15.120:0/892992469 wait complete. 2024-07-27T03:08:42.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.957+0000 7fb22fbbd640 1 Processor -- start 2024-07-27T03:08:42.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.957+0000 7fb22fbbd640 1 -- start start 2024-07-27T03:08:42.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.958+0000 7fb22fbbd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2280b9490 0x7fb2280cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:42.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.958+0000 7fb22fbbd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2281622f0 0x7fb2280b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:42.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.958+0000 7fb22fbbd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb228162c40 0x7fb2281f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:42.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.958+0000 7fb22fbbd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb2280b7a70 con 0x7fb2281622f0 2024-07-27T03:08:42.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.958+0000 7fb22fbbd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb2280b78f0 con 0x7fb228162c40 2024-07-27T03:08:42.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.958+0000 7fb22fbbd640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb2280b7bf0 con 0x7fb2280b9490 2024-07-27T03:08:42.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22d158640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2281622f0 0x7fb2280b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22d158640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2281622f0 0x7fb2280b0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46570/0 (socket says 172.21.15.120:46570) 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22d158640 1 -- 172.21.15.120:0/3651645628 learned_addr learned my addr 172.21.15.120:0/3651645628 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22e15a640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb228162c40 0x7fb2281f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22d959640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2280b9490 0x7fb2280cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22d158640 1 -- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2280b9490 msgr2=0x7fb2280cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22d158640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2280b9490 0x7fb2280cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22d158640 1 -- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb228162c40 msgr2=0x7fb2281f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22d158640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb228162c40 0x7fb2281f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22d158640 1 -- 172.21.15.120:0/3651645628 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2280b1760 con 0x7fb2281622f0 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22d959640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2280b9490 0x7fb2280cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22d158640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2281622f0 0x7fb2280b0c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb22400d6a0 tx=0x7fb22400db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:42.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb21e7fc640 1 -- 172.21.15.120:0/3651645628 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224017070 con 0x7fb2281622f0 2024-07-27T03:08:42.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb21e7fc640 1 -- 172.21.15.120:0/3651645628 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb224009ab0 con 0x7fb2281622f0 2024-07-27T03:08:42.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22fbbd640 1 -- 172.21.15.120:0/3651645628 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22809dda0 con 0x7fb2281622f0 2024-07-27T03:08:42.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb21e7fc640 1 -- 172.21.15.120:0/3651645628 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224010460 con 0x7fb2281622f0 2024-07-27T03:08:42.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.959+0000 7fb22fbbd640 1 -- 172.21.15.120:0/3651645628 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22809e360 con 0x7fb2281622f0 2024-07-27T03:08:42.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.960+0000 7fb22fbbd640 1 -- 172.21.15.120:0/3651645628 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb228162700 con 0x7fb2281622f0 2024-07-27T03:08:42.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.961+0000 7fb21e7fc640 1 -- 172.21.15.120:0/3651645628 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb22401a070 con 0x7fb2281622f0 2024-07-27T03:08:42.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.961+0000 7fb21e7fc640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb20c077010 0x7fb20c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:42.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.961+0000 7fb21e7fc640 1 -- 172.21.15.120:0/3651645628 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb224098880 con 0x7fb2281622f0 2024-07-27T03:08:42.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.961+0000 7fb22d959640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb20c077010 0x7fb20c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:42.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.962+0000 7fb22d959640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb20c077010 0x7fb20c079520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb218000f60 tx=0x7fb218009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:42.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:42.966+0000 7fb21e7fc640 1 -- 172.21.15.120:0/3651645628 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb2240614c0 con 0x7fb2281622f0 2024-07-27T03:08:43.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.150+0000 7fb22fbbd640 1 -- 172.21.15.120:0/3651645628 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fb2280d4ba0 con 0x7fb2281622f0 2024-07-27T03:08:43.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.150+0000 7fb21e7fc640 1 -- 172.21.15.120:0/3651645628 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7fb224065a10 con 0x7fb2281622f0 2024-07-27T03:08:43.153 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:43.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.152+0000 7fb22fbbd640 1 -- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb20c077010 msgr2=0x7fb20c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.152+0000 7fb22fbbd640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb20c077010 0x7fb20c079520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb218000f60 tx=0x7fb218009040 comp rx=0 tx=0).stop 2024-07-27T03:08:43.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.152+0000 7fb22fbbd640 1 -- 172.21.15.120:0/3651645628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2281622f0 msgr2=0x7fb2280b0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.152+0000 7fb22fbbd640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2281622f0 0x7fb2280b0c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb22400d6a0 tx=0x7fb22400db60 comp rx=0 tx=0).stop 2024-07-27T03:08:43.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.152+0000 7fb22fbbd640 1 -- 172.21.15.120:0/3651645628 shutdown_connections 2024-07-27T03:08:43.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.152+0000 7fb22fbbd640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb20c077010 0x7fb20c079520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.152+0000 7fb22fbbd640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb2281622f0 0x7fb2280b0c40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.152+0000 7fb22fbbd640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb228162c40 0x7fb2281f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.152+0000 7fb22fbbd640 1 --2- 172.21.15.120:0/3651645628 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb2280b9490 0x7fb2280cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.152+0000 7fb22fbbd640 1 -- 172.21.15.120:0/3651645628 >> 172.21.15.120:0/3651645628 conn(0x7fb2280d3fb0 msgr2=0x7fb228075850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:43.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.153+0000 7fb22fbbd640 1 -- 172.21.15.120:0/3651645628 shutdown_connections 2024-07-27T03:08:43.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.153+0000 7fb22fbbd640 1 -- 172.21.15.120:0/3651645628 wait complete. 2024-07-27T03:08:43.166 INFO:teuthology.orchestra.run.smithi120.stdout:[{"version":27,"timestamp":"2024-07-27T03:08:27.041228+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"5257.409462"}]}] 2024-07-27T03:08:43.167 INFO:tasks.ceph_manager:config epoch is 27 2024-07-27T03:08:43.167 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-07-27T03:08:43.167 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-07-27T03:08:43.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-07-27T03:08:43.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.278+0000 7f86aedb9640 1 -- 172.21.15.120:0/2355840668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8690003c10 msgr2=0x7f8690004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.278+0000 7f86aedb9640 1 --2- 172.21.15.120:0/2355840668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8690003c10 0x7f8690004060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f869800c4a0 tx=0x7f8690005830 comp rx=0 tx=0).stop 2024-07-27T03:08:43.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.278+0000 7f86ad356640 1 -- 172.21.15.120:0/2355840668 reap_dead start 2024-07-27T03:08:43.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.278+0000 7f86aedb9640 1 -- 172.21.15.120:0/2355840668 shutdown_connections 2024-07-27T03:08:43.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.278+0000 7f86aedb9640 1 -- 172.21.15.120:0/2355840668 >> 172.21.15.120:0/2355840668 conn(0x7f86a80d0f00 msgr2=0x7f86a80d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:43.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.279+0000 7f86aedb9640 1 -- 172.21.15.120:0/2355840668 shutdown_connections 2024-07-27T03:08:43.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.279+0000 7f86aedb9640 1 -- 172.21.15.120:0/2355840668 wait complete. 2024-07-27T03:08:43.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.280+0000 7f86aedb9640 1 Processor -- start 2024-07-27T03:08:43.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.280+0000 7f86aedb9640 1 -- start start 2024-07-27T03:08:43.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86aedb9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8690003c10 0x7f86a8151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86aedb9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86a80ca700 0x7f86a806c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86aedb9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86a806cea0 0x7f86a81f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86aedb9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8158fb0 con 0x7f86a806cea0 2024-07-27T03:08:43.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86aedb9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f86a80b50f0 con 0x7f86a80ca700 2024-07-27T03:08:43.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86aedb9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f86a8159130 con 0x7f8690003c10 2024-07-27T03:08:43.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86ad356640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86a806cea0 0x7f86a81f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86ad356640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86a806cea0 0x7f86a81f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46582/0 (socket says 172.21.15.120:46582) 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86ad356640 1 -- 172.21.15.120:0/3115290901 learned_addr learned my addr 172.21.15.120:0/3115290901 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86acb55640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8690003c10 0x7f86a8151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86a7fff640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86a80ca700 0x7f86a806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86ad356640 1 -- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8690003c10 msgr2=0x7f86a8151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86ad356640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8690003c10 0x7f86a8151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86ad356640 1 -- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86a80ca700 msgr2=0x7f86a806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86ad356640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86a80ca700 0x7f86a806c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86ad356640 1 -- 172.21.15.120:0/3115290901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a81f8cb0 con 0x7f86a806cea0 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86ad356640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86a806cea0 0x7f86a81f56f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f86a80d0eb0 tx=0x7f86a0011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86a57fa640 1 -- 172.21.15.120:0/3115290901 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a000fad0 con 0x7f86a806cea0 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86a57fa640 1 -- 172.21.15.120:0/3115290901 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86a000fc70 con 0x7f86a806cea0 2024-07-27T03:08:43.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86a57fa640 1 -- 172.21.15.120:0/3115290901 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0005280 con 0x7f86a806cea0 2024-07-27T03:08:43.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.282+0000 7f86aedb9640 1 -- 172.21.15.120:0/3115290901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a81f8f90 con 0x7f86a806cea0 2024-07-27T03:08:43.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.283+0000 7f86aedb9640 1 -- 172.21.15.120:0/3115290901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a81f51d0 con 0x7f86a806cea0 2024-07-27T03:08:43.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.284+0000 7f86aedb9640 1 -- 172.21.15.120:0/3115290901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a81f8a20 con 0x7f86a806cea0 2024-07-27T03:08:43.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.284+0000 7f86a57fa640 1 -- 172.21.15.120:0/3115290901 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f86a0005420 con 0x7f86a806cea0 2024-07-27T03:08:43.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.285+0000 7f86a57fa640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8694077040 0x7f8694079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.285+0000 7f86a57fa640 1 -- 172.21.15.120:0/3115290901 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f86a0098f00 con 0x7f86a806cea0 2024-07-27T03:08:43.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.285+0000 7f86acb55640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8694077040 0x7f8694079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:43.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.286+0000 7f86acb55640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8694077040 0x7f8694079550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8698033000 tx=0x7f869802d070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:43.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.289+0000 7f86a57fa640 1 -- 172.21.15.120:0/3115290901 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f86a000fe60 con 0x7f86a806cea0 2024-07-27T03:08:43.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.521+0000 7f86aedb9640 1 -- 172.21.15.120:0/3115290901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f86a8070800 con 0x7f86a806cea0 2024-07-27T03:08:43.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.524+0000 7f86a57fa640 1 -- 172.21.15.120:0/3115290901 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+191110 (secure 0 0 0) 0x7f86a0061ab0 con 0x7f86a806cea0 2024-07-27T03:08:43.529 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:43.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.526+0000 7f86aedb9640 1 -- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8694077040 msgr2=0x7f8694079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.526+0000 7f86aedb9640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8694077040 0x7f8694079550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8698033000 tx=0x7f869802d070 comp rx=0 tx=0).stop 2024-07-27T03:08:43.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.526+0000 7f86aedb9640 1 -- 172.21.15.120:0/3115290901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86a806cea0 msgr2=0x7f86a81f56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.526+0000 7f86aedb9640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86a806cea0 0x7f86a81f56f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f86a80d0eb0 tx=0x7f86a0011e70 comp rx=0 tx=0).stop 2024-07-27T03:08:43.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.527+0000 7f86aedb9640 1 -- 172.21.15.120:0/3115290901 shutdown_connections 2024-07-27T03:08:43.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.527+0000 7f86aedb9640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8694077040 0x7f8694079550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.527+0000 7f86aedb9640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86a806cea0 0x7f86a81f56f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.527+0000 7f86aedb9640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86a80ca700 0x7f86a806c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.527+0000 7f86aedb9640 1 --2- 172.21.15.120:0/3115290901 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8690003c10 0x7f86a8151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.527+0000 7f86aedb9640 1 -- 172.21.15.120:0/3115290901 >> 172.21.15.120:0/3115290901 conn(0x7f86a80d0f00 msgr2=0x7f86a8154930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:43.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.527+0000 7f86aedb9640 1 -- 172.21.15.120:0/3115290901 shutdown_connections 2024-07-27T03:08:43.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.527+0000 7f86aedb9640 1 -- 172.21.15.120:0/3115290901 wait complete. 2024-07-27T03:08:43.540 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1255903814},{"type":"v1","addr":"172.21.15.121:6833","nonce":1255903814}]},"active_addr":"172.21.15.121:6833/1255903814","active_change":"2024-07-27T03:08:20.523883+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":2097571596}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":4093168702}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":1949844055}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":1468955351}]}]} 2024-07-27T03:08:43.544 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-07-27T03:08:43.545 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-07-27T03:08:43.545 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:08:43.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.656+0000 7f11d0684640 1 -- 172.21.15.120:0/2534558779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c80b4fd0 msgr2=0x7f11c80b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.656+0000 7f11d0684640 1 --2- 172.21.15.120:0/2534558779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c80b4fd0 0x7f11c80b53e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11c80738d0 tx=0x7f11c002a980 comp rx=0 tx=0).stop 2024-07-27T03:08:43.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.656+0000 7f11d0684640 1 -- 172.21.15.120:0/2534558779 shutdown_connections 2024-07-27T03:08:43.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.656+0000 7f11d0684640 1 --2- 172.21.15.120:0/2534558779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c80b4fd0 0x7f11c80b53e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.656+0000 7f11d0684640 1 --2- 172.21.15.120:0/2534558779 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11c80d0500 0x7f11c80d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.656+0000 7f11d0684640 1 --2- 172.21.15.120:0/2534558779 >> v2:172.21.15.121:3300/0 conn(0x7f11c80b2110 0x7f11c80b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.656+0000 7f11d0684640 1 -- 172.21.15.120:0/2534558779 >> 172.21.15.120:0/2534558779 conn(0x7f11c80b3920 msgr2=0x7f11c80b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:43.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.656+0000 7f11d0684640 1 -- 172.21.15.120:0/2534558779 shutdown_connections 2024-07-27T03:08:43.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.656+0000 7f11d0684640 1 -- 172.21.15.120:0/2534558779 wait complete. 2024-07-27T03:08:43.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.658+0000 7f11d0684640 1 Processor -- start 2024-07-27T03:08:43.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.658+0000 7f11d0684640 1 -- start start 2024-07-27T03:08:43.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11d0684640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11c80b2110 0x7f11c81f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11d0684640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11c80b4fd0 0x7f11c809d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11d0684640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c80d0500 0x7f11c81e5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11d0684640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f11c80b5d30 con 0x7f11c80d0500 2024-07-27T03:08:43.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11d0684640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11c80b5bb0 con 0x7f11c80b2110 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11d0684640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f11c80b5eb0 con 0x7f11c80b4fd0 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11cec21640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c80d0500 0x7f11c81e5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11cec21640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c80d0500 0x7f11c81e5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46602/0 (socket says 172.21.15.120:46602) 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11cec21640 1 -- 172.21.15.120:0/1061855908 learned_addr learned my addr 172.21.15.120:0/1061855908 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11cec21640 1 -- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11c80b4fd0 msgr2=0x7f11c809d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11ce420640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11c80b2110 0x7f11c81f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11cec21640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11c80b4fd0 0x7f11c809d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11cec21640 1 -- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11c80b2110 msgr2=0x7f11c81f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11cec21640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11c80b2110 0x7f11c81f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11cec21640 1 -- 172.21.15.120:0/1061855908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c81f3810 con 0x7f11c80d0500 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.659+0000 7f11ce420640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11c80b2110 0x7f11c81f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:08:43.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.660+0000 7f11cec21640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c80d0500 0x7f11c81e5060 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11c0033040 tx=0x7f11c0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:43.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.660+0000 7f11beffd640 1 -- 172.21.15.120:0/1061855908 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c0034040 con 0x7f11c80d0500 2024-07-27T03:08:43.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.660+0000 7f11beffd640 1 -- 172.21.15.120:0/1061855908 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11c0004540 con 0x7f11c80d0500 2024-07-27T03:08:43.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.660+0000 7f11beffd640 1 -- 172.21.15.120:0/1061855908 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c0045480 con 0x7f11c80d0500 2024-07-27T03:08:43.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.660+0000 7f11d0684640 1 -- 172.21.15.120:0/1061855908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c81f3ab0 con 0x7f11c80d0500 2024-07-27T03:08:43.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.660+0000 7f11d0684640 1 -- 172.21.15.120:0/1061855908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c81f4070 con 0x7f11c80d0500 2024-07-27T03:08:43.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.661+0000 7f11d0684640 1 -- 172.21.15.120:0/1061855908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c80b53e0 con 0x7f11c80d0500 2024-07-27T03:08:43.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.661+0000 7f11beffd640 1 -- 172.21.15.120:0/1061855908 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f11c0037020 con 0x7f11c80d0500 2024-07-27T03:08:43.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.662+0000 7f11beffd640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f11ac077010 0x7f11ac079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.662+0000 7f11beffd640 1 -- 172.21.15.120:0/1061855908 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f11c00ba270 con 0x7f11c80d0500 2024-07-27T03:08:43.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.662+0000 7f11ce420640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f11ac077010 0x7f11ac079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:43.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.663+0000 7f11ce420640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f11ac077010 0x7f11ac079520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009a20 tx=0x7f11c4005d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:43.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.666+0000 7f11beffd640 1 -- 172.21.15.120:0/1061855908 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f11c0082ec0 con 0x7f11c80d0500 2024-07-27T03:08:43.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.853+0000 7f11d0684640 1 -- 172.21.15.120:0/1061855908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11c809f940 con 0x7f11c80d0500 2024-07-27T03:08:43.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.854+0000 7f11beffd640 1 -- 172.21.15.120:0/1061855908 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16629 (secure 0 0 0) 0x7f11c0087410 con 0x7f11c80d0500 2024-07-27T03:08:43.856 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:43.857 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:34.926699+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:08:31.185623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-27T03:08:32.262408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:08:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 -- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f11ac077010 msgr2=0x7f11ac079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f11ac077010 0x7f11ac079520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009a20 tx=0x7f11c4005d30 comp rx=0 tx=0).stop 2024-07-27T03:08:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 -- 172.21.15.120:0/1061855908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c80d0500 msgr2=0x7f11c81e5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c80d0500 0x7f11c81e5060 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11c0033040 tx=0x7f11c0003f10 comp rx=0 tx=0).stop 2024-07-27T03:08:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 -- 172.21.15.120:0/1061855908 shutdown_connections 2024-07-27T03:08:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f11ac077010 0x7f11ac079520 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11c80d0500 0x7f11c81e5060 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f11c80b4fd0 0x7f11c809d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 --2- 172.21.15.120:0/1061855908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11c80b2110 0x7f11c81f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 -- 172.21.15.120:0/1061855908 >> 172.21.15.120:0/1061855908 conn(0x7f11c80b3920 msgr2=0x7f11c815bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:43.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 -- 172.21.15.120:0/1061855908 shutdown_connections 2024-07-27T03:08:43.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.856+0000 7f11d0684640 1 -- 172.21.15.120:0/1061855908 wait complete. 2024-07-27T03:08:43.870 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-07-27T03:08:43.870 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:08:43.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.980+0000 7fee1baeb640 1 -- 172.21.15.120:0/1696065302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee140d09c0 msgr2=0x7fee140d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.980+0000 7fee1baeb640 1 --2- 172.21.15.120:0/1696065302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee140d09c0 0x7fee140d0dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fee140b6b50 tx=0x7fee0c02a560 comp rx=0 tx=0).stop 2024-07-27T03:08:43.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.980+0000 7fee1baeb640 1 -- 172.21.15.120:0/1696065302 shutdown_connections 2024-07-27T03:08:43.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.980+0000 7fee1baeb640 1 --2- 172.21.15.120:0/1696065302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee140d09c0 0x7fee140d0dd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.980+0000 7fee1baeb640 1 --2- 172.21.15.120:0/1696065302 >> v2:172.21.15.121:3300/0 conn(0x7fee140d27e0 0x7fee140d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.980+0000 7fee1baeb640 1 --2- 172.21.15.120:0/1696065302 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee140b4740 0x7fee140b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.980+0000 7fee1baeb640 1 -- 172.21.15.120:0/1696065302 >> 172.21.15.120:0/1696065302 conn(0x7fee1408d690 msgr2=0x7fee1409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:43.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.980+0000 7fee1baeb640 1 -- 172.21.15.120:0/1696065302 shutdown_connections 2024-07-27T03:08:43.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.980+0000 7fee1baeb640 1 -- 172.21.15.120:0/1696065302 wait complete. 2024-07-27T03:08:43.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.982+0000 7fee1baeb640 1 Processor -- start 2024-07-27T03:08:43.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.982+0000 7fee1baeb640 1 -- start start 2024-07-27T03:08:43.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.983+0000 7fee1baeb640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee140b4740 0x7fee14152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.983+0000 7fee1baeb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee140d09c0 0x7fee141f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.983+0000 7fee1baeb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee140d27e0 0x7fee140b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.983+0000 7fee1baeb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fee140ced60 con 0x7fee140d27e0 2024-07-27T03:08:43.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.983+0000 7fee1baeb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee140cebe0 con 0x7fee140d09c0 2024-07-27T03:08:43.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.983+0000 7fee1baeb640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fee140ceee0 con 0x7fee140b4740 2024-07-27T03:08:43.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.983+0000 7fee1a088640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee140d27e0 0x7fee140b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:43.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.983+0000 7fee1a088640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee140d27e0 0x7fee140b7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46614/0 (socket says 172.21.15.120:46614) 2024-07-27T03:08:43.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.983+0000 7fee1a088640 1 -- 172.21.15.120:0/2536346637 learned_addr learned my addr 172.21.15.120:0/2536346637 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:43.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.983+0000 7fee19086640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee140d09c0 0x7fee141f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:43.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.983+0000 7fee19887640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee140b4740 0x7fee14152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:43.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.984+0000 7fee1a088640 1 -- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee140b4740 msgr2=0x7fee14152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.984+0000 7fee1a088640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee140b4740 0x7fee14152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.984+0000 7fee1a088640 1 -- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee140d09c0 msgr2=0x7fee141f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:43.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.984+0000 7fee1a088640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee140d09c0 0x7fee141f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:43.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.984+0000 7fee1a088640 1 -- 172.21.15.120:0/2536346637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee141f5610 con 0x7fee140d27e0 2024-07-27T03:08:43.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.984+0000 7fee19086640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee140d09c0 0x7fee141f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:43.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.984+0000 7fee1a088640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee140d27e0 0x7fee140b7e30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009230 tx=0x7fee0c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:43.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.986+0000 7fee127fc640 1 -- 172.21.15.120:0/2536346637 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c03e030 con 0x7fee140d27e0 2024-07-27T03:08:43.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.986+0000 7fee127fc640 1 -- 172.21.15.120:0/2536346637 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee0c003e50 con 0x7fee140d27e0 2024-07-27T03:08:43.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.986+0000 7fee1baeb640 1 -- 172.21.15.120:0/2536346637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee141f5880 con 0x7fee140d27e0 2024-07-27T03:08:43.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.986+0000 7fee127fc640 1 -- 172.21.15.120:0/2536346637 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c035040 con 0x7fee140d27e0 2024-07-27T03:08:43.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.986+0000 7fee1baeb640 1 -- 172.21.15.120:0/2536346637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee141f5e40 con 0x7fee140d27e0 2024-07-27T03:08:43.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.987+0000 7fee1baeb640 1 -- 172.21.15.120:0/2536346637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee140cfbc0 con 0x7fee140d27e0 2024-07-27T03:08:43.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.988+0000 7fee127fc640 1 -- 172.21.15.120:0/2536346637 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fee0c041030 con 0x7fee140d27e0 2024-07-27T03:08:43.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.988+0000 7fee127fc640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee00077040 0x7fee00079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:43.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.988+0000 7fee127fc640 1 -- 172.21.15.120:0/2536346637 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fee0c0b8f70 con 0x7fee140d27e0 2024-07-27T03:08:43.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.988+0000 7fee19887640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee00077040 0x7fee00079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:43.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.989+0000 7fee19887640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee00077040 0x7fee00079550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee04005fd0 tx=0x7fee04009560 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:43.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:43.993+0000 7fee127fc640 1 -- 172.21.15.120:0/2536346637 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fee0c081b20 con 0x7fee140d27e0 2024-07-27T03:08:44.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.176+0000 7fee1baeb640 1 -- 172.21.15.120:0/2536346637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee141f9700 con 0x7fee140d27e0 2024-07-27T03:08:44.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.177+0000 7fee127fc640 1 -- 172.21.15.120:0/2536346637 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16629 (secure 0 0 0) 0x7fee0c086070 con 0x7fee140d27e0 2024-07-27T03:08:44.179 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:44.180 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:34.926699+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:08:31.185623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-27T03:08:32.262408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:08:44.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 -- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee00077040 msgr2=0x7fee00079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee00077040 0x7fee00079550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee04005fd0 tx=0x7fee04009560 comp rx=0 tx=0).stop 2024-07-27T03:08:44.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 -- 172.21.15.120:0/2536346637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee140d27e0 msgr2=0x7fee140b7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee140d27e0 0x7fee140b7e30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009230 tx=0x7fee0c003960 comp rx=0 tx=0).stop 2024-07-27T03:08:44.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 -- 172.21.15.120:0/2536346637 shutdown_connections 2024-07-27T03:08:44.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee00077040 0x7fee00079550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee140d27e0 0x7fee140b7e30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee140d09c0 0x7fee141f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 --2- 172.21.15.120:0/2536346637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee140b4740 0x7fee14152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 -- 172.21.15.120:0/2536346637 >> 172.21.15.120:0/2536346637 conn(0x7fee1408d690 msgr2=0x7fee1415fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 -- 172.21.15.120:0/2536346637 shutdown_connections 2024-07-27T03:08:44.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.179+0000 7fee1baeb640 1 -- 172.21.15.120:0/2536346637 wait complete. 2024-07-27T03:08:44.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-07-27T03:08:44.194 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-07-27T03:08:44.194 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-07-27T03:08:44.194 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-07-27T03:08:44.195 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-07-27T03:08:44.195 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-07-27T03:08:44.196 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-07-27T03:08:44.196 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-07-27T03:08:44.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.410+0000 7f0f938e2640 1 -- 172.21.15.120:0/707439652 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f8c155410 msgr2=0x7f0f8c072c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.410+0000 7f0f938e2640 1 --2- 172.21.15.120:0/707439652 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f8c155410 0x7f0f8c072c70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009830 tx=0x7f0f8802a510 comp rx=0 tx=0).stop 2024-07-27T03:08:44.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.410+0000 7f0f938e2640 1 -- 172.21.15.120:0/707439652 shutdown_connections 2024-07-27T03:08:44.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.410+0000 7f0f938e2640 1 --2- 172.21.15.120:0/707439652 >> v2:172.21.15.120:3300/0 conn(0x7f0f8c0731b0 0x7f0f8c0ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.410+0000 7f0f938e2640 1 --2- 172.21.15.120:0/707439652 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f8c155410 0x7f0f8c072c70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.410+0000 7f0f938e2640 1 -- 172.21.15.120:0/707439652 >> 172.21.15.120:0/707439652 conn(0x7f0f8c0b2dc0 msgr2=0x7f0f8c0d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.410+0000 7f9100b2d640 1 -- 172.21.15.120:0/373216932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90fc06e270 msgr2=0x7f90fc0725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f0f938e2640 1 -- 172.21.15.120:0/707439652 shutdown_connections 2024-07-27T03:08:44.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f697759e640 1 -- 172.21.15.120:0/1792635685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6970006b80 msgr2=0x7f6970006f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f697759e640 1 --2- 172.21.15.120:0/1792635685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6970006b80 0x7f6970006f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f697806ab60 tx=0x7f697806c6b0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.410+0000 7f9100b2d640 1 --2- 172.21.15.120:0/373216932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90fc06e270 0x7f90fc0725b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009830 tx=0x7f90ec02a3f0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f9100b2d640 1 -- 172.21.15.120:0/373216932 shutdown_connections 2024-07-27T03:08:44.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f9100b2d640 1 --2- 172.21.15.120:0/373216932 >> v2:172.21.15.120:3300/0 conn(0x7f90fc072af0 0x7f90fc161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f9100b2d640 1 --2- 172.21.15.120:0/373216932 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90fc06e270 0x7f90fc0725b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f9100b2d640 1 -- 172.21.15.120:0/373216932 >> 172.21.15.120:0/373216932 conn(0x7f90fc06cdb0 msgr2=0x7f90fc0b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f0f938e2640 1 -- 172.21.15.120:0/707439652 wait complete. 2024-07-27T03:08:44.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f697759e640 1 -- 172.21.15.120:0/1792635685 shutdown_connections 2024-07-27T03:08:44.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f697759e640 1 --2- 172.21.15.120:0/1792635685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6970006b80 0x7f6970006f90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f697759e640 1 --2- 172.21.15.120:0/1792635685 >> v2:172.21.15.120:3300/0 conn(0x7f6970052240 0x7f6970052650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f697759e640 1 -- 172.21.15.120:0/1792635685 >> 172.21.15.120:0/1792635685 conn(0x7f697001eae0 msgr2=0x7f697003a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f697759e640 1 -- 172.21.15.120:0/1792635685 shutdown_connections 2024-07-27T03:08:44.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.411+0000 7f697759e640 1 -- 172.21.15.120:0/1792635685 wait complete. 2024-07-27T03:08:44.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.412+0000 7f9100b2d640 1 -- 172.21.15.120:0/373216932 shutdown_connections 2024-07-27T03:08:44.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.412+0000 7f9100b2d640 1 -- 172.21.15.120:0/373216932 wait complete. 2024-07-27T03:08:44.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.414+0000 7f0f938e2640 1 Processor -- start 2024-07-27T03:08:44.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.414+0000 7f0f938e2640 1 -- start start 2024-07-27T03:08:44.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.414+0000 7fae97fff640 1 -- 172.21.15.120:0/2793148699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae980722c0 msgr2=0x7fae98073fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.414+0000 7fae97fff640 1 --2- 172.21.15.120:0/2793148699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae980722c0 0x7fae98073fe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fae88009860 tx=0x7fae8802a3f0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.414+0000 7fae97fff640 1 -- 172.21.15.120:0/2793148699 shutdown_connections 2024-07-27T03:08:44.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.414+0000 7fae97fff640 1 --2- 172.21.15.120:0/2793148699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae980722c0 0x7fae98073fe0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.414+0000 7fae97fff640 1 -- 172.21.15.120:0/2793148699 >> 172.21.15.120:0/2793148699 conn(0x7fae980cfa90 msgr2=0x7fae980cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.414+0000 7fae97fff640 1 -- 172.21.15.120:0/2793148699 shutdown_connections 2024-07-27T03:08:44.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.414+0000 7f9100b2d640 1 Processor -- start 2024-07-27T03:08:44.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.415+0000 7f697759e640 1 Processor -- start 2024-07-27T03:08:44.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.415+0000 7f697759e640 1 -- start start 2024-07-27T03:08:44.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.415+0000 7ff9eb198640 1 -- 172.21.15.120:0/42081292 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e40cb920 msgr2=0x7ff9e4070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.415+0000 7ff9eb198640 1 --2- 172.21.15.120:0/42081292 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e40cb920 0x7ff9e4070090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009ca0 tx=0x7ff9dc02a9e0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7fb35940b640 1 -- 172.21.15.120:0/2989436205 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350031c30 con 0x7fb34c00bc30 2024-07-27T03:08:44.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.415+0000 7fae97fff640 1 -- 172.21.15.120:0/2793148699 wait complete. 2024-07-27T03:08:44.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7fabd3fff640 1 -- 172.21.15.120:0/2398034719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabd4074ae0 msgr2=0x7fabd40b55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7f0f938e2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f8c0731b0 0x7f0f8c070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7fabd3fff640 1 --2- 172.21.15.120:0/2398034719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabd4074ae0 0x7fabd40b55a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fabcc005fd0 tx=0x7fabcc02aa10 comp rx=0 tx=0).stop 2024-07-27T03:08:44.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7f0f938e2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f8c0ae760 0x7f0f8c145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7ff9eb198640 1 -- 172.21.15.120:0/42081292 shutdown_connections 2024-07-27T03:08:44.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7ff9eb198640 1 --2- 172.21.15.120:0/42081292 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e40cb920 0x7ff9e4070090 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7ff9eb198640 1 -- 172.21.15.120:0/42081292 >> 172.21.15.120:0/42081292 conn(0x7ff9e40cfa90 msgr2=0x7ff9e40cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7f0f9167e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f8c0731b0 0x7f0f8c070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7fb35b40f640 1 -- 172.21.15.120:0/2989436205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb34c00bc30 msgr2=0x7fb34c0df180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7fb35b40f640 1 --2- 172.21.15.120:0/2989436205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb34c00bc30 0x7fb34c0df180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00ca70 tx=0x7fb35002a540 comp rx=0 tx=0).stop 2024-07-27T03:08:44.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7fabd3fff640 1 -- 172.21.15.120:0/2398034719 shutdown_connections 2024-07-27T03:08:44.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7fabd3fff640 1 --2- 172.21.15.120:0/2398034719 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fabd40d0290 0x7fabd40d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7fabd3fff640 1 --2- 172.21.15.120:0/2398034719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabd4074ae0 0x7fabd40b55a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7fabd3fff640 1 -- 172.21.15.120:0/2398034719 >> 172.21.15.120:0/2398034719 conn(0x7fabd4073e30 msgr2=0x7fabd4074240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7fabd3fff640 1 -- 172.21.15.120:0/2398034719 shutdown_connections 2024-07-27T03:08:44.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7fb35b40f640 1 -- 172.21.15.120:0/2989436205 shutdown_connections 2024-07-27T03:08:44.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7fb35b40f640 1 --2- 172.21.15.120:0/2989436205 >> v2:172.21.15.120:3300/0 conn(0x7fb34c036b10 0x7fb34c005c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7fb35b40f640 1 --2- 172.21.15.120:0/2989436205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb34c00bc30 0x7fb34c0df180 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7fb35b40f640 1 -- 172.21.15.120:0/2989436205 >> 172.21.15.120:0/2989436205 conn(0x7fb34c051420 msgr2=0x7fb34c051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7fb35b40f640 1 -- 172.21.15.120:0/2989436205 shutdown_connections 2024-07-27T03:08:44.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7fb35b40f640 1 -- 172.21.15.120:0/2989436205 wait complete. 2024-07-27T03:08:44.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.416+0000 7ff9eb198640 1 -- 172.21.15.120:0/42081292 shutdown_connections 2024-07-27T03:08:44.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f697759e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6970006b80 0x7f69700d6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f0f938e2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f8c155410 0x7f0f8c0b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f697759e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6970034c50 0x7f6970036a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f697759e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6970052240 0x7f6970036f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f697759e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6970007650 con 0x7f6970006b80 2024-07-27T03:08:44.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f697759e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f69700074d0 con 0x7f6970052240 2024-07-27T03:08:44.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f697759e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f69700077d0 con 0x7f6970034c50 2024-07-27T03:08:44.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f6976d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6970052240 0x7f6970036f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7fabd3fff640 1 -- 172.21.15.120:0/2398034719 wait complete. 2024-07-27T03:08:44.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7ff9eb198640 1 -- 172.21.15.120:0/42081292 wait complete. 2024-07-27T03:08:44.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7fae97fff640 1 Processor -- start 2024-07-27T03:08:44.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.415+0000 7f9100b2d640 1 -- start start 2024-07-27T03:08:44.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f9100b2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90fc06e270 0x7f90fc14bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f9100b2d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90fc06e680 0x7f90fc0b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f9100b2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90fc072af0 0x7f90fc0b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f90fa59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90fc06e270 0x7f90fc14bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f90fa59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90fc06e270 0x7f90fc14bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46708/0 (socket says 172.21.15.120:46708) 2024-07-27T03:08:44.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f90fa59c640 1 -- 172.21.15.120:0/2855364314 learned_addr learned my addr 172.21.15.120:0/2855364314 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f90fad9d640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90fc072af0 0x7f90fc0b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f90f9d9b640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90fc06e680 0x7f90fc0b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f9100b2d640 1 -- 172.21.15.120:0/2855364314 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc162ce0 con 0x7f90fc06e270 2024-07-27T03:08:44.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f9100b2d640 1 -- 172.21.15.120:0/2855364314 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc15ec10 con 0x7f90fc072af0 2024-07-27T03:08:44.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f9100b2d640 1 -- 172.21.15.120:0/2855364314 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f90fc154ef0 con 0x7f90fc06e680 2024-07-27T03:08:44.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f0f938e2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c1626e0 con 0x7f0f8c0731b0 2024-07-27T03:08:44.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f0f9167e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f8c0731b0 0x7f0f8c070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46698/0 (socket says 172.21.15.120:46698) 2024-07-27T03:08:44.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f90fad9d640 1 -- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90fc06e680 msgr2=0x7f90fc0b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f0f9167e640 1 -- 172.21.15.120:0/869678427 learned_addr learned my addr 172.21.15.120:0/869678427 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f90fad9d640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90fc06e680 0x7f90fc0b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f90fad9d640 1 -- 172.21.15.120:0/2855364314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90fc06e270 msgr2=0x7f90fc14bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f0f938e2640 1 -- 172.21.15.120:0/869678427 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c161d00 con 0x7f0f8c0ae760 2024-07-27T03:08:44.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7fae97fff640 1 -- start start 2024-07-27T03:08:44.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.419+0000 7f90fad9d640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90fc06e270 0x7f90fc14bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f697659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6970006b80 0x7f69700d6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f6975d9b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6970034c50 0x7f6970036a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f6976d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6970052240 0x7f6970036f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.120:40984/0 (socket says 172.21.15.120:40984) 2024-07-27T03:08:44.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f6976d9d640 1 -- 172.21.15.120:0/1641245694 learned_addr learned my addr 172.21.15.120:0/1641245694 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.419+0000 7f90fad9d640 1 -- 172.21.15.120:0/2855364314 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc0b45d0 con 0x7f90fc072af0 2024-07-27T03:08:44.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f6976d9d640 1 -- 172.21.15.120:0/1641245694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6970034c50 msgr2=0x7f6970036a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f6976d9d640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6970034c50 0x7f6970036a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f6976d9d640 1 -- 172.21.15.120:0/1641245694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6970006b80 msgr2=0x7f69700d6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f6976d9d640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6970006b80 0x7f69700d6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f6976d9d640 1 -- 172.21.15.120:0/1641245694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69700d7060 con 0x7f6970052240 2024-07-27T03:08:44.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.419+0000 7f6976d9d640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6970052240 0x7f6970036f50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f697806bab0 tx=0x7f697806b380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.419+0000 7f90fa59c640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f90fc06e270 0x7f90fc14bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:44.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.417+0000 7f0f938e2640 1 -- 172.21.15.120:0/869678427 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8c162860 con 0x7f0f8c155410 2024-07-27T03:08:44.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f0f9167e640 1 -- 172.21.15.120:0/869678427 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f8c155410 msgr2=0x7f0f8c0b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f0f9167e640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f8c155410 0x7f0f8c0b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.419+0000 7f90fad9d640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90fc072af0 0x7f90fc0b0ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90fc072380 tx=0x7f90f400cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.419+0000 7fabd3fff640 1 Processor -- start 2024-07-27T03:08:44.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f0f9167e640 1 -- 172.21.15.120:0/869678427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f8c0ae760 msgr2=0x7f0f8c145080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-27T03:08:44.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f0f9167e640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f8c0ae760 0x7f0f8c145080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.418+0000 7f0f9167e640 1 -- 172.21.15.120:0/869678427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8c06f000 con 0x7f0f8c0731b0 2024-07-27T03:08:44.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.419+0000 7f90eaffd640 1 -- 172.21.15.120:0/2855364314 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4016020 con 0x7f90fc072af0 2024-07-27T03:08:44.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7fb35b40f640 1 Processor -- start 2024-07-27T03:08:44.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7f90eaffd640 1 -- 172.21.15.120:0/2855364314 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90f400ac00 con 0x7f90fc072af0 2024-07-27T03:08:44.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7f90eaffd640 1 -- 172.21.15.120:0/2855364314 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4012420 con 0x7f90fc072af0 2024-07-27T03:08:44.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7fb35b40f640 1 -- start start 2024-07-27T03:08:44.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7fae97fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae980701d0 0x7fae98141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7fae97fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae980722c0 0x7fae980b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7fae97fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae980aea20 0x7fae980b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7fae97fff640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fae981688a0 con 0x7fae980aea20 2024-07-27T03:08:44.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7fae97fff640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae98168720 con 0x7fae980701d0 2024-07-27T03:08:44.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7fae97fff640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fae98168a20 con 0x7fae980722c0 2024-07-27T03:08:44.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7fae96ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae980701d0 0x7fae98141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7fae96ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae980701d0 0x7fae98141c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.120:40986/0 (socket says 172.21.15.120:40986) 2024-07-27T03:08:44.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7fae96ffd640 1 -- 172.21.15.120:0/2389936592 learned_addr learned my addr 172.21.15.120:0/2389936592 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7fae967fc640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae980722c0 0x7fae980b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7fae977fe640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae980aea20 0x7fae980b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7f0f9167e640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f8c0731b0 0x7f0f8c070950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f88000c00 tx=0x7f0f88033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7f0f81ffb640 1 -- 172.21.15.120:0/869678427 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88031d60 con 0x7f0f8c0731b0 2024-07-27T03:08:44.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7f0f81ffb640 1 -- 172.21.15.120:0/869678427 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f88033e10 con 0x7f0f8c0731b0 2024-07-27T03:08:44.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7f0f81ffb640 1 -- 172.21.15.120:0/869678427 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88033310 con 0x7f0f8c0731b0 2024-07-27T03:08:44.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7f0f938e2640 1 -- 172.21.15.120:0/869678427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8c06f2e0 con 0x7f0f8c0731b0 2024-07-27T03:08:44.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7f0f938e2640 1 -- 172.21.15.120:0/869678427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8c06f8a0 con 0x7f0f8c0731b0 2024-07-27T03:08:44.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7ff9eb198640 1 Processor -- start 2024-07-27T03:08:44.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7ff9eb198640 1 -- start start 2024-07-27T03:08:44.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.419+0000 7f6966ffd640 1 -- 172.21.15.120:0/1641245694 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69780b3050 con 0x7f6970052240 2024-07-27T03:08:44.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.419+0000 7f6966ffd640 1 -- 172.21.15.120:0/1641245694 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69780b4040 con 0x7f6970052240 2024-07-27T03:08:44.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.419+0000 7f697759e640 1 -- 172.21.15.120:0/1641245694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69700d7840 con 0x7f6970052240 2024-07-27T03:08:44.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.419+0000 7f697759e640 1 -- 172.21.15.120:0/1641245694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69700d8890 con 0x7f6970052240 2024-07-27T03:08:44.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7f6966ffd640 1 -- 172.21.15.120:0/1641245694 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69780a7e60 con 0x7f6970052240 2024-07-27T03:08:44.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7f697759e640 1 -- 172.21.15.120:0/1641245694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f69700d8f50 con 0x7f6970052240 2024-07-27T03:08:44.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7f9100b2d640 1 -- 172.21.15.120:0/2855364314 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90fc09d640 con 0x7f90fc072af0 2024-07-27T03:08:44.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7f9100b2d640 1 -- 172.21.15.120:0/2855364314 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90fc0b42f0 con 0x7f90fc072af0 2024-07-27T03:08:44.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7f5f9506c640 1 -- 172.21.15.120:0/217706467 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0047a0 con 0x7f5f900b3460 2024-07-27T03:08:44.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7f5f982d2640 1 -- 172.21.15.120:0/217706467 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f900b3460 msgr2=0x7f5f900b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7f5f982d2640 1 --2- 172.21.15.120:0/217706467 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f900b3460 0x7f5f900b3870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f90072c20 tx=0x7f5f8c02c7b0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7f5f982d2640 1 -- 172.21.15.120:0/217706467 shutdown_connections 2024-07-27T03:08:44.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7f5f982d2640 1 --2- 172.21.15.120:0/217706467 >> v2:172.21.15.120:3300/0 conn(0x7f5f90072c70 0x7f5f90073080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7f5f982d2640 1 --2- 172.21.15.120:0/217706467 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f900b3460 0x7f5f900b3870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7f5f982d2640 1 -- 172.21.15.120:0/217706467 >> 172.21.15.120:0/217706467 conn(0x7f5f900b2dc0 msgr2=0x7f5f900d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.420+0000 7fabd3fff640 1 -- start start 2024-07-27T03:08:44.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7fae96ffd640 1 -- 172.21.15.120:0/2389936592 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae980722c0 msgr2=0x7fae980b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7fae96ffd640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fae980722c0 0x7fae980b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7fae96ffd640 1 -- 172.21.15.120:0/2389936592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae980aea20 msgr2=0x7fae980b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7fae96ffd640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae980aea20 0x7fae980b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fabd4074ae0 0x7fabd40b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabd40d0290 0x7fabd40b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fabd3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabd415f510 0x7fabd40aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fabd3fff640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fabd40ad420 con 0x7fabd40d0290 2024-07-27T03:08:44.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fabd3fff640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fabd40ad2a0 con 0x7fabd415f510 2024-07-27T03:08:44.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fabd3fff640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fabd40ad5a0 con 0x7fabd4074ae0 2024-07-27T03:08:44.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7fae96ffd640 1 -- 172.21.15.120:0/2389936592 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9814ca00 con 0x7fae980701d0 2024-07-27T03:08:44.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.421+0000 7fae977fe640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae980aea20 0x7fae980b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:44.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fae96ffd640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae980701d0 0x7fae98141c90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae90001780 tx=0x7fae9000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fabd27fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabd40d0290 0x7fabd40b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fabd27fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabd40d0290 0x7fabd40b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46722/0 (socket says 172.21.15.120:46722) 2024-07-27T03:08:44.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fabd27fc640 1 -- 172.21.15.120:0/4238403286 learned_addr learned my addr 172.21.15.120:0/4238403286 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fae7f7fe640 1 -- 172.21.15.120:0/2389936592 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90012420 con 0x7fae980701d0 2024-07-27T03:08:44.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fae7f7fe640 1 -- 172.21.15.120:0/2389936592 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae90017070 con 0x7fae980701d0 2024-07-27T03:08:44.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7fb35b40f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb34c009ba0 0x7fb34c0d89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7f5f982d2640 1 -- 172.21.15.120:0/217706467 shutdown_connections 2024-07-27T03:08:44.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7ff9eb198640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e40705d0 0x7ff9e4073320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7f9100b2d640 1 -- 172.21.15.120:0/2855364314 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90fc09d920 con 0x7f90fc072af0 2024-07-27T03:08:44.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fae97fff640 1 -- 172.21.15.120:0/2389936592 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae98167b50 con 0x7fae980701d0 2024-07-27T03:08:44.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fae97fff640 1 -- 172.21.15.120:0/2389936592 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae9814ed40 con 0x7fae980701d0 2024-07-27T03:08:44.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7f5f982d2640 1 -- 172.21.15.120:0/217706467 wait complete. 2024-07-27T03:08:44.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7ff9eb198640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9e40cb920 0x7ff9e4073860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fb35b40f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb34c00bc30 0x7fb34c0e1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7ff9ea196640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e40705d0 0x7ff9e4073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fb35b40f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb34c036b10 0x7fb34c03ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fb35b40f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c0069f0 con 0x7fb34c00bc30 2024-07-27T03:08:44.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fb35b40f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c006870 con 0x7fb34c036b10 2024-07-27T03:08:44.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7ff9ea196640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e40705d0 0x7ff9e4073320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.120:46518/0 (socket says 172.21.15.120:46518) 2024-07-27T03:08:44.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fb35b40f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb34c006b70 con 0x7fb34c009ba0 2024-07-27T03:08:44.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7ff9ea196640 1 -- 172.21.15.120:0/3053757541 learned_addr learned my addr 172.21.15.120:0/3053757541 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fabd27fc640 1 -- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fabd4074ae0 msgr2=0x7fabd40b0a00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-27T03:08:44.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fabd27fc640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fabd4074ae0 0x7fabd40b0a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fabd27fc640 1 -- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabd415f510 msgr2=0x7fabd40aed30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-27T03:08:44.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fabd27fc640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fabd415f510 0x7fabd40aed30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fabd27fc640 1 -- 172.21.15.120:0/4238403286 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd40c4040 con 0x7fabd40d0290 2024-07-27T03:08:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7ff9eb198640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9e40cf4e0 0x7ff9e41fd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40a02d0 con 0x7ff9e40cb920 2024-07-27T03:08:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40a0150 con 0x7ff9e40cf4e0 2024-07-27T03:08:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7ff9e9995640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9e40cb920 0x7ff9e4073860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.422+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e40a0450 con 0x7ff9e40705d0 2024-07-27T03:08:44.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7f0f938e2640 1 -- 172.21.15.120:0/869678427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f6c001030 con 0x7f0f8c0731b0 2024-07-27T03:08:44.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7ff9e9995640 1 -- 172.21.15.120:0/3053757541 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e40705d0 msgr2=0x7ff9e4073320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7ff9e9995640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e40705d0 0x7ff9e4073320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7ff9e9995640 1 -- 172.21.15.120:0/3053757541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9e40cf4e0 msgr2=0x7ff9e41fd0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-27T03:08:44.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7ff9e9995640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9e40cf4e0 0x7ff9e41fd0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7ff9e9995640 1 -- 172.21.15.120:0/3053757541 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e40b2db0 con 0x7ff9e40cb920 2024-07-27T03:08:44.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fb35a40d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb34c009ba0 0x7fb34c0d89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7ff9e9995640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9e40cb920 0x7ff9e4073860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc032000 tx=0x7ff9dc003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fabd27fc640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabd40d0290 0x7fabd40b0200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fabc400b780 tx=0x7fabc400bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.423+0000 7fae7f7fe640 1 -- 172.21.15.120:0/2389936592 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90012420 con 0x7fae980701d0 2024-07-27T03:08:44.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fb35a40d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb34c009ba0 0x7fb34c0d89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.120:46526/0 (socket says 172.21.15.120:46526) 2024-07-27T03:08:44.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fb35a40d640 1 -- 172.21.15.120:0/2801326244 learned_addr learned my addr 172.21.15.120:0/2801326244 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fae7d7fa640 1 -- 172.21.15.120:0/2389936592 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae70001030 con 0x7fae980701d0 2024-07-27T03:08:44.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fb359c0c640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb34c00bc30 0x7fb34c0e1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7ff9daffd640 1 -- 172.21.15.120:0/3053757541 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc033050 con 0x7ff9e40cb920 2024-07-27T03:08:44.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fb35ac0e640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb34c036b10 0x7fb34c03ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7ff9daffd640 1 -- 172.21.15.120:0/3053757541 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9dc0045d0 con 0x7ff9e40cb920 2024-07-27T03:08:44.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7f6966ffd640 1 -- 172.21.15.120:0/1641245694 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f69780d2070 con 0x7f6970052240 2024-07-27T03:08:44.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7f6966ffd640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6958077060 0x7f6958079570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7f6966ffd640 1 -- 172.21.15.120:0/1641245694 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6978145e30 con 0x7f6970052240 2024-07-27T03:08:44.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7f6966ffd640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] conn(0x7f695807f330 0x7f6958081780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7f6966ffd640 1 -- 172.21.15.120:0/1641245694 --> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f697806ee80 con 0x7f695807f330 2024-07-27T03:08:44.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7f6966ffd640 1 -- 172.21.15.120:0/1641245694 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6978146220 con 0x7f6970052240 2024-07-27T03:08:44.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fb35a40d640 1 -- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb34c036b10 msgr2=0x7fb34c03ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fb35a40d640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb34c036b10 0x7fb34c03ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fb35a40d640 1 -- 172.21.15.120:0/2801326244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb34c00bc30 msgr2=0x7fb34c0e1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fb35a40d640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb34c00bc30 0x7fb34c0e1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fb35a40d640 1 -- 172.21.15.120:0/2801326244 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c0d7a50 con 0x7fb34c009ba0 2024-07-27T03:08:44.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7fb359c0c640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb34c00bc30 0x7fb34c0e1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:44.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7fb35a40d640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb34c009ba0 0x7fb34c0d89d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb350009910 tx=0x7fb3500052c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7fabbbfff640 1 -- 172.21.15.120:0/4238403286 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4019070 con 0x7fabd40d0290 2024-07-27T03:08:44.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7fabbbfff640 1 -- 172.21.15.120:0/4238403286 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabc400c830 con 0x7fabd40d0290 2024-07-27T03:08:44.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7fabbbfff640 1 -- 172.21.15.120:0/4238403286 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc400cc80 con 0x7fabd40d0290 2024-07-27T03:08:44.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7fabd3fff640 1 -- 172.21.15.120:0/4238403286 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd40c4320 con 0x7fabd40d0290 2024-07-27T03:08:44.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7fabd3fff640 1 -- 172.21.15.120:0/4238403286 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd40b0740 con 0x7fabd40d0290 2024-07-27T03:08:44.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7f6975d9b640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] conn(0x7f695807f330 0x7f6958081780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7ff9daffd640 1 -- 172.21.15.120:0/3053757541 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc038450 con 0x7ff9e40cb920 2024-07-27T03:08:44.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e40b3090 con 0x7ff9e40cb920 2024-07-27T03:08:44.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e40b3650 con 0x7ff9e40cb920 2024-07-27T03:08:44.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7f5f982d2640 1 Processor -- start 2024-07-27T03:08:44.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.424+0000 7f0f81ffb640 1 -- 172.21.15.120:0/869678427 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0f880334b0 con 0x7f0f8c0731b0 2024-07-27T03:08:44.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7f0f81ffb640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f70077110 0x7f0f70079620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7f0f81ffb640 1 -- 172.21.15.120:0/869678427 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0f880b9c40 con 0x7f0f8c0731b0 2024-07-27T03:08:44.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7f697659c640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6958077060 0x7f6958079570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7f0f81ffb640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] conn(0x7f0f7007f300 0x7f0f70081750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.425+0000 7f0f91e7f640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] conn(0x7f0f7007f300 0x7f0f70081750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7f6975d9b640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] conn(0x7f695807f330 0x7f6958081780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7f90eaffd640 1 -- 172.21.15.120:0/2855364314 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f90f4019020 con 0x7f90fc072af0 2024-07-27T03:08:44.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7fb34affd640 1 -- 172.21.15.120:0/2801326244 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350031b50 con 0x7fb34c009ba0 2024-07-27T03:08:44.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7fb35b40f640 1 -- 172.21.15.120:0/2801326244 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34c0d7d30 con 0x7fb34c009ba0 2024-07-27T03:08:44.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7f5f982d2640 1 -- start start 2024-07-27T03:08:44.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9e40b39c0 con 0x7ff9e40cb920 2024-07-27T03:08:44.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7fb35b40f640 1 -- 172.21.15.120:0/2801326244 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb34c0d9010 con 0x7fb34c009ba0 2024-07-27T03:08:44.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.427+0000 7f90eaffd640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f90dc077110 0x7f90dc079620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.427+0000 7fabd3fff640 1 -- 172.21.15.120:0/4238403286 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fabb4001030 con 0x7fabd40d0290 2024-07-27T03:08:44.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.427+0000 7f697659c640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6958077060 0x7f6958079570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f696c000f60 tx=0x7f696c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.427+0000 7fb34affd640 1 -- 172.21.15.120:0/2801326244 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb350031cf0 con 0x7fb34c009ba0 2024-07-27T03:08:44.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.427+0000 7fae7f7fe640 1 -- 172.21.15.120:0/2389936592 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fae900126b0 con 0x7fae980701d0 2024-07-27T03:08:44.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.427+0000 7f90eaffd640 1 -- 172.21.15.120:0/2855364314 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f90f4098670 con 0x7f90fc072af0 2024-07-27T03:08:44.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.427+0000 7f90fa59c640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f90dc077110 0x7f90dc079620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7f0f90e7d640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f70077110 0x7f0f70079620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7f0f81ffb640 1 -- 172.21.15.120:0/869678427 --> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f8800b0b0 con 0x7f0f7007f300 2024-07-27T03:08:44.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.426+0000 7f0f81ffb640 1 -- 172.21.15.120:0/869678427 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0f8807ee00 con 0x7f0f8c0731b0 2024-07-27T03:08:44.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.427+0000 7f0f91e7f640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] conn(0x7f0f7007f300 0x7f0f70081750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.427+0000 7fb34affd640 1 -- 172.21.15.120:0/2801326244 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350004a00 con 0x7fb34c009ba0 2024-07-27T03:08:44.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7f0f90e7d640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f70077110 0x7f0f70079620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0717b0 tx=0x7f0f7c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7f6966ffd640 1 -- 172.21.15.120:0/1641245694 <== osd.3 v2:172.21.15.120:6816/253357243 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f697806ee80 con 0x7f695807f330 2024-07-27T03:08:44.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7f0f81ffb640 1 -- 172.21.15.120:0/869678427 <== osd.1 v2:172.21.15.120:6800/1875902283 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f8800b0b0 con 0x7f0f7007f300 2024-07-27T03:08:44.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7fabbbfff640 1 -- 172.21.15.120:0/4238403286 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fabc401c070 con 0x7fabd40d0290 2024-07-27T03:08:44.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7fae7f7fe640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fae84077410 0x7fae84079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7f90eaffd640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] conn(0x7f90dc07f380 0x7f90dc0817d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7f90eaffd640 1 -- 172.21.15.120:0/2855364314 --> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90f40047f0 con 0x7f90dc07f380 2024-07-27T03:08:44.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7f90eaffd640 1 -- 172.21.15.120:0/2855364314 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f90f409f050 con 0x7f90fc072af0 2024-07-27T03:08:44.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7f90f9d9b640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] conn(0x7f90dc07f380 0x7f90dc0817d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7fb35b40f640 1 -- 172.21.15.120:0/2801326244 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb33c001030 con 0x7fb34c009ba0 2024-07-27T03:08:44.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7f5f982d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f90072c70 0x7f5f9013a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7f5f982d2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f900b3460 0x7f5f9015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7f5f9606e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f90072c70 0x7f5f9013a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f9606e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f90072c70 0x7f5f9013a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.120:41002/0 (socket says 172.21.15.120:41002) 2024-07-27T03:08:44.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f982d2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f900cffb0 0x7f5f901547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f9586d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f900b3460 0x7f5f9015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f9586d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f900b3460 0x7f5f9015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.120:46540/0 (socket says 172.21.15.120:46540) 2024-07-27T03:08:44.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.428+0000 7fae7f7fe640 1 -- 172.21.15.120:0/2389936592 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fae9000ad20 con 0x7fae980701d0 2024-07-27T03:08:44.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7fae7f7fe640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] conn(0x7fae8407f660 0x7fae84081ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7fae7f7fe640 1 -- 172.21.15.120:0/2389936592 --> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae84082180 con 0x7fae8407f660 2024-07-27T03:08:44.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7fae7f7fe640 1 -- 172.21.15.120:0/2389936592 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fae900994a0 con 0x7fae980701d0 2024-07-27T03:08:44.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f90fa59c640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f90dc077110 0x7f90dc079620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90ec005eb0 tx=0x7f90ec004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f9606e640 1 -- 172.21.15.120:0/1257188796 learned_addr learned my addr 172.21.15.120:0/1257188796 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f9686f640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f900cffb0 0x7f5f901547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5f900688f0 con 0x7f5f900cffb0 2024-07-27T03:08:44.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5f90068770 con 0x7f5f90072c70 2024-07-27T03:08:44.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5f90068a70 con 0x7f5f900b3460 2024-07-27T03:08:44.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f90f9d9b640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] conn(0x7f90dc07f380 0x7f90dc0817d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7ff9daffd640 1 -- 172.21.15.120:0/3053757541 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff9dc036070 con 0x7ff9e40cb920 2024-07-27T03:08:44.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7ff9daffd640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff9c80770e0 0x7ff9c80795f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f9586d640 1 -- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f90072c70 msgr2=0x7f5f9013a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7ff9daffd640 1 -- 172.21.15.120:0/3053757541 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff9dc0ba090 con 0x7ff9e40cb920 2024-07-27T03:08:44.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7ff9daffd640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] conn(0x7ff9c807f3b0 0x7ff9c8081800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7ff9daffd640 1 -- 172.21.15.120:0/3053757541 --> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9dc044ec0 con 0x7ff9c807f3b0 2024-07-27T03:08:44.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7ff9daffd640 1 -- 172.21.15.120:0/3053757541 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff9dc0ba480 con 0x7ff9e40cb920 2024-07-27T03:08:44.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7fabbbfff640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fabc0077090 0x7fabc00795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7fabbbfff640 1 -- 172.21.15.120:0/4238403286 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fabc4097cb0 con 0x7fabd40d0290 2024-07-27T03:08:44.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7fae967fc640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fae84077410 0x7fae84079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7fae977fe640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] conn(0x7fae8407f660 0x7fae84081ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f9586d640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f90072c70 0x7f5f9013a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f9586d640 1 -- 172.21.15.120:0/1257188796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f900cffb0 msgr2=0x7f5f901547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f9586d640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f900cffb0 0x7f5f901547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.429+0000 7f5f9586d640 1 -- 172.21.15.120:0/1257188796 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f90140320 con 0x7f5f900b3460 2024-07-27T03:08:44.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7fabbbfff640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] conn(0x7fabc007f300 0x7fabc0081750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7fabbbfff640 1 -- 172.21.15.120:0/4238403286 --> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabc0081e20 con 0x7fabc007f300 2024-07-27T03:08:44.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7fabbbfff640 1 -- 172.21.15.120:0/4238403286 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fabc409a250 con 0x7fabd40d0290 2024-07-27T03:08:44.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7ff9ea196640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff9c80770e0 0x7ff9c80795f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7f5f9586d640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f900b3460 0x7f5f9015d950 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f900b45f0 tx=0x7f5f8c003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7ff9ea997640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] conn(0x7ff9c807f3b0 0x7ff9c8081800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7fabd37fe640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] conn(0x7fabc007f300 0x7fabc0081750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7fabd2ffd640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fabc0077090 0x7fabc00795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7fb34affd640 1 -- 172.21.15.120:0/2801326244 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb350004ba0 con 0x7fb34c009ba0 2024-07-27T03:08:44.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7f5f86ffd640 1 -- 172.21.15.120:0/1257188796 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c037070 con 0x7f5f900b3460 2024-07-27T03:08:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7fae977fe640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] conn(0x7fae8407f660 0x7fae84081ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7f5f86ffd640 1 -- 172.21.15.120:0/1257188796 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f8c040070 con 0x7f5f900b3460 2024-07-27T03:08:44.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7f90eaffd640 1 -- 172.21.15.120:0/2855364314 <== osd.4 v2:172.21.15.121:6808/3344380023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90f40047f0 con 0x7f90dc07f380 2024-07-27T03:08:44.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.430+0000 7fae967fc640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fae84077410 0x7fae84079920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fae980cd1c0 tx=0x7fae8c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.431+0000 7fabd2ffd640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fabc0077090 0x7fabc00795a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fabcc035000 tx=0x7fabcc004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.431+0000 7ff9ea196640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff9c80770e0 0x7ff9c80795f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00099a0 tx=0x7ff9e00090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.431+0000 7ff9ea997640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] conn(0x7ff9c807f3b0 0x7ff9c8081800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.431+0000 7f5f86ffd640 1 -- 172.21.15.120:0/1257188796 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c004a00 con 0x7f5f900b3460 2024-07-27T03:08:44.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.431+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f90140600 con 0x7f5f900b3460 2024-07-27T03:08:44.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.431+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f900a96e0 con 0x7f5f900b3460 2024-07-27T03:08:44.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.431+0000 7fb34affd640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb338077110 0x7fb338079620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.431+0000 7fabd37fe640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] conn(0x7fabc007f300 0x7fabc0081750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.431+0000 7fb34affd640 1 -- 172.21.15.120:0/2801326244 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb3500b9ab0 con 0x7fb34c009ba0 2024-07-27T03:08:44.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.431+0000 7fb359c0c640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb338077110 0x7fb338079620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.431+0000 7fb34affd640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] conn(0x7fb33807f3e0 0x7fb338081830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.432+0000 7fb34affd640 1 -- 172.21.15.120:0/2801326244 --> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb35003ae50 con 0x7fb33807f3e0 2024-07-27T03:08:44.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.432+0000 7fb34affd640 1 -- 172.21.15.120:0/2801326244 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb3500be2a0 con 0x7fb34c009ba0 2024-07-27T03:08:44.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.432+0000 7fae7f7fe640 1 -- 172.21.15.120:0/2389936592 <== osd.0 v2:172.21.15.120:6824/505581380 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae84082180 con 0x7fae8407f660 2024-07-27T03:08:44.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.432+0000 7fb35ac0e640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] conn(0x7fb33807f3e0 0x7fb338081830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.432+0000 7fabbbfff640 1 -- 172.21.15.120:0/4238403286 <== osd.7 v2:172.21.15.121:6816/2396581528 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fabc0081e20 con 0x7fabc007f300 2024-07-27T03:08:44.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.432+0000 7ff9daffd640 1 -- 172.21.15.120:0/3053757541 <== osd.2 v2:172.21.15.120:6808/1765193874 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9dc044ec0 con 0x7ff9c807f3b0 2024-07-27T03:08:44.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.432+0000 7fb35ac0e640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] conn(0x7fb33807f3e0 0x7fb338081830 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.432+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5f90073080 con 0x7f5f900b3460 2024-07-27T03:08:44.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.432+0000 7fb359c0c640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb338077110 0x7fb338079620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb34c036590 tx=0x7fb344007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.434+0000 7fb34affd640 1 -- 172.21.15.120:0/2801326244 <== osd.5 v2:172.21.15.121:6824/3272535131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb35003ae50 con 0x7fb33807f3e0 2024-07-27T03:08:44.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.434+0000 7f5f86ffd640 1 -- 172.21.15.120:0/1257188796 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5f8c004ba0 con 0x7f5f900b3460 2024-07-27T03:08:44.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.435+0000 7f5f86ffd640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5f74077110 0x7f5f74079620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.435+0000 7f5f86ffd640 1 -- 172.21.15.120:0/1257188796 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5f8c0b9330 con 0x7f5f900b3460 2024-07-27T03:08:44.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.435+0000 7f5f86ffd640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] conn(0x7f5f7407f3e0 0x7f5f74081830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.435+0000 7f5f86ffd640 1 -- 172.21.15.120:0/1257188796 --> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f8c005310 con 0x7f5f7407f3e0 2024-07-27T03:08:44.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.435+0000 7f5f86ffd640 1 -- 172.21.15.120:0/1257188796 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5f8c0b9720 con 0x7f5f900b3460 2024-07-27T03:08:44.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.435+0000 7f5f9606e640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5f74077110 0x7f5f74079620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.436+0000 7f5f9686f640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] conn(0x7f5f7407f3e0 0x7f5f74081830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.436+0000 7f5f9606e640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5f74077110 0x7f5f74079620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f88007fd0 tx=0x7f5f88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.436+0000 7f5f9686f640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] conn(0x7f5f7407f3e0 0x7f5f74081830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.437+0000 7f5f86ffd640 1 -- 172.21.15.120:0/1257188796 <== osd.6 v2:172.21.15.121:6800/375857749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5f8c005310 con 0x7f5f7407f3e0 2024-07-27T03:08:44.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.458+0000 7f0f938e2640 1 -- 172.21.15.120:0/869678427 --> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0f6c002d50 con 0x7f0f7007f300 2024-07-27T03:08:44.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.459+0000 7f0f81ffb640 1 -- 172.21.15.120:0/869678427 <== osd.1 v2:172.21.15.120:6800/1875902283 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0f6c002d50 con 0x7f0f7007f300 2024-07-27T03:08:44.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.459+0000 7f697759e640 1 -- 172.21.15.120:0/1641245694 --> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f69700d75f0 con 0x7f695807f330 2024-07-27T03:08:44.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.459+0000 7f6966ffd640 1 -- 172.21.15.120:0/1641245694 <== osd.3 v2:172.21.15.120:6816/253357243 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f69700d75f0 con 0x7f695807f330 2024-07-27T03:08:44.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f0f777fe640 1 -- 172.21.15.120:0/869678427 >> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] conn(0x7f0f7007f300 msgr2=0x7f0f70081750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f0f777fe640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] conn(0x7f0f7007f300 0x7f0f70081750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f697759e640 1 -- 172.21.15.120:0/1641245694 >> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] conn(0x7f695807f330 msgr2=0x7f6958081780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f697759e640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] conn(0x7f695807f330 0x7f6958081780 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f697759e640 1 -- 172.21.15.120:0/1641245694 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6958077060 msgr2=0x7f6958079570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f697759e640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6958077060 0x7f6958079570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f696c000f60 tx=0x7f696c009040 comp rx=0 tx=0).stop 2024-07-27T03:08:44.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f697759e640 1 -- 172.21.15.120:0/1641245694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6970052240 msgr2=0x7f6970036f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f697759e640 1 --2- 172.21.15.120:0/1641245694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6970052240 0x7f6970036f50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f697806bab0 tx=0x7f697806b380 comp rx=0 tx=0).stop 2024-07-27T03:08:44.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f6976d9d640 1 -- 172.21.15.120:0/1641245694 reap_dead start 2024-07-27T03:08:44.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f0f777fe640 1 -- 172.21.15.120:0/869678427 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f70077110 msgr2=0x7f0f70079620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.461+0000 7f697759e640 1 -- 172.21.15.120:0/1641245694 shutdown_connections 2024-07-27T03:08:44.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f0f777fe640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f70077110 0x7f0f70079620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0717b0 tx=0x7f0f7c005850 comp rx=0 tx=0).stop 2024-07-27T03:08:44.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.461+0000 7f697759e640 1 -- 172.21.15.120:0/1641245694 >> 172.21.15.120:0/1641245694 conn(0x7f697001eae0 msgr2=0x7f69700056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f0f777fe640 1 -- 172.21.15.120:0/869678427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f8c0731b0 msgr2=0x7f0f8c070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.460+0000 7f0f777fe640 1 --2- 172.21.15.120:0/869678427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f8c0731b0 0x7f0f8c070950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f88000c00 tx=0x7f0f88033c20 comp rx=0 tx=0).stop 2024-07-27T03:08:44.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.462+0000 7f0f91e7f640 1 -- 172.21.15.120:0/869678427 reap_dead start 2024-07-27T03:08:44.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.462+0000 7f0f777fe640 1 -- 172.21.15.120:0/869678427 shutdown_connections 2024-07-27T03:08:44.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.462+0000 7f0f777fe640 1 -- 172.21.15.120:0/869678427 >> 172.21.15.120:0/869678427 conn(0x7f0f8c0b2dc0 msgr2=0x7f0f8c151960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.462+0000 7f697759e640 1 -- 172.21.15.120:0/1641245694 shutdown_connections 2024-07-27T03:08:44.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.462+0000 7f697759e640 1 -- 172.21.15.120:0/1641245694 wait complete. 2024-07-27T03:08:44.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.462+0000 7f0f777fe640 1 -- 172.21.15.120:0/869678427 shutdown_connections 2024-07-27T03:08:44.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.462+0000 7f0f777fe640 1 -- 172.21.15.120:0/869678427 wait complete. 2024-07-27T03:08:44.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.463+0000 7f9100b2d640 1 -- 172.21.15.120:0/2855364314 --> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f90fc14c5e0 con 0x7f90dc07f380 2024-07-27T03:08:44.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.464+0000 7f90eaffd640 1 -- 172.21.15.120:0/2855364314 <== osd.4 v2:172.21.15.121:6808/3344380023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f90fc14c5e0 con 0x7f90dc07f380 2024-07-27T03:08:44.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.464+0000 7fb35b40f640 1 -- 172.21.15.120:0/2801326244 --> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb33c002dd0 con 0x7fb33807f3e0 2024-07-27T03:08:44.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.464+0000 7fb34affd640 1 -- 172.21.15.120:0/2801326244 <== osd.5 v2:172.21.15.121:6824/3272535131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb33c002dd0 con 0x7fb33807f3e0 2024-07-27T03:08:44.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.464+0000 7f90e8ff9640 1 -- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] conn(0x7f90dc07f380 msgr2=0x7f90dc0817d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.464+0000 7f90e8ff9640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] conn(0x7f90dc07f380 0x7f90dc0817d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7f90e8ff9640 1 -- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f90dc077110 msgr2=0x7f90dc079620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7fb35b40f640 1 -- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] conn(0x7fb33807f3e0 msgr2=0x7fb338081830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7f90e8ff9640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f90dc077110 0x7f90dc079620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90ec005eb0 tx=0x7f90ec004730 comp rx=0 tx=0).stop 2024-07-27T03:08:44.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7fb35b40f640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] conn(0x7fb33807f3e0 0x7fb338081830 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7f90e8ff9640 1 -- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90fc072af0 msgr2=0x7f90fc0b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7f90e8ff9640 1 --2- 172.21.15.120:0/2855364314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90fc072af0 0x7f90fc0b0ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90fc072380 tx=0x7f90f400cf00 comp rx=0 tx=0).stop 2024-07-27T03:08:44.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.464+0000 7fae7d7fa640 1 -- 172.21.15.120:0/2389936592 --> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae70002dd0 con 0x7fae8407f660 2024-07-27T03:08:44.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7f90fad9d640 1 -- 172.21.15.120:0/2855364314 reap_dead start 2024-07-27T03:08:44.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7fb35b40f640 1 -- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb338077110 msgr2=0x7fb338079620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7fb35b40f640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb338077110 0x7fb338079620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb34c036590 tx=0x7fb344007e90 comp rx=0 tx=0).stop 2024-07-27T03:08:44.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7fb35b40f640 1 -- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb34c009ba0 msgr2=0x7fb34c0d89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7fb35b40f640 1 --2- 172.21.15.120:0/2801326244 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb34c009ba0 0x7fb34c0d89d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb350009910 tx=0x7fb3500052c0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7fb35ac0e640 1 -- 172.21.15.120:0/2801326244 reap_dead start 2024-07-27T03:08:44.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7f90e8ff9640 1 -- 172.21.15.120:0/2855364314 shutdown_connections 2024-07-27T03:08:44.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7f90e8ff9640 1 -- 172.21.15.120:0/2855364314 >> 172.21.15.120:0/2855364314 conn(0x7f90fc06cdb0 msgr2=0x7f90fc161e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7fb35b40f640 1 -- 172.21.15.120:0/2801326244 shutdown_connections 2024-07-27T03:08:44.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7fb35b40f640 1 -- 172.21.15.120:0/2801326244 >> 172.21.15.120:0/2801326244 conn(0x7fb34c051420 msgr2=0x7fb34c0505e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7fae7f7fe640 1 -- 172.21.15.120:0/2389936592 <== osd.0 v2:172.21.15.120:6824/505581380 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fae70002dd0 con 0x7fae8407f660 2024-07-27T03:08:44.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 --> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff9e40b2b60 con 0x7ff9c807f3b0 2024-07-27T03:08:44.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.465+0000 7fb35b40f640 1 -- 172.21.15.120:0/2801326244 shutdown_connections 2024-07-27T03:08:44.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fb35b40f640 1 -- 172.21.15.120:0/2801326244 wait complete. 2024-07-27T03:08:44.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7f90e8ff9640 1 -- 172.21.15.120:0/2855364314 shutdown_connections 2024-07-27T03:08:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7ff9daffd640 1 -- 172.21.15.120:0/3053757541 <== osd.2 v2:172.21.15.120:6808/1765193874 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff9e40b2b60 con 0x7ff9c807f3b0 2024-07-27T03:08:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fabd3fff640 1 -- 172.21.15.120:0/4238403286 --> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fabb4002dd0 con 0x7fabc007f300 2024-07-27T03:08:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fae7d7fa640 1 -- 172.21.15.120:0/2389936592 >> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] conn(0x7fae8407f660 msgr2=0x7fae84081ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fae7d7fa640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] conn(0x7fae8407f660 0x7fae84081ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7f90e8ff9640 1 -- 172.21.15.120:0/2855364314 wait complete. 2024-07-27T03:08:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fae7d7fa640 1 -- 172.21.15.120:0/2389936592 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fae84077410 msgr2=0x7fae84079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fae7d7fa640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fae84077410 0x7fae84079920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fae980cd1c0 tx=0x7fae8c009060 comp rx=0 tx=0).stop 2024-07-27T03:08:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fae7d7fa640 1 -- 172.21.15.120:0/2389936592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae980701d0 msgr2=0x7fae98141c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fae7d7fa640 1 --2- 172.21.15.120:0/2389936592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae980701d0 0x7fae98141c90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae90001780 tx=0x7fae9000a430 comp rx=0 tx=0).stop 2024-07-27T03:08:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fae977fe640 1 -- 172.21.15.120:0/2389936592 reap_dead start 2024-07-27T03:08:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fae7d7fa640 1 -- 172.21.15.120:0/2389936592 shutdown_connections 2024-07-27T03:08:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fae7d7fa640 1 -- 172.21.15.120:0/2389936592 >> 172.21.15.120:0/2389936592 conn(0x7fae980cfa90 msgr2=0x7fae980cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7fabbbfff640 1 -- 172.21.15.120:0/4238403286 <== osd.7 v2:172.21.15.121:6816/2396581528 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fabb4002dd0 con 0x7fabc007f300 2024-07-27T03:08:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 >> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] conn(0x7ff9c807f3b0 msgr2=0x7ff9c8081800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7ff9eb198640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] conn(0x7ff9c807f3b0 0x7ff9c8081800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.466+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 --> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5f900cf7c0 con 0x7f5f7407f3e0 2024-07-27T03:08:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff9c80770e0 msgr2=0x7ff9c80795f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7ff9eb198640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff9c80770e0 0x7ff9c80795f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00099a0 tx=0x7ff9e00090e0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9e40cb920 msgr2=0x7ff9e4073860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7ff9eb198640 1 --2- 172.21.15.120:0/3053757541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9e40cb920 0x7ff9e4073860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc032000 tx=0x7ff9dc003f80 comp rx=0 tx=0).stop 2024-07-27T03:08:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7ff9ea997640 1 -- 172.21.15.120:0/3053757541 reap_dead start 2024-07-27T03:08:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 shutdown_connections 2024-07-27T03:08:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 >> 172.21.15.120:0/3053757541 conn(0x7ff9e40cfa90 msgr2=0x7ff9e4075900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7fabd3fff640 1 -- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] conn(0x7fabc007f300 msgr2=0x7fabc0081750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7fabd3fff640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] conn(0x7fabc007f300 0x7fabc0081750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7f5f86ffd640 1 -- 172.21.15.120:0/1257188796 <== osd.6 v2:172.21.15.121:6800/375857749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5f900cf7c0 con 0x7f5f7407f3e0 2024-07-27T03:08:44.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 shutdown_connections 2024-07-27T03:08:44.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7fabd3fff640 1 -- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fabc0077090 msgr2=0x7fabc00795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7fabd3fff640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fabc0077090 0x7fabc00795a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fabcc035000 tx=0x7fabcc004ab0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7fabd3fff640 1 -- 172.21.15.120:0/4238403286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabd40d0290 msgr2=0x7fabd40b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7fabd3fff640 1 --2- 172.21.15.120:0/4238403286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabd40d0290 0x7fabd40b0200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fabc400b780 tx=0x7fabc400bc40 comp rx=0 tx=0).stop 2024-07-27T03:08:44.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7ff9eb198640 1 -- 172.21.15.120:0/3053757541 wait complete. 2024-07-27T03:08:44.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7fae7d7fa640 1 -- 172.21.15.120:0/2389936592 shutdown_connections 2024-07-27T03:08:44.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7fabd37fe640 1 -- 172.21.15.120:0/4238403286 reap_dead start 2024-07-27T03:08:44.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7fabd3fff640 1 -- 172.21.15.120:0/4238403286 shutdown_connections 2024-07-27T03:08:44.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7fabd3fff640 1 -- 172.21.15.120:0/4238403286 >> 172.21.15.120:0/4238403286 conn(0x7fabd4073e30 msgr2=0x7fabd406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.467+0000 7fae7d7fa640 1 -- 172.21.15.120:0/2389936592 wait complete. 2024-07-27T03:08:44.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.468+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] conn(0x7f5f7407f3e0 msgr2=0x7f5f74081830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.468+0000 7f5f982d2640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] conn(0x7f5f7407f3e0 0x7f5f74081830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.468+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5f74077110 msgr2=0x7f5f74079620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.468+0000 7f5f982d2640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5f74077110 0x7f5f74079620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f88007fd0 tx=0x7f5f88009040 comp rx=0 tx=0).stop 2024-07-27T03:08:44.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.468+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f900b3460 msgr2=0x7f5f9015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.468+0000 7f5f982d2640 1 --2- 172.21.15.120:0/1257188796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f900b3460 0x7f5f9015d950 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5f900b45f0 tx=0x7f5f8c003820 comp rx=0 tx=0).stop 2024-07-27T03:08:44.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.468+0000 7f5f9686f640 1 -- 172.21.15.120:0/1257188796 reap_dead start 2024-07-27T03:08:44.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.468+0000 7fabd3fff640 1 -- 172.21.15.120:0/4238403286 shutdown_connections 2024-07-27T03:08:44.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.468+0000 7fabd3fff640 1 -- 172.21.15.120:0/4238403286 wait complete. 2024-07-27T03:08:44.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.468+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 shutdown_connections 2024-07-27T03:08:44.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.468+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 >> 172.21.15.120:0/1257188796 conn(0x7f5f900b2dc0 msgr2=0x7f5f90143e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.469+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 shutdown_connections 2024-07-27T03:08:44.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.469+0000 7f5f982d2640 1 -- 172.21.15.120:0/1257188796 wait complete. 2024-07-27T03:08:44.512 INFO:teuthology.orchestra.run.smithi120.stdout:64424509448 2024-07-27T03:08:44.513 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-07-27T03:08:44.514 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-07-27T03:08:44.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-07-27T03:08:44.515 INFO:teuthology.orchestra.run.smithi120.stdout:64424509447 2024-07-27T03:08:44.515 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-07-27T03:08:44.516 INFO:teuthology.orchestra.run.smithi120.stdout:60129542151 2024-07-27T03:08:44.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-07-27T03:08:44.517 INFO:teuthology.orchestra.run.smithi120.stdout:64424509447 2024-07-27T03:08:44.518 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-07-27T03:08:44.519 INFO:teuthology.orchestra.run.smithi120.stdout:64424509447 2024-07-27T03:08:44.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-07-27T03:08:44.520 INFO:teuthology.orchestra.run.smithi120.stdout:60129542151 2024-07-27T03:08:44.520 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-07-27T03:08:44.521 INFO:teuthology.orchestra.run.smithi120.stdout:64424509446 2024-07-27T03:08:44.521 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-07-27T03:08:44.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.767+0000 7f0e877ce640 1 -- 172.21.15.120:0/3482446106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e80072ae0 msgr2=0x7f0e80168230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.767+0000 7f0e877ce640 1 --2- 172.21.15.120:0/3482446106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e80072ae0 0x7f0e80168230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e80070160 tx=0x7f0e7802a9e0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.768+0000 7f0e877ce640 1 -- 172.21.15.120:0/3482446106 shutdown_connections 2024-07-27T03:08:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.768+0000 7f0e877ce640 1 --2- 172.21.15.120:0/3482446106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e80072ae0 0x7f0e80168230 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.769+0000 7f0e877ce640 1 --2- 172.21.15.120:0/3482446106 >> v2:172.21.15.121:3300/0 conn(0x7f0e8015ea00 0x7f0e8006e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.769+0000 7f0e877ce640 1 -- 172.21.15.120:0/3482446106 >> 172.21.15.120:0/3482446106 conn(0x7f0e8006cdb0 msgr2=0x7f0e800b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.769+0000 7f0e877ce640 1 -- 172.21.15.120:0/3482446106 shutdown_connections 2024-07-27T03:08:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.769+0000 7f0e877ce640 1 -- 172.21.15.120:0/3482446106 wait complete. 2024-07-27T03:08:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.769+0000 7f59a7fff640 1 -- 172.21.15.120:0/2582841347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a815e9d0 msgr2=0x7f59a8070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.770+0000 7f59a7fff640 1 --2- 172.21.15.120:0/2582841347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a815e9d0 0x7f59a8070090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5994005fd0 tx=0x7f599402a560 comp rx=0 tx=0).stop 2024-07-27T03:08:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.770+0000 7f59a7fff640 1 -- 172.21.15.120:0/2582841347 shutdown_connections 2024-07-27T03:08:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.770+0000 7f59a7fff640 1 --2- 172.21.15.120:0/2582841347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a815e9d0 0x7f59a8070090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.770+0000 7f59a7fff640 1 --2- 172.21.15.120:0/2582841347 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59a80cf4e0 0x7f59a80cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.770+0000 7f59a7fff640 1 -- 172.21.15.120:0/2582841347 >> 172.21.15.120:0/2582841347 conn(0x7f59a80cfa90 msgr2=0x7f59a80cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.770+0000 7f59a7fff640 1 -- 172.21.15.120:0/2582841347 shutdown_connections 2024-07-27T03:08:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.770+0000 7f59a7fff640 1 -- 172.21.15.120:0/2582841347 wait complete. 2024-07-27T03:08:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.771+0000 7f0c63efa640 1 -- 172.21.15.120:0/1305620623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c54052350 msgr2=0x7f0c540e7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.771+0000 7f0c63efa640 1 --2- 172.21.15.120:0/1305620623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c54052350 0x7f0c540e7270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c07af20 tx=0x7f0c5c06c6b0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.771+0000 7f0e877ce640 1 Processor -- start 2024-07-27T03:08:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.771+0000 7f0e877ce640 1 -- start start 2024-07-27T03:08:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.772+0000 7f0c63efa640 1 -- 172.21.15.120:0/1305620623 shutdown_connections 2024-07-27T03:08:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.772+0000 7f0c63efa640 1 --2- 172.21.15.120:0/1305620623 >> v2:172.21.15.120:3300/0 conn(0x7f0c54005bf0 0x7f0c54006000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.772+0000 7f0c63efa640 1 --2- 172.21.15.120:0/1305620623 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c54051620 0x7f0c54051a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.772+0000 7f0c63efa640 1 --2- 172.21.15.120:0/1305620623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c54052350 0x7f0c540e7270 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.772+0000 7f0c63efa640 1 -- 172.21.15.120:0/1305620623 >> 172.21.15.120:0/1305620623 conn(0x7f0c5401d990 msgr2=0x7f0c54039650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.772+0000 7f0c9affd640 1 -- 172.21.15.120:0/1638513548 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90035020 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.772+0000 7fd171691640 1 -- 172.21.15.120:0/1929738821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd164006b00 msgr2=0x7fd164035e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.772+0000 7fd171691640 1 --2- 172.21.15.120:0/1929738821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd164006b00 0x7fd164035e50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd1540098e0 tx=0x7fd15402a530 comp rx=0 tx=0).stop 2024-07-27T03:08:44.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7fd171691640 1 -- 172.21.15.120:0/1929738821 shutdown_connections 2024-07-27T03:08:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7fd171691640 1 --2- 172.21.15.120:0/1929738821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd164006b00 0x7fd164035e50 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd1540098e0 tx=0x7fd15402a530 comp rx=0 tx=0).stop 2024-07-27T03:08:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7fd171691640 1 -- 172.21.15.120:0/1929738821 >> 172.21.15.120:0/1929738821 conn(0x7fd16401db70 msgr2=0x7fd164039830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1638513548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c15e5b0 msgr2=0x7f0c9c0d4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f0ca11f5640 1 --2- 172.21.15.120:0/1638513548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c15e5b0 0x7f0c9c0d4530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c06ce10 tx=0x7f0c9002a560 comp rx=0 tx=0).stop 2024-07-27T03:08:44.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1638513548 shutdown_connections 2024-07-27T03:08:44.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f0ca11f5640 1 --2- 172.21.15.120:0/1638513548 >> v2:172.21.15.120:3300/0 conn(0x7f0c9c0cfbd0 0x7f0c9c0d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f0ca11f5640 1 --2- 172.21.15.120:0/1638513548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c15e5b0 0x7f0c9c0d4530 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1638513548 >> 172.21.15.120:0/1638513548 conn(0x7f0c9c09d130 msgr2=0x7f0c9c0d3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f1bc359e640 1 -- 172.21.15.120:0/2726576891 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc0df640 msgr2=0x7f1bbc01c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f1bc359e640 1 --2- 172.21.15.120:0/2726576891 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc0df640 0x7f1bbc01c5b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800a940 tx=0x7f1bb802a730 comp rx=0 tx=0).stop 2024-07-27T03:08:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.772+0000 7f0c63efa640 1 -- 172.21.15.120:0/1305620623 shutdown_connections 2024-07-27T03:08:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f59a7fff640 1 Processor -- start 2024-07-27T03:08:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f0c63efa640 1 -- 172.21.15.120:0/1305620623 wait complete. 2024-07-27T03:08:44.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1638513548 shutdown_connections 2024-07-27T03:08:44.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7fd171691640 1 -- 172.21.15.120:0/1929738821 shutdown_connections 2024-07-27T03:08:44.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1638513548 wait complete. 2024-07-27T03:08:44.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.774+0000 7f59a7fff640 1 -- start start 2024-07-27T03:08:44.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.774+0000 7f1bc359e640 1 -- 172.21.15.120:0/2726576891 shutdown_connections 2024-07-27T03:08:44.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.774+0000 7f1bc359e640 1 --2- 172.21.15.120:0/2726576891 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc0df640 0x7f1bbc01c5b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.774+0000 7f1bc359e640 1 -- 172.21.15.120:0/2726576891 >> 172.21.15.120:0/2726576891 conn(0x7f1bbc051420 msgr2=0x7f1bbc051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7fd171691640 1 -- 172.21.15.120:0/1929738821 wait complete. 2024-07-27T03:08:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.773+0000 7f0e877ce640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e801554a0 0x7f0e800b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.774+0000 7f0e8556a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e801554a0 0x7f0e800b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f1bc359e640 1 -- 172.21.15.120:0/2726576891 shutdown_connections 2024-07-27T03:08:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f0e877ce640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e8015ea00 0x7f0e800b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f0e877ce640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e8014da20 0x7f0e800b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f0e877ce640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0e801688f0 con 0x7f0e801554a0 2024-07-27T03:08:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f0e85d6b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e8014da20 0x7f0e800b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f0e85d6b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e8014da20 0x7f0e800b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.120:41046/0 (socket says 172.21.15.120:41046) 2024-07-27T03:08:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f0e85d6b640 1 -- 172.21.15.120:0/3568541403 learned_addr learned my addr 172.21.15.120:0/3568541403 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f1518e4d640 1 -- 172.21.15.120:0/3601990980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f150c036960 msgr2=0x7f150c01c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f0e877ce640 1 -- 172.21.15.120:0/3568541403 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0e80168770 con 0x7f0e8014da20 2024-07-27T03:08:44.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f0e877ce640 1 -- 172.21.15.120:0/3568541403 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0e80168a70 con 0x7f0e8015ea00 2024-07-27T03:08:44.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f1518e4d640 1 --2- 172.21.15.120:0/3601990980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f150c036960 0x7f150c01c5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1514050ca0 tx=0x7f151406c6b0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f1518e4d640 1 -- 172.21.15.120:0/3601990980 shutdown_connections 2024-07-27T03:08:44.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f1518e4d640 1 --2- 172.21.15.120:0/3601990980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f150c036960 0x7f150c01c5a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f1518e4d640 1 --2- 172.21.15.120:0/3601990980 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f150c005c50 0x7f150c036420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f1518e4d640 1 --2- 172.21.15.120:0/3601990980 >> v2:172.21.15.120:3300/0 conn(0x7f150c009b90 0x7f150c0df170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f1518e4d640 1 -- 172.21.15.120:0/3601990980 >> 172.21.15.120:0/3601990980 conn(0x7f150c051410 msgr2=0x7f150c051850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0ca11f5640 1 Processor -- start 2024-07-27T03:08:44.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0e85d6b640 1 -- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e8015ea00 msgr2=0x7f0e800b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0e85d6b640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e8015ea00 0x7f0e800b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0e85d6b640 1 -- 172.21.15.120:0/3568541403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e801554a0 msgr2=0x7f0e800b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0e85d6b640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e801554a0 0x7f0e800b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0e85d6b640 1 -- 172.21.15.120:0/3568541403 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e801fd140 con 0x7f0e8014da20 2024-07-27T03:08:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.775+0000 7f1bc359e640 1 -- 172.21.15.120:0/2726576891 wait complete. 2024-07-27T03:08:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0e85d6b640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e8014da20 0x7f0e800b42a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e7802afd0 tx=0x7f0e78003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0ca11f5640 1 -- start start 2024-07-27T03:08:44.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0c63efa640 1 Processor -- start 2024-07-27T03:08:44.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0e75ffb640 1 -- 172.21.15.120:0/3568541403 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78033050 con 0x7f0e8014da20 2024-07-27T03:08:44.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0c63efa640 1 -- start start 2024-07-27T03:08:44.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f59a7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a80cf4e0 0x7f59a8156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.777+0000 7f59a6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a80cf4e0 0x7f59a8156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0e75ffb640 1 -- 172.21.15.120:0/3568541403 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e78004450 con 0x7f0e8014da20 2024-07-27T03:08:44.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0e75ffb640 1 -- 172.21.15.120:0/3568541403 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78004820 con 0x7f0e8014da20 2024-07-27T03:08:44.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7f0e877ce640 1 -- 172.21.15.120:0/3568541403 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8009de70 con 0x7f0e8014da20 2024-07-27T03:08:44.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.777+0000 7f0e877ce640 1 -- 172.21.15.120:0/3568541403 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e801fd690 con 0x7f0e8014da20 2024-07-27T03:08:44.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.777+0000 7f59a6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a80cf4e0 0x7f59a8156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46832/0 (socket says 172.21.15.120:46832) 2024-07-27T03:08:44.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.777+0000 7f59a6ffd640 1 -- 172.21.15.120:0/1813568810 learned_addr learned my addr 172.21.15.120:0/1813568810 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.777+0000 7f59a7fff640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59a815e9d0 0x7f59a8159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.777+0000 7f59a7fff640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59a815ede0 0x7f59a815a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.777+0000 7f59a67fc640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59a815e9d0 0x7f59a8159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.777+0000 7f59a7fff640 1 -- 172.21.15.120:0/1813568810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f59a81626d0 con 0x7f59a80cf4e0 2024-07-27T03:08:44.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.777+0000 7f59a7fff640 1 -- 172.21.15.120:0/1813568810 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f59a8070980 con 0x7f59a815e9d0 2024-07-27T03:08:44.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.777+0000 7f59a77fe640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59a815ede0 0x7f59a815a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7f59a7fff640 1 -- 172.21.15.120:0/1813568810 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f59a8162850 con 0x7f59a815ede0 2024-07-27T03:08:44.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7fa63e622640 1 -- 172.21.15.120:0/2664823217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6380b33f0 msgr2=0x7fa638154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7f1bc359e640 1 Processor -- start 2024-07-27T03:08:44.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7fa63e622640 1 --2- 172.21.15.120:0/2664823217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6380b33f0 0x7fa638154ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa63000adb0 tx=0x7fa63002a8c0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7f1bc359e640 1 -- start start 2024-07-27T03:08:44.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7fa63e622640 1 -- 172.21.15.120:0/2664823217 shutdown_connections 2024-07-27T03:08:44.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7fa63e622640 1 --2- 172.21.15.120:0/2664823217 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa638073340 0x7fa638070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7fa63e622640 1 --2- 172.21.15.120:0/2664823217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa6380b33f0 0x7fa638154ca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7fa63e622640 1 -- 172.21.15.120:0/2664823217 >> 172.21.15.120:0/2664823217 conn(0x7fa6380b2a30 msgr2=0x7fa6380d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:44.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7f0ca11f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c0cfbd0 0x7f0c9c1f8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7f0ca11f5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c9c0d21b0 0x7f0c9c1f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7f0ca11f5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c9c15e5b0 0x7f0c9c14a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7f0ca11f5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c0cf160 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7f0ca11f5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c0d27d0 con 0x7f0c9c0cfbd0 2024-07-27T03:08:44.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.778+0000 7f0ca11f5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0c9c0cf2e0 con 0x7f0c9c0d21b0 2024-07-27T03:08:44.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0ca09f4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c9c15e5b0 0x7f0c9c14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f59a6ffd640 1 -- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59a815ede0 msgr2=0x7f59a815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0ca09f4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c9c15e5b0 0x7f0c9c14a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46848/0 (socket says 172.21.15.120:46848) 2024-07-27T03:08:44.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0ca09f4640 1 -- 172.21.15.120:0/1721023086 learned_addr learned my addr 172.21.15.120:0/1721023086 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0c9b7fe640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c9c0d21b0 0x7f0c9c1f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0c63efa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c54005bf0 0x7f0c54031a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0c63efa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c54051620 0x7f0c5404dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f59a6ffd640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59a815ede0 0x7f59a815a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f59a6ffd640 1 -- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59a815e9d0 msgr2=0x7f59a8159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f59a6ffd640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59a815e9d0 0x7f59a8159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f59a6ffd640 1 -- 172.21.15.120:0/1813568810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a8072fe0 con 0x7f59a80cf4e0 2024-07-27T03:08:44.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7fd171691640 1 Processor -- start 2024-07-27T03:08:44.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.776+0000 7fd171691640 1 -- start start 2024-07-27T03:08:44.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fd171691640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd164007180 0x7fd164108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fd171691640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd164103920 0x7fd164031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fd171691640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd164103360 0x7fd1640319a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fd171691640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd164100cd0 con 0x7fd164007180 2024-07-27T03:08:44.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fd171691640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd164055700 con 0x7fd164103920 2024-07-27T03:08:44.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fd171691640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd164100e50 con 0x7fd164103360 2024-07-27T03:08:44.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0c63efa640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c54052350 0x7f0c5404e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0e75ffb640 1 -- 172.21.15.120:0/3568541403 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0e78036070 con 0x7f0e8014da20 2024-07-27T03:08:44.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fd16a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd164103920 0x7fd164031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fd16a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd164103920 0x7fd164031460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.120:41054/0 (socket says 172.21.15.120:41054) 2024-07-27T03:08:44.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fd16a7fc640 1 -- 172.21.15.120:0/2713375987 learned_addr learned my addr 172.21.15.120:0/2713375987 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fd16bfff640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd164103360 0x7fd1640319a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fd16affd640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd164007180 0x7fd164108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0c63efa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0c540520f0 con 0x7f0c54005bf0 2024-07-27T03:08:44.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0c63efa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0c54051f70 con 0x7f0c54051620 2024-07-27T03:08:44.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0c61495640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c54051620 0x7f0c5404dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0c63efa640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0c54052760 con 0x7f0c54052350 2024-07-27T03:08:44.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0c61495640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c54051620 0x7f0c5404dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.120:41060/0 (socket says 172.21.15.120:41060) 2024-07-27T03:08:44.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0c61495640 1 -- 172.21.15.120:0/2137142160 learned_addr learned my addr 172.21.15.120:0/2137142160 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0c62497640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c54052350 0x7f0c5404e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fa63e622640 1 -- 172.21.15.120:0/2664823217 shutdown_connections 2024-07-27T03:08:44.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7fa63e622640 1 -- 172.21.15.120:0/2664823217 wait complete. 2024-07-27T03:08:44.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0ca09f4640 1 -- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c9c0d21b0 msgr2=0x7f0c9c1f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0ca09f4640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c9c0d21b0 0x7f0c9c1f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0ca09f4640 1 -- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c0cfbd0 msgr2=0x7f0c9c1f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0ca09f4640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c0cfbd0 0x7f0c9c1f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0ca09f4640 1 -- 172.21.15.120:0/1721023086 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c0b4890 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f1518e4d640 1 -- 172.21.15.120:0/3601990980 shutdown_connections 2024-07-27T03:08:44.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f1518e4d640 1 -- 172.21.15.120:0/3601990980 wait complete. 2024-07-27T03:08:44.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.779+0000 7f0e877ce640 1 -- 172.21.15.120:0/3568541403 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e8006e270 con 0x7f0e8014da20 2024-07-27T03:08:44.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f59a67fc640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59a815e9d0 0x7f59a8159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:44.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7fd16bfff640 1 -- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd164103920 msgr2=0x7fd164031460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7fd16bfff640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd164103920 0x7fd164031460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7fd16bfff640 1 -- 172.21.15.120:0/2713375987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd164007180 msgr2=0x7fd164108ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7fd16bfff640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd164007180 0x7fd164108ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7fd16bfff640 1 -- 172.21.15.120:0/2713375987 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1641045e0 con 0x7fd164103360 2024-07-27T03:08:44.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f0e75ffb640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0e640770e0 0x7f0e640795f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f0e75ffb640 1 -- 172.21.15.120:0/3568541403 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0e780b9d70 con 0x7f0e8014da20 2024-07-27T03:08:44.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f0c62497640 1 -- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c54051620 msgr2=0x7f0c5404dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f0c62497640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c54051620 0x7f0c5404dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f0c62497640 1 -- 172.21.15.120:0/2137142160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c54005bf0 msgr2=0x7f0c54031a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-27T03:08:44.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f0c62497640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c54005bf0 0x7f0c54031a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f0c62497640 1 -- 172.21.15.120:0/2137142160 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5417e070 con 0x7f0c54052350 2024-07-27T03:08:44.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f0c62497640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c54052350 0x7f0c5404e2e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00e580 tx=0x7f0c4c00ea40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f59a6ffd640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a80cf4e0 0x7f59a8156b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f59a000bd60 tx=0x7f59a0009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f0ca09f4640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c9c15e5b0 0x7f0c9c14a390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400ba10 tx=0x7f0c9400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f0e8556a640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0e640770e0 0x7f0e640795f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f599ffff640 1 -- 172.21.15.120:0/1813568810 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a0019070 con 0x7f59a80cf4e0 2024-07-27T03:08:44.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7fd16bfff640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd164103360 0x7fd1640319a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd16c052380 tx=0x7fd16c06a9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f1bc359e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc01caf0 0x7f1bbc0d9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f1bc359e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bbc038820 0x7f1bbc0348f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f1bc359e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0df640 0x7f1bbc034e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f0c527fc640 1 -- 172.21.15.120:0/2137142160 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c004220 con 0x7f0c54052350 2024-07-27T03:08:44.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f1bc359e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc0366f0 con 0x7f1bbc01caf0 2024-07-27T03:08:44.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f1bc359e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc036570 con 0x7f1bbc0df640 2024-07-27T03:08:44.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7f1bc359e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1bbc036870 con 0x7f1bbc038820 2024-07-27T03:08:44.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7fd1637fe640 1 -- 172.21.15.120:0/2713375987 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c082600 con 0x7fd164103360 2024-07-27T03:08:44.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f599ffff640 1 -- 172.21.15.120:0/1813568810 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59a000cd90 con 0x7f59a80cf4e0 2024-07-27T03:08:44.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7fd1637fe640 1 -- 172.21.15.120:0/2713375987 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd16c0828d0 con 0x7fd164103360 2024-07-27T03:08:44.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.780+0000 7fd1637fe640 1 -- 172.21.15.120:0/2713375987 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c082de0 con 0x7fd164103360 2024-07-27T03:08:44.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f0c527fc640 1 -- 172.21.15.120:0/2137142160 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c4c005020 con 0x7f0c54052350 2024-07-27T03:08:44.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f1bc259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc01caf0 0x7f1bbc0d9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f1bc259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc01caf0 0x7f1bbc0d9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46866/0 (socket says 172.21.15.120:46866) 2024-07-27T03:08:44.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f1bc259c640 1 -- 172.21.15.120:0/1888727252 learned_addr learned my addr 172.21.15.120:0/1888727252 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f0c98ff9640 1 -- 172.21.15.120:0/1721023086 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94019070 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f0c98ff9640 1 -- 172.21.15.120:0/1721023086 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c9400ccb0 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f0c98ff9640 1 -- 172.21.15.120:0/1721023086 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c940146a0 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f0e8556a640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0e640770e0 0x7f0e640795f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000b810 tx=0x7f0e70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f1bc1d9b640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bbc038820 0x7f1bbc0348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7fd171691640 1 -- 172.21.15.120:0/2713375987 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1641a3700 con 0x7fd164103360 2024-07-27T03:08:44.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7fd171691640 1 -- 172.21.15.120:0/2713375987 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1641a3cc0 con 0x7fd164103360 2024-07-27T03:08:44.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f0c527fc640 1 -- 172.21.15.120:0/2137142160 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c005470 con 0x7f0c54052350 2024-07-27T03:08:44.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f599ffff640 1 -- 172.21.15.120:0/1813568810 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a00146a0 con 0x7f59a80cf4e0 2024-07-27T03:08:44.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f59a7fff640 1 -- 172.21.15.120:0/1813568810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a80732c0 con 0x7f59a80cf4e0 2024-07-27T03:08:44.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.781+0000 7f59a7fff640 1 -- 172.21.15.120:0/1813568810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a8073880 con 0x7f59a80cf4e0 2024-07-27T03:08:44.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f0c63efa640 1 -- 172.21.15.120:0/2137142160 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5417d460 con 0x7f0c54052350 2024-07-27T03:08:44.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f1bc2d9d640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0df640 0x7f1bbc034e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f0c63efa640 1 -- 172.21.15.120:0/2137142160 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c5417da20 con 0x7f0c54052350 2024-07-27T03:08:44.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1721023086 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9c0b2e70 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f599dffb640 1 -- 172.21.15.120:0/1813568810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a8162d40 con 0x7f59a80cf4e0 2024-07-27T03:08:44.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1721023086 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c9c0b33f0 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7fa63e622640 1 Processor -- start 2024-07-27T03:08:44.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.783+0000 7fa63e622640 1 -- start start 2024-07-27T03:08:44.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f1518e4d640 1 Processor -- start 2024-07-27T03:08:44.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f1518e4d640 1 -- start start 2024-07-27T03:08:44.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f1bc1d9b640 1 -- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0df640 msgr2=0x7f1bbc034e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f1bc1d9b640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0df640 0x7f1bbc034e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f1bc1d9b640 1 -- 172.21.15.120:0/1888727252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc01caf0 msgr2=0x7f1bbc0d9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f1bc1d9b640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc01caf0 0x7f1bbc0d9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.782+0000 7f1bc1d9b640 1 -- 172.21.15.120:0/1888727252 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc0d9bb0 con 0x7f1bbc038820 2024-07-27T03:08:44.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.783+0000 7f1bc1d9b640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bbc038820 0x7f1bbc0348f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8031000 tx=0x7f1bb8004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.783+0000 7fd171691640 1 -- 172.21.15.120:0/2713375987 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1641a4380 con 0x7fd164103360 2024-07-27T03:08:44.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.784+0000 7f0c63efa640 1 -- 172.21.15.120:0/2137142160 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c5417d1d0 con 0x7f0c54052350 2024-07-27T03:08:44.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.784+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1721023086 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c9c0cf760 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.783+0000 7f1bb2ffd640 1 -- 172.21.15.120:0/1888727252 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80037f0 con 0x7f1bbc038820 2024-07-27T03:08:44.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.783+0000 7f1bb2ffd640 1 -- 172.21.15.120:0/1888727252 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bb8003a80 con 0x7f1bbc038820 2024-07-27T03:08:44.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7fa63e622640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa638070050 0x7fa6381591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7fa63e622640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6380b33f0 0x7fa6381e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7fa63e622640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6381e5040 0x7fa6381f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7fa63e622640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa638068b00 con 0x7fa638070050 2024-07-27T03:08:44.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7fa63e622640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa638068980 con 0x7fa6380b33f0 2024-07-27T03:08:44.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7fa63e622640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa638068c80 con 0x7fa6381e5040 2024-07-27T03:08:44.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7fa637fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa638070050 0x7fa6381591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7fa637fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa638070050 0x7fa6381591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46874/0 (socket says 172.21.15.120:46874) 2024-07-27T03:08:44.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7fa637fff640 1 -- 172.21.15.120:0/825503003 learned_addr learned my addr 172.21.15.120:0/825503003 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f599ffff640 1 -- 172.21.15.120:0/1813568810 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f59a001c070 con 0x7f59a80cf4e0 2024-07-27T03:08:44.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7fa6377fe640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6380b33f0 0x7fa6381e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7fa63cbbf640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6381e5040 0x7fa6381f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1518e4d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f150c005c50 0x7f150c0479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1518e4d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f150c009b90 0x7f150c0e19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1518e4d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f150c036960 0x7f150c0e1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1518e4d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f150c00bda0 con 0x7f150c036960 2024-07-27T03:08:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1518e4d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f150c00bc20 con 0x7f150c005c50 2024-07-27T03:08:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1518e4d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f150c01cae0 con 0x7f150c009b90 2024-07-27T03:08:44.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1513fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f150c036960 0x7f150c0e1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1513fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f150c036960 0x7f150c0e1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46876/0 (socket says 172.21.15.120:46876) 2024-07-27T03:08:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1513fff640 1 -- 172.21.15.120:0/1401069134 learned_addr learned my addr 172.21.15.120:0/1401069134 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f15137fe640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f150c005c50 0x7f150c0479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1513fff640 1 -- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f150c009b90 msgr2=0x7f150c0e19a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-27T03:08:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1513fff640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f150c009b90 0x7f150c0e19a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1513fff640 1 -- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f150c005c50 msgr2=0x7f150c0479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1513fff640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f150c005c50 0x7f150c0479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1513fff640 1 -- 172.21.15.120:0/1401069134 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150c0dcb80 con 0x7f150c036960 2024-07-27T03:08:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f15137fe640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f150c005c50 0x7f150c0479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:08:44.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7f1513fff640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f150c036960 0x7f150c0e1ee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f151406b6a0 tx=0x7f151406a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.784+0000 7f1bb2ffd640 1 -- 172.21.15.120:0/1888727252 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb803b410 con 0x7f1bbc038820 2024-07-27T03:08:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.784+0000 7f1bc359e640 1 -- 172.21.15.120:0/1888727252 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bbc0de0c0 con 0x7f1bbc038820 2024-07-27T03:08:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.784+0000 7f1bc359e640 1 -- 172.21.15.120:0/1888727252 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bbc0de680 con 0x7f1bbc038820 2024-07-27T03:08:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7fa6377fe640 1 -- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6381e5040 msgr2=0x7fa6381f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7fa6377fe640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6381e5040 0x7fa6381f43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7fa6377fe640 1 -- 172.21.15.120:0/825503003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa638070050 msgr2=0x7fa6381591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7fa6377fe640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa638070050 0x7fa6381591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:44.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7f1bc359e640 1 -- 172.21.15.120:0/1888727252 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bbc0dde30 con 0x7f1bbc038820 2024-07-27T03:08:44.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7f599ffff640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f59900770e0 0x7f59900795f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7fa6377fe640 1 -- 172.21.15.120:0/825503003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6381e5810 con 0x7fa6380b33f0 2024-07-27T03:08:44.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.785+0000 7fd1637fe640 1 -- 172.21.15.120:0/2713375987 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd16c08c3f0 con 0x7fd164103360 2024-07-27T03:08:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7fa637fff640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa638070050 0x7fa6381591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:08:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7f59a67fc640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f59900770e0 0x7f59900795f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7f599ffff640 1 -- 172.21.15.120:0/1813568810 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f59a0098bd0 con 0x7f59a80cf4e0 2024-07-27T03:08:44.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7fa6377fe640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6380b33f0 0x7fa6381e4b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa62800c340 tx=0x7fa62800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7fd1637fe640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd14c077110 0x7fd14c079620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.786+0000 7fd1637fe640 1 -- 172.21.15.120:0/2713375987 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd16c102570 con 0x7fd164103360 2024-07-27T03:08:44.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.787+0000 7f59a67fc640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f59900770e0 0x7f59900795f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5994033000 tx=0x7f5994004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.787+0000 7fa634ff9640 1 -- 172.21.15.120:0/825503003 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628017070 con 0x7fa6380b33f0 2024-07-27T03:08:44.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.787+0000 7fa63e622640 1 -- 172.21.15.120:0/825503003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6381f20b0 con 0x7fa6380b33f0 2024-07-27T03:08:44.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.787+0000 7f0c527fc640 1 -- 172.21.15.120:0/2137142160 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0c4c0047a0 con 0x7f0c54052350 2024-07-27T03:08:44.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.787+0000 7fa63e622640 1 -- 172.21.15.120:0/825503003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6381f3c10 con 0x7fa6380b33f0 2024-07-27T03:08:44.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.787+0000 7fa634ff9640 1 -- 172.21.15.120:0/825503003 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6280053c0 con 0x7fa6380b33f0 2024-07-27T03:08:44.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.787+0000 7fa634ff9640 1 -- 172.21.15.120:0/825503003 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628003850 con 0x7fa6380b33f0 2024-07-27T03:08:44.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.787+0000 7f0e75ffb640 1 -- 172.21.15.120:0/3568541403 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f0e8009de70 con 0x7f0e8014da20 2024-07-27T03:08:44.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.787+0000 7f1bb2ffd640 1 -- 172.21.15.120:0/1888727252 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1bb803b5b0 con 0x7f1bbc038820 2024-07-27T03:08:44.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.787+0000 7f0c527fc640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c40077040 0x7f0c40079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.788+0000 7f0c527fc640 1 -- 172.21.15.120:0/2137142160 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0c4c099030 con 0x7f0c54052350 2024-07-27T03:08:44.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.788+0000 7f1bb2ffd640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1ba4077090 0x7f1ba40795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.788+0000 7fd16affd640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd14c077110 0x7fd14c079620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.788+0000 7f0c61c96640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c40077040 0x7f0c40079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.788+0000 7f1bb2ffd640 1 -- 172.21.15.120:0/1888727252 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1bb80b9c00 con 0x7f1bbc038820 2024-07-27T03:08:44.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.788+0000 7f1bc259c640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1ba4077090 0x7f1ba40795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.788+0000 7fd16affd640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd14c077110 0x7fd14c079620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd154034000 tx=0x7fd154004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.788+0000 7fa63e622640 1 -- 172.21.15.120:0/825503003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa61c005290 con 0x7fa6380b33f0 2024-07-27T03:08:44.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.789+0000 7f0c61c96640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c40077040 0x7f0c40079550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c54051310 tx=0x7f0c5c072040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.789+0000 7f1bc259c640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1ba4077090 0x7f1ba40795a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40017d0 tx=0x7f1bb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.790+0000 7fa634ff9640 1 -- 172.21.15.120:0/825503003 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fa62801a070 con 0x7fa6380b33f0 2024-07-27T03:08:44.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.790+0000 7fa634ff9640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa618077040 0x7fa618079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.790+0000 7fa634ff9640 1 -- 172.21.15.120:0/825503003 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa628097b30 con 0x7fa6380b33f0 2024-07-27T03:08:44.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.790+0000 7fa637fff640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa618077040 0x7fa618079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.791+0000 7f599ffff640 1 -- 172.21.15.120:0/1813568810 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f59a0098e20 con 0x7f59a80cf4e0 2024-07-27T03:08:44.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.791+0000 7f14fffff640 1 -- 172.21.15.120:0/1401069134 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140b3050 con 0x7f150c036960 2024-07-27T03:08:44.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.791+0000 7f1518e4d640 1 -- 172.21.15.120:0/1401069134 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150c0dc7f0 con 0x7f150c036960 2024-07-27T03:08:44.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.791+0000 7f1518e4d640 1 -- 172.21.15.120:0/1401069134 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f150c0dd100 con 0x7f150c036960 2024-07-27T03:08:44.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.791+0000 7f14fffff640 1 -- 172.21.15.120:0/1401069134 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15140d0070 con 0x7f150c036960 2024-07-27T03:08:44.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.791+0000 7f14fffff640 1 -- 172.21.15.120:0/1401069134 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15140c9b10 con 0x7f150c036960 2024-07-27T03:08:44.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.792+0000 7fa637fff640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa618077040 0x7fa618079550 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa63000adb0 tx=0x7fa630004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.792+0000 7f1518e4d640 1 -- 172.21.15.120:0/1401069134 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f4005290 con 0x7f150c036960 2024-07-27T03:08:44.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.793+0000 7f0c98ff9640 1 -- 172.21.15.120:0/1721023086 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0c9401c070 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.794+0000 7f0c98ff9640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c880770e0 0x7f0c880795f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.794+0000 7f0c98ff9640 1 -- 172.21.15.120:0/1721023086 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0c94098f40 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.794+0000 7fd1637fe640 1 -- 172.21.15.120:0/2713375987 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd1641a4380 con 0x7fd164103360 2024-07-27T03:08:44.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.794+0000 7f0c9bfff640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c880770e0 0x7f0c880795f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.795+0000 7f0c9bfff640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c880770e0 0x7f0c880795f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c90033000 tx=0x7f0c900046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.797+0000 7f0c98ff9640 1 -- 172.21.15.120:0/1721023086 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f0c94023070 con 0x7f0c9c15e5b0 2024-07-27T03:08:44.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.799+0000 7f14fffff640 1 -- 172.21.15.120:0/1401069134 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f15140c9cb0 con 0x7f150c036960 2024-07-27T03:08:44.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.800+0000 7f14fffff640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f8077040 0x7f14f8079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:44.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.800+0000 7f14fffff640 1 -- 172.21.15.120:0/1401069134 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1514146270 con 0x7f150c036960 2024-07-27T03:08:44.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.800+0000 7f15137fe640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f8077040 0x7f14f8079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:44.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.800+0000 7fa634ff9640 1 -- 172.21.15.120:0/825503003 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fa628060640 con 0x7fa6380b33f0 2024-07-27T03:08:44.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.801+0000 7f15137fe640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f8077040 0x7f14f8079550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1500009aa0 tx=0x7f1500005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:44.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.802+0000 7f0c527fc640 1 -- 172.21.15.120:0/2137142160 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f0c4c0622b0 con 0x7f0c54052350 2024-07-27T03:08:44.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.806+0000 7f14fffff640 1 -- 172.21.15.120:0/1401069134 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f151410f470 con 0x7f150c036960 2024-07-27T03:08:44.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:44.807+0000 7f1bb2ffd640 1 -- 172.21.15.120:0/1888727252 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f1bb803f030 con 0x7f1bbc038820 2024-07-27T03:08:45.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.216+0000 7f0e877ce640 1 -- 172.21.15.120:0/3568541403 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0e800cf9f0 con 0x7f0e8014da20 2024-07-27T03:08:45.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.217+0000 7f0e75ffb640 1 -- 172.21.15.120:0/3568541403 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e78082f50 con 0x7f0e8014da20 2024-07-27T03:08:45.219 INFO:teuthology.orchestra.run.smithi120.stdout:64424509447 2024-07-27T03:08:45.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.220+0000 7f0e6b7fe640 1 -- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0e640770e0 msgr2=0x7f0e640795f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.220+0000 7f0e6b7fe640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0e640770e0 0x7f0e640795f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000b810 tx=0x7f0e70008040 comp rx=0 tx=0).stop 2024-07-27T03:08:45.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.220+0000 7f0e6b7fe640 1 -- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e8014da20 msgr2=0x7f0e800b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.221+0000 7f0e6b7fe640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e8014da20 0x7f0e800b42a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e7802afd0 tx=0x7f0e78003f10 comp rx=0 tx=0).stop 2024-07-27T03:08:45.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.221+0000 7f0e6b7fe640 1 -- 172.21.15.120:0/3568541403 shutdown_connections 2024-07-27T03:08:45.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.221+0000 7f0e6b7fe640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0e640770e0 0x7f0e640795f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.221+0000 7f0e6b7fe640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e8014da20 0x7f0e800b42a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.221+0000 7f0e6b7fe640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0e8015ea00 0x7f0e800b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.221+0000 7f0e6b7fe640 1 --2- 172.21.15.120:0/3568541403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e801554a0 0x7f0e800b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.221+0000 7f0e6b7fe640 1 -- 172.21.15.120:0/3568541403 >> 172.21.15.120:0/3568541403 conn(0x7f0e8006cdb0 msgr2=0x7f0e801604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.221+0000 7f0e6b7fe640 1 -- 172.21.15.120:0/3568541403 shutdown_connections 2024-07-27T03:08:45.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.221+0000 7f0e6b7fe640 1 -- 172.21.15.120:0/3568541403 wait complete. 2024-07-27T03:08:45.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.232+0000 7f599dffb640 1 -- 172.21.15.120:0/1813568810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f59a8157080 con 0x7f59a80cf4e0 2024-07-27T03:08:45.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.233+0000 7f599ffff640 1 -- 172.21.15.120:0/1813568810 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f59a0023020 con 0x7f59a80cf4e0 2024-07-27T03:08:45.238 INFO:teuthology.orchestra.run.smithi120.stdout:60129542151 2024-07-27T03:08:45.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.236+0000 7f599dffb640 1 -- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f59900770e0 msgr2=0x7f59900795f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.236+0000 7f599dffb640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f59900770e0 0x7f59900795f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5994033000 tx=0x7f5994004730 comp rx=0 tx=0).stop 2024-07-27T03:08:45.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.236+0000 7f599dffb640 1 -- 172.21.15.120:0/1813568810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a80cf4e0 msgr2=0x7f59a8156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.236+0000 7f599dffb640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a80cf4e0 0x7f59a8156b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f59a000bd60 tx=0x7f59a0009f10 comp rx=0 tx=0).stop 2024-07-27T03:08:45.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.236+0000 7f599dffb640 1 -- 172.21.15.120:0/1813568810 shutdown_connections 2024-07-27T03:08:45.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.236+0000 7f599dffb640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f59900770e0 0x7f59900795f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.236+0000 7f599dffb640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59a815ede0 0x7f59a815a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.237+0000 7f599dffb640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59a815e9d0 0x7f59a8159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.237+0000 7f599dffb640 1 --2- 172.21.15.120:0/1813568810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f59a80cf4e0 0x7f59a8156b40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.237+0000 7f599dffb640 1 -- 172.21.15.120:0/1813568810 >> 172.21.15.120:0/1813568810 conn(0x7f59a80cfa90 msgr2=0x7f59a80ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.237+0000 7f599dffb640 1 -- 172.21.15.120:0/1813568810 shutdown_connections 2024-07-27T03:08:45.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.237+0000 7f599dffb640 1 -- 172.21.15.120:0/1813568810 wait complete. 2024-07-27T03:08:45.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-07-27T03:08:45.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.239+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1721023086 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0c9c15c4f0 con 0x7f0c9c15e5b0 2024-07-27T03:08:45.242 DEBUG:teuthology.parallel:result is None 2024-07-27T03:08:45.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.239+0000 7f0c98ff9640 1 -- 172.21.15.120:0/1721023086 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c9c0b4890 con 0x7f0c9c15e5b0 2024-07-27T03:08:45.242 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-07-27T03:08:45.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.242+0000 7fa63e622640 1 -- 172.21.15.120:0/825503003 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa61c005580 con 0x7fa6380b33f0 2024-07-27T03:08:45.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.242+0000 7fa634ff9640 1 -- 172.21.15.120:0/825503003 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa628064b90 con 0x7fa6380b33f0 2024-07-27T03:08:45.245 INFO:teuthology.orchestra.run.smithi120.stdout:64424509446 2024-07-27T03:08:45.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c880770e0 msgr2=0x7f0c880795f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c880770e0 0x7f0c880795f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c90033000 tx=0x7f0c900046c0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1721023086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c9c15e5b0 msgr2=0x7f0c9c14a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c9c15e5b0 0x7f0c9c14a390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400ba10 tx=0x7f0c9400bed0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1721023086 shutdown_connections 2024-07-27T03:08:45.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c880770e0 0x7f0c880795f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c9c15e5b0 0x7f0c9c14a390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c9c0d21b0 0x7f0c9c1f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 --2- 172.21.15.120:0/1721023086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c0cfbd0 0x7f0c9c1f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1721023086 >> 172.21.15.120:0/1721023086 conn(0x7f0c9c09d130 msgr2=0x7f0c9c0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1721023086 shutdown_connections 2024-07-27T03:08:45.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.243+0000 7f0ca11f5640 1 -- 172.21.15.120:0/1721023086 wait complete. 2024-07-27T03:08:45.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.245+0000 7fa63e622640 1 -- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa618077040 msgr2=0x7fa618079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.245+0000 7fa63e622640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa618077040 0x7fa618079550 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa63000adb0 tx=0x7fa630004ab0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.245+0000 7fa63e622640 1 -- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6380b33f0 msgr2=0x7fa6381e4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.245+0000 7fa63e622640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6380b33f0 0x7fa6381e4b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa62800c340 tx=0x7fa62800c800 comp rx=0 tx=0).stop 2024-07-27T03:08:45.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.248+0000 7fa63e622640 1 -- 172.21.15.120:0/825503003 shutdown_connections 2024-07-27T03:08:45.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.248+0000 7fa63e622640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa618077040 0x7fa618079550 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.248+0000 7fa63e622640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6381e5040 0x7fa6381f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.248+0000 7fa63e622640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6380b33f0 0x7fa6381e4b00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.248+0000 7fa63e622640 1 --2- 172.21.15.120:0/825503003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa638070050 0x7fa6381591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.248+0000 7fa63e622640 1 -- 172.21.15.120:0/825503003 >> 172.21.15.120:0/825503003 conn(0x7fa6380b2a30 msgr2=0x7fa6380cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.248+0000 7fa63e622640 1 -- 172.21.15.120:0/825503003 shutdown_connections 2024-07-27T03:08:45.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.248+0000 7fa63e622640 1 -- 172.21.15.120:0/825503003 wait complete. 2024-07-27T03:08:45.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.249+0000 7f0c63efa640 1 -- 172.21.15.120:0/2137142160 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0c54009d70 con 0x7f0c54052350 2024-07-27T03:08:45.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.249+0000 7f0c527fc640 1 -- 172.21.15.120:0/2137142160 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c4c061bb0 con 0x7f0c54052350 2024-07-27T03:08:45.252 INFO:teuthology.orchestra.run.smithi120.stdout:64424509447 2024-07-27T03:08:45.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.250+0000 7f1bc359e640 1 -- 172.21.15.120:0/1888727252 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1bbc01c5b0 con 0x7f1bbc038820 2024-07-27T03:08:45.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.250+0000 7f1518e4d640 1 -- 172.21.15.120:0/1401069134 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f14f4005850 con 0x7f150c036960 2024-07-27T03:08:45.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.251+0000 7f14fffff640 1 -- 172.21.15.120:0/1401069134 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f151410ed70 con 0x7f150c036960 2024-07-27T03:08:45.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.251+0000 7fd171691640 1 -- 172.21.15.120:0/2713375987 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd164006b00 con 0x7fd164103360 2024-07-27T03:08:45.254 INFO:teuthology.orchestra.run.smithi120.stdout:64424509447 2024-07-27T03:08:45.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.251+0000 7f1bb2ffd640 1 -- 172.21.15.120:0/1888727252 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1bb8082ee0 con 0x7f1bbc038820 2024-07-27T03:08:45.254 INFO:teuthology.orchestra.run.smithi120.stdout:64424509448 2024-07-27T03:08:45.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.252+0000 7fd1637fe640 1 -- 172.21.15.120:0/2713375987 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd16c07e030 con 0x7fd164103360 2024-07-27T03:08:45.255 INFO:teuthology.orchestra.run.smithi120.stdout:60129542151 2024-07-27T03:08:45.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 -- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c40077040 msgr2=0x7f0c40079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c40077040 0x7f0c40079550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c54051310 tx=0x7f0c5c072040 comp rx=0 tx=0).stop 2024-07-27T03:08:45.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 -- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c54052350 msgr2=0x7f0c5404e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c54052350 0x7f0c5404e2e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00e580 tx=0x7f0c4c00ea40 comp rx=0 tx=0).stop 2024-07-27T03:08:45.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 -- 172.21.15.120:0/2137142160 shutdown_connections 2024-07-27T03:08:45.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0c40077040 0x7f0c40079550 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0c54052350 0x7f0c5404e2e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c54051620 0x7f0c5404dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 --2- 172.21.15.120:0/2137142160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c54005bf0 0x7f0c54031a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 -- 172.21.15.120:0/2137142160 >> 172.21.15.120:0/2137142160 conn(0x7f0c5401d990 msgr2=0x7f0c54054710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 -- 172.21.15.120:0/2137142160 shutdown_connections 2024-07-27T03:08:45.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.253+0000 7f0c63efa640 1 -- 172.21.15.120:0/2137142160 wait complete. 2024-07-27T03:08:45.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.254+0000 7f1bc359e640 1 -- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1ba4077090 msgr2=0x7f1ba40795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.254+0000 7f1bc359e640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1ba4077090 0x7f1ba40795a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40017d0 tx=0x7f1bb4009040 comp rx=0 tx=0).stop 2024-07-27T03:08:45.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2024-07-27T03:08:45.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.254+0000 7f1518e4d640 1 -- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f8077040 msgr2=0x7f14f8079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.254+0000 7f1518e4d640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f8077040 0x7f14f8079550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1500009aa0 tx=0x7f1500005f30 comp rx=0 tx=0).stop 2024-07-27T03:08:45.259 DEBUG:teuthology.parallel:result is None 2024-07-27T03:08:45.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.254+0000 7f1bc359e640 1 -- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bbc038820 msgr2=0x7f1bbc0348f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1bc359e640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bbc038820 0x7f1bbc0348f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8031000 tx=0x7f1bb8004270 comp rx=0 tx=0).stop 2024-07-27T03:08:45.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1bc359e640 1 -- 172.21.15.120:0/1888727252 shutdown_connections 2024-07-27T03:08:45.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1518e4d640 1 -- 172.21.15.120:0/1401069134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f150c036960 msgr2=0x7f150c0e1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1bc359e640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1ba4077090 0x7f1ba40795a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1518e4d640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f150c036960 0x7f150c0e1ee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f151406b6a0 tx=0x7f151406a490 comp rx=0 tx=0).stop 2024-07-27T03:08:45.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1bc359e640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bbc0df640 0x7f1bbc034e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1bc359e640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bbc038820 0x7f1bbc0348f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1bc359e640 1 --2- 172.21.15.120:0/1888727252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bbc01caf0 0x7f1bbc0d9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1bc359e640 1 -- 172.21.15.120:0/1888727252 >> 172.21.15.120:0/1888727252 conn(0x7f1bbc051420 msgr2=0x7f1bbc032690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1518e4d640 1 -- 172.21.15.120:0/1401069134 shutdown_connections 2024-07-27T03:08:45.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1bc359e640 1 -- 172.21.15.120:0/1888727252 shutdown_connections 2024-07-27T03:08:45.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1518e4d640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f8077040 0x7f14f8079550 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1518e4d640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f150c036960 0x7f150c0e1ee0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1bc359e640 1 -- 172.21.15.120:0/1888727252 wait complete. 2024-07-27T03:08:45.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1518e4d640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f150c009b90 0x7f150c0e19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1518e4d640 1 --2- 172.21.15.120:0/1401069134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f150c005c50 0x7f150c0479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1518e4d640 1 -- 172.21.15.120:0/1401069134 >> 172.21.15.120:0/1401069134 conn(0x7f150c051410 msgr2=0x7f150c0546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1518e4d640 1 -- 172.21.15.120:0/1401069134 shutdown_connections 2024-07-27T03:08:45.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7f1518e4d640 1 -- 172.21.15.120:0/1401069134 wait complete. 2024-07-27T03:08:45.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7fd171691640 1 -- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd14c077110 msgr2=0x7fd14c079620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7fd171691640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd14c077110 0x7fd14c079620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd154034000 tx=0x7fd154004730 comp rx=0 tx=0).stop 2024-07-27T03:08:45.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7fd171691640 1 -- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd164103360 msgr2=0x7fd1640319a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.255+0000 7fd171691640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd164103360 0x7fd1640319a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd16c052380 tx=0x7fd16c06a9e0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.256+0000 7fd171691640 1 -- 172.21.15.120:0/2713375987 shutdown_connections 2024-07-27T03:08:45.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.256+0000 7fd171691640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd14c077110 0x7fd14c079620 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.256+0000 7fd171691640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd164103360 0x7fd1640319a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.256+0000 7fd171691640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd164103920 0x7fd164031460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.256+0000 7fd171691640 1 --2- 172.21.15.120:0/2713375987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd164007180 0x7fd164108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.256+0000 7fd171691640 1 -- 172.21.15.120:0/2713375987 >> 172.21.15.120:0/2713375987 conn(0x7fd16401db70 msgr2=0x7fd16400a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.256+0000 7fd171691640 1 -- 172.21.15.120:0/2713375987 shutdown_connections 2024-07-27T03:08:45.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.256+0000 7fd171691640 1 -- 172.21.15.120:0/2713375987 wait complete. 2024-07-27T03:08:45.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-07-27T03:08:45.267 DEBUG:teuthology.parallel:result is None 2024-07-27T03:08:45.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-07-27T03:08:45.270 DEBUG:teuthology.parallel:result is None 2024-07-27T03:08:45.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-07-27T03:08:45.275 DEBUG:teuthology.parallel:result is None 2024-07-27T03:08:45.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-07-27T03:08:45.275 DEBUG:teuthology.parallel:result is None 2024-07-27T03:08:45.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-07-27T03:08:45.279 DEBUG:teuthology.parallel:result is None 2024-07-27T03:08:45.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2024-07-27T03:08:45.279 DEBUG:teuthology.parallel:result is None 2024-07-27T03:08:45.279 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-27T03:08:45.280 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:08:45.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.429+0000 7f76788bf640 1 -- 172.21.15.120:0/191347685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f765c003c30 msgr2=0x7f765c004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.429+0000 7f76788bf640 1 --2- 172.21.15.120:0/191347685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f765c003c30 0x7f765c004080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7664009b50 tx=0x7f765c005830 comp rx=0 tx=0).stop 2024-07-27T03:08:45.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.429+0000 7f76788bf640 1 -- 172.21.15.120:0/191347685 shutdown_connections 2024-07-27T03:08:45.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.429+0000 7f76788bf640 1 --2- 172.21.15.120:0/191347685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f765c003c30 0x7f765c004080 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.429+0000 7f76788bf640 1 -- 172.21.15.120:0/191347685 >> 172.21.15.120:0/191347685 conn(0x7f76740d0f00 msgr2=0x7f76740d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.430+0000 7f76788bf640 1 -- 172.21.15.120:0/191347685 shutdown_connections 2024-07-27T03:08:45.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.430+0000 7f76788bf640 1 -- 172.21.15.120:0/191347685 wait complete. 2024-07-27T03:08:45.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.431+0000 7f76788bf640 1 Processor -- start 2024-07-27T03:08:45.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.432+0000 7f76788bf640 1 -- start start 2024-07-27T03:08:45.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f76788bf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f765c003c30 0x7f76740cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:45.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f76788bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f767406c960 0x7f767406cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f76788bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7674150120 0x7f7674150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f76788bf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7674158f20 con 0x7f7674150120 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f76788bf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7674158da0 con 0x7f767406c960 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f76788bf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f76741590a0 con 0x7f765c003c30 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f7672d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7674150120 0x7f7674150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f7672d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7674150120 0x7f7674150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46894/0 (socket says 172.21.15.120:46894) 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f7672d9d640 1 -- 172.21.15.120:0/3430012895 learned_addr learned my addr 172.21.15.120:0/3430012895 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f767259c640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f765c003c30 0x7f76740cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f7671d9b640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f767406c960 0x7f767406cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f7672d9d640 1 -- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f765c003c30 msgr2=0x7f76740cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f7672d9d640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f765c003c30 0x7f76740cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f7672d9d640 1 -- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f767406c960 msgr2=0x7f767406cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f7672d9d640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f767406c960 0x7f767406cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f7672d9d640 1 -- 172.21.15.120:0/3430012895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76741f8790 con 0x7f7674150120 2024-07-27T03:08:45.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f7671d9b640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f767406c960 0x7f767406cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:45.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f767259c640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f765c003c30 0x7f76740cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:45.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.433+0000 7f7672d9d640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7674150120 0x7f7674150530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f766c000f80 tx=0x7f766c0064e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:45.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.434+0000 7f7662ffd640 1 -- 172.21.15.120:0/3430012895 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c010890 con 0x7f7674150120 2024-07-27T03:08:45.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.434+0000 7f7662ffd640 1 -- 172.21.15.120:0/3430012895 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f766c017070 con 0x7f7674150120 2024-07-27T03:08:45.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.434+0000 7f76788bf640 1 -- 172.21.15.120:0/3430012895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76741f8a70 con 0x7f7674150120 2024-07-27T03:08:45.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.434+0000 7f7662ffd640 1 -- 172.21.15.120:0/3430012895 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c010da0 con 0x7f7674150120 2024-07-27T03:08:45.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.434+0000 7f76788bf640 1 -- 172.21.15.120:0/3430012895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76741f9030 con 0x7f7674150120 2024-07-27T03:08:45.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.435+0000 7f76788bf640 1 -- 172.21.15.120:0/3430012895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76740d1ad0 con 0x7f7674150120 2024-07-27T03:08:45.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.435+0000 7f7662ffd640 1 -- 172.21.15.120:0/3430012895 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f766c01c460 con 0x7f7674150120 2024-07-27T03:08:45.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.436+0000 7f7662ffd640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7654077010 0x7f7654079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:45.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.436+0000 7f7662ffd640 1 -- 172.21.15.120:0/3430012895 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f766c0992b0 con 0x7f7674150120 2024-07-27T03:08:45.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.436+0000 7f767259c640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7654077010 0x7f7654079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:45.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.437+0000 7f767259c640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7654077010 0x7f7654079520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7664035000 tx=0x7f76640046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:45.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.440+0000 7f7662ffd640 1 -- 172.21.15.120:0/3430012895 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f76740d1ad0 con 0x7f7674150120 2024-07-27T03:08:45.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.620+0000 7f76788bf640 1 -- 172.21.15.120:0/3430012895 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76741ef490 con 0x7f7654077010 2024-07-27T03:08:45.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.625+0000 7f7662ffd640 1 -- 172.21.15.120:0/3430012895 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f766402bbe0 con 0x7f7654077010 2024-07-27T03:08:45.630 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:45.631 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:08:45.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 -- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7654077010 msgr2=0x7f7654079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7654077010 0x7f7654079520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7664035000 tx=0x7f76640046c0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 -- 172.21.15.120:0/3430012895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7674150120 msgr2=0x7f7674150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7674150120 0x7f7674150530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f766c000f80 tx=0x7f766c0064e0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 -- 172.21.15.120:0/3430012895 shutdown_connections 2024-07-27T03:08:45.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7654077010 0x7f7654079520 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7674150120 0x7f7674150530 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f767406c960 0x7f767406cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 --2- 172.21.15.120:0/3430012895 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f765c003c30 0x7f76740cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 -- 172.21.15.120:0/3430012895 >> 172.21.15.120:0/3430012895 conn(0x7f76740d0f00 msgr2=0x7f76741548c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 -- 172.21.15.120:0/3430012895 shutdown_connections 2024-07-27T03:08:45.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.628+0000 7f76788bf640 1 -- 172.21.15.120:0/3430012895 wait complete. 2024-07-27T03:08:45.642 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-07-27T03:08:44.534007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219120,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755600,"statfs":{"total":773094113280,"available":772869734400,"internally_reserved":0,"allocated":3022848,"data_stored":1803844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002607"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650035+0000","last_change":"2024-07-27T03:08:33.948286+0000","last_active":"2024-07-27T03:08:37.650035+0000","last_peered":"2024-07-27T03:08:37.650035+0000","last_clean":"2024-07-27T03:08:37.650035+0000","last_became_active":"2024-07-27T03:08:33.947946+0000","last_became_peered":"2024-07-27T03:08:33.947946+0000","last_unstale":"2024-07-27T03:08:37.650035+0000","last_undegraded":"2024-07-27T03:08:37.650035+0000","last_fullsized":"2024-07-27T03:08:37.650035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:51.758397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930553+0000","last_change":"2024-07-27T03:08:33.951685+0000","last_active":"2024-07-27T03:08:34.930553+0000","last_peered":"2024-07-27T03:08:34.930553+0000","last_clean":"2024-07-27T03:08:34.930553+0000","last_became_active":"2024-07-27T03:08:33.951388+0000","last_became_peered":"2024-07-27T03:08:33.951388+0000","last_unstale":"2024-07-27T03:08:34.930553+0000","last_undegraded":"2024-07-27T03:08:34.930553+0000","last_fullsized":"2024-07-27T03:08:34.930553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868470+0000","last_change":"2024-07-27T03:08:33.949530+0000","last_active":"2024-07-27T03:08:36.868470+0000","last_peered":"2024-07-27T03:08:36.868470+0000","last_clean":"2024-07-27T03:08:36.868470+0000","last_became_active":"2024-07-27T03:08:33.948989+0000","last_became_peered":"2024-07-27T03:08:33.948989+0000","last_unstale":"2024-07-27T03:08:36.868470+0000","last_undegraded":"2024-07-27T03:08:36.868470+0000","last_fullsized":"2024-07-27T03:08:36.868470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:14.764441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932869+0000","last_change":"2024-07-27T03:08:33.957256+0000","last_active":"2024-07-27T03:08:34.932869+0000","last_peered":"2024-07-27T03:08:34.932869+0000","last_clean":"2024-07-27T03:08:34.932869+0000","last_became_active":"2024-07-27T03:08:33.956922+0000","last_became_peered":"2024-07-27T03:08:33.956922+0000","last_unstale":"2024-07-27T03:08:34.932869+0000","last_undegraded":"2024-07-27T03:08:34.932869+0000","last_fullsized":"2024-07-27T03:08:34.932869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:58.998778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649852+0000","last_change":"2024-07-27T03:08:33.947489+0000","last_active":"2024-07-27T03:08:37.649852+0000","last_peered":"2024-07-27T03:08:37.649852+0000","last_clean":"2024-07-27T03:08:37.649852+0000","last_became_active":"2024-07-27T03:08:33.947123+0000","last_became_peered":"2024-07-27T03:08:33.947123+0000","last_unstale":"2024-07-27T03:08:37.649852+0000","last_undegraded":"2024-07-27T03:08:37.649852+0000","last_fullsized":"2024-07-27T03:08:37.649852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:02:56.479634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932061+0000","last_change":"2024-07-27T03:08:33.960086+0000","last_active":"2024-07-27T03:08:34.932061+0000","last_peered":"2024-07-27T03:08:34.932061+0000","last_clean":"2024-07-27T03:08:34.932061+0000","last_became_active":"2024-07-27T03:08:33.956547+0000","last_became_peered":"2024-07-27T03:08:33.956547+0000","last_unstale":"2024-07-27T03:08:34.932061+0000","last_undegraded":"2024-07-27T03:08:34.932061+0000","last_fullsized":"2024-07-27T03:08:34.932061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:53:39.837754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649542+0000","last_change":"2024-07-27T03:08:33.958341+0000","last_active":"2024-07-27T03:08:37.649542+0000","last_peered":"2024-07-27T03:08:37.649542+0000","last_clean":"2024-07-27T03:08:37.649542+0000","last_became_active":"2024-07-27T03:08:33.958024+0000","last_became_peered":"2024-07-27T03:08:33.958024+0000","last_unstale":"2024-07-27T03:08:37.649542+0000","last_undegraded":"2024-07-27T03:08:37.649542+0000","last_fullsized":"2024-07-27T03:08:37.649542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:22.536071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825730+0000","last_change":"2024-07-27T03:08:33.959349+0000","last_active":"2024-07-27T03:08:35.825730+0000","last_peered":"2024-07-27T03:08:35.825730+0000","last_clean":"2024-07-27T03:08:35.825730+0000","last_became_active":"2024-07-27T03:08:33.959108+0000","last_became_peered":"2024-07-27T03:08:33.959108+0000","last_unstale":"2024-07-27T03:08:35.825730+0000","last_undegraded":"2024-07-27T03:08:35.825730+0000","last_fullsized":"2024-07-27T03:08:35.825730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:24:20.622662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650213+0000","last_change":"2024-07-27T03:08:33.959480+0000","last_active":"2024-07-27T03:08:37.650213+0000","last_peered":"2024-07-27T03:08:37.650213+0000","last_clean":"2024-07-27T03:08:37.650213+0000","last_became_active":"2024-07-27T03:08:33.959108+0000","last_became_peered":"2024-07-27T03:08:33.959108+0000","last_unstale":"2024-07-27T03:08:37.650213+0000","last_undegraded":"2024-07-27T03:08:37.650213+0000","last_fullsized":"2024-07-27T03:08:37.650213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:34:51.510109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934161+0000","last_change":"2024-07-27T03:08:33.952605+0000","last_active":"2024-07-27T03:08:35.934161+0000","last_peered":"2024-07-27T03:08:35.934161+0000","last_clean":"2024-07-27T03:08:35.934161+0000","last_became_active":"2024-07-27T03:08:33.952198+0000","last_became_peered":"2024-07-27T03:08:33.952198+0000","last_unstale":"2024-07-27T03:08:35.934161+0000","last_undegraded":"2024-07-27T03:08:35.934161+0000","last_fullsized":"2024-07-27T03:08:35.934161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934003+0000","last_change":"2024-07-27T03:08:33.960066+0000","last_active":"2024-07-27T03:08:35.934003+0000","last_peered":"2024-07-27T03:08:35.934003+0000","last_clean":"2024-07-27T03:08:35.934003+0000","last_became_active":"2024-07-27T03:08:33.959677+0000","last_became_peered":"2024-07-27T03:08:33.959677+0000","last_unstale":"2024-07-27T03:08:35.934003+0000","last_undegraded":"2024-07-27T03:08:35.934003+0000","last_fullsized":"2024-07-27T03:08:35.934003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:24:20.622662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932043+0000","last_change":"2024-07-27T03:08:33.951057+0000","last_active":"2024-07-27T03:08:34.932043+0000","last_peered":"2024-07-27T03:08:34.932043+0000","last_clean":"2024-07-27T03:08:34.932043+0000","last_became_active":"2024-07-27T03:08:33.950764+0000","last_became_peered":"2024-07-27T03:08:33.950764+0000","last_unstale":"2024-07-27T03:08:34.932043+0000","last_undegraded":"2024-07-27T03:08:34.932043+0000","last_fullsized":"2024-07-27T03:08:34.932043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:25.800481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825997+0000","last_change":"2024-07-27T03:08:33.954641+0000","last_active":"2024-07-27T03:08:35.825997+0000","last_peered":"2024-07-27T03:08:35.825997+0000","last_clean":"2024-07-27T03:08:35.825997+0000","last_became_active":"2024-07-27T03:08:33.953618+0000","last_became_peered":"2024-07-27T03:08:33.953618+0000","last_unstale":"2024-07-27T03:08:35.825997+0000","last_undegraded":"2024-07-27T03:08:35.825997+0000","last_fullsized":"2024-07-27T03:08:35.825997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.867964+0000","last_change":"2024-07-27T03:08:33.949632+0000","last_active":"2024-07-27T03:08:36.867964+0000","last_peered":"2024-07-27T03:08:36.867964+0000","last_clean":"2024-07-27T03:08:36.867964+0000","last_became_active":"2024-07-27T03:08:33.949329+0000","last_became_peered":"2024-07-27T03:08:33.949329+0000","last_unstale":"2024-07-27T03:08:36.867964+0000","last_undegraded":"2024-07-27T03:08:36.867964+0000","last_fullsized":"2024-07-27T03:08:36.867964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:14:24.431954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930265+0000","last_change":"2024-07-27T03:08:33.933362+0000","last_active":"2024-07-27T03:08:34.930265+0000","last_peered":"2024-07-27T03:08:34.930265+0000","last_clean":"2024-07-27T03:08:34.930265+0000","last_became_active":"2024-07-27T03:08:33.933038+0000","last_became_peered":"2024-07-27T03:08:33.933038+0000","last_unstale":"2024-07-27T03:08:34.930265+0000","last_undegraded":"2024-07-27T03:08:34.930265+0000","last_fullsized":"2024-07-27T03:08:34.930265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931188+0000","last_change":"2024-07-27T03:08:33.959089+0000","last_active":"2024-07-27T03:08:34.931188+0000","last_peered":"2024-07-27T03:08:34.931188+0000","last_clean":"2024-07-27T03:08:34.931188+0000","last_became_active":"2024-07-27T03:08:33.957410+0000","last_became_peered":"2024-07-27T03:08:33.957410+0000","last_unstale":"2024-07-27T03:08:34.931188+0000","last_undegraded":"2024-07-27T03:08:34.931188+0000","last_fullsized":"2024-07-27T03:08:34.931188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:43:46.381317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932620+0000","last_change":"2024-07-27T03:08:33.950566+0000","last_active":"2024-07-27T03:08:34.932620+0000","last_peered":"2024-07-27T03:08:34.932620+0000","last_clean":"2024-07-27T03:08:34.932620+0000","last_became_active":"2024-07-27T03:08:33.950143+0000","last_became_peered":"2024-07-27T03:08:33.950143+0000","last_unstale":"2024-07-27T03:08:34.932620+0000","last_undegraded":"2024-07-27T03:08:34.932620+0000","last_fullsized":"2024-07-27T03:08:34.932620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:01:16.829706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755294+0000","last_change":"2024-07-27T03:08:33.942989+0000","last_active":"2024-07-27T03:08:36.755294+0000","last_peered":"2024-07-27T03:08:36.755294+0000","last_clean":"2024-07-27T03:08:36.755294+0000","last_became_active":"2024-07-27T03:08:33.942703+0000","last_became_peered":"2024-07-27T03:08:33.942703+0000","last_unstale":"2024-07-27T03:08:36.755294+0000","last_undegraded":"2024-07-27T03:08:36.755294+0000","last_fullsized":"2024-07-27T03:08:36.755294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:08:51.055336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650174+0000","last_change":"2024-07-27T03:08:33.953473+0000","last_active":"2024-07-27T03:08:37.650174+0000","last_peered":"2024-07-27T03:08:37.650174+0000","last_clean":"2024-07-27T03:08:37.650174+0000","last_became_active":"2024-07-27T03:08:33.950631+0000","last_became_peered":"2024-07-27T03:08:33.950631+0000","last_unstale":"2024-07-27T03:08:37.650174+0000","last_undegraded":"2024-07-27T03:08:37.650174+0000","last_fullsized":"2024-07-27T03:08:37.650174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:42:29.401799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934076+0000","last_change":"2024-07-27T03:08:33.957419+0000","last_active":"2024-07-27T03:08:35.934076+0000","last_peered":"2024-07-27T03:08:35.934076+0000","last_clean":"2024-07-27T03:08:35.934076+0000","last_became_active":"2024-07-27T03:08:33.957075+0000","last_became_peered":"2024-07-27T03:08:33.957075+0000","last_unstale":"2024-07-27T03:08:35.934076+0000","last_undegraded":"2024-07-27T03:08:35.934076+0000","last_fullsized":"2024-07-27T03:08:35.934076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868036+0000","last_change":"2024-07-27T03:08:33.950713+0000","last_active":"2024-07-27T03:08:36.868036+0000","last_peered":"2024-07-27T03:08:36.868036+0000","last_clean":"2024-07-27T03:08:36.868036+0000","last_became_active":"2024-07-27T03:08:33.950427+0000","last_became_peered":"2024-07-27T03:08:33.950427+0000","last_unstale":"2024-07-27T03:08:36.868036+0000","last_undegraded":"2024-07-27T03:08:36.868036+0000","last_fullsized":"2024-07-27T03:08:36.868036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:42:22.203747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932247+0000","last_change":"2024-07-27T03:08:33.943108+0000","last_active":"2024-07-27T03:08:34.932247+0000","last_peered":"2024-07-27T03:08:34.932247+0000","last_clean":"2024-07-27T03:08:34.932247+0000","last_became_active":"2024-07-27T03:08:33.942757+0000","last_became_peered":"2024-07-27T03:08:33.942757+0000","last_unstale":"2024-07-27T03:08:34.932247+0000","last_undegraded":"2024-07-27T03:08:34.932247+0000","last_fullsized":"2024-07-27T03:08:34.932247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:24:42.625083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825841+0000","last_change":"2024-07-27T03:08:33.952481+0000","last_active":"2024-07-27T03:08:35.825841+0000","last_peered":"2024-07-27T03:08:35.825841+0000","last_clean":"2024-07-27T03:08:35.825841+0000","last_became_active":"2024-07-27T03:08:33.950017+0000","last_became_peered":"2024-07-27T03:08:33.950017+0000","last_unstale":"2024-07-27T03:08:35.825841+0000","last_undegraded":"2024-07-27T03:08:35.825841+0000","last_fullsized":"2024-07-27T03:08:35.825841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931255+0000","last_change":"2024-07-27T03:08:33.955109+0000","last_active":"2024-07-27T03:08:34.931255+0000","last_peered":"2024-07-27T03:08:34.931255+0000","last_clean":"2024-07-27T03:08:34.931255+0000","last_became_active":"2024-07-27T03:08:33.954787+0000","last_became_peered":"2024-07-27T03:08:33.954787+0000","last_unstale":"2024-07-27T03:08:34.931255+0000","last_undegraded":"2024-07-27T03:08:34.931255+0000","last_fullsized":"2024-07-27T03:08:34.931255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:14.764441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826467+0000","last_change":"2024-07-27T03:08:33.954526+0000","last_active":"2024-07-27T03:08:35.826467+0000","last_peered":"2024-07-27T03:08:35.826467+0000","last_clean":"2024-07-27T03:08:35.826467+0000","last_became_active":"2024-07-27T03:08:33.953792+0000","last_became_peered":"2024-07-27T03:08:33.953792+0000","last_unstale":"2024-07-27T03:08:35.826467+0000","last_undegraded":"2024-07-27T03:08:35.826467+0000","last_fullsized":"2024-07-27T03:08:35.826467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:37:57.039727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934267+0000","last_change":"2024-07-27T03:08:33.947980+0000","last_active":"2024-07-27T03:08:35.934267+0000","last_peered":"2024-07-27T03:08:35.934267+0000","last_clean":"2024-07-27T03:08:35.934267+0000","last_became_active":"2024-07-27T03:08:33.947719+0000","last_became_peered":"2024-07-27T03:08:33.947719+0000","last_unstale":"2024-07-27T03:08:35.934267+0000","last_undegraded":"2024-07-27T03:08:35.934267+0000","last_fullsized":"2024-07-27T03:08:35.934267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930564+0000","last_change":"2024-07-27T03:08:33.948063+0000","last_active":"2024-07-27T03:08:34.930564+0000","last_peered":"2024-07-27T03:08:34.930564+0000","last_clean":"2024-07-27T03:08:34.930564+0000","last_became_active":"2024-07-27T03:08:33.947778+0000","last_became_peered":"2024-07-27T03:08:33.947778+0000","last_unstale":"2024-07-27T03:08:34.930564+0000","last_undegraded":"2024-07-27T03:08:34.930564+0000","last_fullsized":"2024-07-27T03:08:34.930564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:13:24.620410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826274+0000","last_change":"2024-07-27T03:08:33.954136+0000","last_active":"2024-07-27T03:08:35.826274+0000","last_peered":"2024-07-27T03:08:35.826274+0000","last_clean":"2024-07-27T03:08:35.826274+0000","last_became_active":"2024-07-27T03:08:33.953381+0000","last_became_peered":"2024-07-27T03:08:33.953381+0000","last_unstale":"2024-07-27T03:08:35.826274+0000","last_undegraded":"2024-07-27T03:08:35.826274+0000","last_fullsized":"2024-07-27T03:08:35.826274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:13:24.620410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868169+0000","last_change":"2024-07-27T03:08:33.954554+0000","last_active":"2024-07-27T03:08:36.868169+0000","last_peered":"2024-07-27T03:08:36.868169+0000","last_clean":"2024-07-27T03:08:36.868169+0000","last_became_active":"2024-07-27T03:08:33.954226+0000","last_became_peered":"2024-07-27T03:08:33.954226+0000","last_unstale":"2024-07-27T03:08:36.868169+0000","last_undegraded":"2024-07-27T03:08:36.868169+0000","last_fullsized":"2024-07-27T03:08:36.868169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:43:46.381317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932443+0000","last_change":"2024-07-27T03:08:33.949720+0000","last_active":"2024-07-27T03:08:34.932443+0000","last_peered":"2024-07-27T03:08:34.932443+0000","last_clean":"2024-07-27T03:08:34.932443+0000","last_became_active":"2024-07-27T03:08:33.949300+0000","last_became_peered":"2024-07-27T03:08:33.949300+0000","last_unstale":"2024-07-27T03:08:34.932443+0000","last_undegraded":"2024-07-27T03:08:34.932443+0000","last_fullsized":"2024-07-27T03:08:34.932443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:22.536071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755128+0000","last_change":"2024-07-27T03:08:33.939020+0000","last_active":"2024-07-27T03:08:36.755128+0000","last_peered":"2024-07-27T03:08:36.755128+0000","last_clean":"2024-07-27T03:08:36.755128+0000","last_became_active":"2024-07-27T03:08:33.938648+0000","last_became_peered":"2024-07-27T03:08:33.938648+0000","last_unstale":"2024-07-27T03:08:36.755128+0000","last_undegraded":"2024-07-27T03:08:36.755128+0000","last_fullsized":"2024-07-27T03:08:36.755128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:15:40.187027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933962+0000","last_change":"2024-07-27T03:08:33.957896+0000","last_active":"2024-07-27T03:08:35.933962+0000","last_peered":"2024-07-27T03:08:35.933962+0000","last_clean":"2024-07-27T03:08:35.933962+0000","last_became_active":"2024-07-27T03:08:33.957571+0000","last_became_peered":"2024-07-27T03:08:33.957571+0000","last_unstale":"2024-07-27T03:08:35.933962+0000","last_undegraded":"2024-07-27T03:08:35.933962+0000","last_fullsized":"2024-07-27T03:08:35.933962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:02:10.905040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931554+0000","last_change":"2024-07-27T03:08:33.933266+0000","last_active":"2024-07-27T03:08:34.931554+0000","last_peered":"2024-07-27T03:08:34.931554+0000","last_clean":"2024-07-27T03:08:34.931554+0000","last_became_active":"2024-07-27T03:08:33.932884+0000","last_became_peered":"2024-07-27T03:08:33.932884+0000","last_unstale":"2024-07-27T03:08:34.931554+0000","last_undegraded":"2024-07-27T03:08:34.931554+0000","last_fullsized":"2024-07-27T03:08:34.931554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:39.773288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826178+0000","last_change":"2024-07-27T03:08:32.950534+0000","last_active":"2024-07-27T03:08:35.826178+0000","last_peered":"2024-07-27T03:08:35.826178+0000","last_clean":"2024-07-27T03:08:35.826178+0000","last_became_active":"2024-07-27T03:08:32.949394+0000","last_became_peered":"2024-07-27T03:08:32.949394+0000","last_unstale":"2024-07-27T03:08:35.826178+0000","last_undegraded":"2024-07-27T03:08:35.826178+0000","last_fullsized":"2024-07-27T03:08:35.826178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:53:04.632649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868190+0000","last_change":"2024-07-27T03:08:33.953285+0000","last_active":"2024-07-27T03:08:36.868190+0000","last_peered":"2024-07-27T03:08:36.868190+0000","last_clean":"2024-07-27T03:08:36.868190+0000","last_became_active":"2024-07-27T03:08:33.952303+0000","last_became_peered":"2024-07-27T03:08:33.952303+0000","last_unstale":"2024-07-27T03:08:36.868190+0000","last_undegraded":"2024-07-27T03:08:36.868190+0000","last_fullsized":"2024-07-27T03:08:36.868190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:48:47.476886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933676+0000","last_change":"2024-07-27T03:08:32.946959+0000","last_active":"2024-07-27T03:08:35.933676+0000","last_peered":"2024-07-27T03:08:35.933676+0000","last_clean":"2024-07-27T03:08:35.933676+0000","last_became_active":"2024-07-27T03:08:32.946603+0000","last_became_peered":"2024-07-27T03:08:32.946603+0000","last_unstale":"2024-07-27T03:08:35.933676+0000","last_undegraded":"2024-07-27T03:08:35.933676+0000","last_fullsized":"2024-07-27T03:08:35.933676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:24:33.462183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826062+0000","last_change":"2024-07-27T03:08:32.951105+0000","last_active":"2024-07-27T03:08:35.826062+0000","last_peered":"2024-07-27T03:08:35.826062+0000","last_clean":"2024-07-27T03:08:35.826062+0000","last_became_active":"2024-07-27T03:08:32.950768+0000","last_became_peered":"2024-07-27T03:08:32.950768+0000","last_unstale":"2024-07-27T03:08:35.826062+0000","last_undegraded":"2024-07-27T03:08:35.826062+0000","last_fullsized":"2024-07-27T03:08:35.826062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:08:45.268483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825827+0000","last_change":"2024-07-27T03:08:33.956827+0000","last_active":"2024-07-27T03:08:35.825827+0000","last_peered":"2024-07-27T03:08:35.825827+0000","last_clean":"2024-07-27T03:08:35.825827+0000","last_became_active":"2024-07-27T03:08:33.956528+0000","last_became_peered":"2024-07-27T03:08:33.956528+0000","last_unstale":"2024-07-27T03:08:35.825827+0000","last_undegraded":"2024-07-27T03:08:35.825827+0000","last_fullsized":"2024-07-27T03:08:35.825827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:52:05.096628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931459+0000","last_change":"2024-07-27T03:08:32.951650+0000","last_active":"2024-07-27T03:08:34.931459+0000","last_peered":"2024-07-27T03:08:34.931459+0000","last_clean":"2024-07-27T03:08:34.931459+0000","last_became_active":"2024-07-27T03:08:32.950807+0000","last_became_peered":"2024-07-27T03:08:32.950807+0000","last_unstale":"2024-07-27T03:08:34.931459+0000","last_undegraded":"2024-07-27T03:08:34.931459+0000","last_fullsized":"2024-07-27T03:08:34.931459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:16:05.521168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930234+0000","last_change":"2024-07-27T03:08:33.955840+0000","last_active":"2024-07-27T03:08:34.930234+0000","last_peered":"2024-07-27T03:08:34.930234+0000","last_clean":"2024-07-27T03:08:34.930234+0000","last_became_active":"2024-07-27T03:08:33.955515+0000","last_became_peered":"2024-07-27T03:08:33.955515+0000","last_unstale":"2024-07-27T03:08:34.930234+0000","last_undegraded":"2024-07-27T03:08:34.930234+0000","last_fullsized":"2024-07-27T03:08:34.930234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933924+0000","last_change":"2024-07-27T03:08:32.952580+0000","last_active":"2024-07-27T03:08:35.933924+0000","last_peered":"2024-07-27T03:08:35.933924+0000","last_clean":"2024-07-27T03:08:35.933924+0000","last_became_active":"2024-07-27T03:08:32.951849+0000","last_became_peered":"2024-07-27T03:08:32.951849+0000","last_unstale":"2024-07-27T03:08:35.933924+0000","last_undegraded":"2024-07-27T03:08:35.933924+0000","last_fullsized":"2024-07-27T03:08:35.933924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:24.797895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931964+0000","last_change":"2024-07-27T03:08:33.947195+0000","last_active":"2024-07-27T03:08:34.931964+0000","last_peered":"2024-07-27T03:08:34.931964+0000","last_clean":"2024-07-27T03:08:34.931964+0000","last_became_active":"2024-07-27T03:08:33.946831+0000","last_became_peered":"2024-07-27T03:08:33.946831+0000","last_unstale":"2024-07-27T03:08:34.931964+0000","last_undegraded":"2024-07-27T03:08:34.931964+0000","last_fullsized":"2024-07-27T03:08:34.931964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:35:20.173378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932094+0000","last_change":"2024-07-27T03:08:32.948775+0000","last_active":"2024-07-27T03:08:34.932094+0000","last_peered":"2024-07-27T03:08:34.932094+0000","last_clean":"2024-07-27T03:08:34.932094+0000","last_became_active":"2024-07-27T03:08:32.948396+0000","last_became_peered":"2024-07-27T03:08:32.948396+0000","last_unstale":"2024-07-27T03:08:34.932094+0000","last_undegraded":"2024-07-27T03:08:34.932094+0000","last_fullsized":"2024-07-27T03:08:34.932094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:02:35.203630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868581+0000","last_change":"2024-07-27T03:08:33.951343+0000","last_active":"2024-07-27T03:08:36.868581+0000","last_peered":"2024-07-27T03:08:36.868581+0000","last_clean":"2024-07-27T03:08:36.868581+0000","last_became_active":"2024-07-27T03:08:33.950827+0000","last_became_peered":"2024-07-27T03:08:33.950827+0000","last_unstale":"2024-07-27T03:08:36.868581+0000","last_undegraded":"2024-07-27T03:08:36.868581+0000","last_fullsized":"2024-07-27T03:08:36.868581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:24:42.625083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930431+0000","last_change":"2024-07-27T03:08:32.950138+0000","last_active":"2024-07-27T03:08:34.930431+0000","last_peered":"2024-07-27T03:08:34.930431+0000","last_clean":"2024-07-27T03:08:34.930431+0000","last_became_active":"2024-07-27T03:08:32.949805+0000","last_became_peered":"2024-07-27T03:08:32.949805+0000","last_unstale":"2024-07-27T03:08:34.930431+0000","last_undegraded":"2024-07-27T03:08:34.930431+0000","last_fullsized":"2024-07-27T03:08:34.930431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:54:05.204464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932119+0000","last_change":"2024-07-27T03:08:33.949864+0000","last_active":"2024-07-27T03:08:34.932119+0000","last_peered":"2024-07-27T03:08:34.932119+0000","last_clean":"2024-07-27T03:08:34.932119+0000","last_became_active":"2024-07-27T03:08:33.949559+0000","last_became_peered":"2024-07-27T03:08:33.949559+0000","last_unstale":"2024-07-27T03:08:34.932119+0000","last_undegraded":"2024-07-27T03:08:34.932119+0000","last_fullsized":"2024-07-27T03:08:34.932119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:54:06.207049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933893+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:35.933893+0000","last_peered":"2024-07-27T03:08:35.933893+0000","last_clean":"2024-07-27T03:08:35.933893+0000","last_became_active":"2024-07-27T03:08:32.950507+0000","last_became_peered":"2024-07-27T03:08:32.950507+0000","last_unstale":"2024-07-27T03:08:35.933893+0000","last_undegraded":"2024-07-27T03:08:35.933893+0000","last_fullsized":"2024-07-27T03:08:35.933893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:38.770703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649938+0000","last_change":"2024-07-27T03:08:33.956829+0000","last_active":"2024-07-27T03:08:37.649938+0000","last_peered":"2024-07-27T03:08:37.649938+0000","last_clean":"2024-07-27T03:08:37.649938+0000","last_became_active":"2024-07-27T03:08:33.951501+0000","last_became_peered":"2024-07-27T03:08:33.951501+0000","last_unstale":"2024-07-27T03:08:37.649938+0000","last_undegraded":"2024-07-27T03:08:37.649938+0000","last_fullsized":"2024-07-27T03:08:37.649938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:09:25.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868296+0000","last_change":"2024-07-27T03:08:32.944499+0000","last_active":"2024-07-27T03:08:36.868296+0000","last_peered":"2024-07-27T03:08:36.868296+0000","last_clean":"2024-07-27T03:08:36.868296+0000","last_became_active":"2024-07-27T03:08:32.943866+0000","last_became_peered":"2024-07-27T03:08:32.943866+0000","last_unstale":"2024-07-27T03:08:36.868296+0000","last_undegraded":"2024-07-27T03:08:36.868296+0000","last_fullsized":"2024-07-27T03:08:36.868296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:09.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868050+0000","last_change":"2024-07-27T03:08:33.949435+0000","last_active":"2024-07-27T03:08:36.868050+0000","last_peered":"2024-07-27T03:08:36.868050+0000","last_clean":"2024-07-27T03:08:36.868050+0000","last_became_active":"2024-07-27T03:08:33.949090+0000","last_became_peered":"2024-07-27T03:08:33.949090+0000","last_unstale":"2024-07-27T03:08:36.868050+0000","last_undegraded":"2024-07-27T03:08:36.868050+0000","last_fullsized":"2024-07-27T03:08:36.868050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:35:51.827596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932564+0000","last_change":"2024-07-27T03:08:32.949082+0000","last_active":"2024-07-27T03:08:34.932564+0000","last_peered":"2024-07-27T03:08:34.932564+0000","last_clean":"2024-07-27T03:08:34.932564+0000","last_became_active":"2024-07-27T03:08:32.948684+0000","last_became_peered":"2024-07-27T03:08:32.948684+0000","last_unstale":"2024-07-27T03:08:34.932564+0000","last_undegraded":"2024-07-27T03:08:34.932564+0000","last_fullsized":"2024-07-27T03:08:34.932564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:00:08.849358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649859+0000","last_change":"2024-07-27T03:08:33.953574+0000","last_active":"2024-07-27T03:08:37.649859+0000","last_peered":"2024-07-27T03:08:37.649859+0000","last_clean":"2024-07-27T03:08:37.649859+0000","last_became_active":"2024-07-27T03:08:33.953247+0000","last_became_peered":"2024-07-27T03:08:33.953247+0000","last_unstale":"2024-07-27T03:08:37.649859+0000","last_undegraded":"2024-07-27T03:08:37.649859+0000","last_fullsized":"2024-07-27T03:08:37.649859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:58.998778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933743+0000","last_change":"2024-07-27T03:08:32.952599+0000","last_active":"2024-07-27T03:08:35.933743+0000","last_peered":"2024-07-27T03:08:35.933743+0000","last_clean":"2024-07-27T03:08:35.933743+0000","last_became_active":"2024-07-27T03:08:32.952293+0000","last_became_peered":"2024-07-27T03:08:32.952293+0000","last_unstale":"2024-07-27T03:08:35.933743+0000","last_undegraded":"2024-07-27T03:08:35.933743+0000","last_fullsized":"2024-07-27T03:08:35.933743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:01:24.017164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934003+0000","last_change":"2024-07-27T03:08:33.957887+0000","last_active":"2024-07-27T03:08:35.934003+0000","last_peered":"2024-07-27T03:08:35.934003+0000","last_clean":"2024-07-27T03:08:35.934003+0000","last_became_active":"2024-07-27T03:08:33.957528+0000","last_became_peered":"2024-07-27T03:08:33.957528+0000","last_unstale":"2024-07-27T03:08:35.934003+0000","last_undegraded":"2024-07-27T03:08:35.934003+0000","last_fullsized":"2024-07-27T03:08:35.934003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:52:05.096628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755038+0000","last_change":"2024-07-27T03:08:32.946673+0000","last_active":"2024-07-27T03:08:36.755038+0000","last_peered":"2024-07-27T03:08:36.755038+0000","last_clean":"2024-07-27T03:08:36.755038+0000","last_became_active":"2024-07-27T03:08:32.946188+0000","last_became_peered":"2024-07-27T03:08:32.946188+0000","last_unstale":"2024-07-27T03:08:36.755038+0000","last_undegraded":"2024-07-27T03:08:36.755038+0000","last_fullsized":"2024-07-27T03:08:36.755038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:16:05.521168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649536+0000","last_change":"2024-07-27T03:08:33.952508+0000","last_active":"2024-07-27T03:08:37.649536+0000","last_peered":"2024-07-27T03:08:37.649536+0000","last_clean":"2024-07-27T03:08:37.649536+0000","last_became_active":"2024-07-27T03:08:33.952215+0000","last_became_peered":"2024-07-27T03:08:33.952215+0000","last_unstale":"2024-07-27T03:08:37.649536+0000","last_undegraded":"2024-07-27T03:08:37.649536+0000","last_fullsized":"2024-07-27T03:08:37.649536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:24:42.625083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931892+0000","last_change":"2024-07-27T03:08:32.943381+0000","last_active":"2024-07-27T03:08:34.931892+0000","last_peered":"2024-07-27T03:08:34.931892+0000","last_clean":"2024-07-27T03:08:34.931892+0000","last_became_active":"2024-07-27T03:08:32.943077+0000","last_became_peered":"2024-07-27T03:08:32.943077+0000","last_unstale":"2024-07-27T03:08:34.931892+0000","last_undegraded":"2024-07-27T03:08:34.931892+0000","last_fullsized":"2024-07-27T03:08:34.931892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:56:08.696748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650043+0000","last_change":"2024-07-27T03:08:33.952835+0000","last_active":"2024-07-27T03:08:37.650043+0000","last_peered":"2024-07-27T03:08:37.650043+0000","last_clean":"2024-07-27T03:08:37.650043+0000","last_became_active":"2024-07-27T03:08:33.952454+0000","last_became_peered":"2024-07-27T03:08:33.952454+0000","last_unstale":"2024-07-27T03:08:37.650043+0000","last_undegraded":"2024-07-27T03:08:37.650043+0000","last_fullsized":"2024-07-27T03:08:37.650043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:59.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755311+0000","last_change":"2024-07-27T03:08:32.952496+0000","last_active":"2024-07-27T03:08:36.755311+0000","last_peered":"2024-07-27T03:08:36.755311+0000","last_clean":"2024-07-27T03:08:36.755311+0000","last_became_active":"2024-07-27T03:08:32.952196+0000","last_became_peered":"2024-07-27T03:08:32.952196+0000","last_unstale":"2024-07-27T03:08:36.755311+0000","last_undegraded":"2024-07-27T03:08:36.755311+0000","last_fullsized":"2024-07-27T03:08:36.755311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:37:28.835075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650316+0000","last_change":"2024-07-27T03:08:33.954543+0000","last_active":"2024-07-27T03:08:37.650316+0000","last_peered":"2024-07-27T03:08:37.650316+0000","last_clean":"2024-07-27T03:08:37.650316+0000","last_became_active":"2024-07-27T03:08:33.954185+0000","last_became_peered":"2024-07-27T03:08:33.954185+0000","last_unstale":"2024-07-27T03:08:37.650316+0000","last_undegraded":"2024-07-27T03:08:37.650316+0000","last_fullsized":"2024-07-27T03:08:37.650316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:25:33.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930593+0000","last_change":"2024-07-27T03:08:32.941336+0000","last_active":"2024-07-27T03:08:34.930593+0000","last_peered":"2024-07-27T03:08:34.930593+0000","last_clean":"2024-07-27T03:08:34.930593+0000","last_became_active":"2024-07-27T03:08:32.940512+0000","last_became_peered":"2024-07-27T03:08:32.940512+0000","last_unstale":"2024-07-27T03:08:34.930593+0000","last_undegraded":"2024-07-27T03:08:34.930593+0000","last_fullsized":"2024-07-27T03:08:34.930593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:28:24.786534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933070+0000","last_change":"2024-07-27T03:08:33.959413+0000","last_active":"2024-07-27T03:08:34.933070+0000","last_peered":"2024-07-27T03:08:34.933070+0000","last_clean":"2024-07-27T03:08:34.933070+0000","last_became_active":"2024-07-27T03:08:33.956911+0000","last_became_peered":"2024-07-27T03:08:33.956911+0000","last_unstale":"2024-07-27T03:08:34.933070+0000","last_undegraded":"2024-07-27T03:08:34.933070+0000","last_fullsized":"2024-07-27T03:08:34.933070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:02:56.479634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755189+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:36.755189+0000","last_peered":"2024-07-27T03:08:36.755189+0000","last_clean":"2024-07-27T03:08:36.755189+0000","last_became_active":"2024-07-27T03:08:32.950533+0000","last_became_peered":"2024-07-27T03:08:32.950533+0000","last_unstale":"2024-07-27T03:08:36.755189+0000","last_undegraded":"2024-07-27T03:08:36.755189+0000","last_fullsized":"2024-07-27T03:08:36.755189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:00:08.849358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649904+0000","last_change":"2024-07-27T03:08:33.954154+0000","last_active":"2024-07-27T03:08:37.649904+0000","last_peered":"2024-07-27T03:08:37.649904+0000","last_clean":"2024-07-27T03:08:37.649904+0000","last_became_active":"2024-07-27T03:08:33.953132+0000","last_became_peered":"2024-07-27T03:08:33.953132+0000","last_unstale":"2024-07-27T03:08:37.649904+0000","last_undegraded":"2024-07-27T03:08:37.649904+0000","last_fullsized":"2024-07-27T03:08:37.649904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:01:16.829706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649547+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:08:37.649547+0000","last_peered":"2024-07-27T03:08:37.649547+0000","last_clean":"2024-07-27T03:08:37.649547+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:08:37.649547+0000","last_undegraded":"2024-07-27T03:08:37.649547+0000","last_fullsized":"2024-07-27T03:08:37.649547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931659+0000","last_change":"2024-07-27T03:08:32.948243+0000","last_active":"2024-07-27T03:08:34.931659+0000","last_peered":"2024-07-27T03:08:34.931659+0000","last_clean":"2024-07-27T03:08:34.931659+0000","last_became_active":"2024-07-27T03:08:32.947945+0000","last_became_peered":"2024-07-27T03:08:32.947945+0000","last_unstale":"2024-07-27T03:08:34.931659+0000","last_undegraded":"2024-07-27T03:08:34.931659+0000","last_fullsized":"2024-07-27T03:08:34.931659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825946+0000","last_change":"2024-07-27T03:08:33.948128+0000","last_active":"2024-07-27T03:08:35.825946+0000","last_peered":"2024-07-27T03:08:35.825946+0000","last_clean":"2024-07-27T03:08:35.825946+0000","last_became_active":"2024-07-27T03:08:33.947486+0000","last_became_peered":"2024-07-27T03:08:33.947486+0000","last_unstale":"2024-07-27T03:08:35.825946+0000","last_undegraded":"2024-07-27T03:08:35.825946+0000","last_fullsized":"2024-07-27T03:08:35.825946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649403+0000","last_change":"2024-07-27T03:08:32.955404+0000","last_active":"2024-07-27T03:08:37.649403+0000","last_peered":"2024-07-27T03:08:37.649403+0000","last_clean":"2024-07-27T03:08:37.649403+0000","last_became_active":"2024-07-27T03:08:32.955120+0000","last_became_peered":"2024-07-27T03:08:32.955120+0000","last_unstale":"2024-07-27T03:08:37.649403+0000","last_undegraded":"2024-07-27T03:08:37.649403+0000","last_fullsized":"2024-07-27T03:08:37.649403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:02:16.712233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.867978+0000","last_change":"2024-07-27T03:08:33.953727+0000","last_active":"2024-07-27T03:08:36.867978+0000","last_peered":"2024-07-27T03:08:36.867978+0000","last_clean":"2024-07-27T03:08:36.867978+0000","last_became_active":"2024-07-27T03:08:33.952917+0000","last_became_peered":"2024-07-27T03:08:33.952917+0000","last_unstale":"2024-07-27T03:08:36.867978+0000","last_undegraded":"2024-07-27T03:08:36.867978+0000","last_fullsized":"2024-07-27T03:08:36.867978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:11:19.253618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755186+0000","last_change":"2024-07-27T03:08:32.951299+0000","last_active":"2024-07-27T03:08:36.755186+0000","last_peered":"2024-07-27T03:08:36.755186+0000","last_clean":"2024-07-27T03:08:36.755186+0000","last_became_active":"2024-07-27T03:08:32.950946+0000","last_became_peered":"2024-07-27T03:08:32.950946+0000","last_unstale":"2024-07-27T03:08:36.755186+0000","last_undegraded":"2024-07-27T03:08:36.755186+0000","last_fullsized":"2024-07-27T03:08:36.755186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:19:16.481538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930286+0000","last_change":"2024-07-27T03:08:33.937577+0000","last_active":"2024-07-27T03:08:34.930286+0000","last_peered":"2024-07-27T03:08:34.930286+0000","last_clean":"2024-07-27T03:08:34.930286+0000","last_became_active":"2024-07-27T03:08:33.937262+0000","last_became_peered":"2024-07-27T03:08:33.937262+0000","last_unstale":"2024-07-27T03:08:34.930286+0000","last_undegraded":"2024-07-27T03:08:34.930286+0000","last_fullsized":"2024-07-27T03:08:34.930286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932797+0000","last_change":"2024-07-27T03:08:32.943293+0000","last_active":"2024-07-27T03:08:34.932797+0000","last_peered":"2024-07-27T03:08:34.932797+0000","last_clean":"2024-07-27T03:08:34.932797+0000","last_became_active":"2024-07-27T03:08:32.942974+0000","last_became_peered":"2024-07-27T03:08:32.942974+0000","last_unstale":"2024-07-27T03:08:34.932797+0000","last_undegraded":"2024-07-27T03:08:34.932797+0000","last_fullsized":"2024-07-27T03:08:34.932797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:19:16.481538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932094+0000","last_change":"2024-07-27T03:08:33.954605+0000","last_active":"2024-07-27T03:08:34.932094+0000","last_peered":"2024-07-27T03:08:34.932094+0000","last_clean":"2024-07-27T03:08:34.932094+0000","last_became_active":"2024-07-27T03:08:33.954160+0000","last_became_peered":"2024-07-27T03:08:33.954160+0000","last_unstale":"2024-07-27T03:08:34.932094+0000","last_undegraded":"2024-07-27T03:08:34.932094+0000","last_fullsized":"2024-07-27T03:08:34.932094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:32.582766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930412+0000","last_change":"2024-07-27T03:08:32.938940+0000","last_active":"2024-07-27T03:08:34.930412+0000","last_peered":"2024-07-27T03:08:34.930412+0000","last_clean":"2024-07-27T03:08:34.930412+0000","last_became_active":"2024-07-27T03:08:32.938639+0000","last_became_peered":"2024-07-27T03:08:32.938639+0000","last_unstale":"2024-07-27T03:08:34.930412+0000","last_undegraded":"2024-07-27T03:08:34.930412+0000","last_fullsized":"2024-07-27T03:08:34.930412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:24.797895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933291+0000","last_change":"2024-07-27T03:08:33.948481+0000","last_active":"2024-07-27T03:08:34.933291+0000","last_peered":"2024-07-27T03:08:34.933291+0000","last_clean":"2024-07-27T03:08:34.933291+0000","last_became_active":"2024-07-27T03:08:33.948155+0000","last_became_peered":"2024-07-27T03:08:33.948155+0000","last_unstale":"2024-07-27T03:08:34.933291+0000","last_undegraded":"2024-07-27T03:08:34.933291+0000","last_fullsized":"2024-07-27T03:08:34.933291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:59.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650236+0000","last_change":"2024-07-27T03:08:32.955213+0000","last_active":"2024-07-27T03:08:37.650236+0000","last_peered":"2024-07-27T03:08:37.650236+0000","last_clean":"2024-07-27T03:08:37.650236+0000","last_became_active":"2024-07-27T03:08:32.954883+0000","last_became_peered":"2024-07-27T03:08:32.954883+0000","last_unstale":"2024-07-27T03:08:37.650236+0000","last_undegraded":"2024-07-27T03:08:37.650236+0000","last_fullsized":"2024-07-27T03:08:37.650236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:53:17.583725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930594+0000","last_change":"2024-07-27T03:08:33.941170+0000","last_active":"2024-07-27T03:08:34.930594+0000","last_peered":"2024-07-27T03:08:34.930594+0000","last_clean":"2024-07-27T03:08:34.930594+0000","last_became_active":"2024-07-27T03:08:33.940792+0000","last_became_peered":"2024-07-27T03:08:33.940792+0000","last_unstale":"2024-07-27T03:08:34.930594+0000","last_undegraded":"2024-07-27T03:08:34.930594+0000","last_fullsized":"2024-07-27T03:08:34.930594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:35:01.175302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930630+0000","last_change":"2024-07-27T03:08:32.945506+0000","last_active":"2024-07-27T03:08:34.930630+0000","last_peered":"2024-07-27T03:08:34.930630+0000","last_clean":"2024-07-27T03:08:34.930630+0000","last_became_active":"2024-07-27T03:08:32.945201+0000","last_became_peered":"2024-07-27T03:08:32.945201+0000","last_unstale":"2024-07-27T03:08:34.930630+0000","last_undegraded":"2024-07-27T03:08:34.930630+0000","last_fullsized":"2024-07-27T03:08:34.930630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:58:54.316561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826477+0000","last_change":"2024-07-27T03:08:33.956128+0000","last_active":"2024-07-27T03:08:35.826477+0000","last_peered":"2024-07-27T03:08:35.826477+0000","last_clean":"2024-07-27T03:08:35.826477+0000","last_became_active":"2024-07-27T03:08:33.955341+0000","last_became_peered":"2024-07-27T03:08:33.955341+0000","last_unstale":"2024-07-27T03:08:35.826477+0000","last_undegraded":"2024-07-27T03:08:35.826477+0000","last_fullsized":"2024-07-27T03:08:35.826477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:04:25.906455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934062+0000","last_change":"2024-07-27T03:08:32.949210+0000","last_active":"2024-07-27T03:08:35.934062+0000","last_peered":"2024-07-27T03:08:35.934062+0000","last_clean":"2024-07-27T03:08:35.934062+0000","last_became_active":"2024-07-27T03:08:32.948858+0000","last_became_peered":"2024-07-27T03:08:32.948858+0000","last_unstale":"2024-07-27T03:08:35.934062+0000","last_undegraded":"2024-07-27T03:08:35.934062+0000","last_fullsized":"2024-07-27T03:08:35.934062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:31.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868515+0000","last_change":"2024-07-27T03:08:33.952497+0000","last_active":"2024-07-27T03:08:36.868515+0000","last_peered":"2024-07-27T03:08:36.868515+0000","last_clean":"2024-07-27T03:08:36.868515+0000","last_became_active":"2024-07-27T03:08:33.952113+0000","last_became_peered":"2024-07-27T03:08:33.952113+0000","last_unstale":"2024-07-27T03:08:36.868515+0000","last_undegraded":"2024-07-27T03:08:36.868515+0000","last_fullsized":"2024-07-27T03:08:36.868515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:35:20.173378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649390+0000","last_change":"2024-07-27T03:08:32.955144+0000","last_active":"2024-07-27T03:08:37.649390+0000","last_peered":"2024-07-27T03:08:37.649390+0000","last_clean":"2024-07-27T03:08:37.649390+0000","last_became_active":"2024-07-27T03:08:32.954645+0000","last_became_peered":"2024-07-27T03:08:32.954645+0000","last_unstale":"2024-07-27T03:08:37.649390+0000","last_undegraded":"2024-07-27T03:08:37.649390+0000","last_fullsized":"2024-07-27T03:08:37.649390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:19:16.481538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932211+0000","last_change":"2024-07-27T03:08:33.941376+0000","last_active":"2024-07-27T03:08:34.932211+0000","last_peered":"2024-07-27T03:08:34.932211+0000","last_clean":"2024-07-27T03:08:34.932211+0000","last_became_active":"2024-07-27T03:08:33.940032+0000","last_became_peered":"2024-07-27T03:08:33.940032+0000","last_unstale":"2024-07-27T03:08:34.932211+0000","last_undegraded":"2024-07-27T03:08:34.932211+0000","last_fullsized":"2024-07-27T03:08:34.932211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:28:25.789119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930293+0000","last_change":"2024-07-27T03:08:32.947719+0000","last_active":"2024-07-27T03:08:34.930293+0000","last_peered":"2024-07-27T03:08:34.930293+0000","last_clean":"2024-07-27T03:08:34.930293+0000","last_became_active":"2024-07-27T03:08:32.947422+0000","last_became_peered":"2024-07-27T03:08:32.947422+0000","last_unstale":"2024-07-27T03:08:34.930293+0000","last_undegraded":"2024-07-27T03:08:34.930293+0000","last_fullsized":"2024-07-27T03:08:34.930293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:31.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826037+0000","last_change":"2024-07-27T03:08:33.944591+0000","last_active":"2024-07-27T03:08:35.826037+0000","last_peered":"2024-07-27T03:08:35.826037+0000","last_clean":"2024-07-27T03:08:35.826037+0000","last_became_active":"2024-07-27T03:08:33.944286+0000","last_became_peered":"2024-07-27T03:08:33.944286+0000","last_unstale":"2024-07-27T03:08:35.826037+0000","last_undegraded":"2024-07-27T03:08:35.826037+0000","last_fullsized":"2024-07-27T03:08:35.826037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930426+0000","last_change":"2024-07-27T03:08:32.950885+0000","last_active":"2024-07-27T03:08:34.930426+0000","last_peered":"2024-07-27T03:08:34.930426+0000","last_clean":"2024-07-27T03:08:34.930426+0000","last_became_active":"2024-07-27T03:08:32.950569+0000","last_became_peered":"2024-07-27T03:08:32.950569+0000","last_unstale":"2024-07-27T03:08:34.930426+0000","last_undegraded":"2024-07-27T03:08:34.930426+0000","last_fullsized":"2024-07-27T03:08:34.930426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:38.770703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826274+0000","last_change":"2024-07-27T03:08:33.954837+0000","last_active":"2024-07-27T03:08:35.826274+0000","last_peered":"2024-07-27T03:08:35.826274+0000","last_clean":"2024-07-27T03:08:35.826274+0000","last_became_active":"2024-07-27T03:08:33.953709+0000","last_became_peered":"2024-07-27T03:08:33.953709+0000","last_unstale":"2024-07-27T03:08:35.826274+0000","last_undegraded":"2024-07-27T03:08:35.826274+0000","last_fullsized":"2024-07-27T03:08:35.826274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:35:01.175302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650106+0000","last_change":"2024-07-27T03:08:32.952714+0000","last_active":"2024-07-27T03:08:37.650106+0000","last_peered":"2024-07-27T03:08:37.650106+0000","last_clean":"2024-07-27T03:08:37.650106+0000","last_became_active":"2024-07-27T03:08:32.952425+0000","last_became_peered":"2024-07-27T03:08:32.952425+0000","last_unstale":"2024-07-27T03:08:37.650106+0000","last_undegraded":"2024-07-27T03:08:37.650106+0000","last_fullsized":"2024-07-27T03:08:37.650106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:00:08.849358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934081+0000","last_change":"2024-07-27T03:08:33.957221+0000","last_active":"2024-07-27T03:08:35.934081+0000","last_peered":"2024-07-27T03:08:35.934081+0000","last_clean":"2024-07-27T03:08:35.934081+0000","last_became_active":"2024-07-27T03:08:33.956847+0000","last_became_peered":"2024-07-27T03:08:33.956847+0000","last_unstale":"2024-07-27T03:08:35.934081+0000","last_undegraded":"2024-07-27T03:08:35.934081+0000","last_fullsized":"2024-07-27T03:08:35.934081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933249+0000","last_change":"2024-07-27T03:08:33.941040+0000","last_active":"2024-07-27T03:08:34.933249+0000","last_peered":"2024-07-27T03:08:34.933249+0000","last_clean":"2024-07-27T03:08:34.933249+0000","last_became_active":"2024-07-27T03:08:33.940723+0000","last_became_peered":"2024-07-27T03:08:33.940723+0000","last_unstale":"2024-07-27T03:08:34.933249+0000","last_undegraded":"2024-07-27T03:08:34.933249+0000","last_fullsized":"2024-07-27T03:08:34.933249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:51.758397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649790+0000","last_change":"2024-07-27T03:08:32.953454+0000","last_active":"2024-07-27T03:08:37.649790+0000","last_peered":"2024-07-27T03:08:37.649790+0000","last_clean":"2024-07-27T03:08:37.649790+0000","last_became_active":"2024-07-27T03:08:32.953065+0000","last_became_peered":"2024-07-27T03:08:32.953065+0000","last_unstale":"2024-07-27T03:08:37.649790+0000","last_undegraded":"2024-07-27T03:08:37.649790+0000","last_fullsized":"2024-07-27T03:08:37.649790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:32:44.100894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933070+0000","last_change":"2024-07-27T03:08:33.945495+0000","last_active":"2024-07-27T03:08:34.933070+0000","last_peered":"2024-07-27T03:08:34.933070+0000","last_clean":"2024-07-27T03:08:34.933070+0000","last_became_active":"2024-07-27T03:08:33.945151+0000","last_became_peered":"2024-07-27T03:08:33.945151+0000","last_unstale":"2024-07-27T03:08:34.933070+0000","last_undegraded":"2024-07-27T03:08:34.933070+0000","last_fullsized":"2024-07-27T03:08:34.933070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:09:25.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650078+0000","last_change":"2024-07-27T03:08:32.951809+0000","last_active":"2024-07-27T03:08:37.650078+0000","last_peered":"2024-07-27T03:08:37.650078+0000","last_clean":"2024-07-27T03:08:37.650078+0000","last_became_active":"2024-07-27T03:08:32.951495+0000","last_became_peered":"2024-07-27T03:08:32.951495+0000","last_unstale":"2024-07-27T03:08:37.650078+0000","last_undegraded":"2024-07-27T03:08:37.650078+0000","last_fullsized":"2024-07-27T03:08:37.650078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:37:28.835075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868576+0000","last_change":"2024-07-27T03:08:33.960311+0000","last_active":"2024-07-27T03:08:36.868576+0000","last_peered":"2024-07-27T03:08:36.868576+0000","last_clean":"2024-07-27T03:08:36.868576+0000","last_became_active":"2024-07-27T03:08:33.960017+0000","last_became_peered":"2024-07-27T03:08:33.960017+0000","last_unstale":"2024-07-27T03:08:36.868576+0000","last_undegraded":"2024-07-27T03:08:36.868576+0000","last_fullsized":"2024-07-27T03:08:36.868576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:53:39.837754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826447+0000","last_change":"2024-07-27T03:08:32.951332+0000","last_active":"2024-07-27T03:08:35.826447+0000","last_peered":"2024-07-27T03:08:35.826447+0000","last_clean":"2024-07-27T03:08:35.826447+0000","last_became_active":"2024-07-27T03:08:32.949369+0000","last_became_peered":"2024-07-27T03:08:32.949369+0000","last_unstale":"2024-07-27T03:08:35.826447+0000","last_undegraded":"2024-07-27T03:08:35.826447+0000","last_fullsized":"2024-07-27T03:08:35.826447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:01:24.017164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826448+0000","last_change":"2024-07-27T03:08:33.952852+0000","last_active":"2024-07-27T03:08:35.826448+0000","last_peered":"2024-07-27T03:08:35.826448+0000","last_clean":"2024-07-27T03:08:35.826448+0000","last_became_active":"2024-07-27T03:08:33.952541+0000","last_became_peered":"2024-07-27T03:08:33.952541+0000","last_unstale":"2024-07-27T03:08:35.826448+0000","last_undegraded":"2024-07-27T03:08:35.826448+0000","last_fullsized":"2024-07-27T03:08:35.826448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:00:35.656920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868665+0000","last_change":"2024-07-27T03:08:32.949235+0000","last_active":"2024-07-27T03:08:36.868665+0000","last_peered":"2024-07-27T03:08:36.868665+0000","last_clean":"2024-07-27T03:08:36.868665+0000","last_became_active":"2024-07-27T03:08:32.948934+0000","last_became_peered":"2024-07-27T03:08:32.948934+0000","last_unstale":"2024-07-27T03:08:36.868665+0000","last_undegraded":"2024-07-27T03:08:36.868665+0000","last_fullsized":"2024-07-27T03:08:36.868665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":668236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":77376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":77286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":668292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:08:45.646 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:08:45.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.794+0000 7f6c4756b640 1 -- 172.21.15.120:0/1490891512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c28003a50 msgr2=0x7f6c28003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.794+0000 7f6c4756b640 1 --2- 172.21.15.120:0/1490891512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c28003a50 0x7f6c28003ec0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009ed0 tx=0x7f6c28005830 comp rx=0 tx=0).stop 2024-07-27T03:08:45.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.794+0000 7f6c4756b640 1 -- 172.21.15.120:0/1490891512 shutdown_connections 2024-07-27T03:08:45.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.794+0000 7f6c4756b640 1 --2- 172.21.15.120:0/1490891512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c28003a50 0x7f6c28003ec0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.794+0000 7f6c4756b640 1 -- 172.21.15.120:0/1490891512 >> 172.21.15.120:0/1490891512 conn(0x7f6c4008d690 msgr2=0x7f6c4009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.794+0000 7f6c4756b640 1 -- 172.21.15.120:0/1490891512 shutdown_connections 2024-07-27T03:08:45.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.794+0000 7f6c4756b640 1 -- 172.21.15.120:0/1490891512 wait complete. 2024-07-27T03:08:45.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.796+0000 7f6c4756b640 1 Processor -- start 2024-07-27T03:08:45.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.796+0000 7f6c4756b640 1 -- start start 2024-07-27T03:08:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c4756b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c28003a50 0x7f6c4015d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c4756b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4009df80 0x7f6c401601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c4756b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c401606f0 0x7f6c400ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c4756b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6c400d2bf0 con 0x7f6c4009df80 2024-07-27T03:08:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c4756b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6c400b2f60 con 0x7f6c401606f0 2024-07-27T03:08:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c4756b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6c400d2d70 con 0x7f6c28003a50 2024-07-27T03:08:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c44b06640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4009df80 0x7f6c401601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c44b06640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4009df80 0x7f6c401601b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46916/0 (socket says 172.21.15.120:46916) 2024-07-27T03:08:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c44b06640 1 -- 172.21.15.120:0/3659582166 learned_addr learned my addr 172.21.15.120:0/3659582166 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c45307640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c28003a50 0x7f6c4015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:45.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c44b06640 1 -- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c28003a50 msgr2=0x7f6c4015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c44b06640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c28003a50 0x7f6c4015d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c44b06640 1 -- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c401606f0 msgr2=0x7f6c400ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c45b08640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c401606f0 0x7f6c400ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c44b06640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c401606f0 0x7f6c400ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c44b06640 1 -- 172.21.15.120:0/3659582166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c40160b00 con 0x7f6c4009df80 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c45b08640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c401606f0 0x7f6c400ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.797+0000 7f6c44b06640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4009df80 0x7f6c401601b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c34003fb0 tx=0x7f6c340016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.798+0000 7f6c3dffb640 1 -- 172.21.15.120:0/3659582166 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34015070 con 0x7f6c4009df80 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.798+0000 7f6c3dffb640 1 -- 172.21.15.120:0/3659582166 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c34011840 con 0x7f6c4009df80 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.798+0000 7f6c4756b640 1 -- 172.21.15.120:0/3659582166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c401f8830 con 0x7f6c4009df80 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.798+0000 7f6c3dffb640 1 -- 172.21.15.120:0/3659582166 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34011c90 con 0x7f6c4009df80 2024-07-27T03:08:45.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.798+0000 7f6c4756b640 1 -- 172.21.15.120:0/3659582166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c401f8df0 con 0x7f6c4009df80 2024-07-27T03:08:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.799+0000 7f6c4756b640 1 -- 172.21.15.120:0/3659582166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c400d09c0 con 0x7f6c4009df80 2024-07-27T03:08:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.799+0000 7f6c3dffb640 1 -- 172.21.15.120:0/3659582166 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6c34018070 con 0x7f6c4009df80 2024-07-27T03:08:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.800+0000 7f6c3dffb640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c2c077010 0x7f6c2c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.800+0000 7f6c3dffb640 1 -- 172.21.15.120:0/3659582166 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6c340993e0 con 0x7f6c4009df80 2024-07-27T03:08:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.800+0000 7f6c45307640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c2c077010 0x7f6c2c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:45.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.801+0000 7f6c45307640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c2c077010 0x7f6c2c079520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c30035000 tx=0x7f6c30004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:45.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.805+0000 7f6c3dffb640 1 -- 172.21.15.120:0/3659582166 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6c40160b00 con 0x7f6c4009df80 2024-07-27T03:08:45.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.984+0000 7f6c4756b640 1 -- 172.21.15.120:0/3659582166 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c401f8fc0 con 0x7f6c2c077010 2024-07-27T03:08:45.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.988+0000 7f6c3dffb640 1 -- 172.21.15.120:0/3659582166 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f6c401f8fc0 con 0x7f6c2c077010 2024-07-27T03:08:45.993 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:45.995 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:08:45.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 -- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c2c077010 msgr2=0x7f6c2c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c2c077010 0x7f6c2c079520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c30035000 tx=0x7f6c30004a40 comp rx=0 tx=0).stop 2024-07-27T03:08:45.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 -- 172.21.15.120:0/3659582166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4009df80 msgr2=0x7f6c401601b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:45.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4009df80 0x7f6c401601b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c34003fb0 tx=0x7f6c340016f0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 -- 172.21.15.120:0/3659582166 shutdown_connections 2024-07-27T03:08:45.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c2c077010 0x7f6c2c079520 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c4009df80 0x7f6c401601b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c401606f0 0x7f6c400ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 --2- 172.21.15.120:0/3659582166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c28003a50 0x7f6c4015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:45.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 -- 172.21.15.120:0/3659582166 >> 172.21.15.120:0/3659582166 conn(0x7f6c4008d690 msgr2=0x7f6c4006e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:45.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 -- 172.21.15.120:0/3659582166 shutdown_connections 2024-07-27T03:08:45.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:45.992+0000 7f6c4756b640 1 -- 172.21.15.120:0/3659582166 wait complete. 2024-07-27T03:08:46.006 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-07-27T03:08:44.534007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219120,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755600,"statfs":{"total":773094113280,"available":772869734400,"internally_reserved":0,"allocated":3022848,"data_stored":1803844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002607"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650035+0000","last_change":"2024-07-27T03:08:33.948286+0000","last_active":"2024-07-27T03:08:37.650035+0000","last_peered":"2024-07-27T03:08:37.650035+0000","last_clean":"2024-07-27T03:08:37.650035+0000","last_became_active":"2024-07-27T03:08:33.947946+0000","last_became_peered":"2024-07-27T03:08:33.947946+0000","last_unstale":"2024-07-27T03:08:37.650035+0000","last_undegraded":"2024-07-27T03:08:37.650035+0000","last_fullsized":"2024-07-27T03:08:37.650035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:51.758397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930553+0000","last_change":"2024-07-27T03:08:33.951685+0000","last_active":"2024-07-27T03:08:34.930553+0000","last_peered":"2024-07-27T03:08:34.930553+0000","last_clean":"2024-07-27T03:08:34.930553+0000","last_became_active":"2024-07-27T03:08:33.951388+0000","last_became_peered":"2024-07-27T03:08:33.951388+0000","last_unstale":"2024-07-27T03:08:34.930553+0000","last_undegraded":"2024-07-27T03:08:34.930553+0000","last_fullsized":"2024-07-27T03:08:34.930553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868470+0000","last_change":"2024-07-27T03:08:33.949530+0000","last_active":"2024-07-27T03:08:36.868470+0000","last_peered":"2024-07-27T03:08:36.868470+0000","last_clean":"2024-07-27T03:08:36.868470+0000","last_became_active":"2024-07-27T03:08:33.948989+0000","last_became_peered":"2024-07-27T03:08:33.948989+0000","last_unstale":"2024-07-27T03:08:36.868470+0000","last_undegraded":"2024-07-27T03:08:36.868470+0000","last_fullsized":"2024-07-27T03:08:36.868470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:14.764441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932869+0000","last_change":"2024-07-27T03:08:33.957256+0000","last_active":"2024-07-27T03:08:34.932869+0000","last_peered":"2024-07-27T03:08:34.932869+0000","last_clean":"2024-07-27T03:08:34.932869+0000","last_became_active":"2024-07-27T03:08:33.956922+0000","last_became_peered":"2024-07-27T03:08:33.956922+0000","last_unstale":"2024-07-27T03:08:34.932869+0000","last_undegraded":"2024-07-27T03:08:34.932869+0000","last_fullsized":"2024-07-27T03:08:34.932869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:58.998778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649852+0000","last_change":"2024-07-27T03:08:33.947489+0000","last_active":"2024-07-27T03:08:37.649852+0000","last_peered":"2024-07-27T03:08:37.649852+0000","last_clean":"2024-07-27T03:08:37.649852+0000","last_became_active":"2024-07-27T03:08:33.947123+0000","last_became_peered":"2024-07-27T03:08:33.947123+0000","last_unstale":"2024-07-27T03:08:37.649852+0000","last_undegraded":"2024-07-27T03:08:37.649852+0000","last_fullsized":"2024-07-27T03:08:37.649852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:02:56.479634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932061+0000","last_change":"2024-07-27T03:08:33.960086+0000","last_active":"2024-07-27T03:08:34.932061+0000","last_peered":"2024-07-27T03:08:34.932061+0000","last_clean":"2024-07-27T03:08:34.932061+0000","last_became_active":"2024-07-27T03:08:33.956547+0000","last_became_peered":"2024-07-27T03:08:33.956547+0000","last_unstale":"2024-07-27T03:08:34.932061+0000","last_undegraded":"2024-07-27T03:08:34.932061+0000","last_fullsized":"2024-07-27T03:08:34.932061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:53:39.837754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649542+0000","last_change":"2024-07-27T03:08:33.958341+0000","last_active":"2024-07-27T03:08:37.649542+0000","last_peered":"2024-07-27T03:08:37.649542+0000","last_clean":"2024-07-27T03:08:37.649542+0000","last_became_active":"2024-07-27T03:08:33.958024+0000","last_became_peered":"2024-07-27T03:08:33.958024+0000","last_unstale":"2024-07-27T03:08:37.649542+0000","last_undegraded":"2024-07-27T03:08:37.649542+0000","last_fullsized":"2024-07-27T03:08:37.649542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:22.536071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825730+0000","last_change":"2024-07-27T03:08:33.959349+0000","last_active":"2024-07-27T03:08:35.825730+0000","last_peered":"2024-07-27T03:08:35.825730+0000","last_clean":"2024-07-27T03:08:35.825730+0000","last_became_active":"2024-07-27T03:08:33.959108+0000","last_became_peered":"2024-07-27T03:08:33.959108+0000","last_unstale":"2024-07-27T03:08:35.825730+0000","last_undegraded":"2024-07-27T03:08:35.825730+0000","last_fullsized":"2024-07-27T03:08:35.825730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:24:20.622662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650213+0000","last_change":"2024-07-27T03:08:33.959480+0000","last_active":"2024-07-27T03:08:37.650213+0000","last_peered":"2024-07-27T03:08:37.650213+0000","last_clean":"2024-07-27T03:08:37.650213+0000","last_became_active":"2024-07-27T03:08:33.959108+0000","last_became_peered":"2024-07-27T03:08:33.959108+0000","last_unstale":"2024-07-27T03:08:37.650213+0000","last_undegraded":"2024-07-27T03:08:37.650213+0000","last_fullsized":"2024-07-27T03:08:37.650213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:34:51.510109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934161+0000","last_change":"2024-07-27T03:08:33.952605+0000","last_active":"2024-07-27T03:08:35.934161+0000","last_peered":"2024-07-27T03:08:35.934161+0000","last_clean":"2024-07-27T03:08:35.934161+0000","last_became_active":"2024-07-27T03:08:33.952198+0000","last_became_peered":"2024-07-27T03:08:33.952198+0000","last_unstale":"2024-07-27T03:08:35.934161+0000","last_undegraded":"2024-07-27T03:08:35.934161+0000","last_fullsized":"2024-07-27T03:08:35.934161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934003+0000","last_change":"2024-07-27T03:08:33.960066+0000","last_active":"2024-07-27T03:08:35.934003+0000","last_peered":"2024-07-27T03:08:35.934003+0000","last_clean":"2024-07-27T03:08:35.934003+0000","last_became_active":"2024-07-27T03:08:33.959677+0000","last_became_peered":"2024-07-27T03:08:33.959677+0000","last_unstale":"2024-07-27T03:08:35.934003+0000","last_undegraded":"2024-07-27T03:08:35.934003+0000","last_fullsized":"2024-07-27T03:08:35.934003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:24:20.622662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932043+0000","last_change":"2024-07-27T03:08:33.951057+0000","last_active":"2024-07-27T03:08:34.932043+0000","last_peered":"2024-07-27T03:08:34.932043+0000","last_clean":"2024-07-27T03:08:34.932043+0000","last_became_active":"2024-07-27T03:08:33.950764+0000","last_became_peered":"2024-07-27T03:08:33.950764+0000","last_unstale":"2024-07-27T03:08:34.932043+0000","last_undegraded":"2024-07-27T03:08:34.932043+0000","last_fullsized":"2024-07-27T03:08:34.932043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:25.800481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825997+0000","last_change":"2024-07-27T03:08:33.954641+0000","last_active":"2024-07-27T03:08:35.825997+0000","last_peered":"2024-07-27T03:08:35.825997+0000","last_clean":"2024-07-27T03:08:35.825997+0000","last_became_active":"2024-07-27T03:08:33.953618+0000","last_became_peered":"2024-07-27T03:08:33.953618+0000","last_unstale":"2024-07-27T03:08:35.825997+0000","last_undegraded":"2024-07-27T03:08:35.825997+0000","last_fullsized":"2024-07-27T03:08:35.825997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.867964+0000","last_change":"2024-07-27T03:08:33.949632+0000","last_active":"2024-07-27T03:08:36.867964+0000","last_peered":"2024-07-27T03:08:36.867964+0000","last_clean":"2024-07-27T03:08:36.867964+0000","last_became_active":"2024-07-27T03:08:33.949329+0000","last_became_peered":"2024-07-27T03:08:33.949329+0000","last_unstale":"2024-07-27T03:08:36.867964+0000","last_undegraded":"2024-07-27T03:08:36.867964+0000","last_fullsized":"2024-07-27T03:08:36.867964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:14:24.431954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930265+0000","last_change":"2024-07-27T03:08:33.933362+0000","last_active":"2024-07-27T03:08:34.930265+0000","last_peered":"2024-07-27T03:08:34.930265+0000","last_clean":"2024-07-27T03:08:34.930265+0000","last_became_active":"2024-07-27T03:08:33.933038+0000","last_became_peered":"2024-07-27T03:08:33.933038+0000","last_unstale":"2024-07-27T03:08:34.930265+0000","last_undegraded":"2024-07-27T03:08:34.930265+0000","last_fullsized":"2024-07-27T03:08:34.930265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931188+0000","last_change":"2024-07-27T03:08:33.959089+0000","last_active":"2024-07-27T03:08:34.931188+0000","last_peered":"2024-07-27T03:08:34.931188+0000","last_clean":"2024-07-27T03:08:34.931188+0000","last_became_active":"2024-07-27T03:08:33.957410+0000","last_became_peered":"2024-07-27T03:08:33.957410+0000","last_unstale":"2024-07-27T03:08:34.931188+0000","last_undegraded":"2024-07-27T03:08:34.931188+0000","last_fullsized":"2024-07-27T03:08:34.931188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:43:46.381317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932620+0000","last_change":"2024-07-27T03:08:33.950566+0000","last_active":"2024-07-27T03:08:34.932620+0000","last_peered":"2024-07-27T03:08:34.932620+0000","last_clean":"2024-07-27T03:08:34.932620+0000","last_became_active":"2024-07-27T03:08:33.950143+0000","last_became_peered":"2024-07-27T03:08:33.950143+0000","last_unstale":"2024-07-27T03:08:34.932620+0000","last_undegraded":"2024-07-27T03:08:34.932620+0000","last_fullsized":"2024-07-27T03:08:34.932620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:01:16.829706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755294+0000","last_change":"2024-07-27T03:08:33.942989+0000","last_active":"2024-07-27T03:08:36.755294+0000","last_peered":"2024-07-27T03:08:36.755294+0000","last_clean":"2024-07-27T03:08:36.755294+0000","last_became_active":"2024-07-27T03:08:33.942703+0000","last_became_peered":"2024-07-27T03:08:33.942703+0000","last_unstale":"2024-07-27T03:08:36.755294+0000","last_undegraded":"2024-07-27T03:08:36.755294+0000","last_fullsized":"2024-07-27T03:08:36.755294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:08:51.055336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650174+0000","last_change":"2024-07-27T03:08:33.953473+0000","last_active":"2024-07-27T03:08:37.650174+0000","last_peered":"2024-07-27T03:08:37.650174+0000","last_clean":"2024-07-27T03:08:37.650174+0000","last_became_active":"2024-07-27T03:08:33.950631+0000","last_became_peered":"2024-07-27T03:08:33.950631+0000","last_unstale":"2024-07-27T03:08:37.650174+0000","last_undegraded":"2024-07-27T03:08:37.650174+0000","last_fullsized":"2024-07-27T03:08:37.650174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:42:29.401799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934076+0000","last_change":"2024-07-27T03:08:33.957419+0000","last_active":"2024-07-27T03:08:35.934076+0000","last_peered":"2024-07-27T03:08:35.934076+0000","last_clean":"2024-07-27T03:08:35.934076+0000","last_became_active":"2024-07-27T03:08:33.957075+0000","last_became_peered":"2024-07-27T03:08:33.957075+0000","last_unstale":"2024-07-27T03:08:35.934076+0000","last_undegraded":"2024-07-27T03:08:35.934076+0000","last_fullsized":"2024-07-27T03:08:35.934076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868036+0000","last_change":"2024-07-27T03:08:33.950713+0000","last_active":"2024-07-27T03:08:36.868036+0000","last_peered":"2024-07-27T03:08:36.868036+0000","last_clean":"2024-07-27T03:08:36.868036+0000","last_became_active":"2024-07-27T03:08:33.950427+0000","last_became_peered":"2024-07-27T03:08:33.950427+0000","last_unstale":"2024-07-27T03:08:36.868036+0000","last_undegraded":"2024-07-27T03:08:36.868036+0000","last_fullsized":"2024-07-27T03:08:36.868036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:42:22.203747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932247+0000","last_change":"2024-07-27T03:08:33.943108+0000","last_active":"2024-07-27T03:08:34.932247+0000","last_peered":"2024-07-27T03:08:34.932247+0000","last_clean":"2024-07-27T03:08:34.932247+0000","last_became_active":"2024-07-27T03:08:33.942757+0000","last_became_peered":"2024-07-27T03:08:33.942757+0000","last_unstale":"2024-07-27T03:08:34.932247+0000","last_undegraded":"2024-07-27T03:08:34.932247+0000","last_fullsized":"2024-07-27T03:08:34.932247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:24:42.625083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825841+0000","last_change":"2024-07-27T03:08:33.952481+0000","last_active":"2024-07-27T03:08:35.825841+0000","last_peered":"2024-07-27T03:08:35.825841+0000","last_clean":"2024-07-27T03:08:35.825841+0000","last_became_active":"2024-07-27T03:08:33.950017+0000","last_became_peered":"2024-07-27T03:08:33.950017+0000","last_unstale":"2024-07-27T03:08:35.825841+0000","last_undegraded":"2024-07-27T03:08:35.825841+0000","last_fullsized":"2024-07-27T03:08:35.825841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931255+0000","last_change":"2024-07-27T03:08:33.955109+0000","last_active":"2024-07-27T03:08:34.931255+0000","last_peered":"2024-07-27T03:08:34.931255+0000","last_clean":"2024-07-27T03:08:34.931255+0000","last_became_active":"2024-07-27T03:08:33.954787+0000","last_became_peered":"2024-07-27T03:08:33.954787+0000","last_unstale":"2024-07-27T03:08:34.931255+0000","last_undegraded":"2024-07-27T03:08:34.931255+0000","last_fullsized":"2024-07-27T03:08:34.931255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:14.764441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826467+0000","last_change":"2024-07-27T03:08:33.954526+0000","last_active":"2024-07-27T03:08:35.826467+0000","last_peered":"2024-07-27T03:08:35.826467+0000","last_clean":"2024-07-27T03:08:35.826467+0000","last_became_active":"2024-07-27T03:08:33.953792+0000","last_became_peered":"2024-07-27T03:08:33.953792+0000","last_unstale":"2024-07-27T03:08:35.826467+0000","last_undegraded":"2024-07-27T03:08:35.826467+0000","last_fullsized":"2024-07-27T03:08:35.826467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:37:57.039727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934267+0000","last_change":"2024-07-27T03:08:33.947980+0000","last_active":"2024-07-27T03:08:35.934267+0000","last_peered":"2024-07-27T03:08:35.934267+0000","last_clean":"2024-07-27T03:08:35.934267+0000","last_became_active":"2024-07-27T03:08:33.947719+0000","last_became_peered":"2024-07-27T03:08:33.947719+0000","last_unstale":"2024-07-27T03:08:35.934267+0000","last_undegraded":"2024-07-27T03:08:35.934267+0000","last_fullsized":"2024-07-27T03:08:35.934267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930564+0000","last_change":"2024-07-27T03:08:33.948063+0000","last_active":"2024-07-27T03:08:34.930564+0000","last_peered":"2024-07-27T03:08:34.930564+0000","last_clean":"2024-07-27T03:08:34.930564+0000","last_became_active":"2024-07-27T03:08:33.947778+0000","last_became_peered":"2024-07-27T03:08:33.947778+0000","last_unstale":"2024-07-27T03:08:34.930564+0000","last_undegraded":"2024-07-27T03:08:34.930564+0000","last_fullsized":"2024-07-27T03:08:34.930564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:13:24.620410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826274+0000","last_change":"2024-07-27T03:08:33.954136+0000","last_active":"2024-07-27T03:08:35.826274+0000","last_peered":"2024-07-27T03:08:35.826274+0000","last_clean":"2024-07-27T03:08:35.826274+0000","last_became_active":"2024-07-27T03:08:33.953381+0000","last_became_peered":"2024-07-27T03:08:33.953381+0000","last_unstale":"2024-07-27T03:08:35.826274+0000","last_undegraded":"2024-07-27T03:08:35.826274+0000","last_fullsized":"2024-07-27T03:08:35.826274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:13:24.620410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868169+0000","last_change":"2024-07-27T03:08:33.954554+0000","last_active":"2024-07-27T03:08:36.868169+0000","last_peered":"2024-07-27T03:08:36.868169+0000","last_clean":"2024-07-27T03:08:36.868169+0000","last_became_active":"2024-07-27T03:08:33.954226+0000","last_became_peered":"2024-07-27T03:08:33.954226+0000","last_unstale":"2024-07-27T03:08:36.868169+0000","last_undegraded":"2024-07-27T03:08:36.868169+0000","last_fullsized":"2024-07-27T03:08:36.868169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:43:46.381317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932443+0000","last_change":"2024-07-27T03:08:33.949720+0000","last_active":"2024-07-27T03:08:34.932443+0000","last_peered":"2024-07-27T03:08:34.932443+0000","last_clean":"2024-07-27T03:08:34.932443+0000","last_became_active":"2024-07-27T03:08:33.949300+0000","last_became_peered":"2024-07-27T03:08:33.949300+0000","last_unstale":"2024-07-27T03:08:34.932443+0000","last_undegraded":"2024-07-27T03:08:34.932443+0000","last_fullsized":"2024-07-27T03:08:34.932443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:22.536071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755128+0000","last_change":"2024-07-27T03:08:33.939020+0000","last_active":"2024-07-27T03:08:36.755128+0000","last_peered":"2024-07-27T03:08:36.755128+0000","last_clean":"2024-07-27T03:08:36.755128+0000","last_became_active":"2024-07-27T03:08:33.938648+0000","last_became_peered":"2024-07-27T03:08:33.938648+0000","last_unstale":"2024-07-27T03:08:36.755128+0000","last_undegraded":"2024-07-27T03:08:36.755128+0000","last_fullsized":"2024-07-27T03:08:36.755128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:15:40.187027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933962+0000","last_change":"2024-07-27T03:08:33.957896+0000","last_active":"2024-07-27T03:08:35.933962+0000","last_peered":"2024-07-27T03:08:35.933962+0000","last_clean":"2024-07-27T03:08:35.933962+0000","last_became_active":"2024-07-27T03:08:33.957571+0000","last_became_peered":"2024-07-27T03:08:33.957571+0000","last_unstale":"2024-07-27T03:08:35.933962+0000","last_undegraded":"2024-07-27T03:08:35.933962+0000","last_fullsized":"2024-07-27T03:08:35.933962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:02:10.905040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931554+0000","last_change":"2024-07-27T03:08:33.933266+0000","last_active":"2024-07-27T03:08:34.931554+0000","last_peered":"2024-07-27T03:08:34.931554+0000","last_clean":"2024-07-27T03:08:34.931554+0000","last_became_active":"2024-07-27T03:08:33.932884+0000","last_became_peered":"2024-07-27T03:08:33.932884+0000","last_unstale":"2024-07-27T03:08:34.931554+0000","last_undegraded":"2024-07-27T03:08:34.931554+0000","last_fullsized":"2024-07-27T03:08:34.931554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:39.773288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826178+0000","last_change":"2024-07-27T03:08:32.950534+0000","last_active":"2024-07-27T03:08:35.826178+0000","last_peered":"2024-07-27T03:08:35.826178+0000","last_clean":"2024-07-27T03:08:35.826178+0000","last_became_active":"2024-07-27T03:08:32.949394+0000","last_became_peered":"2024-07-27T03:08:32.949394+0000","last_unstale":"2024-07-27T03:08:35.826178+0000","last_undegraded":"2024-07-27T03:08:35.826178+0000","last_fullsized":"2024-07-27T03:08:35.826178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:53:04.632649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868190+0000","last_change":"2024-07-27T03:08:33.953285+0000","last_active":"2024-07-27T03:08:36.868190+0000","last_peered":"2024-07-27T03:08:36.868190+0000","last_clean":"2024-07-27T03:08:36.868190+0000","last_became_active":"2024-07-27T03:08:33.952303+0000","last_became_peered":"2024-07-27T03:08:33.952303+0000","last_unstale":"2024-07-27T03:08:36.868190+0000","last_undegraded":"2024-07-27T03:08:36.868190+0000","last_fullsized":"2024-07-27T03:08:36.868190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:48:47.476886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933676+0000","last_change":"2024-07-27T03:08:32.946959+0000","last_active":"2024-07-27T03:08:35.933676+0000","last_peered":"2024-07-27T03:08:35.933676+0000","last_clean":"2024-07-27T03:08:35.933676+0000","last_became_active":"2024-07-27T03:08:32.946603+0000","last_became_peered":"2024-07-27T03:08:32.946603+0000","last_unstale":"2024-07-27T03:08:35.933676+0000","last_undegraded":"2024-07-27T03:08:35.933676+0000","last_fullsized":"2024-07-27T03:08:35.933676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:24:33.462183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826062+0000","last_change":"2024-07-27T03:08:32.951105+0000","last_active":"2024-07-27T03:08:35.826062+0000","last_peered":"2024-07-27T03:08:35.826062+0000","last_clean":"2024-07-27T03:08:35.826062+0000","last_became_active":"2024-07-27T03:08:32.950768+0000","last_became_peered":"2024-07-27T03:08:32.950768+0000","last_unstale":"2024-07-27T03:08:35.826062+0000","last_undegraded":"2024-07-27T03:08:35.826062+0000","last_fullsized":"2024-07-27T03:08:35.826062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:08:45.268483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825827+0000","last_change":"2024-07-27T03:08:33.956827+0000","last_active":"2024-07-27T03:08:35.825827+0000","last_peered":"2024-07-27T03:08:35.825827+0000","last_clean":"2024-07-27T03:08:35.825827+0000","last_became_active":"2024-07-27T03:08:33.956528+0000","last_became_peered":"2024-07-27T03:08:33.956528+0000","last_unstale":"2024-07-27T03:08:35.825827+0000","last_undegraded":"2024-07-27T03:08:35.825827+0000","last_fullsized":"2024-07-27T03:08:35.825827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:52:05.096628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931459+0000","last_change":"2024-07-27T03:08:32.951650+0000","last_active":"2024-07-27T03:08:34.931459+0000","last_peered":"2024-07-27T03:08:34.931459+0000","last_clean":"2024-07-27T03:08:34.931459+0000","last_became_active":"2024-07-27T03:08:32.950807+0000","last_became_peered":"2024-07-27T03:08:32.950807+0000","last_unstale":"2024-07-27T03:08:34.931459+0000","last_undegraded":"2024-07-27T03:08:34.931459+0000","last_fullsized":"2024-07-27T03:08:34.931459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:16:05.521168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930234+0000","last_change":"2024-07-27T03:08:33.955840+0000","last_active":"2024-07-27T03:08:34.930234+0000","last_peered":"2024-07-27T03:08:34.930234+0000","last_clean":"2024-07-27T03:08:34.930234+0000","last_became_active":"2024-07-27T03:08:33.955515+0000","last_became_peered":"2024-07-27T03:08:33.955515+0000","last_unstale":"2024-07-27T03:08:34.930234+0000","last_undegraded":"2024-07-27T03:08:34.930234+0000","last_fullsized":"2024-07-27T03:08:34.930234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:21:41.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933924+0000","last_change":"2024-07-27T03:08:32.952580+0000","last_active":"2024-07-27T03:08:35.933924+0000","last_peered":"2024-07-27T03:08:35.933924+0000","last_clean":"2024-07-27T03:08:35.933924+0000","last_became_active":"2024-07-27T03:08:32.951849+0000","last_became_peered":"2024-07-27T03:08:32.951849+0000","last_unstale":"2024-07-27T03:08:35.933924+0000","last_undegraded":"2024-07-27T03:08:35.933924+0000","last_fullsized":"2024-07-27T03:08:35.933924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:24.797895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931964+0000","last_change":"2024-07-27T03:08:33.947195+0000","last_active":"2024-07-27T03:08:34.931964+0000","last_peered":"2024-07-27T03:08:34.931964+0000","last_clean":"2024-07-27T03:08:34.931964+0000","last_became_active":"2024-07-27T03:08:33.946831+0000","last_became_peered":"2024-07-27T03:08:33.946831+0000","last_unstale":"2024-07-27T03:08:34.931964+0000","last_undegraded":"2024-07-27T03:08:34.931964+0000","last_fullsized":"2024-07-27T03:08:34.931964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:35:20.173378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932094+0000","last_change":"2024-07-27T03:08:32.948775+0000","last_active":"2024-07-27T03:08:34.932094+0000","last_peered":"2024-07-27T03:08:34.932094+0000","last_clean":"2024-07-27T03:08:34.932094+0000","last_became_active":"2024-07-27T03:08:32.948396+0000","last_became_peered":"2024-07-27T03:08:32.948396+0000","last_unstale":"2024-07-27T03:08:34.932094+0000","last_undegraded":"2024-07-27T03:08:34.932094+0000","last_fullsized":"2024-07-27T03:08:34.932094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:02:35.203630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868581+0000","last_change":"2024-07-27T03:08:33.951343+0000","last_active":"2024-07-27T03:08:36.868581+0000","last_peered":"2024-07-27T03:08:36.868581+0000","last_clean":"2024-07-27T03:08:36.868581+0000","last_became_active":"2024-07-27T03:08:33.950827+0000","last_became_peered":"2024-07-27T03:08:33.950827+0000","last_unstale":"2024-07-27T03:08:36.868581+0000","last_undegraded":"2024-07-27T03:08:36.868581+0000","last_fullsized":"2024-07-27T03:08:36.868581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:24:42.625083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930431+0000","last_change":"2024-07-27T03:08:32.950138+0000","last_active":"2024-07-27T03:08:34.930431+0000","last_peered":"2024-07-27T03:08:34.930431+0000","last_clean":"2024-07-27T03:08:34.930431+0000","last_became_active":"2024-07-27T03:08:32.949805+0000","last_became_peered":"2024-07-27T03:08:32.949805+0000","last_unstale":"2024-07-27T03:08:34.930431+0000","last_undegraded":"2024-07-27T03:08:34.930431+0000","last_fullsized":"2024-07-27T03:08:34.930431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:54:05.204464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932119+0000","last_change":"2024-07-27T03:08:33.949864+0000","last_active":"2024-07-27T03:08:34.932119+0000","last_peered":"2024-07-27T03:08:34.932119+0000","last_clean":"2024-07-27T03:08:34.932119+0000","last_became_active":"2024-07-27T03:08:33.949559+0000","last_became_peered":"2024-07-27T03:08:33.949559+0000","last_unstale":"2024-07-27T03:08:34.932119+0000","last_undegraded":"2024-07-27T03:08:34.932119+0000","last_fullsized":"2024-07-27T03:08:34.932119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:54:06.207049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933893+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:35.933893+0000","last_peered":"2024-07-27T03:08:35.933893+0000","last_clean":"2024-07-27T03:08:35.933893+0000","last_became_active":"2024-07-27T03:08:32.950507+0000","last_became_peered":"2024-07-27T03:08:32.950507+0000","last_unstale":"2024-07-27T03:08:35.933893+0000","last_undegraded":"2024-07-27T03:08:35.933893+0000","last_fullsized":"2024-07-27T03:08:35.933893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:38.770703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649938+0000","last_change":"2024-07-27T03:08:33.956829+0000","last_active":"2024-07-27T03:08:37.649938+0000","last_peered":"2024-07-27T03:08:37.649938+0000","last_clean":"2024-07-27T03:08:37.649938+0000","last_became_active":"2024-07-27T03:08:33.951501+0000","last_became_peered":"2024-07-27T03:08:33.951501+0000","last_unstale":"2024-07-27T03:08:37.649938+0000","last_undegraded":"2024-07-27T03:08:37.649938+0000","last_fullsized":"2024-07-27T03:08:37.649938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:09:25.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868296+0000","last_change":"2024-07-27T03:08:32.944499+0000","last_active":"2024-07-27T03:08:36.868296+0000","last_peered":"2024-07-27T03:08:36.868296+0000","last_clean":"2024-07-27T03:08:36.868296+0000","last_became_active":"2024-07-27T03:08:32.943866+0000","last_became_peered":"2024-07-27T03:08:32.943866+0000","last_unstale":"2024-07-27T03:08:36.868296+0000","last_undegraded":"2024-07-27T03:08:36.868296+0000","last_fullsized":"2024-07-27T03:08:36.868296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:09.559040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868050+0000","last_change":"2024-07-27T03:08:33.949435+0000","last_active":"2024-07-27T03:08:36.868050+0000","last_peered":"2024-07-27T03:08:36.868050+0000","last_clean":"2024-07-27T03:08:36.868050+0000","last_became_active":"2024-07-27T03:08:33.949090+0000","last_became_peered":"2024-07-27T03:08:33.949090+0000","last_unstale":"2024-07-27T03:08:36.868050+0000","last_undegraded":"2024-07-27T03:08:36.868050+0000","last_fullsized":"2024-07-27T03:08:36.868050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:35:51.827596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932564+0000","last_change":"2024-07-27T03:08:32.949082+0000","last_active":"2024-07-27T03:08:34.932564+0000","last_peered":"2024-07-27T03:08:34.932564+0000","last_clean":"2024-07-27T03:08:34.932564+0000","last_became_active":"2024-07-27T03:08:32.948684+0000","last_became_peered":"2024-07-27T03:08:32.948684+0000","last_unstale":"2024-07-27T03:08:34.932564+0000","last_undegraded":"2024-07-27T03:08:34.932564+0000","last_fullsized":"2024-07-27T03:08:34.932564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:00:08.849358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649859+0000","last_change":"2024-07-27T03:08:33.953574+0000","last_active":"2024-07-27T03:08:37.649859+0000","last_peered":"2024-07-27T03:08:37.649859+0000","last_clean":"2024-07-27T03:08:37.649859+0000","last_became_active":"2024-07-27T03:08:33.953247+0000","last_became_peered":"2024-07-27T03:08:33.953247+0000","last_unstale":"2024-07-27T03:08:37.649859+0000","last_undegraded":"2024-07-27T03:08:37.649859+0000","last_fullsized":"2024-07-27T03:08:37.649859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:36:58.998778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.933743+0000","last_change":"2024-07-27T03:08:32.952599+0000","last_active":"2024-07-27T03:08:35.933743+0000","last_peered":"2024-07-27T03:08:35.933743+0000","last_clean":"2024-07-27T03:08:35.933743+0000","last_became_active":"2024-07-27T03:08:32.952293+0000","last_became_peered":"2024-07-27T03:08:32.952293+0000","last_unstale":"2024-07-27T03:08:35.933743+0000","last_undegraded":"2024-07-27T03:08:35.933743+0000","last_fullsized":"2024-07-27T03:08:35.933743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:01:24.017164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934003+0000","last_change":"2024-07-27T03:08:33.957887+0000","last_active":"2024-07-27T03:08:35.934003+0000","last_peered":"2024-07-27T03:08:35.934003+0000","last_clean":"2024-07-27T03:08:35.934003+0000","last_became_active":"2024-07-27T03:08:33.957528+0000","last_became_peered":"2024-07-27T03:08:33.957528+0000","last_unstale":"2024-07-27T03:08:35.934003+0000","last_undegraded":"2024-07-27T03:08:35.934003+0000","last_fullsized":"2024-07-27T03:08:35.934003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:52:05.096628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755038+0000","last_change":"2024-07-27T03:08:32.946673+0000","last_active":"2024-07-27T03:08:36.755038+0000","last_peered":"2024-07-27T03:08:36.755038+0000","last_clean":"2024-07-27T03:08:36.755038+0000","last_became_active":"2024-07-27T03:08:32.946188+0000","last_became_peered":"2024-07-27T03:08:32.946188+0000","last_unstale":"2024-07-27T03:08:36.755038+0000","last_undegraded":"2024-07-27T03:08:36.755038+0000","last_fullsized":"2024-07-27T03:08:36.755038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:16:05.521168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649536+0000","last_change":"2024-07-27T03:08:33.952508+0000","last_active":"2024-07-27T03:08:37.649536+0000","last_peered":"2024-07-27T03:08:37.649536+0000","last_clean":"2024-07-27T03:08:37.649536+0000","last_became_active":"2024-07-27T03:08:33.952215+0000","last_became_peered":"2024-07-27T03:08:33.952215+0000","last_unstale":"2024-07-27T03:08:37.649536+0000","last_undegraded":"2024-07-27T03:08:37.649536+0000","last_fullsized":"2024-07-27T03:08:37.649536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:24:42.625083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931892+0000","last_change":"2024-07-27T03:08:32.943381+0000","last_active":"2024-07-27T03:08:34.931892+0000","last_peered":"2024-07-27T03:08:34.931892+0000","last_clean":"2024-07-27T03:08:34.931892+0000","last_became_active":"2024-07-27T03:08:32.943077+0000","last_became_peered":"2024-07-27T03:08:32.943077+0000","last_unstale":"2024-07-27T03:08:34.931892+0000","last_undegraded":"2024-07-27T03:08:34.931892+0000","last_fullsized":"2024-07-27T03:08:34.931892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:56:08.696748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650043+0000","last_change":"2024-07-27T03:08:33.952835+0000","last_active":"2024-07-27T03:08:37.650043+0000","last_peered":"2024-07-27T03:08:37.650043+0000","last_clean":"2024-07-27T03:08:37.650043+0000","last_became_active":"2024-07-27T03:08:33.952454+0000","last_became_peered":"2024-07-27T03:08:33.952454+0000","last_unstale":"2024-07-27T03:08:37.650043+0000","last_undegraded":"2024-07-27T03:08:37.650043+0000","last_fullsized":"2024-07-27T03:08:37.650043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:59.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755311+0000","last_change":"2024-07-27T03:08:32.952496+0000","last_active":"2024-07-27T03:08:36.755311+0000","last_peered":"2024-07-27T03:08:36.755311+0000","last_clean":"2024-07-27T03:08:36.755311+0000","last_became_active":"2024-07-27T03:08:32.952196+0000","last_became_peered":"2024-07-27T03:08:32.952196+0000","last_unstale":"2024-07-27T03:08:36.755311+0000","last_undegraded":"2024-07-27T03:08:36.755311+0000","last_fullsized":"2024-07-27T03:08:36.755311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:37:28.835075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650316+0000","last_change":"2024-07-27T03:08:33.954543+0000","last_active":"2024-07-27T03:08:37.650316+0000","last_peered":"2024-07-27T03:08:37.650316+0000","last_clean":"2024-07-27T03:08:37.650316+0000","last_became_active":"2024-07-27T03:08:33.954185+0000","last_became_peered":"2024-07-27T03:08:33.954185+0000","last_unstale":"2024-07-27T03:08:37.650316+0000","last_undegraded":"2024-07-27T03:08:37.650316+0000","last_fullsized":"2024-07-27T03:08:37.650316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:25:33.717037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930593+0000","last_change":"2024-07-27T03:08:32.941336+0000","last_active":"2024-07-27T03:08:34.930593+0000","last_peered":"2024-07-27T03:08:34.930593+0000","last_clean":"2024-07-27T03:08:34.930593+0000","last_became_active":"2024-07-27T03:08:32.940512+0000","last_became_peered":"2024-07-27T03:08:32.940512+0000","last_unstale":"2024-07-27T03:08:34.930593+0000","last_undegraded":"2024-07-27T03:08:34.930593+0000","last_fullsized":"2024-07-27T03:08:34.930593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:28:24.786534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933070+0000","last_change":"2024-07-27T03:08:33.959413+0000","last_active":"2024-07-27T03:08:34.933070+0000","last_peered":"2024-07-27T03:08:34.933070+0000","last_clean":"2024-07-27T03:08:34.933070+0000","last_became_active":"2024-07-27T03:08:33.956911+0000","last_became_peered":"2024-07-27T03:08:33.956911+0000","last_unstale":"2024-07-27T03:08:34.933070+0000","last_undegraded":"2024-07-27T03:08:34.933070+0000","last_fullsized":"2024-07-27T03:08:34.933070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:02:56.479634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755189+0000","last_change":"2024-07-27T03:08:32.950854+0000","last_active":"2024-07-27T03:08:36.755189+0000","last_peered":"2024-07-27T03:08:36.755189+0000","last_clean":"2024-07-27T03:08:36.755189+0000","last_became_active":"2024-07-27T03:08:32.950533+0000","last_became_peered":"2024-07-27T03:08:32.950533+0000","last_unstale":"2024-07-27T03:08:36.755189+0000","last_undegraded":"2024-07-27T03:08:36.755189+0000","last_fullsized":"2024-07-27T03:08:36.755189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:00:08.849358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649904+0000","last_change":"2024-07-27T03:08:33.954154+0000","last_active":"2024-07-27T03:08:37.649904+0000","last_peered":"2024-07-27T03:08:37.649904+0000","last_clean":"2024-07-27T03:08:37.649904+0000","last_became_active":"2024-07-27T03:08:33.953132+0000","last_became_peered":"2024-07-27T03:08:33.953132+0000","last_unstale":"2024-07-27T03:08:37.649904+0000","last_undegraded":"2024-07-27T03:08:37.649904+0000","last_fullsized":"2024-07-27T03:08:37.649904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:01:16.829706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649547+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:08:37.649547+0000","last_peered":"2024-07-27T03:08:37.649547+0000","last_clean":"2024-07-27T03:08:37.649547+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:08:37.649547+0000","last_undegraded":"2024-07-27T03:08:37.649547+0000","last_fullsized":"2024-07-27T03:08:37.649547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.931659+0000","last_change":"2024-07-27T03:08:32.948243+0000","last_active":"2024-07-27T03:08:34.931659+0000","last_peered":"2024-07-27T03:08:34.931659+0000","last_clean":"2024-07-27T03:08:34.931659+0000","last_became_active":"2024-07-27T03:08:32.947945+0000","last_became_peered":"2024-07-27T03:08:32.947945+0000","last_unstale":"2024-07-27T03:08:34.931659+0000","last_undegraded":"2024-07-27T03:08:34.931659+0000","last_fullsized":"2024-07-27T03:08:34.931659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.825946+0000","last_change":"2024-07-27T03:08:33.948128+0000","last_active":"2024-07-27T03:08:35.825946+0000","last_peered":"2024-07-27T03:08:35.825946+0000","last_clean":"2024-07-27T03:08:35.825946+0000","last_became_active":"2024-07-27T03:08:33.947486+0000","last_became_peered":"2024-07-27T03:08:33.947486+0000","last_unstale":"2024-07-27T03:08:35.825946+0000","last_undegraded":"2024-07-27T03:08:35.825946+0000","last_fullsized":"2024-07-27T03:08:35.825946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649403+0000","last_change":"2024-07-27T03:08:32.955404+0000","last_active":"2024-07-27T03:08:37.649403+0000","last_peered":"2024-07-27T03:08:37.649403+0000","last_clean":"2024-07-27T03:08:37.649403+0000","last_became_active":"2024-07-27T03:08:32.955120+0000","last_became_peered":"2024-07-27T03:08:32.955120+0000","last_unstale":"2024-07-27T03:08:37.649403+0000","last_undegraded":"2024-07-27T03:08:37.649403+0000","last_fullsized":"2024-07-27T03:08:37.649403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:02:16.712233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.867978+0000","last_change":"2024-07-27T03:08:33.953727+0000","last_active":"2024-07-27T03:08:36.867978+0000","last_peered":"2024-07-27T03:08:36.867978+0000","last_clean":"2024-07-27T03:08:36.867978+0000","last_became_active":"2024-07-27T03:08:33.952917+0000","last_became_peered":"2024-07-27T03:08:33.952917+0000","last_unstale":"2024-07-27T03:08:36.867978+0000","last_undegraded":"2024-07-27T03:08:36.867978+0000","last_fullsized":"2024-07-27T03:08:36.867978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:11:19.253618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.755186+0000","last_change":"2024-07-27T03:08:32.951299+0000","last_active":"2024-07-27T03:08:36.755186+0000","last_peered":"2024-07-27T03:08:36.755186+0000","last_clean":"2024-07-27T03:08:36.755186+0000","last_became_active":"2024-07-27T03:08:32.950946+0000","last_became_peered":"2024-07-27T03:08:32.950946+0000","last_unstale":"2024-07-27T03:08:36.755186+0000","last_undegraded":"2024-07-27T03:08:36.755186+0000","last_fullsized":"2024-07-27T03:08:36.755186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:19:16.481538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930286+0000","last_change":"2024-07-27T03:08:33.937577+0000","last_active":"2024-07-27T03:08:34.930286+0000","last_peered":"2024-07-27T03:08:34.930286+0000","last_clean":"2024-07-27T03:08:34.930286+0000","last_became_active":"2024-07-27T03:08:33.937262+0000","last_became_peered":"2024-07-27T03:08:33.937262+0000","last_unstale":"2024-07-27T03:08:34.930286+0000","last_undegraded":"2024-07-27T03:08:34.930286+0000","last_fullsized":"2024-07-27T03:08:34.930286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:03:44.111780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932797+0000","last_change":"2024-07-27T03:08:32.943293+0000","last_active":"2024-07-27T03:08:34.932797+0000","last_peered":"2024-07-27T03:08:34.932797+0000","last_clean":"2024-07-27T03:08:34.932797+0000","last_became_active":"2024-07-27T03:08:32.942974+0000","last_became_peered":"2024-07-27T03:08:32.942974+0000","last_unstale":"2024-07-27T03:08:34.932797+0000","last_undegraded":"2024-07-27T03:08:34.932797+0000","last_fullsized":"2024-07-27T03:08:34.932797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:19:16.481538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932094+0000","last_change":"2024-07-27T03:08:33.954605+0000","last_active":"2024-07-27T03:08:34.932094+0000","last_peered":"2024-07-27T03:08:34.932094+0000","last_clean":"2024-07-27T03:08:34.932094+0000","last_became_active":"2024-07-27T03:08:33.954160+0000","last_became_peered":"2024-07-27T03:08:33.954160+0000","last_unstale":"2024-07-27T03:08:34.932094+0000","last_undegraded":"2024-07-27T03:08:34.932094+0000","last_fullsized":"2024-07-27T03:08:34.932094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:32.582766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930412+0000","last_change":"2024-07-27T03:08:32.938940+0000","last_active":"2024-07-27T03:08:34.930412+0000","last_peered":"2024-07-27T03:08:34.930412+0000","last_clean":"2024-07-27T03:08:34.930412+0000","last_became_active":"2024-07-27T03:08:32.938639+0000","last_became_peered":"2024-07-27T03:08:32.938639+0000","last_unstale":"2024-07-27T03:08:34.930412+0000","last_undegraded":"2024-07-27T03:08:34.930412+0000","last_fullsized":"2024-07-27T03:08:34.930412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:59:24.797895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933291+0000","last_change":"2024-07-27T03:08:33.948481+0000","last_active":"2024-07-27T03:08:34.933291+0000","last_peered":"2024-07-27T03:08:34.933291+0000","last_clean":"2024-07-27T03:08:34.933291+0000","last_became_active":"2024-07-27T03:08:33.948155+0000","last_became_peered":"2024-07-27T03:08:33.948155+0000","last_unstale":"2024-07-27T03:08:34.933291+0000","last_undegraded":"2024-07-27T03:08:34.933291+0000","last_fullsized":"2024-07-27T03:08:34.933291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:59.531187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650236+0000","last_change":"2024-07-27T03:08:32.955213+0000","last_active":"2024-07-27T03:08:37.650236+0000","last_peered":"2024-07-27T03:08:37.650236+0000","last_clean":"2024-07-27T03:08:37.650236+0000","last_became_active":"2024-07-27T03:08:32.954883+0000","last_became_peered":"2024-07-27T03:08:32.954883+0000","last_unstale":"2024-07-27T03:08:37.650236+0000","last_undegraded":"2024-07-27T03:08:37.650236+0000","last_fullsized":"2024-07-27T03:08:37.650236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:53:17.583725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930594+0000","last_change":"2024-07-27T03:08:33.941170+0000","last_active":"2024-07-27T03:08:34.930594+0000","last_peered":"2024-07-27T03:08:34.930594+0000","last_clean":"2024-07-27T03:08:34.930594+0000","last_became_active":"2024-07-27T03:08:33.940792+0000","last_became_peered":"2024-07-27T03:08:33.940792+0000","last_unstale":"2024-07-27T03:08:34.930594+0000","last_undegraded":"2024-07-27T03:08:34.930594+0000","last_fullsized":"2024-07-27T03:08:34.930594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:35:01.175302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930630+0000","last_change":"2024-07-27T03:08:32.945506+0000","last_active":"2024-07-27T03:08:34.930630+0000","last_peered":"2024-07-27T03:08:34.930630+0000","last_clean":"2024-07-27T03:08:34.930630+0000","last_became_active":"2024-07-27T03:08:32.945201+0000","last_became_peered":"2024-07-27T03:08:32.945201+0000","last_unstale":"2024-07-27T03:08:34.930630+0000","last_undegraded":"2024-07-27T03:08:34.930630+0000","last_fullsized":"2024-07-27T03:08:34.930630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:58:54.316561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826477+0000","last_change":"2024-07-27T03:08:33.956128+0000","last_active":"2024-07-27T03:08:35.826477+0000","last_peered":"2024-07-27T03:08:35.826477+0000","last_clean":"2024-07-27T03:08:35.826477+0000","last_became_active":"2024-07-27T03:08:33.955341+0000","last_became_peered":"2024-07-27T03:08:33.955341+0000","last_unstale":"2024-07-27T03:08:35.826477+0000","last_undegraded":"2024-07-27T03:08:35.826477+0000","last_fullsized":"2024-07-27T03:08:35.826477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:04:25.906455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934062+0000","last_change":"2024-07-27T03:08:32.949210+0000","last_active":"2024-07-27T03:08:35.934062+0000","last_peered":"2024-07-27T03:08:35.934062+0000","last_clean":"2024-07-27T03:08:35.934062+0000","last_became_active":"2024-07-27T03:08:32.948858+0000","last_became_peered":"2024-07-27T03:08:32.948858+0000","last_unstale":"2024-07-27T03:08:35.934062+0000","last_undegraded":"2024-07-27T03:08:35.934062+0000","last_fullsized":"2024-07-27T03:08:35.934062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:31.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868515+0000","last_change":"2024-07-27T03:08:33.952497+0000","last_active":"2024-07-27T03:08:36.868515+0000","last_peered":"2024-07-27T03:08:36.868515+0000","last_clean":"2024-07-27T03:08:36.868515+0000","last_became_active":"2024-07-27T03:08:33.952113+0000","last_became_peered":"2024-07-27T03:08:33.952113+0000","last_unstale":"2024-07-27T03:08:36.868515+0000","last_undegraded":"2024-07-27T03:08:36.868515+0000","last_fullsized":"2024-07-27T03:08:36.868515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:35:20.173378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649390+0000","last_change":"2024-07-27T03:08:32.955144+0000","last_active":"2024-07-27T03:08:37.649390+0000","last_peered":"2024-07-27T03:08:37.649390+0000","last_clean":"2024-07-27T03:08:37.649390+0000","last_became_active":"2024-07-27T03:08:32.954645+0000","last_became_peered":"2024-07-27T03:08:32.954645+0000","last_unstale":"2024-07-27T03:08:37.649390+0000","last_undegraded":"2024-07-27T03:08:37.649390+0000","last_fullsized":"2024-07-27T03:08:37.649390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:19:16.481538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.932211+0000","last_change":"2024-07-27T03:08:33.941376+0000","last_active":"2024-07-27T03:08:34.932211+0000","last_peered":"2024-07-27T03:08:34.932211+0000","last_clean":"2024-07-27T03:08:34.932211+0000","last_became_active":"2024-07-27T03:08:33.940032+0000","last_became_peered":"2024-07-27T03:08:33.940032+0000","last_unstale":"2024-07-27T03:08:34.932211+0000","last_undegraded":"2024-07-27T03:08:34.932211+0000","last_fullsized":"2024-07-27T03:08:34.932211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:28:25.789119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930293+0000","last_change":"2024-07-27T03:08:32.947719+0000","last_active":"2024-07-27T03:08:34.930293+0000","last_peered":"2024-07-27T03:08:34.930293+0000","last_clean":"2024-07-27T03:08:34.930293+0000","last_became_active":"2024-07-27T03:08:32.947422+0000","last_became_peered":"2024-07-27T03:08:32.947422+0000","last_unstale":"2024-07-27T03:08:34.930293+0000","last_undegraded":"2024-07-27T03:08:34.930293+0000","last_fullsized":"2024-07-27T03:08:34.930293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:31.580180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826037+0000","last_change":"2024-07-27T03:08:33.944591+0000","last_active":"2024-07-27T03:08:35.826037+0000","last_peered":"2024-07-27T03:08:35.826037+0000","last_clean":"2024-07-27T03:08:35.826037+0000","last_became_active":"2024-07-27T03:08:33.944286+0000","last_became_peered":"2024-07-27T03:08:33.944286+0000","last_unstale":"2024-07-27T03:08:35.826037+0000","last_undegraded":"2024-07-27T03:08:35.826037+0000","last_fullsized":"2024-07-27T03:08:35.826037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:28.601363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.930426+0000","last_change":"2024-07-27T03:08:32.950885+0000","last_active":"2024-07-27T03:08:34.930426+0000","last_peered":"2024-07-27T03:08:34.930426+0000","last_clean":"2024-07-27T03:08:34.930426+0000","last_became_active":"2024-07-27T03:08:32.950569+0000","last_became_peered":"2024-07-27T03:08:32.950569+0000","last_unstale":"2024-07-27T03:08:34.930426+0000","last_undegraded":"2024-07-27T03:08:34.930426+0000","last_fullsized":"2024-07-27T03:08:34.930426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:38.770703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826274+0000","last_change":"2024-07-27T03:08:33.954837+0000","last_active":"2024-07-27T03:08:35.826274+0000","last_peered":"2024-07-27T03:08:35.826274+0000","last_clean":"2024-07-27T03:08:35.826274+0000","last_became_active":"2024-07-27T03:08:33.953709+0000","last_became_peered":"2024-07-27T03:08:33.953709+0000","last_unstale":"2024-07-27T03:08:35.826274+0000","last_undegraded":"2024-07-27T03:08:35.826274+0000","last_fullsized":"2024-07-27T03:08:35.826274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:35:01.175302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650106+0000","last_change":"2024-07-27T03:08:32.952714+0000","last_active":"2024-07-27T03:08:37.650106+0000","last_peered":"2024-07-27T03:08:37.650106+0000","last_clean":"2024-07-27T03:08:37.650106+0000","last_became_active":"2024-07-27T03:08:32.952425+0000","last_became_peered":"2024-07-27T03:08:32.952425+0000","last_unstale":"2024-07-27T03:08:37.650106+0000","last_undegraded":"2024-07-27T03:08:37.650106+0000","last_fullsized":"2024-07-27T03:08:37.650106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:00:08.849358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.934081+0000","last_change":"2024-07-27T03:08:33.957221+0000","last_active":"2024-07-27T03:08:35.934081+0000","last_peered":"2024-07-27T03:08:35.934081+0000","last_clean":"2024-07-27T03:08:35.934081+0000","last_became_active":"2024-07-27T03:08:33.956847+0000","last_became_peered":"2024-07-27T03:08:33.956847+0000","last_unstale":"2024-07-27T03:08:35.934081+0000","last_undegraded":"2024-07-27T03:08:35.934081+0000","last_fullsized":"2024-07-27T03:08:35.934081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:00:50.876018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933249+0000","last_change":"2024-07-27T03:08:33.941040+0000","last_active":"2024-07-27T03:08:34.933249+0000","last_peered":"2024-07-27T03:08:34.933249+0000","last_clean":"2024-07-27T03:08:34.933249+0000","last_became_active":"2024-07-27T03:08:33.940723+0000","last_became_peered":"2024-07-27T03:08:33.940723+0000","last_unstale":"2024-07-27T03:08:34.933249+0000","last_undegraded":"2024-07-27T03:08:34.933249+0000","last_fullsized":"2024-07-27T03:08:34.933249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:51.758397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.649790+0000","last_change":"2024-07-27T03:08:32.953454+0000","last_active":"2024-07-27T03:08:37.649790+0000","last_peered":"2024-07-27T03:08:37.649790+0000","last_clean":"2024-07-27T03:08:37.649790+0000","last_became_active":"2024-07-27T03:08:32.953065+0000","last_became_peered":"2024-07-27T03:08:32.953065+0000","last_unstale":"2024-07-27T03:08:37.649790+0000","last_undegraded":"2024-07-27T03:08:37.649790+0000","last_fullsized":"2024-07-27T03:08:37.649790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:32:44.100894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:34.933070+0000","last_change":"2024-07-27T03:08:33.945495+0000","last_active":"2024-07-27T03:08:34.933070+0000","last_peered":"2024-07-27T03:08:34.933070+0000","last_clean":"2024-07-27T03:08:34.933070+0000","last_became_active":"2024-07-27T03:08:33.945151+0000","last_became_peered":"2024-07-27T03:08:33.945151+0000","last_unstale":"2024-07-27T03:08:34.933070+0000","last_undegraded":"2024-07-27T03:08:34.933070+0000","last_fullsized":"2024-07-27T03:08:34.933070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:09:25.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:37.650078+0000","last_change":"2024-07-27T03:08:32.951809+0000","last_active":"2024-07-27T03:08:37.650078+0000","last_peered":"2024-07-27T03:08:37.650078+0000","last_clean":"2024-07-27T03:08:37.650078+0000","last_became_active":"2024-07-27T03:08:32.951495+0000","last_became_peered":"2024-07-27T03:08:32.951495+0000","last_unstale":"2024-07-27T03:08:37.650078+0000","last_undegraded":"2024-07-27T03:08:37.650078+0000","last_fullsized":"2024-07-27T03:08:37.650078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:37:28.835075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868576+0000","last_change":"2024-07-27T03:08:33.960311+0000","last_active":"2024-07-27T03:08:36.868576+0000","last_peered":"2024-07-27T03:08:36.868576+0000","last_clean":"2024-07-27T03:08:36.868576+0000","last_became_active":"2024-07-27T03:08:33.960017+0000","last_became_peered":"2024-07-27T03:08:33.960017+0000","last_unstale":"2024-07-27T03:08:36.868576+0000","last_undegraded":"2024-07-27T03:08:36.868576+0000","last_fullsized":"2024-07-27T03:08:36.868576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:53:39.837754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826447+0000","last_change":"2024-07-27T03:08:32.951332+0000","last_active":"2024-07-27T03:08:35.826447+0000","last_peered":"2024-07-27T03:08:35.826447+0000","last_clean":"2024-07-27T03:08:35.826447+0000","last_became_active":"2024-07-27T03:08:32.949369+0000","last_became_peered":"2024-07-27T03:08:32.949369+0000","last_unstale":"2024-07-27T03:08:35.826447+0000","last_undegraded":"2024-07-27T03:08:35.826447+0000","last_fullsized":"2024-07-27T03:08:35.826447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:01:24.017164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:35.826448+0000","last_change":"2024-07-27T03:08:33.952852+0000","last_active":"2024-07-27T03:08:35.826448+0000","last_peered":"2024-07-27T03:08:35.826448+0000","last_clean":"2024-07-27T03:08:35.826448+0000","last_became_active":"2024-07-27T03:08:33.952541+0000","last_became_peered":"2024-07-27T03:08:33.952541+0000","last_unstale":"2024-07-27T03:08:35.826448+0000","last_undegraded":"2024-07-27T03:08:35.826448+0000","last_fullsized":"2024-07-27T03:08:35.826448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:32.918223+0000","last_clean_scrub_stamp":"2024-07-27T03:08:32.918223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:00:35.656920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-07-27T03:08:36.868665+0000","last_change":"2024-07-27T03:08:32.949235+0000","last_active":"2024-07-27T03:08:36.868665+0000","last_peered":"2024-07-27T03:08:36.868665+0000","last_clean":"2024-07-27T03:08:36.868665+0000","last_became_active":"2024-07-27T03:08:32.948934+0000","last_became_peered":"2024-07-27T03:08:32.948934+0000","last_unstale":"2024-07-27T03:08:36.868665+0000","last_undegraded":"2024-07-27T03:08:36.868665+0000","last_fullsized":"2024-07-27T03:08:36.868665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:31.915638+0000","last_clean_scrub_stamp":"2024-07-27T03:08:31.915638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:07:06.101509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":668236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":77376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":77286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":668292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":78898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:08:46.010 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-27T03:08:46.010 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-07-27T03:08:46.010 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-07-27T03:08:46.010 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-07-27T03:08:46.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.156+0000 7f5c75d40640 1 -- 172.21.15.120:0/1426813552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c700b75b0 msgr2=0x7f5c700d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.156+0000 7f5c75d40640 1 --2- 172.21.15.120:0/1426813552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c700b75b0 0x7f5c700d0790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5c700b7000 tx=0x7f5c6002a560 comp rx=0 tx=0).stop 2024-07-27T03:08:46.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.156+0000 7f5c75d40640 1 -- 172.21.15.120:0/1426813552 shutdown_connections 2024-07-27T03:08:46.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.156+0000 7f5c75d40640 1 --2- 172.21.15.120:0/1426813552 >> v2:172.21.15.121:3300/0 conn(0x7f5c700cd940 0x7f5c700b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.156+0000 7f5c75d40640 1 --2- 172.21.15.120:0/1426813552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c700b75b0 0x7f5c700d0790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.156+0000 7f5c75d40640 1 -- 172.21.15.120:0/1426813552 >> 172.21.15.120:0/1426813552 conn(0x7f5c700d1dd0 msgr2=0x7f5c700d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:46.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.156+0000 7f5c75d40640 1 -- 172.21.15.120:0/1426813552 shutdown_connections 2024-07-27T03:08:46.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.156+0000 7f5c75d40640 1 -- 172.21.15.120:0/1426813552 wait complete. 2024-07-27T03:08:46.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.158+0000 7f5c75d40640 1 Processor -- start 2024-07-27T03:08:46.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.158+0000 7f5c75d40640 1 -- start start 2024-07-27T03:08:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.159+0000 7f5c75d40640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c700b75b0 0x7f5c7015f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.159+0000 7f5c75d40640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c700cd940 0x7f5c70159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.159+0000 7f5c75d40640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c700d28f0 0x7f5c700b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.159+0000 7f5c75d40640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5c700b1f50 con 0x7f5c700b75b0 2024-07-27T03:08:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.159+0000 7f5c75d40640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5c700b1dd0 con 0x7f5c700d28f0 2024-07-27T03:08:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.159+0000 7f5c75d40640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5c70166aa0 con 0x7f5c700cd940 2024-07-27T03:08:46.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.159+0000 7f5c6f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c700b75b0 0x7f5c7015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c6f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c700b75b0 0x7f5c7015f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46940/0 (socket says 172.21.15.120:46940) 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c6f7fe640 1 -- 172.21.15.120:0/295424741 learned_addr learned my addr 172.21.15.120:0/295424741 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c6ffff640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c700d28f0 0x7f5c700b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c6effd640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c700cd940 0x7f5c70159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c6f7fe640 1 -- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c700cd940 msgr2=0x7f5c70159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c6f7fe640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c700cd940 0x7f5c70159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c6f7fe640 1 -- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c700d28f0 msgr2=0x7f5c700b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c6f7fe640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c700d28f0 0x7f5c700b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c6f7fe640 1 -- 172.21.15.120:0/295424741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c701f32d0 con 0x7f5c700b75b0 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c6f7fe640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c700b75b0 0x7f5c7015f9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c60034040 tx=0x7f5c60003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c57fff640 1 -- 172.21.15.120:0/295424741 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6003e030 con 0x7f5c700b75b0 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c57fff640 1 -- 172.21.15.120:0/295424741 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c60003e00 con 0x7f5c700b75b0 2024-07-27T03:08:46.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c75d40640 1 -- 172.21.15.120:0/295424741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c700b5140 con 0x7f5c700b75b0 2024-07-27T03:08:46.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c57fff640 1 -- 172.21.15.120:0/295424741 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60035040 con 0x7f5c700b75b0 2024-07-27T03:08:46.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.160+0000 7f5c75d40640 1 -- 172.21.15.120:0/295424741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c700b69c0 con 0x7f5c700b75b0 2024-07-27T03:08:46.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.161+0000 7f5c75d40640 1 -- 172.21.15.120:0/295424741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c700cc290 con 0x7f5c700b75b0 2024-07-27T03:08:46.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.162+0000 7f5c57fff640 1 -- 172.21.15.120:0/295424741 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5c60041030 con 0x7f5c700b75b0 2024-07-27T03:08:46.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.162+0000 7f5c57fff640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c5c077010 0x7f5c5c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.163+0000 7f5c57fff640 1 -- 172.21.15.120:0/295424741 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5c600b90d0 con 0x7f5c700b75b0 2024-07-27T03:08:46.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.163+0000 7f5c6effd640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c5c077010 0x7f5c5c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.163+0000 7f5c6effd640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c5c077010 0x7f5c5c079520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5c7015f090 tx=0x7f5c64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:46.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.167+0000 7f5c57fff640 1 -- 172.21.15.120:0/295424741 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5c700cc290 con 0x7f5c700b75b0 2024-07-27T03:08:46.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.391+0000 7f5c75d40640 1 -- 172.21.15.120:0/295424741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5c700d0790 con 0x7f5c700b75b0 2024-07-27T03:08:46.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.391+0000 7f5c57fff640 1 -- 172.21.15.120:0/295424741 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5c60081c80 con 0x7f5c700b75b0 2024-07-27T03:08:46.394 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:46.394 INFO:teuthology.orchestra.run.smithi120.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-07-27T03:08:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 -- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c5c077010 msgr2=0x7f5c5c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c5c077010 0x7f5c5c079520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5c7015f090 tx=0x7f5c64009040 comp rx=0 tx=0).stop 2024-07-27T03:08:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 -- 172.21.15.120:0/295424741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c700b75b0 msgr2=0x7f5c7015f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c700b75b0 0x7f5c7015f9d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c60034040 tx=0x7f5c60003910 comp rx=0 tx=0).stop 2024-07-27T03:08:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 -- 172.21.15.120:0/295424741 shutdown_connections 2024-07-27T03:08:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c5c077010 0x7f5c5c079520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c700d28f0 0x7f5c700b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c700cd940 0x7f5c70159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 --2- 172.21.15.120:0/295424741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c700b75b0 0x7f5c7015f9d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 -- 172.21.15.120:0/295424741 >> 172.21.15.120:0/295424741 conn(0x7f5c700d1dd0 msgr2=0x7f5c7015ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:46.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 -- 172.21.15.120:0/295424741 shutdown_connections 2024-07-27T03:08:46.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.394+0000 7f5c75d40640 1 -- 172.21.15.120:0/295424741 wait complete. 2024-07-27T03:08:46.407 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-07-27T03:08:46.408 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:08:46.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.519+0000 7fd2898c1640 1 -- 172.21.15.120:0/630459906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd26c003a50 msgr2=0x7fd26c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.519+0000 7fd2898c1640 1 --2- 172.21.15.120:0/630459906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd26c003a50 0x7fd26c003ec0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd274009b50 tx=0x7fd26c005830 comp rx=0 tx=0).stop 2024-07-27T03:08:46.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.519+0000 7fd2898c1640 1 -- 172.21.15.120:0/630459906 shutdown_connections 2024-07-27T03:08:46.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.519+0000 7fd2898c1640 1 --2- 172.21.15.120:0/630459906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd26c003a50 0x7fd26c003ec0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.519+0000 7fd2898c1640 1 -- 172.21.15.120:0/630459906 >> 172.21.15.120:0/630459906 conn(0x7fd28408d690 msgr2=0x7fd28409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:46.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.519+0000 7fd2898c1640 1 -- 172.21.15.120:0/630459906 shutdown_connections 2024-07-27T03:08:46.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.519+0000 7fd2898c1640 1 -- 172.21.15.120:0/630459906 wait complete. 2024-07-27T03:08:46.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.521+0000 7fd2898c1640 1 Processor -- start 2024-07-27T03:08:46.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.521+0000 7fd2898c1640 1 -- start start 2024-07-27T03:08:46.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.522+0000 7fd2898c1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd26c003a50 0x7fd2840c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.522+0000 7fd2898c1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28415d120 0x7fd2840b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.522+0000 7fd2898c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2840b8370 0x7fd2840c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.522+0000 7fd2898c1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd2840d2bf0 con 0x7fd2840b8370 2024-07-27T03:08:46.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.522+0000 7fd2898c1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd2840b2f60 con 0x7fd28415d120 2024-07-27T03:08:46.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.522+0000 7fd2898c1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd2840d2d70 con 0x7fd26c003a50 2024-07-27T03:08:46.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.522+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2840b8370 0x7fd2840c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.522+0000 7fd2837fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2840b8370 0x7fd2840c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46954/0 (socket says 172.21.15.120:46954) 2024-07-27T03:08:46.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.522+0000 7fd2837fe640 1 -- 172.21.15.120:0/1917637869 learned_addr learned my addr 172.21.15.120:0/1917637869 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:46.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.522+0000 7fd2827fc640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28415d120 0x7fd2840b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.522+0000 7fd282ffd640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd26c003a50 0x7fd2840c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd2837fe640 1 -- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd26c003a50 msgr2=0x7fd2840c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd2837fe640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd26c003a50 0x7fd2840c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd2837fe640 1 -- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28415d120 msgr2=0x7fd2840b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd2837fe640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28415d120 0x7fd2840b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd2837fe640 1 -- 172.21.15.120:0/1917637869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2840b8780 con 0x7fd2840b8370 2024-07-27T03:08:46.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd282ffd640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd26c003a50 0x7fd2840c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:46.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd2837fe640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2840b8370 0x7fd2840c7a50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd27c001330 tx=0x7fd27c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:46.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd26bfff640 1 -- 172.21.15.120:0/1917637869 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c010890 con 0x7fd2840b8370 2024-07-27T03:08:46.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd26bfff640 1 -- 172.21.15.120:0/1917637869 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd27c017070 con 0x7fd2840b8370 2024-07-27T03:08:46.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd2898c1640 1 -- 172.21.15.120:0/1917637869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2840ca150 con 0x7fd2840b8370 2024-07-27T03:08:46.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd26bfff640 1 -- 172.21.15.120:0/1917637869 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c010da0 con 0x7fd2840b8370 2024-07-27T03:08:46.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.523+0000 7fd2898c1640 1 -- 172.21.15.120:0/1917637869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2841f5870 con 0x7fd2840b8370 2024-07-27T03:08:46.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.524+0000 7fd2898c1640 1 -- 172.21.15.120:0/1917637869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2840c9ec0 con 0x7fd2840b8370 2024-07-27T03:08:46.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.525+0000 7fd26bfff640 1 -- 172.21.15.120:0/1917637869 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd27c01c460 con 0x7fd2840b8370 2024-07-27T03:08:46.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.525+0000 7fd26bfff640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd270077040 0x7fd270079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.526+0000 7fd26bfff640 1 -- 172.21.15.120:0/1917637869 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd27c0989e0 con 0x7fd2840b8370 2024-07-27T03:08:46.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.526+0000 7fd282ffd640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd270077040 0x7fd270079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.526+0000 7fd282ffd640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd270077040 0x7fd270079550 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd274035000 tx=0x7fd2740046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:46.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.530+0000 7fd26bfff640 1 -- 172.21.15.120:0/1917637869 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd2840b8780 con 0x7fd2840b8370 2024-07-27T03:08:46.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.748+0000 7fd2898c1640 1 -- 172.21.15.120:0/1917637869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd284161480 con 0x7fd2840b8370 2024-07-27T03:08:46.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.748+0000 7fd26bfff640 1 -- 172.21.15.120:0/1917637869 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7fd284161480 con 0x7fd2840b8370 2024-07-27T03:08:46.751 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:46.751 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":8,"btime":"2024-07-27T03:08:36:963563+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/4223514676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4223514676},{"type":"v1","addr":"172.21.15.120:6834","nonce":4223514676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1736241961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1736241961},{"type":"v1","addr":"172.21.15.121:6837","nonce":1736241961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/625386978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":625386978},{"type":"v1","addr":"172.21.15.121:6836","nonce":625386978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:08:33.299496+0000","modified":"2024-07-27T03:08:36.330563+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/552629761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":552629761},{"type":"v1","addr":"172.21.15.120:6835","nonce":552629761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4359,"qdb_cluster":[4359]},"id":1}]} 2024-07-27T03:08:46.751 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 8 2024-07-27T03:08:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 -- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd270077040 msgr2=0x7fd270079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd270077040 0x7fd270079550 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd274035000 tx=0x7fd2740046c0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 -- 172.21.15.120:0/1917637869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2840b8370 msgr2=0x7fd2840c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2840b8370 0x7fd2840c7a50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd27c001330 tx=0x7fd27c00ea50 comp rx=0 tx=0).stop 2024-07-27T03:08:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 -- 172.21.15.120:0/1917637869 shutdown_connections 2024-07-27T03:08:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd270077040 0x7fd270079550 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2840b8370 0x7fd2840c7a50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd28415d120 0x7fd2840b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 --2- 172.21.15.120:0/1917637869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd26c003a50 0x7fd2840c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 -- 172.21.15.120:0/1917637869 >> 172.21.15.120:0/1917637869 conn(0x7fd28408d690 msgr2=0x7fd2840cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 -- 172.21.15.120:0/1917637869 shutdown_connections 2024-07-27T03:08:46.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.750+0000 7fd2898c1640 1 -- 172.21.15.120:0/1917637869 wait complete. 2024-07-27T03:08:46.764 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:08:46.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.875+0000 7f151539f640 1 -- 172.21.15.120:0/925219279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15100d0c50 msgr2=0x7f15100b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.875+0000 7f151539f640 1 --2- 172.21.15.120:0/925219279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15100d0c50 0x7f15100b36f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f151008c370 tx=0x7f14f802a560 comp rx=0 tx=0).stop 2024-07-27T03:08:46.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.875+0000 7f151539f640 1 -- 172.21.15.120:0/925219279 shutdown_connections 2024-07-27T03:08:46.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.875+0000 7f151539f640 1 --2- 172.21.15.120:0/925219279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15100d1060 0x7f15100b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.875+0000 7f151539f640 1 --2- 172.21.15.120:0/925219279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15100d0c50 0x7f15100b36f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.875+0000 7f151539f640 1 --2- 172.21.15.120:0/925219279 >> v2:172.21.15.121:3300/0 conn(0x7f15100d4960 0x7f15100d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.875+0000 7f151539f640 1 -- 172.21.15.120:0/925219279 >> 172.21.15.120:0/925219279 conn(0x7f15100d3e40 msgr2=0x7f15100d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:46.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.875+0000 7f151539f640 1 -- 172.21.15.120:0/925219279 shutdown_connections 2024-07-27T03:08:46.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.875+0000 7f151539f640 1 -- 172.21.15.120:0/925219279 wait complete. 2024-07-27T03:08:46.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.877+0000 7f151539f640 1 Processor -- start 2024-07-27T03:08:46.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.877+0000 7f151539f640 1 -- start start 2024-07-27T03:08:46.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.878+0000 7f151539f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15100d0c50 0x7f15100cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.878+0000 7f151539f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15100d1060 0x7f15101d9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.878+0000 7f151539f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15100d4960 0x7f15101d9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.878+0000 7f151539f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f15100b42f0 con 0x7f15100d0c50 2024-07-27T03:08:46.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.878+0000 7f151539f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f15100b4170 con 0x7f15100d1060 2024-07-27T03:08:46.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.878+0000 7f151539f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f15100b4470 con 0x7f15100d4960 2024-07-27T03:08:46.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15100d0c50 0x7f15100cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15100d0c50 0x7f15100cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46972/0 (socket says 172.21.15.120:46972) 2024-07-27T03:08:46.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150ffff640 1 -- 172.21.15.120:0/1785368160 learned_addr learned my addr 172.21.15.120:0/1785368160 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:46.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150f7fe640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15100d1060 0x7f15101d9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f1514b9e640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15100d4960 0x7f15101d9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150ffff640 1 -- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15100d4960 msgr2=0x7f15101d9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150ffff640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15100d4960 0x7f15101d9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150ffff640 1 -- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15100d1060 msgr2=0x7f15101d9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:46.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150ffff640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15100d1060 0x7f15101d9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:46.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150ffff640 1 -- 172.21.15.120:0/1785368160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15101f6360 con 0x7f15100d0c50 2024-07-27T03:08:46.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f1514b9e640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15100d4960 0x7f15101d9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:46.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150ffff640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15100d0c50 0x7f15100cd370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f150000d750 tx=0x7f150000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:46.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150cff9640 1 -- 172.21.15.120:0/1785368160 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500017070 con 0x7f15100d0c50 2024-07-27T03:08:46.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150cff9640 1 -- 172.21.15.120:0/1785368160 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1500004310 con 0x7f15100d0c50 2024-07-27T03:08:46.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f151539f640 1 -- 172.21.15.120:0/1785368160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15101f6600 con 0x7f15100d0c50 2024-07-27T03:08:46.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f150cff9640 1 -- 172.21.15.120:0/1785368160 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150000de60 con 0x7f15100d0c50 2024-07-27T03:08:46.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.879+0000 7f151539f640 1 -- 172.21.15.120:0/1785368160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15101f6bc0 con 0x7f15100d0c50 2024-07-27T03:08:46.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.880+0000 7f151539f640 1 -- 172.21.15.120:0/1785368160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15100b9930 con 0x7f15100d0c50 2024-07-27T03:08:46.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.881+0000 7f150cff9640 1 -- 172.21.15.120:0/1785368160 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1500009c30 con 0x7f15100d0c50 2024-07-27T03:08:46.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.881+0000 7f150cff9640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f0077010 0x7f14f0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:46.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.881+0000 7f150cff9640 1 -- 172.21.15.120:0/1785368160 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1500098d30 con 0x7f15100d0c50 2024-07-27T03:08:46.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.882+0000 7f150f7fe640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f0077010 0x7f14f0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:46.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.882+0000 7f150f7fe640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f0077010 0x7f14f0079520 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f14f8033000 tx=0x7f14f8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:46.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:46.886+0000 7f150cff9640 1 -- 172.21.15.120:0/1785368160 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f15100b9930 con 0x7f15100d0c50 2024-07-27T03:08:47.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.109+0000 7f151539f640 1 -- 172.21.15.120:0/1785368160 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15100d0710 con 0x7f15100d0c50 2024-07-27T03:08:47.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.109+0000 7f150cff9640 1 -- 172.21.15.120:0/1785368160 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7f150009e020 con 0x7f15100d0c50 2024-07-27T03:08:47.113 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:47.113 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":8,"btime":"2024-07-27T03:08:36:963563+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/4223514676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4223514676},{"type":"v1","addr":"172.21.15.120:6834","nonce":4223514676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1736241961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1736241961},{"type":"v1","addr":"172.21.15.121:6837","nonce":1736241961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/625386978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":625386978},{"type":"v1","addr":"172.21.15.121:6836","nonce":625386978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:08:33.299496+0000","modified":"2024-07-27T03:08:36.330563+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/552629761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":552629761},{"type":"v1","addr":"172.21.15.120:6835","nonce":552629761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4359,"qdb_cluster":[4359]},"id":1}]} 2024-07-27T03:08:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 8 2024-07-27T03:08:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 -- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f0077010 msgr2=0x7f14f0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f0077010 0x7f14f0079520 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f14f8033000 tx=0x7f14f8004730 comp rx=0 tx=0).stop 2024-07-27T03:08:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 -- 172.21.15.120:0/1785368160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15100d0c50 msgr2=0x7f15100cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15100d0c50 0x7f15100cd370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f150000d750 tx=0x7f150000dc10 comp rx=0 tx=0).stop 2024-07-27T03:08:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 -- 172.21.15.120:0/1785368160 shutdown_connections 2024-07-27T03:08:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f14f0077010 0x7f14f0079520 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f15100d4960 0x7f15101d9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15100d1060 0x7f15101d9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 --2- 172.21.15.120:0/1785368160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15100d0c50 0x7f15100cd370 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 -- 172.21.15.120:0/1785368160 >> 172.21.15.120:0/1785368160 conn(0x7f15100d3e40 msgr2=0x7f151006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 -- 172.21.15.120:0/1785368160 shutdown_connections 2024-07-27T03:08:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.112+0000 7f151539f640 1 -- 172.21.15.120:0/1785368160 wait complete. 2024-07-27T03:08:47.126 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:08:47.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.236+0000 7fc5971b9640 1 -- 172.21.15.120:0/3028171389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5900d1de0 msgr2=0x7fc5900d21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.236+0000 7fc5971b9640 1 --2- 172.21.15.120:0/3028171389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5900d1de0 0x7fc5900d21f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc584005fd0 tx=0x7fc58402a530 comp rx=0 tx=0).stop 2024-07-27T03:08:47.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.236+0000 7fc5971b9640 1 -- 172.21.15.120:0/3028171389 shutdown_connections 2024-07-27T03:08:47.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.236+0000 7fc5971b9640 1 --2- 172.21.15.120:0/3028171389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5900d1de0 0x7fc5900d21f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.236+0000 7fc5971b9640 1 --2- 172.21.15.120:0/3028171389 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5900b9430 0x7fc59015e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.236+0000 7fc5971b9640 1 -- 172.21.15.120:0/3028171389 >> 172.21.15.120:0/3028171389 conn(0x7fc5900d3f90 msgr2=0x7fc5900d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:47.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.236+0000 7fc5971b9640 1 -- 172.21.15.120:0/3028171389 shutdown_connections 2024-07-27T03:08:47.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.236+0000 7fc5971b9640 1 -- 172.21.15.120:0/3028171389 wait complete. 2024-07-27T03:08:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.238+0000 7fc5971b9640 1 Processor -- start 2024-07-27T03:08:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.238+0000 7fc5971b9640 1 -- start start 2024-07-27T03:08:47.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc5971b9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5900b8190 0x7fc59009e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:47.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc5971b9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5900b9430 0x7fc5901f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:47.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc5971b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5900d1de0 0x7fc59009ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:47.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc5971b9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc5900b90c0 con 0x7fc5900d1de0 2024-07-27T03:08:47.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc5971b9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc5900b8f40 con 0x7fc5900b9430 2024-07-27T03:08:47.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc5971b9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc5900b9240 con 0x7fc5900b8190 2024-07-27T03:08:47.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc595756640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5900d1de0 0x7fc59009ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:47.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc595756640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5900d1de0 0x7fc59009ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46984/0 (socket says 172.21.15.120:46984) 2024-07-27T03:08:47.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc595756640 1 -- 172.21.15.120:0/1102720762 learned_addr learned my addr 172.21.15.120:0/1102720762 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:47.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc58ffff640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5900b9430 0x7fc5901f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:47.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc594f55640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5900b8190 0x7fc59009e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:47.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc595756640 1 -- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5900b8190 msgr2=0x7fc59009e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc595756640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5900b8190 0x7fc59009e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc595756640 1 -- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5900b9430 msgr2=0x7fc5901f8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc595756640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5900b9430 0x7fc5901f8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc595756640 1 -- 172.21.15.120:0/1102720762 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59009eef0 con 0x7fc5900d1de0 2024-07-27T03:08:47.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.239+0000 7fc58ffff640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5900b9430 0x7fc5901f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:47.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.240+0000 7fc595756640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5900d1de0 0x7fc59009ff90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc58800ba10 tx=0x7fc58800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:47.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.240+0000 7fc58d7fa640 1 -- 172.21.15.120:0/1102720762 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc588019070 con 0x7fc5900d1de0 2024-07-27T03:08:47.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.240+0000 7fc58d7fa640 1 -- 172.21.15.120:0/1102720762 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc58800cc30 con 0x7fc5900d1de0 2024-07-27T03:08:47.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.240+0000 7fc5971b9640 1 -- 172.21.15.120:0/1102720762 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc59009f1d0 con 0x7fc5900d1de0 2024-07-27T03:08:47.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.240+0000 7fc58d7fa640 1 -- 172.21.15.120:0/1102720762 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58800ce60 con 0x7fc5900d1de0 2024-07-27T03:08:47.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.240+0000 7fc5971b9640 1 -- 172.21.15.120:0/1102720762 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc59009f790 con 0x7fc5900d1de0 2024-07-27T03:08:47.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.241+0000 7fc5971b9640 1 -- 172.21.15.120:0/1102720762 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc59006a060 con 0x7fc5900d1de0 2024-07-27T03:08:47.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.242+0000 7fc58d7fa640 1 -- 172.21.15.120:0/1102720762 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc58801c070 con 0x7fc5900d1de0 2024-07-27T03:08:47.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.242+0000 7fc58d7fa640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc57c077040 0x7fc57c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:47.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.242+0000 7fc58d7fa640 1 -- 172.21.15.120:0/1102720762 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc5880985b0 con 0x7fc5900d1de0 2024-07-27T03:08:47.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.242+0000 7fc594f55640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc57c077040 0x7fc57c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:47.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.243+0000 7fc594f55640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc57c077040 0x7fc57c079550 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc5900699b0 tx=0x7fc58000a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:47.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.246+0000 7fc58d7fa640 1 -- 172.21.15.120:0/1102720762 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc59006a060 con 0x7fc5900d1de0 2024-07-27T03:08:47.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.432+0000 7fc5971b9640 1 -- 172.21.15.120:0/1102720762 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc59009ec80 con 0x7fc5900d1de0 2024-07-27T03:08:47.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.433+0000 7fc58d7fa640 1 -- 172.21.15.120:0/1102720762 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16629 (secure 0 0 0) 0x7fc588061170 con 0x7fc5900d1de0 2024-07-27T03:08:47.436 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:47.436 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:34.926699+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:08:31.185623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-27T03:08:32.262408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:08:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 -- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc57c077040 msgr2=0x7fc57c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc57c077040 0x7fc57c079550 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc5900699b0 tx=0x7fc58000a250 comp rx=0 tx=0).stop 2024-07-27T03:08:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 -- 172.21.15.120:0/1102720762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5900d1de0 msgr2=0x7fc59009ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5900d1de0 0x7fc59009ff90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc58800ba10 tx=0x7fc58800bed0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 -- 172.21.15.120:0/1102720762 shutdown_connections 2024-07-27T03:08:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc57c077040 0x7fc57c079550 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5900d1de0 0x7fc59009ff90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5900b9430 0x7fc5901f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 --2- 172.21.15.120:0/1102720762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5900b8190 0x7fc59009e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 -- 172.21.15.120:0/1102720762 >> 172.21.15.120:0/1102720762 conn(0x7fc5900d3f90 msgr2=0x7fc59015d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:47.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 -- 172.21.15.120:0/1102720762 shutdown_connections 2024-07-27T03:08:47.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.435+0000 7fc5971b9640 1 -- 172.21.15.120:0/1102720762 wait complete. 2024-07-27T03:08:47.449 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:08:47.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.561+0000 7ff67b56f640 1 -- 172.21.15.120:0/221816620 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff674073680 msgr2=0x7ff6740745a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.561+0000 7ff67b56f640 1 --2- 172.21.15.120:0/221816620 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff674073680 0x7ff6740745a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff664005fd0 tx=0x7ff66402a5d0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.561+0000 7ff67b56f640 1 -- 172.21.15.120:0/221816620 shutdown_connections 2024-07-27T03:08:47.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.561+0000 7ff67b56f640 1 --2- 172.21.15.120:0/221816620 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff674073680 0x7ff6740745a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.561+0000 7ff67b56f640 1 --2- 172.21.15.120:0/221816620 >> v2:172.21.15.121:3300/0 conn(0x7ff67415c8f0 0x7ff674145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.561+0000 7ff67b56f640 1 -- 172.21.15.120:0/221816620 >> 172.21.15.120:0/221816620 conn(0x7ff6740d0f00 msgr2=0x7ff6740d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:47.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.561+0000 7ff67b56f640 1 -- 172.21.15.120:0/221816620 shutdown_connections 2024-07-27T03:08:47.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.561+0000 7ff67b56f640 1 -- 172.21.15.120:0/221816620 wait complete. 2024-07-27T03:08:47.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.563+0000 7ff67b56f640 1 Processor -- start 2024-07-27T03:08:47.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.563+0000 7ff67b56f640 1 -- start start 2024-07-27T03:08:47.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67b56f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff67406c780 0x7ff6741e6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:47.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67b56f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff674073680 0x7ff6741e4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:47.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67b56f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff67415c8f0 0x7ff6741e41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:47.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67b56f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff6740d03f0 con 0x7ff67406c780 2024-07-27T03:08:47.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67b56f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff6740d0270 con 0x7ff67415c8f0 2024-07-27T03:08:47.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67b56f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff6740d0570 con 0x7ff674073680 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67930b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff67406c780 0x7ff6741e6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67930b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff67406c780 0x7ff6741e6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46998/0 (socket says 172.21.15.120:46998) 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67930b640 1 -- 172.21.15.120:0/144439822 learned_addr learned my addr 172.21.15.120:0/144439822 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff679b0c640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff67415c8f0 0x7ff6741e41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff678b0a640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff674073680 0x7ff6741e4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67930b640 1 -- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff674073680 msgr2=0x7ff6741e4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67930b640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff674073680 0x7ff6741e4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67930b640 1 -- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff67415c8f0 msgr2=0x7ff6741e41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67930b640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff67415c8f0 0x7ff6741e41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.564+0000 7ff67930b640 1 -- 172.21.15.120:0/144439822 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6741e1d60 con 0x7ff67406c780 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.565+0000 7ff67930b640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff67406c780 0x7ff6741e6b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff67000e9f0 tx=0x7ff67000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.565+0000 7ff669ffb640 1 -- 172.21.15.120:0/144439822 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67000cd80 con 0x7ff67406c780 2024-07-27T03:08:47.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.565+0000 7ff669ffb640 1 -- 172.21.15.120:0/144439822 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff670004020 con 0x7ff67406c780 2024-07-27T03:08:47.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.565+0000 7ff67b56f640 1 -- 172.21.15.120:0/144439822 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6741e2040 con 0x7ff67406c780 2024-07-27T03:08:47.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.565+0000 7ff669ffb640 1 -- 172.21.15.120:0/144439822 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670004470 con 0x7ff67406c780 2024-07-27T03:08:47.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.565+0000 7ff67b56f640 1 -- 172.21.15.120:0/144439822 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6741e2600 con 0x7ff67406c780 2024-07-27T03:08:47.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.566+0000 7ff67b56f640 1 -- 172.21.15.120:0/144439822 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6740d0a90 con 0x7ff67406c780 2024-07-27T03:08:47.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.566+0000 7ff669ffb640 1 -- 172.21.15.120:0/144439822 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff6700035f0 con 0x7ff67406c780 2024-07-27T03:08:47.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.567+0000 7ff669ffb640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff658077010 0x7ff658079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:47.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.567+0000 7ff669ffb640 1 -- 172.21.15.120:0/144439822 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff670099260 con 0x7ff67406c780 2024-07-27T03:08:47.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.567+0000 7ff678b0a640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff658077010 0x7ff658079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:47.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.568+0000 7ff678b0a640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff658077010 0x7ff658079520 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff664033000 tx=0x7ff664004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:47.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.571+0000 7ff669ffb640 1 -- 172.21.15.120:0/144439822 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff670061e10 con 0x7ff67406c780 2024-07-27T03:08:47.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.788+0000 7ff67b56f640 1 -- 172.21.15.120:0/144439822 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6740b2050 con 0x7ff67406c780 2024-07-27T03:08:47.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.788+0000 7ff669ffb640 1 -- 172.21.15.120:0/144439822 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7ff670066360 con 0x7ff67406c780 2024-07-27T03:08:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:47.791 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":8,"btime":"2024-07-27T03:08:36:963563+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/4223514676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4223514676},{"type":"v1","addr":"172.21.15.120:6834","nonce":4223514676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1736241961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1736241961},{"type":"v1","addr":"172.21.15.121:6837","nonce":1736241961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/625386978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":625386978},{"type":"v1","addr":"172.21.15.121:6836","nonce":625386978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:08:33.299496+0000","modified":"2024-07-27T03:08:36.330563+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/552629761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":552629761},{"type":"v1","addr":"172.21.15.120:6835","nonce":552629761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4359,"qdb_cluster":[4359]},"id":1}]} 2024-07-27T03:08:47.791 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 8 2024-07-27T03:08:47.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.790+0000 7ff67b56f640 1 -- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff658077010 msgr2=0x7ff658079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.790+0000 7ff67b56f640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff658077010 0x7ff658079520 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff664033000 tx=0x7ff664004730 comp rx=0 tx=0).stop 2024-07-27T03:08:47.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.790+0000 7ff67b56f640 1 -- 172.21.15.120:0/144439822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff67406c780 msgr2=0x7ff6741e6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:47.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.790+0000 7ff67b56f640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff67406c780 0x7ff6741e6b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff67000e9f0 tx=0x7ff67000eeb0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.790+0000 7ff67b56f640 1 -- 172.21.15.120:0/144439822 shutdown_connections 2024-07-27T03:08:47.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.790+0000 7ff67b56f640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff658077010 0x7ff658079520 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.790+0000 7ff67b56f640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff67415c8f0 0x7ff6741e41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.790+0000 7ff67b56f640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff674073680 0x7ff6741e4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.790+0000 7ff67b56f640 1 --2- 172.21.15.120:0/144439822 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff67406c780 0x7ff6741e6b60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:47.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.790+0000 7ff67b56f640 1 -- 172.21.15.120:0/144439822 >> 172.21.15.120:0/144439822 conn(0x7ff6740d0f00 msgr2=0x7ff6740d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:47.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.790+0000 7ff67b56f640 1 -- 172.21.15.120:0/144439822 shutdown_connections 2024-07-27T03:08:47.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:47.791+0000 7ff67b56f640 1 -- 172.21.15.120:0/144439822 wait complete. 2024-07-27T03:08:48.207 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:08:33.299496+0000', 'modified': '2024-07-27T03:08:36.330563+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4359}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4359': {'gid': 4359, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6835/552629761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6833', 'nonce': 552629761}, {'type': 'v1', 'addr': '172.21.15.120:6835', 'nonce': 552629761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4359, 'qdb_cluster': [4359]} 2024-07-27T03:08:48.207 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-27T03:08:48.207 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-07-27T03:08:48.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.322+0000 7f3babbe7640 1 -- 172.21.15.120:0/1705559119 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b8c003a30 msgr2=0x7f3b8c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:48.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.322+0000 7f3babbe7640 1 --2- 172.21.15.120:0/1705559119 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b8c003a30 0x7f3b8c003ea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40699b0 tx=0x7f3b8c005830 comp rx=0 tx=0).stop 2024-07-27T03:08:48.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.322+0000 7f3baa184640 1 -- 172.21.15.120:0/1705559119 reap_dead start 2024-07-27T03:08:48.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.322+0000 7f3babbe7640 1 -- 172.21.15.120:0/1705559119 shutdown_connections 2024-07-27T03:08:48.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.322+0000 7f3babbe7640 1 -- 172.21.15.120:0/1705559119 >> 172.21.15.120:0/1705559119 conn(0x7f3ba40d3f90 msgr2=0x7f3ba40d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:48.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.322+0000 7f3babbe7640 1 -- 172.21.15.120:0/1705559119 shutdown_connections 2024-07-27T03:08:48.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.322+0000 7f3babbe7640 1 -- 172.21.15.120:0/1705559119 wait complete. 2024-07-27T03:08:48.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.323+0000 7f3babbe7640 1 Processor -- start 2024-07-27T03:08:48.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.324+0000 7f3babbe7640 1 -- start start 2024-07-27T03:08:48.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3babbe7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b8c003a30 0x7f3ba415a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3babbe7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba4155b40 0x7f3ba41552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3babbe7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ba40a0f70 0x7f3ba40a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3babbe7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba4167590 con 0x7f3b8c003a30 2024-07-27T03:08:48.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3babbe7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba4167410 con 0x7f3ba40a0f70 2024-07-27T03:08:48.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3babbe7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba4167710 con 0x7f3ba4155b40 2024-07-27T03:08:48.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba9983640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b8c003a30 0x7f3ba415a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba9983640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b8c003a30 0x7f3ba415a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47006/0 (socket says 172.21.15.120:47006) 2024-07-27T03:08:48.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba9983640 1 -- 172.21.15.120:0/1887781354 learned_addr learned my addr 172.21.15.120:0/1887781354 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:48.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba9182640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba4155b40 0x7f3ba41552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3baa184640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ba40a0f70 0x7f3ba40a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba9983640 1 -- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba4155b40 msgr2=0x7f3ba41552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba9983640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba4155b40 0x7f3ba41552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba9983640 1 -- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ba40a0f70 msgr2=0x7f3ba40a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba9983640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ba40a0f70 0x7f3ba40a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba9983640 1 -- 172.21.15.120:0/1887781354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba40a18c0 con 0x7f3b8c003a30 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba9983640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b8c003a30 0x7f3ba415a1d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400c700 tx=0x7f3b94004c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba27fc640 1 -- 172.21.15.120:0/1887781354 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b94039070 con 0x7f3b8c003a30 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.325+0000 7f3ba27fc640 1 -- 172.21.15.120:0/1887781354 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b9402bc60 con 0x7f3b8c003a30 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.326+0000 7f3babbe7640 1 -- 172.21.15.120:0/1887781354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba40ca2b0 con 0x7f3b8c003a30 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.326+0000 7f3ba27fc640 1 -- 172.21.15.120:0/1887781354 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b940062b0 con 0x7f3b8c003a30 2024-07-27T03:08:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.326+0000 7f3babbe7640 1 -- 172.21.15.120:0/1887781354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba40c7640 con 0x7f3b8c003a30 2024-07-27T03:08:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.327+0000 7f3ba27fc640 1 -- 172.21.15.120:0/1887781354 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f3b94006450 con 0x7f3b8c003a30 2024-07-27T03:08:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.328+0000 7f3ba27fc640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b90077070 0x7f3b90079580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.328+0000 7f3ba27fc640 1 -- 172.21.15.120:0/1887781354 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3b940b8b30 con 0x7f3b8c003a30 2024-07-27T03:08:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.328+0000 7f3ba9182640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b90077070 0x7f3b90079580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.328+0000 7f3ba9182640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b90077070 0x7f3b90079580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40c96b0 tx=0x7f3b98006ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.329+0000 7f3bb2bd5740 1 Processor -- start 2024-07-27T03:08:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.329+0000 7f3bb2bd5740 1 -- start start 2024-07-27T03:08:48.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.330+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5964270 0x55a5c5d51170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.330+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c593b3b0 0x55a5c5d33e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.330+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5943590 0x55a5c5d34380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.330+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a5c5c7c360 con 0x55a5c5943590 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.330+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a5c5c6b860 con 0x55a5c593b3b0 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.330+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55a5c5c6f8a0 con 0x55a5c5964270 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.330+0000 7f3baa184640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5943590 0x55a5c5d34380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3baa184640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5943590 0x55a5c5d34380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47014/0 (socket says 172.21.15.120:47014) 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3baa184640 1 -- 172.21.15.120:0/3693084059 learned_addr learned my addr 172.21.15.120:0/3693084059 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3ba9983640 1 --2- 172.21.15.120:0/3693084059 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5964270 0x55a5c5d51170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3ba9182640 1 --2- 172.21.15.120:0/3693084059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c593b3b0 0x55a5c5d33e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3baa184640 1 -- 172.21.15.120:0/3693084059 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5964270 msgr2=0x55a5c5d51170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3baa184640 1 --2- 172.21.15.120:0/3693084059 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5964270 0x55a5c5d51170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3baa184640 1 -- 172.21.15.120:0/3693084059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c593b3b0 msgr2=0x55a5c5d33e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3baa184640 1 --2- 172.21.15.120:0/3693084059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c593b3b0 0x55a5c5d33e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3baa184640 1 -- 172.21.15.120:0/3693084059 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5c5bfb360 con 0x55a5c5943590 2024-07-27T03:08:48.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3baa184640 1 --2- 172.21.15.120:0/3693084059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5943590 0x55a5c5d34380 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009900 tx=0x7f3b9c009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d592ba6851d0c745 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3b8b7fe640 1 -- 172.21.15.120:0/3693084059 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c013d40 con 0x55a5c5943590 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3b8b7fe640 1 -- 172.21.15.120:0/3693084059 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b9c004030 con 0x55a5c5943590 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.331+0000 7f3b8b7fe640 1 -- 172.21.15.120:0/3693084059 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c004440 con 0x55a5c5943590 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.332+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3693084059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5943590 msgr2=0x55a5c5d34380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.332+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/3693084059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5943590 0x55a5c5d34380 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009900 tx=0x7f3b9c009dc0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.332+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3693084059 shutdown_connections 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.332+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/3693084059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5943590 0x55a5c5d34380 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.332+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/3693084059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c593b3b0 0x55a5c5d33e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.332+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/3693084059 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5964270 0x55a5c5d51170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.332+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3693084059 >> 172.21.15.120:0/3693084059 conn(0x55a5c59583c0 msgr2=0x55a5c5d0a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.332+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3693084059 shutdown_connections 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.332+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3693084059 wait complete. 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.333+0000 7f3bb2bd5740 1 -- start start 2024-07-27T03:08:48.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.333+0000 7f3bb2bd5740 1 Processor -- start 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.334+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5d5ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.334+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5943590 0x55a5c5d45a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.334+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5964270 0x55a5c5d22860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.334+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a5c59de620 con 0x55a5c593b3b0 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.334+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a5c5c07140 con 0x55a5c5943590 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.334+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55a5c5d46440 con 0x55a5c5964270 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.334+0000 7f3bb2bd5740 10 client.0 _ll_register_callbacks cb 0x55a5c5c64c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.334+0000 7f3ba9983640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5d5ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3ba9983640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5d5ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47016/0 (socket says 172.21.15.120:47016) 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3ba9983640 1 -- 172.21.15.120:0/438840327 learned_addr learned my addr 172.21.15.120:0/438840327 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3baa184640 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5964270 0x55a5c5d22860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3ba9182640 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5943590 0x55a5c5d45a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3ba9983640 1 -- 172.21.15.120:0/438840327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5964270 msgr2=0x55a5c5d22860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:08:48.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3ba9983640 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5964270 0x55a5c5d22860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3ba9983640 1 -- 172.21.15.120:0/438840327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5943590 msgr2=0x55a5c5d45a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3ba9983640 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5943590 0x55a5c5d45a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3ba9983640 1 -- 172.21.15.120:0/438840327 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5c59cf850 con 0x55a5c593b3b0 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3ba9983640 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5d5ddd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b940813c0 tx=0x7f3b9402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956ced31eee0d39 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3b88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3b88ff9640 1 -- 172.21.15.120:0/438840327 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9408a450 con 0x55a5c593b3b0 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3b88ff9640 1 -- 172.21.15.120:0/438840327 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3b94006740 con 0x55a5c593b3b0 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/438840327 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b9c004030 con 0x55a5c593b3b0 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3b88ff9640 1 -- 172.21.15.120:0/438840327 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f3b940816c0 con 0x55a5c593b3b0 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3bb2bd5740 10 client.4662 fetch_fsmap learned FSMap version 8 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/438840327 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55a5c5a466b0 con 0x55a5c593b3b0 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3b88ff9640 1 -- 172.21.15.120:0/438840327 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b9c004030 con 0x55a5c593b3b0 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.335+0000 7f3b88ff9640 1 -- 172.21.15.120:0/438840327 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f3b94097ce0 con 0x55a5c593b3b0 2024-07-27T03:08:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.336+0000 7f3bb2bd5740 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.336+0000 7f3bb2bd5740 10 client.4662 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.336+0000 7f3bb2bd5740 20 client.4662 populate_metadata read hostname 'smithi120' 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.336+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.120:6833/552629761,v1:172.21.15.120:6835/552629761] conn(0x55a5c5922e40 0x55a5c5d491f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.336+0000 7f3bb2bd5740 4 client.4662 mds_command: new command op to 4359 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.336+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/438840327 --> [v2:172.21.15.120:6833/552629761,v1:172.21.15.120:6835/552629761] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5c5c7e2b0 con 0x55a5c5922e40 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.336+0000 7f3ba9182640 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.120:6833/552629761,v1:172.21.15.120:6835/552629761] conn(0x55a5c5922e40 0x55a5c5d491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.336+0000 7f3b88ff9640 10 client.4662 ms_handle_connect on v2:172.21.15.120:6833/552629761 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.336+0000 7f3ba9182640 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.120:6833/552629761,v1:172.21.15.120:6835/552629761] conn(0x55a5c5922e40 0x55a5c5d491f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13c1ed2272678964 server_cookie=b93bd835aaf2ecce in_seq=0 out_seq=0 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3b88ff9640 1 -- 172.21.15.120:0/438840327 <== mds.0 v2:172.21.15.120:6833/552629761 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5c5c7e2b0 con 0x55a5c5922e40 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3b88ff9640 10 client.4662 handle_command_reply: tid=0 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 1 client.4662 shutdown 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/438840327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 msgr2=0x55a5c5d5ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5d5ddd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b940813c0 tx=0x7f3b9402be50 comp rx=0 tx=0).stop 2024-07-27T03:08:48.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/438840327 shutdown_connections 2024-07-27T03:08:48.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.120:6833/552629761,v1:172.21.15.120:6835/552629761] conn(0x55a5c5922e40 0x55a5c5d491f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5964270 0x55a5c5d22860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5943590 0x55a5c5d45a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/438840327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5d5ddd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3b88ff9640 0 client.4662 ms_handle_reset on v2:172.21.15.120:6833/552629761 2024-07-27T03:08:48.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/438840327 >> 172.21.15.120:0/438840327 conn(0x55a5c59583c0 msgr2=0x55a5c5d03760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:48.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/438840327 shutdown_connections 2024-07-27T03:08:48.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/438840327 wait complete. 2024-07-27T03:08:48.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.337+0000 7f3bb2bd5740 20 client.4662 trim_cache size 0 max 16384 2024-07-27T03:08:48.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.356+0000 7f3bb2bd5740 1 Processor -- start 2024-07-27T03:08:48.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.356+0000 7f3bb2bd5740 1 -- start start 2024-07-27T03:08:48.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c593b3b0 0x55a5c5dc2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5943590 0x55a5c5d0ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5964270 0x55a5c5d0b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba42010e0 con 0x55a5c5964270 2024-07-27T03:08:48.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba40c8ee0 con 0x55a5c5943590 2024-07-27T03:08:48.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba4200ac0 con 0x55a5c593b3b0 2024-07-27T03:08:48.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3baa184640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5964270 0x55a5c5d0b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3baa184640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5964270 0x55a5c5d0b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47020/0 (socket says 172.21.15.120:47020) 2024-07-27T03:08:48.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3baa184640 1 -- 172.21.15.120:0/2354789331 learned_addr learned my addr 172.21.15.120:0/2354789331 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:48.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3baa184640 1 -- 172.21.15.120:0/2354789331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c593b3b0 msgr2=0x55a5c5dc2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:08:48.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3baa184640 1 --2- 172.21.15.120:0/2354789331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c593b3b0 0x55a5c5dc2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3baa184640 1 -- 172.21.15.120:0/2354789331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5943590 msgr2=0x55a5c5d0ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:08:48.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3baa184640 1 --2- 172.21.15.120:0/2354789331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5943590 0x55a5c5d0ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3baa184640 1 -- 172.21.15.120:0/2354789331 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5c5d4b0b0 con 0x55a5c5964270 2024-07-27T03:08:48.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3baa184640 1 --2- 172.21.15.120:0/2354789331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5964270 0x55a5c5d0b280 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c013830 tx=0x7f3b9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b76d3dd9edab6b server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:48.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3b8affd640 1 -- 172.21.15.120:0/2354789331 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c02b070 con 0x55a5c5964270 2024-07-27T03:08:48.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3b8affd640 1 -- 172.21.15.120:0/2354789331 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b9c004050 con 0x55a5c5964270 2024-07-27T03:08:48.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.358+0000 7f3b8affd640 1 -- 172.21.15.120:0/2354789331 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c013d40 con 0x55a5c5964270 2024-07-27T03:08:48.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.359+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/2354789331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5964270 msgr2=0x55a5c5d0b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:48.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.359+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/2354789331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5964270 0x55a5c5d0b280 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c013830 tx=0x7f3b9c0046c0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.359+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/2354789331 shutdown_connections 2024-07-27T03:08:48.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.359+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/2354789331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c5964270 0x55a5c5d0b280 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.359+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/2354789331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5943590 0x55a5c5d0ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.359+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/2354789331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c593b3b0 0x55a5c5dc2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.359+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/2354789331 >> 172.21.15.120:0/2354789331 conn(0x55a5c59583c0 msgr2=0x55a5c5d4ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:48.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.359+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/2354789331 shutdown_connections 2024-07-27T03:08:48.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.359+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/2354789331 wait complete. 2024-07-27T03:08:48.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.360+0000 7f3bb2bd5740 1 -- start start 2024-07-27T03:08:48.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.360+0000 7f3bb2bd5740 1 Processor -- start 2024-07-27T03:08:48.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5db12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5943590 0x55a5c5d4ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3bb2bd5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5964270 0x55a5c5d4f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a5c5d61b40 con 0x55a5c593b3b0 2024-07-27T03:08:48.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a5c5d22da0 con 0x55a5c5964270 2024-07-27T03:08:48.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3bb2bd5740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55a5c5d62100 con 0x55a5c5943590 2024-07-27T03:08:48.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3bb2bd5740 10 client.0 _ll_register_callbacks cb 0x7f3b940814b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:08:48.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3ba9983640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5db12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3ba9983640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5db12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47034/0 (socket says 172.21.15.120:47034) 2024-07-27T03:08:48.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3ba9983640 1 -- 172.21.15.120:0/3940953488 learned_addr learned my addr 172.21.15.120:0/3940953488 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3ba9182640 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5943590 0x55a5c5d4ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3baa184640 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5964270 0x55a5c5d4f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3ba9983640 1 -- 172.21.15.120:0/3940953488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5943590 msgr2=0x55a5c5d4ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3ba9983640 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5943590 0x55a5c5d4ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3ba9983640 1 -- 172.21.15.120:0/3940953488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5964270 msgr2=0x55a5c5d4f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3ba9983640 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5964270 0x55a5c5d4f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3ba9983640 1 -- 172.21.15.120:0/3940953488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5c5dc5430 con 0x55a5c593b3b0 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3ba9983640 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5db12f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b9407e930 tx=0x7f3b94006970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f22d7ebb4ae3ea server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3b88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3b88ff9640 1 -- 172.21.15.120:0/3940953488 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b94085d10 con 0x55a5c593b3b0 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3b88ff9640 1 -- 172.21.15.120:0/3940953488 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3b94080b20 con 0x55a5c593b3b0 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3940953488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b9c004050 con 0x55a5c593b3b0 2024-07-27T03:08:48.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3b88ff9640 1 -- 172.21.15.120:0/3940953488 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f3b94091020 con 0x55a5c593b3b0 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3bb2bd5740 10 client.4668 fetch_fsmap learned FSMap version 8 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.362+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3940953488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55a5c5dc56d0 con 0x55a5c593b3b0 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.363+0000 7f3b88ff9640 1 -- 172.21.15.120:0/3940953488 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b9c004050 con 0x55a5c593b3b0 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.363+0000 7f3b88ff9640 1 -- 172.21.15.120:0/3940953488 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f3b9407d030 con 0x55a5c593b3b0 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.363+0000 7f3bb2bd5740 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.363+0000 7f3bb2bd5740 10 client.4668 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.363+0000 7f3bb2bd5740 20 client.4668 populate_metadata read hostname 'smithi120' 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.363+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.120:6833/552629761,v1:172.21.15.120:6835/552629761] conn(0x55a5c5d238e0 0x55a5c5d21c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.363+0000 7f3bb2bd5740 4 client.4668 mds_command: new command op to 4359 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.363+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3940953488 --> [v2:172.21.15.120:6833/552629761,v1:172.21.15.120:6835/552629761] -- command(tid 0: {"prefix": "status"}) -- 0x55a5c5d00420 con 0x55a5c5d238e0 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.363+0000 7f3ba9182640 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.120:6833/552629761,v1:172.21.15.120:6835/552629761] conn(0x55a5c5d238e0 0x55a5c5d21c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.363+0000 7f3b88ff9640 10 client.4668 ms_handle_connect on v2:172.21.15.120:6833/552629761 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.363+0000 7f3ba9182640 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.120:6833/552629761,v1:172.21.15.120:6835/552629761] conn(0x55a5c5d238e0 0x55a5c5d21c40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae8326da8ecdcadb server_cookie=d66df1013e1edb60 in_seq=0 out_seq=0 2024-07-27T03:08:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3b88ff9640 1 -- 172.21.15.120:0/3940953488 <== mds.0 v2:172.21.15.120:6833/552629761 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55a5c5d00420 con 0x55a5c5d238e0 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3b88ff9640 10 client.4668 handle_command_reply: tid=0 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 1 client.4668 shutdown 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3940953488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 msgr2=0x55a5c5db12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5db12f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b9407e930 tx=0x7f3b94006970 comp rx=0 tx=0).stop 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3940953488 shutdown_connections 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.120:6833/552629761,v1:172.21.15.120:6835/552629761] conn(0x55a5c5d238e0 0x55a5c5d21c40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a5c5964270 0x55a5c5d4f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55a5c5943590 0x55a5c5d4ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3b88ff9640 0 client.4668 ms_handle_reset on v2:172.21.15.120:6833/552629761 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 1 --2- 172.21.15.120:0/3940953488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a5c593b3b0 0x55a5c5db12f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3940953488 >> 172.21.15.120:0/3940953488 conn(0x55a5c59583c0 msgr2=0x55a5c5d4ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3940953488 shutdown_connections 2024-07-27T03:08:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 1 -- 172.21.15.120:0/3940953488 wait complete. 2024-07-27T03:08:48.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3bb2bd5740 20 client.4668 trim_cache size 0 max 16384 2024-07-27T03:08:48.372 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:08:48.372 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:08:48.372 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-07-27T03:08:48.372 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4359, 2024-07-27T03:08:48.372 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:08:48.372 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:08:48.372 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:08:48.372 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 14.437368303, 2024-07-27T03:08:48.372 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 8, 2024-07-27T03:08:48.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 22, 2024-07-27T03:08:48.373 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 22, 2024-07-27T03:08:48.373 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 20.504458253999999 2024-07-27T03:08:48.373 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:08:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3babbe7640 1 -- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b90077070 msgr2=0x7f3b90079580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3babbe7640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b90077070 0x7f3b90079580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40c96b0 tx=0x7f3b98006ac0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3babbe7640 1 -- 172.21.15.120:0/1887781354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b8c003a30 msgr2=0x7f3ba415a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3babbe7640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b8c003a30 0x7f3ba415a1d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400c700 tx=0x7f3b94004c30 comp rx=0 tx=0).stop 2024-07-27T03:08:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3babbe7640 1 -- 172.21.15.120:0/1887781354 shutdown_connections 2024-07-27T03:08:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3babbe7640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b90077070 0x7f3b90079580 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3babbe7640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ba40a0f70 0x7f3ba40a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3babbe7640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba4155b40 0x7f3ba41552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.364+0000 7f3babbe7640 1 --2- 172.21.15.120:0/1887781354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b8c003a30 0x7f3ba415a1d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.365+0000 7f3babbe7640 1 -- 172.21.15.120:0/1887781354 >> 172.21.15.120:0/1887781354 conn(0x7f3ba40d3f90 msgr2=0x7f3ba40b8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.365+0000 7f3babbe7640 1 -- 172.21.15.120:0/1887781354 shutdown_connections 2024-07-27T03:08:48.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:48.365+0000 7f3babbe7640 1 -- 172.21.15.120:0/1887781354 wait complete. 2024-07-27T03:08:48.378 INFO:teuthology.run_tasks:Running task sequential... 2024-07-27T03:08:48.388 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-07-27T03:08:48.388 INFO:teuthology.task.sequential:In sequential, running task print... 2024-07-27T03:08:48.388 INFO:teuthology.task.print:Enabling mgr modules 2024-07-27T03:08:48.388 INFO:teuthology.run_tasks:Running task kclient... 2024-07-27T03:08:48.473 INFO:tasks.kclient:Mounting kernel clients... 2024-07-27T03:08:48.473 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-07-27T03:08:48.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:48.473 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-07-27T03:08:48.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:48.490 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-07-27T03:08:48.556 INFO:teuthology.orchestra.run.smithi120.stderr:Cannot find device "ceph-brx" 2024-07-27T03:08:48.557 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:08:48.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:48.558 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-07-27T03:08:48.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:48.614 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-07-27T03:08:48.679 INFO:teuthology.orchestra.run.smithi120.stderr:Cannot find device "ceph-brx" 2024-07-27T03:08:48.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:08:48.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:48.681 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-07-27T03:08:48.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:48.701 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-07-27T03:08:48.773 INFO:teuthology.orchestra.run.smithi121.stderr:Cannot find device "ceph-brx" 2024-07-27T03:08:48.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:08:48.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:48.776 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-07-27T03:08:48.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:48.835 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-07-27T03:08:48.907 INFO:teuthology.orchestra.run.smithi121.stderr:Cannot find device "ceph-brx" 2024-07-27T03:08:48.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:08:48.908 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-07-27T03:08:48.908 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-27T03:08:48.909 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-27T03:08:48.909 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-27T03:08:49.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.022+0000 7fe3447fa640 1 -- 172.21.15.120:0/3614103989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe33c1522e0 msgr2=0x7fe33c06e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:49.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.022+0000 7fe3447fa640 1 --2- 172.21.15.120:0/3614103989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe33c1522e0 0x7fe33c06e270 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe32c005fd0 tx=0x7fe32c02a820 comp rx=0 tx=0).stop 2024-07-27T03:08:49.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.022+0000 7fe3447fa640 1 -- 172.21.15.120:0/3614103989 shutdown_connections 2024-07-27T03:08:49.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.022+0000 7fe3447fa640 1 --2- 172.21.15.120:0/3614103989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe33c1522e0 0x7fe33c06e270 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:49.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.022+0000 7fe3447fa640 1 -- 172.21.15.120:0/3614103989 >> 172.21.15.120:0/3614103989 conn(0x7fe33c0b1a10 msgr2=0x7fe33c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:49.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.022+0000 7fe3447fa640 1 -- 172.21.15.120:0/3614103989 shutdown_connections 2024-07-27T03:08:49.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.022+0000 7fe3447fa640 1 -- 172.21.15.120:0/3614103989 wait complete. 2024-07-27T03:08:49.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.024+0000 7fe3447fa640 1 Processor -- start 2024-07-27T03:08:49.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.024+0000 7fe3447fa640 1 -- start start 2024-07-27T03:08:49.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.025+0000 7fe3447fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe33c0733e0 0x7fe33c15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:49.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.025+0000 7fe3447fa640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe33c073f00 0x7fe33c158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:49.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.025+0000 7fe3447fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe33c1522e0 0x7fe33c1e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:49.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.025+0000 7fe3447fa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c15f6b0 con 0x7fe33c1522e0 2024-07-27T03:08:49.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.025+0000 7fe3447fa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c15f530 con 0x7fe33c0733e0 2024-07-27T03:08:49.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.025+0000 7fe3447fa640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe33c15f830 con 0x7fe33c073f00 2024-07-27T03:08:49.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.025+0000 7fe342d97640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe33c1522e0 0x7fe33c1e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.025+0000 7fe342d97640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe33c1522e0 0x7fe33c1e8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47042/0 (socket says 172.21.15.120:47042) 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.025+0000 7fe342d97640 1 -- 172.21.15.120:0/3695003293 learned_addr learned my addr 172.21.15.120:0/3695003293 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe342596640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe33c0733e0 0x7fe33c15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe341d95640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe33c073f00 0x7fe33c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe342d97640 1 -- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe33c073f00 msgr2=0x7fe33c158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe342d97640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe33c073f00 0x7fe33c158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe342d97640 1 -- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe33c0733e0 msgr2=0x7fe33c15bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe342d97640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe33c0733e0 0x7fe33c15bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe342d97640 1 -- 172.21.15.120:0/3695003293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c140380 con 0x7fe33c1522e0 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe342596640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe33c0733e0 0x7fe33c15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe342d97640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe33c1522e0 0x7fe33c1e8e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe33400c3f0 tx=0x7fe33400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe33affd640 1 -- 172.21.15.120:0/3695003293 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe334011790 con 0x7fe33c1522e0 2024-07-27T03:08:49.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe33affd640 1 -- 172.21.15.120:0/3695003293 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe334017070 con 0x7fe33c1522e0 2024-07-27T03:08:49.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe3447fa640 1 -- 172.21.15.120:0/3695003293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33c142a00 con 0x7fe33c1522e0 2024-07-27T03:08:49.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe33affd640 1 -- 172.21.15.120:0/3695003293 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe334011d00 con 0x7fe33c1522e0 2024-07-27T03:08:49.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.026+0000 7fe3447fa640 1 -- 172.21.15.120:0/3695003293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33c142fc0 con 0x7fe33c1522e0 2024-07-27T03:08:49.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.027+0000 7fe3447fa640 1 -- 172.21.15.120:0/3695003293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33c1431c0 con 0x7fe33c1522e0 2024-07-27T03:08:49.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.028+0000 7fe33affd640 1 -- 172.21.15.120:0/3695003293 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe33401c460 con 0x7fe33c1522e0 2024-07-27T03:08:49.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.028+0000 7fe33affd640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe328077010 0x7fe328079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:49.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.029+0000 7fe33affd640 1 -- 172.21.15.120:0/3695003293 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe3340986c0 con 0x7fe33c1522e0 2024-07-27T03:08:49.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.029+0000 7fe342596640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe328077010 0x7fe328079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:49.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.029+0000 7fe342596640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe328077010 0x7fe328079520 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe32c034000 tx=0x7fe32c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:49.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.033+0000 7fe33affd640 1 -- 172.21.15.120:0/3695003293 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fe3340618c0 con 0x7fe33c1522e0 2024-07-27T03:08:49.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.255+0000 7fe3447fa640 1 -- 172.21.15.120:0/3695003293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe33c06e270 con 0x7fe33c1522e0 2024-07-27T03:08:49.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.255+0000 7fe33affd640 1 -- 172.21.15.120:0/3695003293 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fe3340611c0 con 0x7fe33c1522e0 2024-07-27T03:08:49.258 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-27T03:08:49.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 -- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe328077010 msgr2=0x7fe328079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:49.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe328077010 0x7fe328079520 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe32c034000 tx=0x7fe32c004ab0 comp rx=0 tx=0).stop 2024-07-27T03:08:49.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 -- 172.21.15.120:0/3695003293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe33c1522e0 msgr2=0x7fe33c1e8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:49.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe33c1522e0 0x7fe33c1e8e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe33400c3f0 tx=0x7fe33400c7f0 comp rx=0 tx=0).stop 2024-07-27T03:08:49.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 -- 172.21.15.120:0/3695003293 shutdown_connections 2024-07-27T03:08:49.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe328077010 0x7fe328079520 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:49.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe33c1522e0 0x7fe33c1e8e20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:49.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe33c073f00 0x7fe33c158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:49.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 --2- 172.21.15.120:0/3695003293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe33c0733e0 0x7fe33c15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:49.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 -- 172.21.15.120:0/3695003293 >> 172.21.15.120:0/3695003293 conn(0x7fe33c0b1a10 msgr2=0x7fe33c0d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:49.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 -- 172.21.15.120:0/3695003293 shutdown_connections 2024-07-27T03:08:49.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49.257+0000 7fe3447fa640 1 -- 172.21.15.120:0/3695003293 wait complete. 2024-07-27T03:08:49.271 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-07-27T03:08:49.271 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-27T03:08:49.271 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-07-27T03:08:49.271 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-07-27T03:08:49.271 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-27T03:08:49.271 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-07-27T03:08:49.271 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-27T03:08:49.271 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-27T03:08:49.272 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:08:49.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:49.272 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-07-27T03:08:49.288 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:08:49.288 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:08:49.288 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:08:49.288 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:49.288 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-07-27T03:08:49.288 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:49.288 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:49.288 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:49.288 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-07-27T03:08:49.289 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:49.289 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:49.289 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-07-27T03:08:49.289 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:49.289 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:49.289 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-27T03:08:49.289 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:49.289 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-27T03:08:49.289 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42748sec preferred_lft 42748sec 2024-07-27T03:08:49.289 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-07-27T03:08:49.289 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:49.290 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-07-27T03:08:49.290 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:49.290 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:08:49.290 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add name ceph-brx type bridge 2024-07-27T03:08:49.290 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr flush dev ceph-brx 2024-07-27T03:08:49.290 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set ceph-brx up 2024-07-27T03:08:49.290 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-07-27T03:08:49.290 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:08:49.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:49.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:49.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:49.493 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-27T03:08:49.518 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-07-27T03:08:49.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:49.520 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-07-27T03:08:49.586 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-07-27T03:08:49.586 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-27T03:08:49.586 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-27T03:08:49.586 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-27T03:08:49.586 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-27T03:08:49.587 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:49.587 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:08:49.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-27T03:08:49.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-27T03:08:49.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-27T03:08:49.587 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:08:49.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:49.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:49.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:49.853 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-07-27T03:08:49.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:49.869 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2024-07-27T03:08:49.924 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:49.924 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:08:49.925 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-27T03:08:49.925 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-07-27T03:08:49.925 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:08:50.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:50.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:50.048 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-07-27T03:08:50.048 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:50.048 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:08:50.048 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-07-27T03:08:50.049 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-07-27T03:08:50.049 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-07-27T03:08:50.049 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-07-27T03:08:50.049 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-07-27T03:08:50.049 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:08:50.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:50.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:50.179 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:50.180 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:08:50.180 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-07-27T03:08:50.180 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.0 master ceph-brx 2024-07-27T03:08:50.180 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:08:50.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:50.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:50.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:08:50.258 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-07-27T03:08:50.279 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:08:50.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:08:50.280 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-07-27T03:08:50.336 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-07-27T03:08:50.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:50.336 DEBUG:teuthology.orchestra.run.smithi120:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:50.446 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:50.446 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:08:50.571 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:50.571 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:08:50.571 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-07-27T03:08:50.571 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: trying mount with new device syntax: 0@81c6fc84-d59a-4d77-bf87-f698cf0d6963.cephfs=/ 2024-07-27T03:08:50.571 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.120:3300/172.21.15.121:3300/172.21.15.121:3301" will pass to kernel 2024-07-27T03:08:50.571 INFO:teuthology.orchestra.run.smithi120.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-07-27T03:08:50.572 INFO:teuthology.orchestra.run.smithi120.stdout: You just mounted a file system that supports labels which does not 2024-07-27T03:08:50.572 INFO:teuthology.orchestra.run.smithi120.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-27T03:08:50.572 INFO:teuthology.orchestra.run.smithi120.stdout: applications will generate AVC messages and not be allowed access to 2024-07-27T03:08:50.572 INFO:teuthology.orchestra.run.smithi120.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-27T03:08:50.574 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-27T03:08:50.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:50.574 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-07-27T03:08:50.599 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:50.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:50.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:50.701 INFO:teuthology.orchestra.run.smithi120.stdout:client4630 2024-07-27T03:08:50.702 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:50.702 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:08:50.718 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:50.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:50.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:50.820 INFO:teuthology.orchestra.run.smithi120.stdout:client4630 2024-07-27T03:08:50.820 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:50.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:50.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:50.884 INFO:teuthology.orchestra.run.smithi120.stdout:client4630 2024-07-27T03:08:50.884 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/81c6fc84-d59a-4d77-bf87-f698cf0d6963.client4630/status') 2024-07-27T03:08:50.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:50.946 INFO:teuthology.orchestra.run.smithi120.stdout:instance: client.4630 (3)172.21.15.120:0/941199109 2024-07-27T03:08:50.946 INFO:teuthology.orchestra.run.smithi120.stdout:blocklisted: false 2024-07-27T03:08:50.946 INFO:teuthology.orchestra.run.smithi120.stderr:0+1 records in 2024-07-27T03:08:50.946 INFO:teuthology.orchestra.run.smithi120.stderr:0+1 records out 2024-07-27T03:08:50.946 INFO:teuthology.orchestra.run.smithi120.stderr:70 bytes copied, 2.2076e-05 s, 3.2 MB/s 2024-07-27T03:08:50.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:50.953 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-07-27T03:08:50.953 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-27T03:08:50.953 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-07-27T03:08:50.953 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-27T03:08:51.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.064+0000 7f30b6d4e640 1 -- 172.21.15.120:0/3707328455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b0145390 msgr2=0x7f30b006e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:51.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.064+0000 7f30b6d4e640 1 --2- 172.21.15.120:0/3707328455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b0145390 0x7f30b006e270 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f30b0074980 tx=0x7f30ac02aa30 comp rx=0 tx=0).stop 2024-07-27T03:08:51.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.064+0000 7f30b6d4e640 1 -- 172.21.15.120:0/3707328455 shutdown_connections 2024-07-27T03:08:51.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.064+0000 7f30b6d4e640 1 --2- 172.21.15.120:0/3707328455 >> v2:172.21.15.121:3300/0 conn(0x7f30b015fd20 0x7f30b0160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:51.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.064+0000 7f30b6d4e640 1 --2- 172.21.15.120:0/3707328455 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b00aebf0 0x7f30b00af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:51.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.064+0000 7f30b6d4e640 1 --2- 172.21.15.120:0/3707328455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b0145390 0x7f30b006e270 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:51.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.064+0000 7f30b6d4e640 1 -- 172.21.15.120:0/3707328455 >> 172.21.15.120:0/3707328455 conn(0x7f30b00b1a10 msgr2=0x7f30b00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:51.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.064+0000 7f30b6d4e640 1 -- 172.21.15.120:0/3707328455 shutdown_connections 2024-07-27T03:08:51.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.064+0000 7f30b6d4e640 1 -- 172.21.15.120:0/3707328455 wait complete. 2024-07-27T03:08:51.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.066+0000 7f30b6d4e640 1 Processor -- start 2024-07-27T03:08:51.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.066+0000 7f30b6d4e640 1 -- start start 2024-07-27T03:08:51.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b6d4e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b00aebf0 0x7f30b013a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:51.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b6d4e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b0145390 0x7f30b00c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:51.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b6d4e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b015fd20 0x7f30b00c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b6d4e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f30b0145160 con 0x7f30b00aebf0 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b6d4e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f30b0144fe0 con 0x7f30b0145390 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b6d4e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f30b0160670 con 0x7f30b015fd20 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b4aea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b00aebf0 0x7f30b013a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b4aea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b00aebf0 0x7f30b013a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47062/0 (socket says 172.21.15.120:47062) 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b4aea640 1 -- 172.21.15.120:0/979840488 learned_addr learned my addr 172.21.15.120:0/979840488 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30a7fff640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b0145390 0x7f30b00c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b52eb640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b015fd20 0x7f30b00c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b4aea640 1 -- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b015fd20 msgr2=0x7f30b00c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b4aea640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b015fd20 0x7f30b00c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b4aea640 1 -- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b0145390 msgr2=0x7f30b00c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b4aea640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b0145390 0x7f30b00c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:51.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b4aea640 1 -- 172.21.15.120:0/979840488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b00c5850 con 0x7f30b00aebf0 2024-07-27T03:08:51.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30b4aea640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b00aebf0 0x7f30b013a420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f30ac02b020 tx=0x7f30ac003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:51.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30a57fa640 1 -- 172.21.15.120:0/979840488 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac033050 con 0x7f30b00aebf0 2024-07-27T03:08:51.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.068+0000 7f30a57fa640 1 -- 172.21.15.120:0/979840488 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30ac004470 con 0x7f30b00aebf0 2024-07-27T03:08:51.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.069+0000 7f30b6d4e640 1 -- 172.21.15.120:0/979840488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b00c5b30 con 0x7f30b00aebf0 2024-07-27T03:08:51.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.069+0000 7f30a57fa640 1 -- 172.21.15.120:0/979840488 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac038450 con 0x7f30b00aebf0 2024-07-27T03:08:51.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.069+0000 7f30b6d4e640 1 -- 172.21.15.120:0/979840488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b009da40 con 0x7f30b00aebf0 2024-07-27T03:08:51.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.070+0000 7f30b6d4e640 1 -- 172.21.15.120:0/979840488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b0050af0 con 0x7f30b00aebf0 2024-07-27T03:08:51.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.070+0000 7f30a57fa640 1 -- 172.21.15.120:0/979840488 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f30ac036070 con 0x7f30b00aebf0 2024-07-27T03:08:51.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.071+0000 7f30a57fa640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f309c077010 0x7f309c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:51.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.071+0000 7f30a57fa640 1 -- 172.21.15.120:0/979840488 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f30ac0b9ad0 con 0x7f30b00aebf0 2024-07-27T03:08:51.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.071+0000 7f30a7fff640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f309c077010 0x7f309c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:51.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.072+0000 7f30a7fff640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f309c077010 0x7f309c079520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f30b0143690 tx=0x7f30a0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:51.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.075+0000 7f30a57fa640 1 -- 172.21.15.120:0/979840488 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f30b0050af0 con 0x7f30b00aebf0 2024-07-27T03:08:51.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.296+0000 7f30b6d4e640 1 -- 172.21.15.120:0/979840488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f30b0160b00 con 0x7f30b00aebf0 2024-07-27T03:08:51.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.296+0000 7f30a57fa640 1 -- 172.21.15.120:0/979840488 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f30ac082720 con 0x7f30b00aebf0 2024-07-27T03:08:51.300 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-27T03:08:51.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 -- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f309c077010 msgr2=0x7f309c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:51.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f309c077010 0x7f309c079520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f30b0143690 tx=0x7f30a0005f90 comp rx=0 tx=0).stop 2024-07-27T03:08:51.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 -- 172.21.15.120:0/979840488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b00aebf0 msgr2=0x7f30b013a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:51.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b00aebf0 0x7f30b013a420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f30ac02b020 tx=0x7f30ac003f90 comp rx=0 tx=0).stop 2024-07-27T03:08:51.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 -- 172.21.15.120:0/979840488 shutdown_connections 2024-07-27T03:08:51.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f309c077010 0x7f309c079520 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:51.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30b015fd20 0x7f30b00c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:51.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30b0145390 0x7f30b00c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:51.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 --2- 172.21.15.120:0/979840488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30b00aebf0 0x7f30b013a420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:51.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 -- 172.21.15.120:0/979840488 >> 172.21.15.120:0/979840488 conn(0x7f30b00b1a10 msgr2=0x7f30b00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:51.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 -- 172.21.15.120:0/979840488 shutdown_connections 2024-07-27T03:08:51.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51.298+0000 7f30b6d4e640 1 -- 172.21.15.120:0/979840488 wait complete. 2024-07-27T03:08:51.312 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-07-27T03:08:51.312 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-27T03:08:51.312 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-07-27T03:08:51.312 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-07-27T03:08:51.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-07-27T03:08:51.312 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-07-27T03:08:51.312 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-27T03:08:51.312 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-27T03:08:51.312 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-07-27T03:08:51.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:51.313 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-07-27T03:08:51.328 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:51.329 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42746sec preferred_lft 42746sec 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether d2:ac:2a:c4:e4:5e brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::d44a:78ff:feef:fe4e/64 scope link 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.330 INFO:teuthology.orchestra.run.smithi120.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-27T03:08:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether d2:ac:2a:c4:e4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-27T03:08:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::d0ac:2aff:fec4:e45e/64 scope link tentative 2024-07-27T03:08:51.331 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:51.331 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-27T03:08:51.393 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-07-27T03:08:51.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:51.395 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-07-27T03:08:51.451 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-07-27T03:08:51.451 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-27T03:08:51.451 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-27T03:08:51.451 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-27T03:08:51.451 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-27T03:08:51.452 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:51.452 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:08:51.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-27T03:08:51.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-27T03:08:51.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-27T03:08:51.452 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:08:51.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:51.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:51.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:51.577 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-07-27T03:08:51.592 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-27T03:08:51.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:51.593 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2024-07-27T03:08:51.651 INFO:teuthology.orchestra.run.smithi120.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-07-27T03:08:51.651 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:51.651 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:08:51.651 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-07-27T03:08:51.651 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-07-27T03:08:51.651 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:08:51.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:51.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:51.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:51.768 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-07-27T03:08:51.793 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:08:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:08:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:08:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-07-27T03:08:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.793 INFO:teuthology.orchestra.run.smithi120.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-27T03:08:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 76:5d:05:d5:50:84 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-07-27T03:08:51.793 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-07-27T03:08:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::745d:5ff:fed5:5084/64 scope link 2024-07-27T03:08:51.794 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:51.795 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-07-27T03:08:51.859 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:08:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:08:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:08:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-07-27T03:08:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.860 INFO:teuthology.orchestra.run.smithi120.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-27T03:08:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 76:5d:05:d5:50:84 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-07-27T03:08:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-07-27T03:08:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::745d:5ff:fed5:5084/64 scope link 2024-07-27T03:08:51.860 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:51.861 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-07-27T03:08:51.862 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:51.862 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:08:51.862 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-07-27T03:08:51.862 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-07-27T03:08:51.862 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-07-27T03:08:51.862 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-07-27T03:08:51.862 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-07-27T03:08:51.862 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:08:51.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:52.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:52.013 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:52.013 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:08:52.013 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.1 up 2024-07-27T03:08:52.014 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.1 master ceph-brx 2024-07-27T03:08:52.014 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:08:52.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:52.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:52.091 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:08:52.091 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-07-27T03:08:52.106 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-07-27T03:08:52.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:08:52.107 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-07-27T03:08:52.162 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-07-27T03:08:52.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:52.163 DEBUG:teuthology.orchestra.run.smithi120:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:52.256 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:52.256 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:08:52.265 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:52.265 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:08:52.265 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-07-27T03:08:52.265 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: trying mount with new device syntax: 2@81c6fc84-d59a-4d77-bf87-f698cf0d6963.cephfs=/ 2024-07-27T03:08:52.266 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.120:3300/172.21.15.121:3300/172.21.15.121:3301" will pass to kernel 2024-07-27T03:08:52.266 INFO:teuthology.orchestra.run.smithi120.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-07-27T03:08:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: You just mounted a file system that supports labels which does not 2024-07-27T03:08:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-27T03:08:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: applications will generate AVC messages and not be allowed access to 2024-07-27T03:08:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-27T03:08:52.267 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-27T03:08:52.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:52.267 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-07-27T03:08:52.292 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:52.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:52.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:52.389 INFO:teuthology.orchestra.run.smithi120.stdout:client4514 2024-07-27T03:08:52.389 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:52.389 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:08:52.405 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:52.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:52.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:52.501 INFO:teuthology.orchestra.run.smithi120.stdout:client4514 2024-07-27T03:08:52.501 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:52.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:52.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:52.557 INFO:teuthology.orchestra.run.smithi120.stdout:client4514 2024-07-27T03:08:52.558 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/81c6fc84-d59a-4d77-bf87-f698cf0d6963.client4514/status') 2024-07-27T03:08:52.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:52.616 INFO:teuthology.orchestra.run.smithi120.stdout:instance: client.4514 (3)172.21.15.120:0/1817276014 2024-07-27T03:08:52.616 INFO:teuthology.orchestra.run.smithi120.stdout:blocklisted: false 2024-07-27T03:08:52.616 INFO:teuthology.orchestra.run.smithi120.stderr:0+1 records in 2024-07-27T03:08:52.616 INFO:teuthology.orchestra.run.smithi120.stderr:0+1 records out 2024-07-27T03:08:52.616 INFO:teuthology.orchestra.run.smithi120.stderr:71 bytes copied, 2.1846e-05 s, 3.3 MB/s 2024-07-27T03:08:52.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:52.623 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-07-27T03:08:52.624 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-27T03:08:52.624 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-07-27T03:08:52.624 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-27T03:08:52.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.735+0000 7fb3395e7640 1 -- 172.21.15.120:0/660675353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb33409b140 msgr2=0x7fb3340b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:52.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.735+0000 7fb3395e7640 1 --2- 172.21.15.120:0/660675353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb33409b140 0x7fb3340b4ef0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb32c005fd0 tx=0x7fb32c02a8b0 comp rx=0 tx=0).stop 2024-07-27T03:08:52.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.735+0000 7fb3395e7640 1 -- 172.21.15.120:0/660675353 shutdown_connections 2024-07-27T03:08:52.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.735+0000 7fb3395e7640 1 --2- 172.21.15.120:0/660675353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb33409b140 0x7fb3340b4ef0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:52.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.735+0000 7fb3395e7640 1 --2- 172.21.15.120:0/660675353 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb33409b640 0x7fb3340b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:52.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.735+0000 7fb3395e7640 1 -- 172.21.15.120:0/660675353 >> 172.21.15.120:0/660675353 conn(0x7fb3340d20a0 msgr2=0x7fb3340d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:52.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.735+0000 7fb3395e7640 1 -- 172.21.15.120:0/660675353 shutdown_connections 2024-07-27T03:08:52.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.735+0000 7fb3395e7640 1 -- 172.21.15.120:0/660675353 wait complete. 2024-07-27T03:08:52.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.737+0000 7fb3395e7640 1 Processor -- start 2024-07-27T03:08:52.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.737+0000 7fb3395e7640 1 -- start start 2024-07-27T03:08:52.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.738+0000 7fb3395e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb33409b640 0x7fb33414d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:52.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.738+0000 7fb3395e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3340cf4e0 0x7fb33409ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:52.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.738+0000 7fb3395e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb33415cab0 0x7fb33409f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:52.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.738+0000 7fb3395e7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb3340b5a80 con 0x7fb3340cf4e0 2024-07-27T03:08:52.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.738+0000 7fb3395e7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb3340b5900 con 0x7fb33415cab0 2024-07-27T03:08:52.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.738+0000 7fb3395e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb3340b5c00 con 0x7fb33409b640 2024-07-27T03:08:52.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.738+0000 7fb32a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3340cf4e0 0x7fb33409ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:52.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.738+0000 7fb32a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3340cf4e0 0x7fb33409ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37002/0 (socket says 172.21.15.120:37002) 2024-07-27T03:08:52.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.738+0000 7fb32a7fc640 1 -- 172.21.15.120:0/984989916 learned_addr learned my addr 172.21.15.120:0/984989916 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:52.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.738+0000 7fb332ffd640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb33409b640 0x7fb33414d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:52.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.738+0000 7fb3337fe640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb33415cab0 0x7fb33409f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:52.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.739+0000 7fb32a7fc640 1 -- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb33409b640 msgr2=0x7fb33414d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:52.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.739+0000 7fb32a7fc640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb33409b640 0x7fb33414d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:52.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.739+0000 7fb32a7fc640 1 -- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb33415cab0 msgr2=0x7fb33409f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:52.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.739+0000 7fb32a7fc640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb33415cab0 0x7fb33409f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:52.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.739+0000 7fb32a7fc640 1 -- 172.21.15.120:0/984989916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33414df40 con 0x7fb3340cf4e0 2024-07-27T03:08:52.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.739+0000 7fb32a7fc640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3340cf4e0 0x7fb33409ec70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c3d0 tx=0x7fb31c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:52.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.739+0000 7fb32bfff640 1 -- 172.21.15.120:0/984989916 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c011790 con 0x7fb3340cf4e0 2024-07-27T03:08:52.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.739+0000 7fb32bfff640 1 -- 172.21.15.120:0/984989916 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb31c017070 con 0x7fb3340cf4e0 2024-07-27T03:08:52.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.739+0000 7fb3395e7640 1 -- 172.21.15.120:0/984989916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33409dbd0 con 0x7fb3340cf4e0 2024-07-27T03:08:52.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.739+0000 7fb32bfff640 1 -- 172.21.15.120:0/984989916 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c011cc0 con 0x7fb3340cf4e0 2024-07-27T03:08:52.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.739+0000 7fb3395e7640 1 -- 172.21.15.120:0/984989916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33409e190 con 0x7fb3340cf4e0 2024-07-27T03:08:52.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.740+0000 7fb3395e7640 1 -- 172.21.15.120:0/984989916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3340b60b0 con 0x7fb3340cf4e0 2024-07-27T03:08:52.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.741+0000 7fb32bfff640 1 -- 172.21.15.120:0/984989916 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb31c01c460 con 0x7fb3340cf4e0 2024-07-27T03:08:52.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.741+0000 7fb32bfff640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb314077010 0x7fb314079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:52.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.741+0000 7fb32bfff640 1 -- 172.21.15.120:0/984989916 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb31c0985b0 con 0x7fb3340cf4e0 2024-07-27T03:08:52.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.741+0000 7fb332ffd640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb314077010 0x7fb314079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:52.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.742+0000 7fb332ffd640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb314077010 0x7fb314079520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb32400bb30 tx=0x7fb32400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:52.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.745+0000 7fb32bfff640 1 -- 172.21.15.120:0/984989916 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb31c061160 con 0x7fb3340cf4e0 2024-07-27T03:08:52.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.964+0000 7fb3395e7640 1 -- 172.21.15.120:0/984989916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb33409d960 con 0x7fb3340cf4e0 2024-07-27T03:08:52.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.964+0000 7fb32bfff640 1 -- 172.21.15.120:0/984989916 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fb31c0656b0 con 0x7fb3340cf4e0 2024-07-27T03:08:52.967 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-27T03:08:52.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.966+0000 7fb3395e7640 1 -- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb314077010 msgr2=0x7fb314079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:52.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.966+0000 7fb3395e7640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb314077010 0x7fb314079520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb32400bb30 tx=0x7fb32400b2e0 comp rx=0 tx=0).stop 2024-07-27T03:08:52.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.966+0000 7fb3395e7640 1 -- 172.21.15.120:0/984989916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3340cf4e0 msgr2=0x7fb33409ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:52.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.966+0000 7fb3395e7640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3340cf4e0 0x7fb33409ec70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c3d0 tx=0x7fb31c00c890 comp rx=0 tx=0).stop 2024-07-27T03:08:52.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.967+0000 7fb3395e7640 1 -- 172.21.15.120:0/984989916 shutdown_connections 2024-07-27T03:08:52.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.967+0000 7fb3395e7640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb314077010 0x7fb314079520 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:52.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.967+0000 7fb3395e7640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3340cf4e0 0x7fb33409ec70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:52.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.967+0000 7fb3395e7640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb33415cab0 0x7fb33409f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:52.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.967+0000 7fb3395e7640 1 --2- 172.21.15.120:0/984989916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb33409b640 0x7fb33414d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:52.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.967+0000 7fb3395e7640 1 -- 172.21.15.120:0/984989916 >> 172.21.15.120:0/984989916 conn(0x7fb3340d20a0 msgr2=0x7fb334071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:52.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.967+0000 7fb3395e7640 1 -- 172.21.15.120:0/984989916 shutdown_connections 2024-07-27T03:08:52.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:52.967+0000 7fb3395e7640 1 -- 172.21.15.120:0/984989916 wait complete. 2024-07-27T03:08:52.980 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-07-27T03:08:52.980 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-27T03:08:52.980 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-07-27T03:08:52.981 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-07-27T03:08:52.981 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-07-27T03:08:52.981 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-07-27T03:08:52.981 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-27T03:08:52.981 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-27T03:08:52.981 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-07-27T03:08:52.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:52.981 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-07-27T03:08:53.002 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:08:53.002 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:08:53.003 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:08:53.003 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:53.003 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-07-27T03:08:53.004 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:53.004 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:53.004 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:53.004 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-07-27T03:08:53.004 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:53.005 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:53.005 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-07-27T03:08:53.005 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:53.005 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:53.005 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-27T03:08:53.006 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:53.006 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-27T03:08:53.006 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42749sec preferred_lft 42749sec 2024-07-27T03:08:53.006 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link 2024-07-27T03:08:53.006 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:53.007 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-07-27T03:08:53.007 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:53.007 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-07-27T03:08:53.007 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add name ceph-brx type bridge 2024-07-27T03:08:53.008 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr flush dev ceph-brx 2024-07-27T03:08:53.008 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set ceph-brx up 2024-07-27T03:08:53.008 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-07-27T03:08:53.008 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-07-27T03:08:53.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:53.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:53.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:53.221 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-27T03:08:53.246 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-07-27T03:08:53.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:53.247 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-07-27T03:08:53.331 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-07-27T03:08:53.331 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-27T03:08:53.331 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-27T03:08:53.331 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-27T03:08:53.331 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-27T03:08:53.332 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:53.332 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-07-27T03:08:53.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-27T03:08:53.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-27T03:08:53.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-27T03:08:53.332 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-07-27T03:08:53.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:53.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:53.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:53.621 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-07-27T03:08:53.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:53.637 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2024-07-27T03:08:53.693 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:53.693 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-07-27T03:08:53.693 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-07-27T03:08:53.693 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-07-27T03:08:53.693 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-07-27T03:08:53.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:53.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:53.814 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-07-27T03:08:53.814 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:53.815 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-07-27T03:08:53.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-07-27T03:08:53.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-07-27T03:08:53.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-07-27T03:08:53.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-07-27T03:08:53.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-07-27T03:08:53.815 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-07-27T03:08:53.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:53.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:53.940 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:53.940 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-07-27T03:08:53.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-07-27T03:08:53.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.0 master ceph-brx 2024-07-27T03:08:53.940 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-07-27T03:08:53.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:54.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:54.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:08:54.020 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-07-27T03:08:54.035 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-07-27T03:08:54.035 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:08:54.035 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-07-27T03:08:54.091 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-07-27T03:08:54.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:54.091 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:54.196 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:54.196 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:08:54.334 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:54.335 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:08:54.335 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-07-27T03:08:54.335 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with new device syntax: 1@81c6fc84-d59a-4d77-bf87-f698cf0d6963.cephfs=/ 2024-07-27T03:08:54.335 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.120:3300/172.21.15.121:3300/172.21.15.121:3301" will pass to kernel 2024-07-27T03:08:54.336 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-07-27T03:08:54.336 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-07-27T03:08:54.336 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-27T03:08:54.336 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-07-27T03:08:54.336 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-27T03:08:54.337 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-27T03:08:54.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:54.337 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-07-27T03:08:54.362 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:54.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:54.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:54.458 INFO:teuthology.orchestra.run.smithi121.stdout:client4642 2024-07-27T03:08:54.459 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:54.459 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:08:54.474 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:54.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:54.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:54.571 INFO:teuthology.orchestra.run.smithi121.stdout:client4642 2024-07-27T03:08:54.572 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:54.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:54.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:54.629 INFO:teuthology.orchestra.run.smithi121.stdout:client4642 2024-07-27T03:08:54.629 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/81c6fc84-d59a-4d77-bf87-f698cf0d6963.client4642/status') 2024-07-27T03:08:54.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:54.688 INFO:teuthology.orchestra.run.smithi121.stdout:instance: client.4642 (3)192.168.0.1:0/2505049453 2024-07-27T03:08:54.688 INFO:teuthology.orchestra.run.smithi121.stdout:blocklisted: false 2024-07-27T03:08:54.688 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records in 2024-07-27T03:08:54.688 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records out 2024-07-27T03:08:54.688 INFO:teuthology.orchestra.run.smithi121.stderr:69 bytes copied, 4.419e-05 s, 1.6 MB/s 2024-07-27T03:08:54.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:54.695 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-07-27T03:08:54.695 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-27T03:08:54.695 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-07-27T03:08:54.695 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-27T03:08:54.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.820+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/2079999516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a9c15c220 msgr2=0x7f3a9c152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:54.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.820+0000 7f3aa0ddd640 1 --2- 172.21.15.120:0/2079999516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a9c15c220 0x7f3a9c152160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c15b630 tx=0x7f3a8c02a560 comp rx=0 tx=0).stop 2024-07-27T03:08:54.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.820+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/2079999516 shutdown_connections 2024-07-27T03:08:54.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.820+0000 7f3aa0ddd640 1 --2- 172.21.15.120:0/2079999516 >> v2:172.21.15.121:3300/0 conn(0x7f3a9c15ec20 0x7f3a9c15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:54.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.820+0000 7f3aa0ddd640 1 --2- 172.21.15.120:0/2079999516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3a9c0b5cd0 0x7f3a9c0b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:54.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.820+0000 7f3aa0ddd640 1 --2- 172.21.15.120:0/2079999516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a9c15c220 0x7f3a9c152160 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:54.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.820+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/2079999516 >> 172.21.15.120:0/2079999516 conn(0x7f3a9c06cba0 msgr2=0x7f3a9c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:54.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.820+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/2079999516 shutdown_connections 2024-07-27T03:08:54.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.820+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/2079999516 wait complete. 2024-07-27T03:08:54.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.822+0000 7f3aa0ddd640 1 Processor -- start 2024-07-27T03:08:54.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.822+0000 7f3aa0ddd640 1 -- start start 2024-07-27T03:08:54.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.823+0000 7f3aa0ddd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a9c0b5cd0 0x7f3a9c14f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:54.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.823+0000 7f3aa0ddd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3a9c15c220 0x7f3a9c144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:54.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.823+0000 7f3aa0ddd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a9c15ec20 0x7f3a9c072d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:54.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.823+0000 7f3aa0ddd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c0cd920 con 0x7f3a9c0b5cd0 2024-07-27T03:08:54.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.823+0000 7f3aa0ddd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c0cd7a0 con 0x7f3a9c15ec20 2024-07-27T03:08:54.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.823+0000 7f3aa0ddd640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9c0cdaa0 con 0x7f3a9c15c220 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.823+0000 7f3a9a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a9c0b5cd0 0x7f3a9c14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.823+0000 7f3a9a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a9c0b5cd0 0x7f3a9c14f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37018/0 (socket says 172.21.15.120:37018) 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.823+0000 7f3a9a59c640 1 -- 172.21.15.120:0/254720203 learned_addr learned my addr 172.21.15.120:0/254720203 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.823+0000 7f3a99d9b640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3a9c15c220 0x7f3a9c144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.823+0000 7f3a9ad9d640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a9c15ec20 0x7f3a9c072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3a9a59c640 1 -- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3a9c15c220 msgr2=0x7f3a9c144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3a9a59c640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3a9c15c220 0x7f3a9c144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3a9a59c640 1 -- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a9c15ec20 msgr2=0x7f3a9c072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3a9a59c640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a9c15ec20 0x7f3a9c072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3a9a59c640 1 -- 172.21.15.120:0/254720203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c145010 con 0x7f3a9c0b5cd0 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3a9ad9d640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a9c15ec20 0x7f3a9c072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3a9a59c640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a9c0b5cd0 0x7f3a9c14f740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0099c0 tx=0x7f3a8c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3a8affd640 1 -- 172.21.15.120:0/254720203 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c03e030 con 0x7f3a9c0b5cd0 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3a8affd640 1 -- 172.21.15.120:0/254720203 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a8c0047a0 con 0x7f3a9c0b5cd0 2024-07-27T03:08:54.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/254720203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9c1452f0 con 0x7f3a9c0b5cd0 2024-07-27T03:08:54.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3a8affd640 1 -- 172.21.15.120:0/254720203 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c035040 con 0x7f3a9c0b5cd0 2024-07-27T03:08:54.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.824+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/254720203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9c1458b0 con 0x7f3a9c0b5cd0 2024-07-27T03:08:54.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.825+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/254720203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a9c0cdfe0 con 0x7f3a9c0b5cd0 2024-07-27T03:08:54.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.826+0000 7f3a8affd640 1 -- 172.21.15.120:0/254720203 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f3a8c041030 con 0x7f3a9c0b5cd0 2024-07-27T03:08:54.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.826+0000 7f3a8affd640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3a7c077040 0x7f3a7c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:54.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.826+0000 7f3a8affd640 1 -- 172.21.15.120:0/254720203 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3a8c0b8e50 con 0x7f3a9c0b5cd0 2024-07-27T03:08:54.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.827+0000 7f3a99d9b640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3a7c077040 0x7f3a7c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:54.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.827+0000 7f3a99d9b640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3a7c077040 0x7f3a7c079550 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3a90005fd0 tx=0x7f3a9000b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:54.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:54.831+0000 7f3a8affd640 1 -- 172.21.15.120:0/254720203 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f3a9c0b6620 con 0x7f3a9c0b5cd0 2024-07-27T03:08:55.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.049+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/254720203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3a9c0b47b0 con 0x7f3a9c0b5cd0 2024-07-27T03:08:55.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.049+0000 7f3a8affd640 1 -- 172.21.15.120:0/254720203 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f3a8c081b20 con 0x7f3a9c0b5cd0 2024-07-27T03:08:55.052 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-27T03:08:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3a7c077040 msgr2=0x7f3a7c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3a7c077040 0x7f3a7c079550 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3a90005fd0 tx=0x7f3a9000b260 comp rx=0 tx=0).stop 2024-07-27T03:08:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/254720203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a9c0b5cd0 msgr2=0x7f3a9c14f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a9c0b5cd0 0x7f3a9c14f740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0099c0 tx=0x7f3a8c0039e0 comp rx=0 tx=0).stop 2024-07-27T03:08:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/254720203 shutdown_connections 2024-07-27T03:08:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3a7c077040 0x7f3a7c079550 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a9c15ec20 0x7f3a9c072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:55.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3a9c15c220 0x7f3a9c144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:55.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 --2- 172.21.15.120:0/254720203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3a9c0b5cd0 0x7f3a9c14f740 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:55.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/254720203 >> 172.21.15.120:0/254720203 conn(0x7f3a9c06cba0 msgr2=0x7f3a9c15d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:55.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/254720203 shutdown_connections 2024-07-27T03:08:55.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:55.051+0000 7f3aa0ddd640 1 -- 172.21.15.120:0/254720203 wait complete. 2024-07-27T03:08:55.065 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-07-27T03:08:55.065 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-27T03:08:55.065 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-07-27T03:08:55.065 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-07-27T03:08:55.065 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-07-27T03:08:55.065 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-07-27T03:08:55.066 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-27T03:08:55.066 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-27T03:08:55.066 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-07-27T03:08:55.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:55.066 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-07-27T03:08:55.082 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:08:55.083 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:55.084 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-27T03:08:55.084 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:55.084 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-27T03:08:55.084 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-07-27T03:08:55.084 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link 2024-07-27T03:08:55.084 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.084 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-27T03:08:55.084 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 8a:9b:4f:e5:8a:8f brd ff:ff:ff:ff:ff:ff 2024-07-27T03:08:55.085 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-07-27T03:08:55.085 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.085 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::98ba:d1ff:fe2e:65dd/64 scope link 2024-07-27T03:08:55.085 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.085 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-27T03:08:55.085 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 8a:9b:4f:e5:8a:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-07-27T03:08:55.085 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::889b:4fff:fee5:8a8f/64 scope link tentative 2024-07-27T03:08:55.085 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:55.085 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-27T03:08:55.147 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-07-27T03:08:55.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:55.149 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-07-27T03:08:55.207 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-07-27T03:08:55.207 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-27T03:08:55.207 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-27T03:08:55.207 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-27T03:08:55.207 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-27T03:08:55.208 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:55.208 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-07-27T03:08:55.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-27T03:08:55.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-27T03:08:55.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-27T03:08:55.208 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-07-27T03:08:55.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:55.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:55.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:55.334 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-07-27T03:08:55.349 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-07-27T03:08:55.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:55.350 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2024-07-27T03:08:55.404 INFO:teuthology.orchestra.run.smithi121.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-07-27T03:08:55.405 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:55.405 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-07-27T03:08:55.405 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-07-27T03:08:55.405 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-07-27T03:08:55.405 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-07-27T03:08:55.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:55.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:55.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:55.523 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-07-27T03:08:55.547 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:08:55.548 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:08:55.548 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:08:55.548 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.548 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-07-27T03:08:55.548 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.548 INFO:teuthology.orchestra.run.smithi121.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-27T03:08:55.548 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 96:b7:1c:01:4f:e6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-07-27T03:08:55.548 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-07-27T03:08:55.548 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.549 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::94b7:1cff:fe01:4fe6/64 scope link tentative 2024-07-27T03:08:55.549 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:55.550 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-07-27T03:08:55.615 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:08:55.616 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:08:55.616 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:08:55.616 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.616 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-07-27T03:08:55.616 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.616 INFO:teuthology.orchestra.run.smithi121.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-27T03:08:55.616 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 96:b7:1c:01:4f:e6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-07-27T03:08:55.616 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-07-27T03:08:55.616 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.616 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::94b7:1cff:fe01:4fe6/64 scope link tentative 2024-07-27T03:08:55.616 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:08:55.618 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-07-27T03:08:55.618 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:55.618 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-07-27T03:08:55.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-07-27T03:08:55.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-07-27T03:08:55.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-07-27T03:08:55.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-07-27T03:08:55.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-07-27T03:08:55.618 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-07-27T03:08:55.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:55.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:55.770 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:08:55.770 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-07-27T03:08:55.771 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.1 up 2024-07-27T03:08:55.771 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.1 master ceph-brx 2024-07-27T03:08:55.771 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-07-27T03:08:55.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:55.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:55.858 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:08:55.858 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-07-27T03:08:55.886 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-07-27T03:08:55.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:08:55.887 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-07-27T03:08:55.942 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-07-27T03:08:55.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:55.943 DEBUG:teuthology.orchestra.run.smithi121:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:56.037 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:08:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:08:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:08:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-07-27T03:08:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: trying mount with new device syntax: 3@81c6fc84-d59a-4d77-bf87-f698cf0d6963.cephfs=/ 2024-07-27T03:08:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.120:3300/172.21.15.121:3300/172.21.15.121:3301" will pass to kernel 2024-07-27T03:08:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-07-27T03:08:56.046 INFO:teuthology.orchestra.run.smithi121.stdout: You just mounted a file system that supports labels which does not 2024-07-27T03:08:56.047 INFO:teuthology.orchestra.run.smithi121.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-27T03:08:56.047 INFO:teuthology.orchestra.run.smithi121.stdout: applications will generate AVC messages and not be allowed access to 2024-07-27T03:08:56.047 INFO:teuthology.orchestra.run.smithi121.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-27T03:08:56.048 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-27T03:08:56.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:08:56.048 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-07-27T03:08:56.073 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:56.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:56.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:56.171 INFO:teuthology.orchestra.run.smithi121.stdout:client4529 2024-07-27T03:08:56.171 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:08:56.171 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:08:56.187 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:56.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:56.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:56.283 INFO:teuthology.orchestra.run.smithi121.stdout:client4529 2024-07-27T03:08:56.284 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:08:56.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:08:56.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:56.340 INFO:teuthology.orchestra.run.smithi121.stdout:client4529 2024-07-27T03:08:56.340 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/81c6fc84-d59a-4d77-bf87-f698cf0d6963.client4529/status') 2024-07-27T03:08:56.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:08:56.398 INFO:teuthology.orchestra.run.smithi121.stdout:instance: client.4529 (3)192.168.0.2:0/2344112447 2024-07-27T03:08:56.398 INFO:teuthology.orchestra.run.smithi121.stdout:blocklisted: false 2024-07-27T03:08:56.398 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records in 2024-07-27T03:08:56.399 INFO:teuthology.orchestra.run.smithi121.stderr:0+1 records out 2024-07-27T03:08:56.399 INFO:teuthology.orchestra.run.smithi121.stderr:69 bytes copied, 2.3948e-05 s, 2.9 MB/s 2024-07-27T03:08:56.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-07-27T03:08:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:08:56.405 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-07-27T03:08:56.454 INFO:tasks.cephfs_test_runner:Starting test: test_distribute_directory_to_multiple_ranks (tasks.cephfs.test_exports.TestBalMask) That bal.mask distributes a directory to multiple ranks. 2024-07-27T03:08:56.454 INFO:tasks.cephfs_test_runner:test_distribute_directory_to_multiple_ranks (tasks.cephfs.test_exports.TestBalMask) 2024-07-27T03:08:56.454 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:08:56.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.580+0000 7facff422640 1 -- 172.21.15.120:0/639145783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80d0500 msgr2=0x7facf80d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:56.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.580+0000 7facff422640 1 --2- 172.21.15.120:0/639145783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80d0500 0x7facf80d0910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7facf80738d0 tx=0x7face802a560 comp rx=0 tx=0).stop 2024-07-27T03:08:56.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.580+0000 7facff422640 1 -- 172.21.15.120:0/639145783 shutdown_connections 2024-07-27T03:08:56.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.580+0000 7facff422640 1 --2- 172.21.15.120:0/639145783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80d0500 0x7facf80d0910 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.580+0000 7facff422640 1 --2- 172.21.15.120:0/639145783 >> v2:172.21.15.121:3300/0 conn(0x7facf80b2110 0x7facf80b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.580+0000 7facff422640 1 -- 172.21.15.120:0/639145783 >> 172.21.15.120:0/639145783 conn(0x7facf80b3920 msgr2=0x7facf80b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.580+0000 7facff422640 1 -- 172.21.15.120:0/639145783 shutdown_connections 2024-07-27T03:08:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.580+0000 7facff422640 1 -- 172.21.15.120:0/639145783 wait complete. 2024-07-27T03:08:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.582+0000 7facff422640 1 Processor -- start 2024-07-27T03:08:56.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.582+0000 7facff422640 1 -- start start 2024-07-27T03:08:56.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.583+0000 7facff422640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facf80b2110 0x7facf806f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:56.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.583+0000 7facff422640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facf80b4fd0 0x7facf81519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:56.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.583+0000 7facff422640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80d0500 0x7facf80b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:56.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.583+0000 7facff422640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7facf80b5af0 con 0x7facf80d0500 2024-07-27T03:08:56.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.583+0000 7facff422640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7facf815fcf0 con 0x7facf80b2110 2024-07-27T03:08:56.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.583+0000 7facff422640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7facf80b5c70 con 0x7facf80b4fd0 2024-07-27T03:08:56.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.583+0000 7facfd9bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80d0500 0x7facf80b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:56.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.583+0000 7facfd9bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80d0500 0x7facf80b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37036/0 (socket says 172.21.15.120:37036) 2024-07-27T03:08:56.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.583+0000 7facfd9bf640 1 -- 172.21.15.120:0/1535101375 learned_addr learned my addr 172.21.15.120:0/1535101375 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:56.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facfd1be640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facf80b2110 0x7facf806f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:56.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facfc9bd640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facf80b4fd0 0x7facf81519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:56.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facfd9bf640 1 -- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facf80b4fd0 msgr2=0x7facf81519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:56.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facfd9bf640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facf80b4fd0 0x7facf81519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facfd9bf640 1 -- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facf80b2110 msgr2=0x7facf806f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:56.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facfd9bf640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facf80b2110 0x7facf806f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facfd9bf640 1 -- 172.21.15.120:0/1535101375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf80c6b30 con 0x7facf80d0500 2024-07-27T03:08:56.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facfc9bd640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facf80b4fd0 0x7facf81519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:56.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facfd1be640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facf80b2110 0x7facf806f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:56.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facfd9bf640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80d0500 0x7facf80b0c10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7facf000c3c0 tx=0x7facf000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facedffb640 1 -- 172.21.15.120:0/1535101375 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0017070 con 0x7facf80d0500 2024-07-27T03:08:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facedffb640 1 -- 172.21.15.120:0/1535101375 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7facf00053c0 con 0x7facf80d0500 2024-07-27T03:08:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facff422640 1 -- 172.21.15.120:0/1535101375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf80c7d80 con 0x7facf80d0500 2024-07-27T03:08:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facedffb640 1 -- 172.21.15.120:0/1535101375 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0003850 con 0x7facf80d0500 2024-07-27T03:08:56.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.584+0000 7facff422640 1 -- 172.21.15.120:0/1535101375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf80c70b0 con 0x7facf80d0500 2024-07-27T03:08:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.585+0000 7facff422640 1 -- 172.21.15.120:0/1535101375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf80b6100 con 0x7facf80d0500 2024-07-27T03:08:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.586+0000 7facedffb640 1 -- 172.21.15.120:0/1535101375 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7facf001a070 con 0x7facf80d0500 2024-07-27T03:08:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.586+0000 7facedffb640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7facdc077010 0x7facdc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.587+0000 7facedffb640 1 -- 172.21.15.120:0/1535101375 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7facf0097cc0 con 0x7facf80d0500 2024-07-27T03:08:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.587+0000 7facfd1be640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7facdc077010 0x7facdc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:56.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.587+0000 7facfd1be640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7facdc077010 0x7facdc079520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facf4005fd0 tx=0x7facf4009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:56.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.591+0000 7facedffb640 1 -- 172.21.15.120:0/1535101375 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7facf80d0e50 con 0x7facf80d0500 2024-07-27T03:08:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.775+0000 7facff422640 1 -- 172.21.15.120:0/1535101375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facf815bb00 con 0x7facf80d0500 2024-07-27T03:08:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.776+0000 7facedffb640 1 -- 172.21.15.120:0/1535101375 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16629 (secure 0 0 0) 0x7facf0060f50 con 0x7facf80d0500 2024-07-27T03:08:56.779 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:08:56.779 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:34.926699+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:08:31.185623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-27T03:08:32.262408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:08:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 -- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7facdc077010 msgr2=0x7facdc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7facdc077010 0x7facdc079520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facf4005fd0 tx=0x7facf4009500 comp rx=0 tx=0).stop 2024-07-27T03:08:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 -- 172.21.15.120:0/1535101375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80d0500 msgr2=0x7facf80b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80d0500 0x7facf80b0c10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7facf000c3c0 tx=0x7facf000c880 comp rx=0 tx=0).stop 2024-07-27T03:08:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 -- 172.21.15.120:0/1535101375 shutdown_connections 2024-07-27T03:08:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7facdc077010 0x7facdc079520 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facf80d0500 0x7facf80b0c10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facf80b4fd0 0x7facf81519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 --2- 172.21.15.120:0/1535101375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facf80b2110 0x7facf806f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 -- 172.21.15.120:0/1535101375 >> 172.21.15.120:0/1535101375 conn(0x7facf80b3920 msgr2=0x7facf80d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 -- 172.21.15.120:0/1535101375 shutdown_connections 2024-07-27T03:08:56.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.779+0000 7facff422640 1 -- 172.21.15.120:0/1535101375 wait complete. 2024-07-27T03:08:56.793 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-27T03:08:28.548271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-07-27T03:08:31.185623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-07-27T03:08:32.262408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-07-27T03:08:56.793 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-07-27T03:08:56.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.908+0000 7f03d241c640 1 -- 172.21.15.120:0/3969908341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03cc15d420 msgr2=0x7f03cc15ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:56.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.908+0000 7f03d241c640 1 --2- 172.21.15.120:0/3969908341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03cc15d420 0x7f03cc15ee40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f03c4005fd0 tx=0x7f03c402a8b0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.908+0000 7f03d241c640 1 -- 172.21.15.120:0/3969908341 shutdown_connections 2024-07-27T03:08:56.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.908+0000 7f03d241c640 1 --2- 172.21.15.120:0/3969908341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03cc15d420 0x7f03cc15ee40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.908+0000 7f03d241c640 1 -- 172.21.15.120:0/3969908341 >> 172.21.15.120:0/3969908341 conn(0x7f03cc0b1a10 msgr2=0x7f03cc0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:56.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.908+0000 7f03d241c640 1 -- 172.21.15.120:0/3969908341 shutdown_connections 2024-07-27T03:08:56.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.908+0000 7f03d241c640 1 -- 172.21.15.120:0/3969908341 wait complete. 2024-07-27T03:08:56.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.910+0000 7f03d241c640 1 Processor -- start 2024-07-27T03:08:56.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.910+0000 7f03d241c640 1 -- start start 2024-07-27T03:08:56.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.911+0000 7f03d241c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc15ad30 0x7f03cc1f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:56.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.911+0000 7f03d241c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03cc15d420 0x7f03cc0cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:56.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.911+0000 7f03d241c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03cc1508a0 0x7f03cc0d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:56.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.911+0000 7f03d241c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f03cc151590 con 0x7f03cc15d420 2024-07-27T03:08:56.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.911+0000 7f03d241c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f03cc151410 con 0x7f03cc15ad30 2024-07-27T03:08:56.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.911+0000 7f03d241c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f03cc151710 con 0x7f03cc1508a0 2024-07-27T03:08:56.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03cb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03cc15d420 0x7f03cc0cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:56.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03cb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03cc15d420 0x7f03cc0cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37056/0 (socket says 172.21.15.120:37056) 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03cb7fe640 1 -- 172.21.15.120:0/3237504114 learned_addr learned my addr 172.21.15.120:0/3237504114 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03cbfff640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc15ad30 0x7f03cc1f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03d09b9640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03cc1508a0 0x7f03cc0d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03cb7fe640 1 -- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03cc1508a0 msgr2=0x7f03cc0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03cb7fe640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03cc1508a0 0x7f03cc0d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03cb7fe640 1 -- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc15ad30 msgr2=0x7f03cc1f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03cb7fe640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc15ad30 0x7f03cc1f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03cb7fe640 1 -- 172.21.15.120:0/3237504114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03cc1f5e10 con 0x7f03cc15d420 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03cb7fe640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03cc15d420 0x7f03cc0cfc60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03c000c3a0 tx=0x7f03c000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03c8ff9640 1 -- 172.21.15.120:0/3237504114 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0011790 con 0x7f03cc15d420 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03c8ff9640 1 -- 172.21.15.120:0/3237504114 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03c0017070 con 0x7f03cc15d420 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03d241c640 1 -- 172.21.15.120:0/3237504114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03cc0ce8b0 con 0x7f03cc15d420 2024-07-27T03:08:56.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03c8ff9640 1 -- 172.21.15.120:0/3237504114 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0011cc0 con 0x7f03cc15d420 2024-07-27T03:08:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.912+0000 7f03d241c640 1 -- 172.21.15.120:0/3237504114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03cc153250 con 0x7f03cc15d420 2024-07-27T03:08:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.913+0000 7f03d241c640 1 -- 172.21.15.120:0/3237504114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03cc151be0 con 0x7f03cc15d420 2024-07-27T03:08:56.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.914+0000 7f03c8ff9640 1 -- 172.21.15.120:0/3237504114 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f03c001c460 con 0x7f03cc15d420 2024-07-27T03:08:56.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.914+0000 7f03c8ff9640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f03b8077010 0x7f03b8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:56.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.915+0000 7f03c8ff9640 1 -- 172.21.15.120:0/3237504114 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f03c0098560 con 0x7f03cc15d420 2024-07-27T03:08:56.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.915+0000 7f03cbfff640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f03b8077010 0x7f03b8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:56.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.915+0000 7f03cbfff640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f03b8077010 0x7f03b8079520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f03bc006fd0 tx=0x7f03bc009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:56.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:56.919+0000 7f03c8ff9640 1 -- 172.21.15.120:0/3237504114 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f03cc1f5e10 con 0x7f03cc15d420 2024-07-27T03:08:57.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.104+0000 7f03d241c640 1 -- 172.21.15.120:0/3237504114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f03cc0b2f60 con 0x7f03cc15d420 2024-07-27T03:08:57.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.105+0000 7f03c8ff9640 1 -- 172.21.15.120:0/3237504114 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f03c00611a0 con 0x7f03cc15d420 2024-07-27T03:08:57.107 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-07-27T03:08:57.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 -- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f03b8077010 msgr2=0x7f03b8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f03b8077010 0x7f03b8079520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f03bc006fd0 tx=0x7f03bc009060 comp rx=0 tx=0).stop 2024-07-27T03:08:57.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 -- 172.21.15.120:0/3237504114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03cc15d420 msgr2=0x7f03cc0cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03cc15d420 0x7f03cc0cfc60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03c000c3a0 tx=0x7f03c000c860 comp rx=0 tx=0).stop 2024-07-27T03:08:57.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 -- 172.21.15.120:0/3237504114 shutdown_connections 2024-07-27T03:08:57.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f03b8077010 0x7f03b8079520 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03cc15d420 0x7f03cc0cfc60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03cc1508a0 0x7f03cc0d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 --2- 172.21.15.120:0/3237504114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc15ad30 0x7f03cc1f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 -- 172.21.15.120:0/3237504114 >> 172.21.15.120:0/3237504114 conn(0x7f03cc0b1a10 msgr2=0x7f03cc0b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:57.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 -- 172.21.15.120:0/3237504114 shutdown_connections 2024-07-27T03:08:57.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.107+0000 7f03d241c640 1 -- 172.21.15.120:0/3237504114 wait complete. 2024-07-27T03:08:57.121 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-07-27T03:08:57.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.235+0000 7f9123be3640 1 -- 172.21.15.120:0/829842780 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f911c0b2110 msgr2=0x7f911c0b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.235+0000 7f9123be3640 1 --2- 172.21.15.120:0/829842780 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f911c0b2110 0x7f911c0b2520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f910c005fd0 tx=0x7f910c02a820 comp rx=0 tx=0).stop 2024-07-27T03:08:57.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.235+0000 7f9123be3640 1 -- 172.21.15.120:0/829842780 shutdown_connections 2024-07-27T03:08:57.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.235+0000 7f9123be3640 1 --2- 172.21.15.120:0/829842780 >> v2:172.21.15.121:3300/0 conn(0x7f911c0b5fe0 0x7f911c15e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.235+0000 7f9123be3640 1 --2- 172.21.15.120:0/829842780 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f911c0b2110 0x7f911c0b2520 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.235+0000 7f9123be3640 1 -- 172.21.15.120:0/829842780 >> 172.21.15.120:0/829842780 conn(0x7f911c0b3920 msgr2=0x7f911c0b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:57.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.235+0000 7f9123be3640 1 -- 172.21.15.120:0/829842780 shutdown_connections 2024-07-27T03:08:57.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.235+0000 7f9123be3640 1 -- 172.21.15.120:0/829842780 wait complete. 2024-07-27T03:08:57.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.237+0000 7f9123be3640 1 Processor -- start 2024-07-27T03:08:57.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.237+0000 7f9123be3640 1 -- start start 2024-07-27T03:08:57.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.238+0000 7f9123be3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f911c0b2110 0x7f911c0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.238+0000 7f9123be3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f911c0b5fe0 0x7f911c14bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.238+0000 7f9123be3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f911c0d0500 0x7f911c14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.238+0000 7f9123be3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f911c15f540 con 0x7f911c0b5fe0 2024-07-27T03:08:57.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.238+0000 7f9123be3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f911c15f3c0 con 0x7f911c0d0500 2024-07-27T03:08:57.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.238+0000 7f9123be3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f911c15f6c0 con 0x7f911c0b2110 2024-07-27T03:08:57.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.238+0000 7f912117e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f911c0b5fe0 0x7f911c14bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.238+0000 7f912117e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f911c0b5fe0 0x7f911c14bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37066/0 (socket says 172.21.15.120:37066) 2024-07-27T03:08:57.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.238+0000 7f912117e640 1 -- 172.21.15.120:0/2904845678 learned_addr learned my addr 172.21.15.120:0/2904845678 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:57.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f912197f640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f911c0b2110 0x7f911c0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f9122180640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f911c0d0500 0x7f911c14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f912117e640 1 -- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f911c0b2110 msgr2=0x7f911c0c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f912117e640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f911c0b2110 0x7f911c0c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f912117e640 1 -- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f911c0d0500 msgr2=0x7f911c14c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f912117e640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f911c0d0500 0x7f911c14c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f912117e640 1 -- 172.21.15.120:0/2904845678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911c0c8840 con 0x7f911c0b5fe0 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f912117e640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f911c0b5fe0 0x7f911c14bc90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f911000c430 tx=0x7f911000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f911a7fc640 1 -- 172.21.15.120:0/2904845678 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110011790 con 0x7f911c0b5fe0 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f911a7fc640 1 -- 172.21.15.120:0/2904845678 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9110017070 con 0x7f911c0b5fe0 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f911a7fc640 1 -- 172.21.15.120:0/2904845678 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110011ce0 con 0x7f911c0b5fe0 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f9123be3640 1 -- 172.21.15.120:0/2904845678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f911c0cd980 con 0x7f911c0b5fe0 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.239+0000 7f9123be3640 1 -- 172.21.15.120:0/2904845678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f911c0cdf40 con 0x7f911c0b5fe0 2024-07-27T03:08:57.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.240+0000 7f9123be3640 1 -- 172.21.15.120:0/2904845678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f911c15fbe0 con 0x7f911c0b5fe0 2024-07-27T03:08:57.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.241+0000 7f911a7fc640 1 -- 172.21.15.120:0/2904845678 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f911001c460 con 0x7f911c0b5fe0 2024-07-27T03:08:57.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.241+0000 7f911a7fc640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9108077010 0x7f9108079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.242+0000 7f911a7fc640 1 -- 172.21.15.120:0/2904845678 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f91100987d0 con 0x7f911c0b5fe0 2024-07-27T03:08:57.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.242+0000 7f912197f640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9108077010 0x7f9108079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.242+0000 7f912197f640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9108077010 0x7f9108079520 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f910c034000 tx=0x7f910c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:57.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.246+0000 7f911a7fc640 1 -- 172.21.15.120:0/2904845678 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f9110061950 con 0x7f911c0b5fe0 2024-07-27T03:08:57.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.429+0000 7f9123be3640 1 -- 172.21.15.120:0/2904845678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f911c0711c0 con 0x7f911c0b5fe0 2024-07-27T03:08:57.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.429+0000 7f911a7fc640 1 -- 172.21.15.120:0/2904845678 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f9110061250 con 0x7f911c0b5fe0 2024-07-27T03:08:57.432 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-07-27T03:08:57.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 -- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9108077010 msgr2=0x7f9108079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9108077010 0x7f9108079520 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f910c034000 tx=0x7f910c004ab0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 -- 172.21.15.120:0/2904845678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f911c0b5fe0 msgr2=0x7f911c14bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f911c0b5fe0 0x7f911c14bc90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f911000c430 tx=0x7f911000c8f0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 -- 172.21.15.120:0/2904845678 shutdown_connections 2024-07-27T03:08:57.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9108077010 0x7f9108079520 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f911c0b5fe0 0x7f911c14bc90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f911c0d0500 0x7f911c14c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 --2- 172.21.15.120:0/2904845678 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f911c0b2110 0x7f911c0c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 -- 172.21.15.120:0/2904845678 >> 172.21.15.120:0/2904845678 conn(0x7f911c0b3920 msgr2=0x7f911c0b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:57.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 -- 172.21.15.120:0/2904845678 shutdown_connections 2024-07-27T03:08:57.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.431+0000 7f9123be3640 1 -- 172.21.15.120:0/2904845678 wait complete. 2024-07-27T03:08:57.446 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-07-27T03:08:57.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.561+0000 7fc451e14640 1 -- 172.21.15.120:0/2196773551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0b2110 msgr2=0x7fc44c0b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.561+0000 7fc451e14640 1 --2- 172.21.15.120:0/2196773551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0b2110 0x7fc44c0b2520 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009830 tx=0x7fc43c02a3f0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.561+0000 7fc451e14640 1 -- 172.21.15.120:0/2196773551 shutdown_connections 2024-07-27T03:08:57.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.561+0000 7fc451e14640 1 --2- 172.21.15.120:0/2196773551 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc44c0b5fe0 0x7fc44c15e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.561+0000 7fc451e14640 1 --2- 172.21.15.120:0/2196773551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0b2110 0x7fc44c0b2520 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.561+0000 7fc451e14640 1 -- 172.21.15.120:0/2196773551 >> 172.21.15.120:0/2196773551 conn(0x7fc44c0b3920 msgr2=0x7fc44c0b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:57.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.561+0000 7fc451e14640 1 -- 172.21.15.120:0/2196773551 shutdown_connections 2024-07-27T03:08:57.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.561+0000 7fc451e14640 1 -- 172.21.15.120:0/2196773551 wait complete. 2024-07-27T03:08:57.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.563+0000 7fc451e14640 1 Processor -- start 2024-07-27T03:08:57.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.563+0000 7fc451e14640 1 -- start start 2024-07-27T03:08:57.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc451e14640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0b2110 0x7fc44c159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc451e14640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44c0b5fe0 0x7fc44c0c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc451e14640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc44c0d0500 0x7fc44c0712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc451e14640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c15f500 con 0x7fc44c0b2110 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc451e14640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c15f380 con 0x7fc44c0b5fe0 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc451e14640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc44c15f680 con 0x7fc44c0d0500 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc44b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0b2110 0x7fc44c159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc44b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0b2110 0x7fc44c159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37072/0 (socket says 172.21.15.120:37072) 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc44b7fe640 1 -- 172.21.15.120:0/3277202419 learned_addr learned my addr 172.21.15.120:0/3277202419 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc44affd640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44c0b5fe0 0x7fc44c0c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc44bfff640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc44c0d0500 0x7fc44c0712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc44b7fe640 1 -- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc44c0d0500 msgr2=0x7fc44c0712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc44b7fe640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc44c0d0500 0x7fc44c0712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc44b7fe640 1 -- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44c0b5fe0 msgr2=0x7fc44c0c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc44b7fe640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44c0b5fe0 0x7fc44c0c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc44b7fe640 1 -- 172.21.15.120:0/3277202419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c1598d0 con 0x7fc44c0b2110 2024-07-27T03:08:57.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc44b7fe640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0b2110 0x7fc44c159390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009950 tx=0x7fc43c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:57.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc443fff640 1 -- 172.21.15.120:0/3277202419 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c005c90 con 0x7fc44c0b2110 2024-07-27T03:08:57.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc443fff640 1 -- 172.21.15.120:0/3277202419 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc43c031e50 con 0x7fc44c0b2110 2024-07-27T03:08:57.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc443fff640 1 -- 172.21.15.120:0/3277202419 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c005260 con 0x7fc44c0b2110 2024-07-27T03:08:57.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.565+0000 7fc451e14640 1 -- 172.21.15.120:0/3277202419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c0c6ed0 con 0x7fc44c0b2110 2024-07-27T03:08:57.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.566+0000 7fc451e14640 1 -- 172.21.15.120:0/3277202419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c0c7480 con 0x7fc44c0b2110 2024-07-27T03:08:57.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.567+0000 7fc451e14640 1 -- 172.21.15.120:0/3277202419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44c06fd00 con 0x7fc44c0b2110 2024-07-27T03:08:57.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.567+0000 7fc443fff640 1 -- 172.21.15.120:0/3277202419 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc43c005400 con 0x7fc44c0b2110 2024-07-27T03:08:57.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.568+0000 7fc443fff640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc42c077040 0x7fc42c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.568+0000 7fc443fff640 1 -- 172.21.15.120:0/3277202419 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc43c0b9870 con 0x7fc44c0b2110 2024-07-27T03:08:57.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.568+0000 7fc44affd640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc42c077040 0x7fc42c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.569+0000 7fc44affd640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc42c077040 0x7fc42c079550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc434000f60 tx=0x7fc434009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:57.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.572+0000 7fc443fff640 1 -- 172.21.15.120:0/3277202419 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc44c06fd00 con 0x7fc44c0b2110 2024-07-27T03:08:57.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.753+0000 7fc451e14640 1 -- 172.21.15.120:0/3277202419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc44c15a9c0 con 0x7fc44c0b2110 2024-07-27T03:08:57.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.753+0000 7fc443fff640 1 -- 172.21.15.120:0/3277202419 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fc44c1598d0 con 0x7fc44c0b2110 2024-07-27T03:08:57.756 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-07-27T03:08:57.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.755+0000 7fc451e14640 1 -- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc42c077040 msgr2=0x7fc42c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.755+0000 7fc451e14640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc42c077040 0x7fc42c079550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc434000f60 tx=0x7fc434009040 comp rx=0 tx=0).stop 2024-07-27T03:08:57.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.755+0000 7fc451e14640 1 -- 172.21.15.120:0/3277202419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0b2110 msgr2=0x7fc44c159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.755+0000 7fc451e14640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0b2110 0x7fc44c159390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009950 tx=0x7fc43c033c20 comp rx=0 tx=0).stop 2024-07-27T03:08:57.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.755+0000 7fc451e14640 1 -- 172.21.15.120:0/3277202419 shutdown_connections 2024-07-27T03:08:57.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.755+0000 7fc451e14640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc42c077040 0x7fc42c079550 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.755+0000 7fc451e14640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc44c0d0500 0x7fc44c0712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.755+0000 7fc451e14640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc44c0b5fe0 0x7fc44c0c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.755+0000 7fc451e14640 1 --2- 172.21.15.120:0/3277202419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc44c0b2110 0x7fc44c159390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.755+0000 7fc451e14640 1 -- 172.21.15.120:0/3277202419 >> 172.21.15.120:0/3277202419 conn(0x7fc44c0b3920 msgr2=0x7fc44c0ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.756+0000 7fc451e14640 1 -- 172.21.15.120:0/3277202419 shutdown_connections 2024-07-27T03:08:57.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.756+0000 7fc451e14640 1 -- 172.21.15.120:0/3277202419 wait complete. 2024-07-27T03:08:57.769 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_exports.TestBalMask.test_distribute_directory_to_multiple_ranks' 2024-07-27T03:08:57.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.881+0000 7fb755a67640 1 -- 172.21.15.120:0/4077678040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75015c8f0 msgr2=0x7fb750145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.881+0000 7fb755a67640 1 --2- 172.21.15.120:0/4077678040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75015c8f0 0x7fb750145c70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb7500cd2e0 tx=0x7fb74002a4b0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.881+0000 7fb755a67640 1 -- 172.21.15.120:0/4077678040 shutdown_connections 2024-07-27T03:08:57.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.881+0000 7fb755a67640 1 --2- 172.21.15.120:0/4077678040 >> v2:172.21.15.121:3300/0 conn(0x7fb750073680 0x7fb7500745a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.881+0000 7fb755a67640 1 --2- 172.21.15.120:0/4077678040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75015c8f0 0x7fb750145c70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.881+0000 7fb755a67640 1 -- 172.21.15.120:0/4077678040 >> 172.21.15.120:0/4077678040 conn(0x7fb7500d0f00 msgr2=0x7fb7500d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:57.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.881+0000 7fb755a67640 1 -- 172.21.15.120:0/4077678040 shutdown_connections 2024-07-27T03:08:57.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.881+0000 7fb755a67640 1 -- 172.21.15.120:0/4077678040 wait complete. 2024-07-27T03:08:57.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.883+0000 7fb755a67640 1 Processor -- start 2024-07-27T03:08:57.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.883+0000 7fb755a67640 1 -- start start 2024-07-27T03:08:57.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.884+0000 7fb755a67640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb75006c780 0x7fb750141d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.884+0000 7fb755a67640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb750073680 0x7fb750140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.884+0000 7fb755a67640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75015c8f0 0x7fb7501e75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.884+0000 7fb755a67640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb7500d03a0 con 0x7fb75015c8f0 2024-07-27T03:08:57.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.884+0000 7fb755a67640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb7500d0220 con 0x7fb75006c780 2024-07-27T03:08:57.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.884+0000 7fb755a67640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb7500d0520 con 0x7fb750073680 2024-07-27T03:08:57.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.884+0000 7fb74ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75015c8f0 0x7fb7501e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.884+0000 7fb74ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75015c8f0 0x7fb7501e75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37090/0 (socket says 172.21.15.120:37090) 2024-07-27T03:08:57.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.884+0000 7fb74ffff640 1 -- 172.21.15.120:0/4198321129 learned_addr learned my addr 172.21.15.120:0/4198321129 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.884+0000 7fb74f7fe640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb75006c780 0x7fb750141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.884+0000 7fb74effd640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb750073680 0x7fb750140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb74ffff640 1 -- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb750073680 msgr2=0x7fb750140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb74ffff640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb750073680 0x7fb750140860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb74ffff640 1 -- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb75006c780 msgr2=0x7fb750141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb74ffff640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb75006c780 0x7fb750141d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb74ffff640 1 -- 172.21.15.120:0/4198321129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7501e6500 con 0x7fb75015c8f0 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb74f7fe640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb75006c780 0x7fb750141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb74ffff640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75015c8f0 0x7fb7501e75a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb74800c6f0 tx=0x7fb74800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb747fff640 1 -- 172.21.15.120:0/4198321129 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748017070 con 0x7fb75015c8f0 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb747fff640 1 -- 172.21.15.120:0/4198321129 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb748003c90 con 0x7fb75015c8f0 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb755a67640 1 -- 172.21.15.120:0/4198321129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7501e67e0 con 0x7fb75015c8f0 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb747fff640 1 -- 172.21.15.120:0/4198321129 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748003e60 con 0x7fb75015c8f0 2024-07-27T03:08:57.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.885+0000 7fb755a67640 1 -- 172.21.15.120:0/4198321129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7501e6da0 con 0x7fb75015c8f0 2024-07-27T03:08:57.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.886+0000 7fb755a67640 1 -- 172.21.15.120:0/4198321129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7500d0a40 con 0x7fb75015c8f0 2024-07-27T03:08:57.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.887+0000 7fb747fff640 1 -- 172.21.15.120:0/4198321129 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb74801a070 con 0x7fb75015c8f0 2024-07-27T03:08:57.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.887+0000 7fb747fff640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb730077010 0x7fb730079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:57.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.888+0000 7fb747fff640 1 -- 172.21.15.120:0/4198321129 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb748097ef0 con 0x7fb75015c8f0 2024-07-27T03:08:57.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.888+0000 7fb74f7fe640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb730077010 0x7fb730079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:57.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.888+0000 7fb74f7fe640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb730077010 0x7fb730079520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb740034000 tx=0x7fb740004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:57.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:57.892+0000 7fb747fff640 1 -- 172.21.15.120:0/4198321129 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb748061180 con 0x7fb75015c8f0 2024-07-27T03:08:58.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:58.152+0000 7fb755a67640 1 -- 172.21.15.120:0/4198321129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_exports.TestBalMask.test_distribute_directory_to_multiple_ranks"]} v 0) -- 0x7fb750145490 con 0x7fb75015c8f0 2024-07-27T03:08:59.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.024+0000 7fb747fff640 1 -- 172.21.15.120:0/4198321129 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_exports.TestBalMask.test_distribute_directory_to_multiple_ranks"]}]=0 v40) ==== 163+0+0 (secure 0 0 0) 0x7fb7480693c0 con 0x7fb75015c8f0 2024-07-27T03:08:59.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 -- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb730077010 msgr2=0x7fb730079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb730077010 0x7fb730079520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb740034000 tx=0x7fb740004730 comp rx=0 tx=0).stop 2024-07-27T03:08:59.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 -- 172.21.15.120:0/4198321129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75015c8f0 msgr2=0x7fb7501e75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75015c8f0 0x7fb7501e75a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb74800c6f0 tx=0x7fb74800cbb0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 -- 172.21.15.120:0/4198321129 shutdown_connections 2024-07-27T03:08:59.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb730077010 0x7fb730079520 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb75015c8f0 0x7fb7501e75a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb750073680 0x7fb750140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 --2- 172.21.15.120:0/4198321129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb75006c780 0x7fb750141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 -- 172.21.15.120:0/4198321129 >> 172.21.15.120:0/4198321129 conn(0x7fb7500d0f00 msgr2=0x7fb75015bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:59.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 -- 172.21.15.120:0/4198321129 shutdown_connections 2024-07-27T03:08:59.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.027+0000 7fb755a67640 1 -- 172.21.15.120:0/4198321129 wait complete. 2024-07-27T03:08:59.044 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-07-27T03:08:59.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.162+0000 7fdd3a43c640 1 -- 172.21.15.120:0/2668731286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd1c004080 msgr2=0x7fdd1c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.162+0000 7fdd3a43c640 1 --2- 172.21.15.120:0/2668731286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd1c004080 0x7fdd1c004800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd340d3f00 tx=0x7fdd1c005830 comp rx=0 tx=0).stop 2024-07-27T03:08:59.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.162+0000 7fdd389d9640 1 -- 172.21.15.120:0/2668731286 reap_dead start 2024-07-27T03:08:59.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.162+0000 7fdd3a43c640 1 -- 172.21.15.120:0/2668731286 shutdown_connections 2024-07-27T03:08:59.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.162+0000 7fdd3a43c640 1 -- 172.21.15.120:0/2668731286 >> 172.21.15.120:0/2668731286 conn(0x7fdd3408d690 msgr2=0x7fdd3409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:59.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.162+0000 7fdd3a43c640 1 -- 172.21.15.120:0/2668731286 shutdown_connections 2024-07-27T03:08:59.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.162+0000 7fdd3a43c640 1 -- 172.21.15.120:0/2668731286 wait complete. 2024-07-27T03:08:59.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.164+0000 7fdd3a43c640 1 Processor -- start 2024-07-27T03:08:59.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.164+0000 7fdd3a43c640 1 -- start start 2024-07-27T03:08:59.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd3a43c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c004080 0x7fdd34155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:59.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd3a43c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd341f8840 0x7fdd3409e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:59.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd3a43c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdd3415d4f0 0x7fdd3409e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:59.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd3a43c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdd340b2fd0 con 0x7fdd341f8840 2024-07-27T03:08:59.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd3a43c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd340b2e50 con 0x7fdd1c004080 2024-07-27T03:08:59.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd3a43c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fdd340cebe0 con 0x7fdd3415d4f0 2024-07-27T03:08:59.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd341f8840 0x7fdd3409e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:59.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd341f8840 0x7fdd3409e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37114/0 (socket says 172.21.15.120:37114) 2024-07-27T03:08:59.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd337fe640 1 -- 172.21.15.120:0/1404330070 learned_addr learned my addr 172.21.15.120:0/1404330070 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:59.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd389d9640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdd3415d4f0 0x7fdd3409e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:59.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd33fff640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c004080 0x7fdd34155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:59.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd337fe640 1 -- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdd3415d4f0 msgr2=0x7fdd3409e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd337fe640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdd3415d4f0 0x7fdd3409e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd337fe640 1 -- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c004080 msgr2=0x7fdd34155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd337fe640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c004080 0x7fdd34155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd337fe640 1 -- 172.21.15.120:0/1404330070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd341f8fb0 con 0x7fdd341f8840 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd33fff640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c004080 0x7fdd34155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.165+0000 7fdd389d9640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdd3415d4f0 0x7fdd3409e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.166+0000 7fdd337fe640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd341f8840 0x7fdd3409e420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd2802b0b0 tx=0x7fdd28001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.166+0000 7fdd30ff9640 1 -- 172.21.15.120:0/1404330070 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28031040 con 0x7fdd341f8840 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.166+0000 7fdd30ff9640 1 -- 172.21.15.120:0/1404330070 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd280035f0 con 0x7fdd341f8840 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.166+0000 7fdd3a43c640 1 -- 172.21.15.120:0/1404330070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd340a05c0 con 0x7fdd341f8840 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.166+0000 7fdd30ff9640 1 -- 172.21.15.120:0/1404330070 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28003a40 con 0x7fdd341f8840 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.166+0000 7fdd3a43c640 1 -- 172.21.15.120:0/1404330070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd341f9290 con 0x7fdd341f8840 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.167+0000 7fdd3a43c640 1 -- 172.21.15.120:0/1404330070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd340b3790 con 0x7fdd341f8840 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.168+0000 7fdd30ff9640 1 -- 172.21.15.120:0/1404330070 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fdd28034070 con 0x7fdd341f8840 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.168+0000 7fdd30ff9640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd20077010 0x7fdd20079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:59.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.168+0000 7fdd30ff9640 1 -- 172.21.15.120:0/1404330070 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdd280b8820 con 0x7fdd341f8840 2024-07-27T03:08:59.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.168+0000 7fdd33fff640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd20077010 0x7fdd20079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:59.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.169+0000 7fdd33fff640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd20077010 0x7fdd20079520 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd24003700 tx=0x7fdd2400b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:59.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.173+0000 7fdd30ff9640 1 -- 172.21.15.120:0/1404330070 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fdd340b3790 con 0x7fdd341f8840 2024-07-27T03:08:59.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.353+0000 7fdd3a43c640 1 -- 172.21.15.120:0/1404330070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fdd341f8d20 con 0x7fdd341f8840 2024-07-27T03:08:59.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.354+0000 7fdd30ff9640 1 -- 172.21.15.120:0/1404330070 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7fdd28081ab0 con 0x7fdd341f8840 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:mon advanced mon_op_complaint_time 120 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:mon dev mon_warn_on_pool_no_app false 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:osd advanced osd_op_complaint_time 180.000000 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5257.409462 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6039.326463 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5855.738461 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4876.658742 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4850.335109 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5729.677637 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5061.056911 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5680.764045 2024-07-27T03:08:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_mds 20/20 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_mds_balancer 20/20 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_ms 2/2 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_debug_frag true 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_debug_scatterstat true 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced mds_op_complaint_time 180.000000 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_verify_scatter true 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced osd_op_complaint_time 180.000000 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced rados_mon_op_timeout 900 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced rados_osd_op_timeout 900 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced client_mount_timeout 600 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced debug_client 20/20 2024-07-27T03:08:59.358 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced debug_ms 1/1 2024-07-27T03:08:59.359 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced rados_mon_op_timeout 900 2024-07-27T03:08:59.359 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced rados_osd_op_timeout 900 2024-07-27T03:08:59.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 -- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd20077010 msgr2=0x7fdd20079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd20077010 0x7fdd20079520 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd24003700 tx=0x7fdd2400b260 comp rx=0 tx=0).stop 2024-07-27T03:08:59.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 -- 172.21.15.120:0/1404330070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd341f8840 msgr2=0x7fdd3409e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd341f8840 0x7fdd3409e420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd2802b0b0 tx=0x7fdd28001d40 comp rx=0 tx=0).stop 2024-07-27T03:08:59.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 -- 172.21.15.120:0/1404330070 shutdown_connections 2024-07-27T03:08:59.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd20077010 0x7fdd20079520 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd341f8840 0x7fdd3409e420 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdd3415d4f0 0x7fdd3409e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 --2- 172.21.15.120:0/1404330070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c004080 0x7fdd34155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 -- 172.21.15.120:0/1404330070 >> 172.21.15.120:0/1404330070 conn(0x7fdd3408d690 msgr2=0x7fdd340cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:59.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 -- 172.21.15.120:0/1404330070 shutdown_connections 2024-07-27T03:08:59.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.356+0000 7fdd3a43c640 1 -- 172.21.15.120:0/1404330070 wait complete. 2024-07-27T03:08:59.370 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-07-27T03:08:59.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.484+0000 7f3fba0d1640 1 -- 172.21.15.120:0/2235712043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fb40733c0 msgr2=0x7f3fb40737d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.484+0000 7f3fba0d1640 1 --2- 172.21.15.120:0/2235712043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fb40733c0 0x7f3fb40737d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3fac005fd0 tx=0x7f3fac02a780 comp rx=0 tx=0).stop 2024-07-27T03:08:59.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.485+0000 7f3fba0d1640 1 -- 172.21.15.120:0/2235712043 shutdown_connections 2024-07-27T03:08:59.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.485+0000 7f3fba0d1640 1 --2- 172.21.15.120:0/2235712043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fb40733c0 0x7f3fb40737d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.485+0000 7f3fba0d1640 1 --2- 172.21.15.120:0/2235712043 >> v2:172.21.15.121:3300/0 conn(0x7f3fb40d0450 0x7f3fb415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.485+0000 7f3fba0d1640 1 -- 172.21.15.120:0/2235712043 >> 172.21.15.120:0/2235712043 conn(0x7f3fb40d0df0 msgr2=0x7f3fb40d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:59.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.485+0000 7f3fba0d1640 1 -- 172.21.15.120:0/2235712043 shutdown_connections 2024-07-27T03:08:59.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.485+0000 7f3fba0d1640 1 -- 172.21.15.120:0/2235712043 wait complete. 2024-07-27T03:08:59.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.486+0000 7f3fba0d1640 1 Processor -- start 2024-07-27T03:08:59.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.487+0000 7f3fba0d1640 1 -- start start 2024-07-27T03:08:59.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fba0d1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fb40718c0 0x7f3fb414d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:59.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fba0d1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fb40733c0 0x7f3fb4157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:59.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fba0d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb40d0450 0x7f3fb4158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:59.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fba0d1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb415bb50 con 0x7f3fb40d0450 2024-07-27T03:08:59.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fba0d1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb415b9d0 con 0x7f3fb40733c0 2024-07-27T03:08:59.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fba0d1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb415bcd0 con 0x7f3fb40718c0 2024-07-27T03:08:59.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fb3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb40d0450 0x7f3fb4158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:59.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fb3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb40d0450 0x7f3fb4158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37116/0 (socket says 172.21.15.120:37116) 2024-07-27T03:08:59.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fb3fff640 1 -- 172.21.15.120:0/638003919 learned_addr learned my addr 172.21.15.120:0/638003919 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:08:59.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fb37fe640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fb40718c0 0x7f3fb414d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:59.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fb2ffd640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fb40733c0 0x7f3fb4157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:59.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fb3fff640 1 -- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fb40718c0 msgr2=0x7f3fb414d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fb3fff640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fb40718c0 0x7f3fb414d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fb3fff640 1 -- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fb40733c0 msgr2=0x7f3fb4157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fb3fff640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fb40733c0 0x7f3fb4157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.488+0000 7f3fb3fff640 1 -- 172.21.15.120:0/638003919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb41f1d00 con 0x7f3fb40d0450 2024-07-27T03:08:59.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.489+0000 7f3fb3fff640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb40d0450 0x7f3fb4158140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3fac005fd0 tx=0x7f3fac003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:59.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.489+0000 7f3f9bfff640 1 -- 172.21.15.120:0/638003919 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac040070 con 0x7f3fb40d0450 2024-07-27T03:08:59.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.489+0000 7f3f9bfff640 1 -- 172.21.15.120:0/638003919 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fac004580 con 0x7f3fb40d0450 2024-07-27T03:08:59.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.489+0000 7f3f9bfff640 1 -- 172.21.15.120:0/638003919 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac003e10 con 0x7f3fb40d0450 2024-07-27T03:08:59.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.489+0000 7f3fba0d1640 1 -- 172.21.15.120:0/638003919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb41f1fa0 con 0x7f3fb40d0450 2024-07-27T03:08:59.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.489+0000 7f3fba0d1640 1 -- 172.21.15.120:0/638003919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb41f2560 con 0x7f3fb40d0450 2024-07-27T03:08:59.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.490+0000 7f3fba0d1640 1 -- 172.21.15.120:0/638003919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb415c1f0 con 0x7f3fb40d0450 2024-07-27T03:08:59.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.490+0000 7f3f9bfff640 1 -- 172.21.15.120:0/638003919 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f3fac043070 con 0x7f3fb40d0450 2024-07-27T03:08:59.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.491+0000 7f3f9bfff640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3fa0077010 0x7f3fa0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:08:59.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.491+0000 7f3f9bfff640 1 -- 172.21.15.120:0/638003919 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3fac0b9d40 con 0x7f3fb40d0450 2024-07-27T03:08:59.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.491+0000 7f3fb37fe640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3fa0077010 0x7f3fa0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:08:59.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.492+0000 7f3fb37fe640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3fa0077010 0x7f3fa0079520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40095f0 tx=0x7f3fa4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:08:59.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.495+0000 7f3f9bfff640 1 -- 172.21.15.120:0/638003919 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f3fac082980 con 0x7f3fb40d0450 2024-07-27T03:08:59.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.680+0000 7f3fba0d1640 1 -- 172.21.15.120:0/638003919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3fb40ccd20 con 0x7f3fb40d0450 2024-07-27T03:08:59.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.683+0000 7f3f9bfff640 1 -- 172.21.15.120:0/638003919 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f3fac086ed0 con 0x7f3fb40d0450 2024-07-27T03:08:59.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 -- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3fa0077010 msgr2=0x7f3fa0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3fa0077010 0x7f3fa0079520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40095f0 tx=0x7f3fa4005f90 comp rx=0 tx=0).stop 2024-07-27T03:08:59.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 -- 172.21.15.120:0/638003919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb40d0450 msgr2=0x7f3fb4158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:08:59.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb40d0450 0x7f3fb4158140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3fac005fd0 tx=0x7f3fac003c20 comp rx=0 tx=0).stop 2024-07-27T03:08:59.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 -- 172.21.15.120:0/638003919 shutdown_connections 2024-07-27T03:08:59.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3fa0077010 0x7f3fa0079520 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3fb40d0450 0x7f3fb4158140 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fb40733c0 0x7f3fb4157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 --2- 172.21.15.120:0/638003919 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3fb40718c0 0x7f3fb414d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:08:59.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 -- 172.21.15.120:0/638003919 >> 172.21.15.120:0/638003919 conn(0x7f3fb40d0df0 msgr2=0x7f3fb40b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:08:59.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 -- 172.21.15.120:0/638003919 shutdown_connections 2024-07-27T03:08:59.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:08:59.686+0000 7f3fba0d1640 1 -- 172.21.15.120:0/638003919 wait complete. 2024-07-27T03:08:59.699 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-07-27T03:08:59.699 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:08:59.740 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:08:59.780 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-07-27T03:08:59.780 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:59.780 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:08:59.797 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:59.797 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:08:59.853 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:08:59.853 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:08:59.909 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-27T03:09:00.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.062+0000 7f5115727640 1 -- 172.21.15.120:0/2639496475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51100b75b0 msgr2=0x7f51100d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:00.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.062+0000 7f5115727640 1 --2- 172.21.15.120:0/2639496475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51100b75b0 0x7f51100d0790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5100009830 tx=0x7f510002a480 comp rx=0 tx=0).stop 2024-07-27T03:09:00.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.062+0000 7f5115727640 1 -- 172.21.15.120:0/2639496475 shutdown_connections 2024-07-27T03:09:00.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.062+0000 7f5115727640 1 --2- 172.21.15.120:0/2639496475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51100b75b0 0x7f51100d0790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.062+0000 7f5115727640 1 -- 172.21.15.120:0/2639496475 >> 172.21.15.120:0/2639496475 conn(0x7f51100d1dd0 msgr2=0x7f51100d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:00.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.062+0000 7f5115727640 1 -- 172.21.15.120:0/2639496475 shutdown_connections 2024-07-27T03:09:00.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.062+0000 7f5115727640 1 -- 172.21.15.120:0/2639496475 wait complete. 2024-07-27T03:09:00.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.064+0000 7f5115727640 1 Processor -- start 2024-07-27T03:09:00.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.064+0000 7f5115727640 1 -- start start 2024-07-27T03:09:00.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.065+0000 7f5115727640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51100b75b0 0x7f51101619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:00.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.065+0000 7f5115727640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100cd940 0x7f511015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:00.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.065+0000 7f5115727640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51100d28f0 0x7f511015d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.065+0000 7f5115727640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5110167ab0 con 0x7f51100d28f0 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.065+0000 7f5115727640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f51100b1fc0 con 0x7f51100cd940 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.065+0000 7f5115727640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5110167c30 con 0x7f51100b75b0 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.065+0000 7f510f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51100d28f0 0x7f511015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.065+0000 7f510f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51100d28f0 0x7f511015d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37144/0 (socket says 172.21.15.120:37144) 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f510f7fe640 1 -- 172.21.15.120:0/2439095205 learned_addr learned my addr 172.21.15.120:0/2439095205 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f5107fff640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100cd940 0x7f511015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f510effd640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51100b75b0 0x7f51101619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f510f7fe640 1 -- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51100b75b0 msgr2=0x7f51101619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f510f7fe640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51100b75b0 0x7f51101619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f510f7fe640 1 -- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100cd940 msgr2=0x7f511015d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:00.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f510f7fe640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100cd940 0x7f511015d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f510f7fe640 1 -- 172.21.15.120:0/2439095205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511006ea10 con 0x7f51100d28f0 2024-07-27T03:09:00.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f510f7fe640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51100d28f0 0x7f511015d600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f510800c730 tx=0x7f510800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:00.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f51077fe640 1 -- 172.21.15.120:0/2439095205 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108017070 con 0x7f51100d28f0 2024-07-27T03:09:00.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f51077fe640 1 -- 172.21.15.120:0/2439095205 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5108003c60 con 0x7f51100d28f0 2024-07-27T03:09:00.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f51077fe640 1 -- 172.21.15.120:0/2439095205 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51080052d0 con 0x7f51100d28f0 2024-07-27T03:09:00.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f5115727640 1 -- 172.21.15.120:0/2439095205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511006ecf0 con 0x7f51100d28f0 2024-07-27T03:09:00.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.066+0000 7f5115727640 1 -- 172.21.15.120:0/2439095205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f511006f2b0 con 0x7f51100d28f0 2024-07-27T03:09:00.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.067+0000 7f5115727640 1 -- 172.21.15.120:0/2439095205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511006e780 con 0x7f51100d28f0 2024-07-27T03:09:00.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.068+0000 7f51077fe640 1 -- 172.21.15.120:0/2439095205 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f510801a070 con 0x7f51100d28f0 2024-07-27T03:09:00.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.069+0000 7f51077fe640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f50f0077010 0x7f50f0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:00.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.069+0000 7f51077fe640 1 -- 172.21.15.120:0/2439095205 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5108098050 con 0x7f51100d28f0 2024-07-27T03:09:00.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.069+0000 7f510effd640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f50f0077010 0x7f50f0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:00.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.069+0000 7f510effd640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f50f0077010 0x7f50f0079520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5100034000 tx=0x7f5100004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:00.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.073+0000 7f51077fe640 1 -- 172.21.15.120:0/2439095205 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5108060c90 con 0x7f51100d28f0 2024-07-27T03:09:00.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.266+0000 7f5115727640 1 -- 172.21.15.120:0/2439095205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f51100d0790 con 0x7f51100d28f0 2024-07-27T03:09:00.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.267+0000 7f51077fe640 1 -- 172.21.15.120:0/2439095205 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f51080651e0 con 0x7f51100d28f0 2024-07-27T03:09:00.270 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 -- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f50f0077010 msgr2=0x7f50f0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f50f0077010 0x7f50f0079520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5100034000 tx=0x7f5100004730 comp rx=0 tx=0).stop 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 -- 172.21.15.120:0/2439095205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51100d28f0 msgr2=0x7f511015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51100d28f0 0x7f511015d600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f510800c730 tx=0x7f510800cbf0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 -- 172.21.15.120:0/2439095205 shutdown_connections 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f50f0077010 0x7f50f0079520 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5100034000 tx=0x7f5100004730 comp rx=0 tx=0).stop 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51100d28f0 0x7f511015d600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51100cd940 0x7f511015d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 --2- 172.21.15.120:0/2439095205 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51100b75b0 0x7f51101619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 -- 172.21.15.120:0/2439095205 >> 172.21.15.120:0/2439095205 conn(0x7f51100d1dd0 msgr2=0x7f51100ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 -- 172.21.15.120:0/2439095205 shutdown_connections 2024-07-27T03:09:00.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.269+0000 7f5115727640 1 -- 172.21.15.120:0/2439095205 wait complete. 2024-07-27T03:09:00.283 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-07-27T03:09:00.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:00.283 DEBUG:teuthology.orchestra.run.smithi120:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-07-27T03:09:00.310 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:09:00.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:00.310 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-07-27T03:09:00.376 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:09:00.376 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:00.397 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:09:00.397 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:00.456 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:09:00.456 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:00.515 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-27T03:09:00.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.627+0000 7f8c12534640 1 -- 172.21.15.120:0/3819840167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c0c0d28f0 msgr2=0x7f8c0c0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:00.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.627+0000 7f8c12534640 1 --2- 172.21.15.120:0/3819840167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c0c0d28f0 0x7f8c0c0ce840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c073490 tx=0x7f8c0002a4a0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.627+0000 7f8c12534640 1 -- 172.21.15.120:0/3819840167 shutdown_connections 2024-07-27T03:09:00.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.627+0000 7f8c12534640 1 --2- 172.21.15.120:0/3819840167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c0c0d28f0 0x7f8c0c0ce840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.627+0000 7f8c12534640 1 --2- 172.21.15.120:0/3819840167 >> v2:172.21.15.121:3300/0 conn(0x7f8c0c0b75b0 0x7f8c0c0d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.627+0000 7f8c12534640 1 -- 172.21.15.120:0/3819840167 >> 172.21.15.120:0/3819840167 conn(0x7f8c0c0d1dd0 msgr2=0x7f8c0c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:00.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.627+0000 7f8c12534640 1 -- 172.21.15.120:0/3819840167 shutdown_connections 2024-07-27T03:09:00.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.628+0000 7f8c12534640 1 -- 172.21.15.120:0/3819840167 wait complete. 2024-07-27T03:09:00.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.629+0000 7f8c12534640 1 Processor -- start 2024-07-27T03:09:00.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.629+0000 7f8c12534640 1 -- start start 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c12534640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c0c0b75b0 0x7f8c0c0c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c12534640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c0c0ced80 0x7f8c0c0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c12534640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c0c0d28f0 0x7f8c0c164550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c12534640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c0b1f80 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c12534640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c0b1e00 con 0x7f8c0c0b75b0 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c12534640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8c0c166aa0 con 0x7f8c0c0ced80 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c10ad1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c0c0d28f0 0x7f8c0c164550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c10ad1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c0c0d28f0 0x7f8c0c164550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37166/0 (socket says 172.21.15.120:37166) 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c10ad1640 1 -- 172.21.15.120:0/2356097181 learned_addr learned my addr 172.21.15.120:0/2356097181 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c0bfff640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c0c0b75b0 0x7f8c0c0c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c0b7fe640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c0c0ced80 0x7f8c0c0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:00.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c10ad1640 1 -- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c0c0ced80 msgr2=0x7f8c0c0c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:00.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c10ad1640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c0c0ced80 0x7f8c0c0c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c10ad1640 1 -- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c0c0b75b0 msgr2=0x7f8c0c0c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:00.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c10ad1640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c0c0b75b0 0x7f8c0c0c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c10ad1640 1 -- 172.21.15.120:0/2356097181 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0c0c8fa0 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c10ad1640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c0c0d28f0 0x7f8c0c164550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400c760 tx=0x7f8c0400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:00.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c08ff9640 1 -- 172.21.15.120:0/2356097181 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04003b70 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.631+0000 7f8c08ff9640 1 -- 172.21.15.120:0/2356097181 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c04003d30 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.632+0000 7f8c12534640 1 -- 172.21.15.120:0/2356097181 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0c0c6f00 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.632+0000 7f8c08ff9640 1 -- 172.21.15.120:0/2356097181 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c040052d0 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.632+0000 7f8c12534640 1 -- 172.21.15.120:0/2356097181 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0c0c74c0 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.632+0000 7f8c12534640 1 -- 172.21.15.120:0/2356097181 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c0c15d630 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.634+0000 7f8c08ff9640 1 -- 172.21.15.120:0/2356097181 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8c04005470 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.634+0000 7f8c08ff9640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8bf8077010 0x7f8bf8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:00.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.634+0000 7f8c08ff9640 1 -- 172.21.15.120:0/2356097181 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8c04098fe0 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.635+0000 7f8c0bfff640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8bf8077010 0x7f8bf8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:00.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.635+0000 7f8c0bfff640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8bf8077010 0x7f8bf8079520 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0098e0 tx=0x7f8bfc009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:00.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.638+0000 7f8c08ff9640 1 -- 172.21.15.120:0/2356097181 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f8c04061c70 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.832+0000 7f8c12534640 1 -- 172.21.15.120:0/2356097181 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8c0c0cf760 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.833+0000 7f8c08ff9640 1 -- 172.21.15.120:0/2356097181 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f8c040661c0 con 0x7f8c0c0d28f0 2024-07-27T03:09:00.835 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-07-27T03:09:00.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 -- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8bf8077010 msgr2=0x7f8bf8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:00.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8bf8077010 0x7f8bf8079520 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0098e0 tx=0x7f8bfc009060 comp rx=0 tx=0).stop 2024-07-27T03:09:00.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 -- 172.21.15.120:0/2356097181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c0c0d28f0 msgr2=0x7f8c0c164550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:00.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c0c0d28f0 0x7f8c0c164550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400c760 tx=0x7f8c0400cc20 comp rx=0 tx=0).stop 2024-07-27T03:09:00.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 -- 172.21.15.120:0/2356097181 shutdown_connections 2024-07-27T03:09:00.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8bf8077010 0x7f8bf8079520 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c0c0d28f0 0x7f8c0c164550 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c0c0ced80 0x7f8c0c0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 --2- 172.21.15.120:0/2356097181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c0c0b75b0 0x7f8c0c0c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:00.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 -- 172.21.15.120:0/2356097181 >> 172.21.15.120:0/2356097181 conn(0x7f8c0c0d1dd0 msgr2=0x7f8c0c0b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:00.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 -- 172.21.15.120:0/2356097181 shutdown_connections 2024-07-27T03:09:00.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:00.835+0000 7f8c12534640 1 -- 172.21.15.120:0/2356097181 wait complete. 2024-07-27T03:09:00.849 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-07-27T03:09:00.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:00.849 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-07-27T03:09:00.881 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:09:00.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:00.881 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-07-27T03:09:00.955 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:00.956 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:00.972 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:00.972 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:01.029 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:01.030 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:01.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-27T03:09:01.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.236+0000 7fb9273f0640 1 -- 172.21.15.120:0/908906056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9200d28f0 msgr2=0x7fb9200ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:01.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.236+0000 7fb9273f0640 1 --2- 172.21.15.120:0/908906056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9200d28f0 0x7fb9200ce840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb910005fd0 tx=0x7fb91002a4a0 comp rx=0 tx=0).stop 2024-07-27T03:09:01.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.236+0000 7fb9273f0640 1 -- 172.21.15.120:0/908906056 shutdown_connections 2024-07-27T03:09:01.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.236+0000 7fb9273f0640 1 --2- 172.21.15.120:0/908906056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9200d28f0 0x7fb9200ce840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:01.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.236+0000 7fb9273f0640 1 --2- 172.21.15.120:0/908906056 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9200b75b0 0x7fb9200d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:01.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.236+0000 7fb9273f0640 1 -- 172.21.15.120:0/908906056 >> 172.21.15.120:0/908906056 conn(0x7fb9200d1dd0 msgr2=0x7fb9200d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:01.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.236+0000 7fb9273f0640 1 -- 172.21.15.120:0/908906056 shutdown_connections 2024-07-27T03:09:01.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.236+0000 7fb9273f0640 1 -- 172.21.15.120:0/908906056 wait complete. 2024-07-27T03:09:01.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.238+0000 7fb9273f0640 1 Processor -- start 2024-07-27T03:09:01.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.238+0000 7fb9273f0640 1 -- start start 2024-07-27T03:09:01.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.239+0000 7fb9273f0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9200b75b0 0x7fb92015b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:01.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.239+0000 7fb9273f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9200ced80 0x7fb920159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:01.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.239+0000 7fb9273f0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9200d28f0 0x7fb9200c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:01.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.239+0000 7fb9273f0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb9200b2000 con 0x7fb9200b75b0 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.239+0000 7fb9273f0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb9200b1e80 con 0x7fb9200ced80 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.239+0000 7fb9273f0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb920166aa0 con 0x7fb9200d28f0 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.239+0000 7fb92518c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9200b75b0 0x7fb92015b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.239+0000 7fb92518c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9200b75b0 0x7fb92015b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37184/0 (socket says 172.21.15.120:37184) 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.239+0000 7fb92518c640 1 -- 172.21.15.120:0/4272511356 learned_addr learned my addr 172.21.15.120:0/4272511356 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb92598d640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9200d28f0 0x7fb9200c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb92498b640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9200ced80 0x7fb920159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb92518c640 1 -- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9200d28f0 msgr2=0x7fb9200c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb92518c640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9200d28f0 0x7fb9200c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb92518c640 1 -- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9200ced80 msgr2=0x7fb920159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb92518c640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9200ced80 0x7fb920159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb92518c640 1 -- 172.21.15.120:0/4272511356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92015a620 con 0x7fb9200b75b0 2024-07-27T03:09:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb92498b640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9200ced80 0x7fb920159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:01.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb92518c640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9200b75b0 0x7fb92015b3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00c970 tx=0x7fb91c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:01.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb915ffb640 1 -- 172.21.15.120:0/4272511356 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c007bb0 con 0x7fb9200b75b0 2024-07-27T03:09:01.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb915ffb640 1 -- 172.21.15.120:0/4272511356 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb91c005020 con 0x7fb9200b75b0 2024-07-27T03:09:01.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb9273f0640 1 -- 172.21.15.120:0/4272511356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92015a900 con 0x7fb9200b75b0 2024-07-27T03:09:01.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb915ffb640 1 -- 172.21.15.120:0/4272511356 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c007e60 con 0x7fb9200b75b0 2024-07-27T03:09:01.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.240+0000 7fb9273f0640 1 -- 172.21.15.120:0/4272511356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9200b5740 con 0x7fb9200b75b0 2024-07-27T03:09:01.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.241+0000 7fb9273f0640 1 -- 172.21.15.120:0/4272511356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9200d0790 con 0x7fb9200b75b0 2024-07-27T03:09:01.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.242+0000 7fb915ffb640 1 -- 172.21.15.120:0/4272511356 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb91c005470 con 0x7fb9200b75b0 2024-07-27T03:09:01.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.242+0000 7fb915ffb640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb904077010 0x7fb904079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:01.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.242+0000 7fb915ffb640 1 -- 172.21.15.120:0/4272511356 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb91c098c70 con 0x7fb9200b75b0 2024-07-27T03:09:01.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.243+0000 7fb92498b640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb904077010 0x7fb904079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:01.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.243+0000 7fb92498b640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb904077010 0x7fb904079520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb910033000 tx=0x7fb910004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:01.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.247+0000 7fb915ffb640 1 -- 172.21.15.120:0/4272511356 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb91c014030 con 0x7fb9200b75b0 2024-07-27T03:09:01.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.440+0000 7fb9273f0640 1 -- 172.21.15.120:0/4272511356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb9200cea50 con 0x7fb9200b75b0 2024-07-27T03:09:01.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.440+0000 7fb915ffb640 1 -- 172.21.15.120:0/4272511356 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fb91c06a140 con 0x7fb9200b75b0 2024-07-27T03:09:01.443 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-07-27T03:09:01.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.442+0000 7fb9273f0640 1 -- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb904077010 msgr2=0x7fb904079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:01.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.442+0000 7fb9273f0640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb904077010 0x7fb904079520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb910033000 tx=0x7fb910004730 comp rx=0 tx=0).stop 2024-07-27T03:09:01.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.442+0000 7fb9273f0640 1 -- 172.21.15.120:0/4272511356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9200b75b0 msgr2=0x7fb92015b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:01.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.442+0000 7fb9273f0640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9200b75b0 0x7fb92015b3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00c970 tx=0x7fb91c00ce30 comp rx=0 tx=0).stop 2024-07-27T03:09:01.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.443+0000 7fb9273f0640 1 -- 172.21.15.120:0/4272511356 shutdown_connections 2024-07-27T03:09:01.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.443+0000 7fb9273f0640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb904077010 0x7fb904079520 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:01.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.443+0000 7fb9273f0640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb9200d28f0 0x7fb9200c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:01.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.443+0000 7fb9273f0640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9200ced80 0x7fb920159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:01.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.443+0000 7fb9273f0640 1 --2- 172.21.15.120:0/4272511356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9200b75b0 0x7fb92015b3e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:01.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.443+0000 7fb9273f0640 1 -- 172.21.15.120:0/4272511356 >> 172.21.15.120:0/4272511356 conn(0x7fb9200d1dd0 msgr2=0x7fb92015cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:01.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.443+0000 7fb9273f0640 1 -- 172.21.15.120:0/4272511356 shutdown_connections 2024-07-27T03:09:01.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.443+0000 7fb9273f0640 1 -- 172.21.15.120:0/4272511356 wait complete. 2024-07-27T03:09:01.457 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-07-27T03:09:01.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:01.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-07-27T03:09:01.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:09:01.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:01.483 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-07-27T03:09:01.539 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:09:01.539 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:01.559 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:09:01.559 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:01.618 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:09:01.618 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:01.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-27T03:09:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.789+0000 7f6b7bef9640 1 -- 172.21.15.120:0/323846386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b60003a00 msgr2=0x7f6b60003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.789+0000 7f6b7bef9640 1 --2- 172.21.15.120:0/323846386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b60003a00 0x7f6b60003e70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c2e0 tx=0x7f6b60005830 comp rx=0 tx=0).stop 2024-07-27T03:09:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.789+0000 7f6b7a496640 1 -- 172.21.15.120:0/323846386 reap_dead start 2024-07-27T03:09:01.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.789+0000 7f6b7bef9640 1 -- 172.21.15.120:0/323846386 shutdown_connections 2024-07-27T03:09:01.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.789+0000 7f6b7bef9640 1 -- 172.21.15.120:0/323846386 >> 172.21.15.120:0/323846386 conn(0x7f6b740d0f00 msgr2=0x7f6b740d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:01.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.790+0000 7f6b7bef9640 1 -- 172.21.15.120:0/323846386 shutdown_connections 2024-07-27T03:09:01.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.790+0000 7f6b7bef9640 1 -- 172.21.15.120:0/323846386 wait complete. 2024-07-27T03:09:01.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.791+0000 7f6b7bef9640 1 Processor -- start 2024-07-27T03:09:01.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.791+0000 7f6b7bef9640 1 -- start start 2024-07-27T03:09:01.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.792+0000 7f6b7bef9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b60003a00 0x7f6b741f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:01.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7bef9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b741391a0 0x7f6b741f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7bef9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b741396b0 0x7f6b741e1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7bef9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6b740cfee0 con 0x7f6b741396b0 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7bef9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6b740cfd60 con 0x7f6b60003a00 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7bef9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6b740d0060 con 0x7f6b741391a0 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7a496640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b741396b0 0x7f6b741e1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7a496640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b741396b0 0x7f6b741e1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55982/0 (socket says 172.21.15.120:55982) 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7a496640 1 -- 172.21.15.120:0/695820036 learned_addr learned my addr 172.21.15.120:0/695820036 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b79c95640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b60003a00 0x7f6b741f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b79494640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b741391a0 0x7f6b741f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7a496640 1 -- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b741391a0 msgr2=0x7f6b741f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7a496640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b741391a0 0x7f6b741f6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7a496640 1 -- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b60003a00 msgr2=0x7f6b741f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7a496640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b60003a00 0x7f6b741f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7a496640 1 -- 172.21.15.120:0/695820036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b741f3a90 con 0x7f6b741396b0 2024-07-27T03:09:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7a496640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b741396b0 0x7f6b741e1b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6b74070470 tx=0x7f6b6c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b6a7fc640 1 -- 172.21.15.120:0/695820036 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c004b20 con 0x7f6b741396b0 2024-07-27T03:09:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b6a7fc640 1 -- 172.21.15.120:0/695820036 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b6c004cc0 con 0x7f6b741396b0 2024-07-27T03:09:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7bef9640 1 -- 172.21.15.120:0/695820036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b741f3d70 con 0x7f6b741396b0 2024-07-27T03:09:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b6a7fc640 1 -- 172.21.15.120:0/695820036 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c003bd0 con 0x7f6b741396b0 2024-07-27T03:09:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.793+0000 7f6b7bef9640 1 -- 172.21.15.120:0/695820036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b741f6a70 con 0x7f6b741396b0 2024-07-27T03:09:01.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.794+0000 7f6b7bef9640 1 -- 172.21.15.120:0/695820036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b741f3800 con 0x7f6b741396b0 2024-07-27T03:09:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.795+0000 7f6b6a7fc640 1 -- 172.21.15.120:0/695820036 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6b6c004030 con 0x7f6b741396b0 2024-07-27T03:09:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.796+0000 7f6b6a7fc640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b58077010 0x7f6b58079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.796+0000 7f6b6a7fc640 1 -- 172.21.15.120:0/695820036 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6b6c099130 con 0x7f6b741396b0 2024-07-27T03:09:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.796+0000 7f6b79c95640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b58077010 0x7f6b58079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:01.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.797+0000 7f6b79c95640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b58077010 0x7f6b58079520 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c2e0 tx=0x7f6b7002d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.801+0000 7f6b6a7fc640 1 -- 172.21.15.120:0/695820036 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6b6c062450 con 0x7f6b741396b0 2024-07-27T03:09:02.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.999+0000 7f6b7bef9640 1 -- 172.21.15.120:0/695820036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6b74145c70 con 0x7f6b741396b0 2024-07-27T03:09:02.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:01.999+0000 7f6b6a7fc640 1 -- 172.21.15.120:0/695820036 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f6b6c061d50 con 0x7f6b741396b0 2024-07-27T03:09:02.002 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-07-27T03:09:02.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.001+0000 7f6b7bef9640 1 -- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b58077010 msgr2=0x7f6b58079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.001+0000 7f6b7bef9640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b58077010 0x7f6b58079520 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c2e0 tx=0x7f6b7002d000 comp rx=0 tx=0).stop 2024-07-27T03:09:02.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.001+0000 7f6b7bef9640 1 -- 172.21.15.120:0/695820036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b741396b0 msgr2=0x7f6b741e1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.001+0000 7f6b7bef9640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b741396b0 0x7f6b741e1b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6b74070470 tx=0x7f6b6c00f3c0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.001+0000 7f6b7bef9640 1 -- 172.21.15.120:0/695820036 shutdown_connections 2024-07-27T03:09:02.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.001+0000 7f6b7bef9640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b58077010 0x7f6b58079520 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.001+0000 7f6b7bef9640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b741396b0 0x7f6b741e1b10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.001+0000 7f6b7bef9640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b741391a0 0x7f6b741f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.001+0000 7f6b7bef9640 1 --2- 172.21.15.120:0/695820036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b60003a00 0x7f6b741f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.001+0000 7f6b7bef9640 1 -- 172.21.15.120:0/695820036 >> 172.21.15.120:0/695820036 conn(0x7f6b740d0f00 msgr2=0x7f6b740cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:02.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.002+0000 7f6b7bef9640 1 -- 172.21.15.120:0/695820036 shutdown_connections 2024-07-27T03:09:02.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.002+0000 7f6b7bef9640 1 -- 172.21.15.120:0/695820036 wait complete. 2024-07-27T03:09:02.016 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-07-27T03:09:02.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:02.016 DEBUG:teuthology.orchestra.run.smithi121:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-07-27T03:09:02.048 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:09:02.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:02.048 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-07-27T03:09:02.106 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-07-27T03:09:02.107 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.218+0000 7fb636f98640 1 -- 172.21.15.120:0/1175706718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb630154f00 msgr2=0x7fb630155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.218+0000 7fb636f98640 1 --2- 172.21.15.120:0/1175706718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb630154f00 0x7fb630155310 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb628005fd0 tx=0x7fb62802aa10 comp rx=0 tx=0).stop 2024-07-27T03:09:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.218+0000 7fb636f98640 1 -- 172.21.15.120:0/1175706718 shutdown_connections 2024-07-27T03:09:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.218+0000 7fb636f98640 1 --2- 172.21.15.120:0/1175706718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb630154f00 0x7fb630155310 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.218+0000 7fb636f98640 1 --2- 172.21.15.120:0/1175706718 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6300b41c0 0x7fb63006e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.218+0000 7fb636f98640 1 -- 172.21.15.120:0/1175706718 >> 172.21.15.120:0/1175706718 conn(0x7fb6300b1a10 msgr2=0x7fb6300b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:02.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.218+0000 7fb636f98640 1 -- 172.21.15.120:0/1175706718 shutdown_connections 2024-07-27T03:09:02.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.218+0000 7fb636f98640 1 -- 172.21.15.120:0/1175706718 wait complete. 2024-07-27T03:09:02.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.220+0000 7fb636f98640 1 Processor -- start 2024-07-27T03:09:02.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.220+0000 7fb636f98640 1 -- start start 2024-07-27T03:09:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.221+0000 7fb636f98640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6300b41c0 0x7fb6301411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.221+0000 7fb636f98640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb630154f00 0x7fb630143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.221+0000 7fb636f98640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63015ec20 0x7fb630143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.221+0000 7fb636f98640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb630155850 con 0x7fb630154f00 2024-07-27T03:09:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.221+0000 7fb636f98640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb63015fa60 con 0x7fb63015ec20 2024-07-27T03:09:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.221+0000 7fb636f98640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb6301559d0 con 0x7fb6300b41c0 2024-07-27T03:09:02.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.221+0000 7fb627fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb630154f00 0x7fb630143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb627fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb630154f00 0x7fb630143aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55994/0 (socket says 172.21.15.120:55994) 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb627fff640 1 -- 172.21.15.120:0/2468739757 learned_addr learned my addr 172.21.15.120:0/2468739757 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb634d34640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6300b41c0 0x7fb6301411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb635535640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63015ec20 0x7fb630143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb627fff640 1 -- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6300b41c0 msgr2=0x7fb6301411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb627fff640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6300b41c0 0x7fb6301411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb627fff640 1 -- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63015ec20 msgr2=0x7fb630143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb627fff640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63015ec20 0x7fb630143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb627fff640 1 -- 172.21.15.120:0/2468739757 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb630151330 con 0x7fb630154f00 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb627fff640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb630154f00 0x7fb630143aa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb62000b440 tx=0x7fb62000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb6257fa640 1 -- 172.21.15.120:0/2468739757 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620015020 con 0x7fb630154f00 2024-07-27T03:09:02.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb6257fa640 1 -- 172.21.15.120:0/2468739757 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb620011940 con 0x7fb630154f00 2024-07-27T03:09:02.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb636f98640 1 -- 172.21.15.120:0/2468739757 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb630141710 con 0x7fb630154f00 2024-07-27T03:09:02.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb6257fa640 1 -- 172.21.15.120:0/2468739757 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620011d90 con 0x7fb630154f00 2024-07-27T03:09:02.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.222+0000 7fb636f98640 1 -- 172.21.15.120:0/2468739757 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb630141d90 con 0x7fb630154f00 2024-07-27T03:09:02.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.223+0000 7fb636f98640 1 -- 172.21.15.120:0/2468739757 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb63006e270 con 0x7fb630154f00 2024-07-27T03:09:02.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.224+0000 7fb6257fa640 1 -- 172.21.15.120:0/2468739757 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb620018020 con 0x7fb630154f00 2024-07-27T03:09:02.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.225+0000 7fb6257fa640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb61c077010 0x7fb61c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.225+0000 7fb6257fa640 1 -- 172.21.15.120:0/2468739757 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb6200983b0 con 0x7fb630154f00 2024-07-27T03:09:02.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.225+0000 7fb634d34640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb61c077010 0x7fb61c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:02.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.226+0000 7fb634d34640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb61c077010 0x7fb61c079520 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb6300703e0 tx=0x7fb62c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:02.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.229+0000 7fb6257fa640 1 -- 172.21.15.120:0/2468739757 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb62001f030 con 0x7fb630154f00 2024-07-27T03:09:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.446+0000 7fb636f98640 1 -- 172.21.15.120:0/2468739757 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6300ae440 con 0x7fb630154f00 2024-07-27T03:09:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.447+0000 7fb6257fa640 1 -- 172.21.15.120:0/2468739757 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7fb620060ff0 con 0x7fb630154f00 2024-07-27T03:09:02.450 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:02.450 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":8,"btime":"2024-07-27T03:08:36:963563+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/4223514676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4223514676},{"type":"v1","addr":"172.21.15.120:6834","nonce":4223514676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1736241961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1736241961},{"type":"v1","addr":"172.21.15.121:6837","nonce":1736241961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/625386978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":625386978},{"type":"v1","addr":"172.21.15.121:6836","nonce":625386978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:08:33.299496+0000","modified":"2024-07-27T03:08:36.330563+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/552629761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":552629761},{"type":"v1","addr":"172.21.15.120:6835","nonce":552629761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4359,"qdb_cluster":[4359]},"id":1}]} 2024-07-27T03:09:02.450 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 8 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 -- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb61c077010 msgr2=0x7fb61c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb61c077010 0x7fb61c079520 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb6300703e0 tx=0x7fb62c009060 comp rx=0 tx=0).stop 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 -- 172.21.15.120:0/2468739757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb630154f00 msgr2=0x7fb630143aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb630154f00 0x7fb630143aa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb62000b440 tx=0x7fb62000b900 comp rx=0 tx=0).stop 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 -- 172.21.15.120:0/2468739757 shutdown_connections 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb61c077010 0x7fb61c079520 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb630154f00 0x7fb630143aa0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb63015ec20 0x7fb630143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 --2- 172.21.15.120:0/2468739757 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb6300b41c0 0x7fb6301411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 -- 172.21.15.120:0/2468739757 >> 172.21.15.120:0/2468739757 conn(0x7fb6300b1a10 msgr2=0x7fb6300aec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 -- 172.21.15.120:0/2468739757 shutdown_connections 2024-07-27T03:09:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.449+0000 7fb636f98640 1 -- 172.21.15.120:0/2468739757 wait complete. 2024-07-27T03:09:02.463 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:02.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.576+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/4071602407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6c00b5fe0 msgr2=0x7fd6c015e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.576+0000 7fd6c7b1f640 1 --2- 172.21.15.120:0/4071602407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6c00b5fe0 0x7fd6c015e9c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8005fd0 tx=0x7fd6b802a820 comp rx=0 tx=0).stop 2024-07-27T03:09:02.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.576+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/4071602407 shutdown_connections 2024-07-27T03:09:02.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.576+0000 7fd6c7b1f640 1 --2- 172.21.15.120:0/4071602407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6c00b5fe0 0x7fd6c015e9c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.576+0000 7fd6c7b1f640 1 --2- 172.21.15.120:0/4071602407 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6c00d0c10 0x7fd6c00b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.576+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/4071602407 >> 172.21.15.120:0/4071602407 conn(0x7fd6c00b3920 msgr2=0x7fd6c00b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:02.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.576+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/4071602407 shutdown_connections 2024-07-27T03:09:02.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.576+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/4071602407 wait complete. 2024-07-27T03:09:02.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.578+0000 7fd6c7b1f640 1 Processor -- start 2024-07-27T03:09:02.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.578+0000 7fd6c7b1f640 1 -- start start 2024-07-27T03:09:02.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.579+0000 7fd6c7b1f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6c00b2110 0x7fd6c01f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.579+0000 7fd6c7b1f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6c00b5fe0 0x7fd6c00aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.579+0000 7fd6c7b1f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6c00af140 0x7fd6c00cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.579+0000 7fd6c7b1f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c015f500 con 0x7fd6c00b2110 2024-07-27T03:09:02.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.579+0000 7fd6c7b1f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c015f380 con 0x7fd6c00af140 2024-07-27T03:09:02.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.579+0000 7fd6c7b1f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c015f680 con 0x7fd6c00b5fe0 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.579+0000 7fd6c58bb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6c00b2110 0x7fd6c01f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.579+0000 7fd6c58bb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6c00b2110 0x7fd6c01f6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56006/0 (socket says 172.21.15.120:56006) 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.579+0000 7fd6c58bb640 1 -- 172.21.15.120:0/1490037664 learned_addr learned my addr 172.21.15.120:0/1490037664 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.579+0000 7fd6c50ba640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6c00b5fe0 0x7fd6c00aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.579+0000 7fd6c60bc640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6c00af140 0x7fd6c00cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.580+0000 7fd6c58bb640 1 -- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6c00b5fe0 msgr2=0x7fd6c00aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.580+0000 7fd6c58bb640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6c00b5fe0 0x7fd6c00aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.580+0000 7fd6c58bb640 1 -- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6c00af140 msgr2=0x7fd6c00cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.580+0000 7fd6c58bb640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6c00af140 0x7fd6c00cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.580+0000 7fd6c58bb640 1 -- 172.21.15.120:0/1490037664 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c00af550 con 0x7fd6c00b2110 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.580+0000 7fd6c58bb640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6c00b2110 0x7fd6c01f6d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00c3a0 tx=0x7fd6bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.580+0000 7fd6b67fc640 1 -- 172.21.15.120:0/1490037664 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc017070 con 0x7fd6c00b2110 2024-07-27T03:09:02.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.580+0000 7fd6b67fc640 1 -- 172.21.15.120:0/1490037664 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6bc0053c0 con 0x7fd6c00b2110 2024-07-27T03:09:02.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.580+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/1490037664 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c00b1160 con 0x7fd6c00b2110 2024-07-27T03:09:02.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.580+0000 7fd6b67fc640 1 -- 172.21.15.120:0/1490037664 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc003850 con 0x7fd6c00b2110 2024-07-27T03:09:02.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.580+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/1490037664 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c00b1720 con 0x7fd6c00b2110 2024-07-27T03:09:02.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.581+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/1490037664 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c015fba0 con 0x7fd6c00b2110 2024-07-27T03:09:02.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.582+0000 7fd6b67fc640 1 -- 172.21.15.120:0/1490037664 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd6bc01a070 con 0x7fd6c00b2110 2024-07-27T03:09:02.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.582+0000 7fd6b67fc640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd6a4077010 0x7fd6a4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.582+0000 7fd6b67fc640 1 -- 172.21.15.120:0/1490037664 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd6bc097c00 con 0x7fd6c00b2110 2024-07-27T03:09:02.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.583+0000 7fd6c50ba640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd6a4077010 0x7fd6a4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:02.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.583+0000 7fd6c50ba640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd6a4077010 0x7fd6a4079520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00096c0 tx=0x7fd6b0009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:02.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.587+0000 7fd6b67fc640 1 -- 172.21.15.120:0/1490037664 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd6bc09e080 con 0x7fd6c00b2110 2024-07-27T03:09:02.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.805+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/1490037664 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6c00d0750 con 0x7fd6c00b2110 2024-07-27T03:09:02.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.806+0000 7fd6b67fc640 1 -- 172.21.15.120:0/1490037664 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7fd6c00af550 con 0x7fd6c00b2110 2024-07-27T03:09:02.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:02.808 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":8,"btime":"2024-07-27T03:08:36:963563+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/4223514676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4223514676},{"type":"v1","addr":"172.21.15.120:6834","nonce":4223514676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1736241961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1736241961},{"type":"v1","addr":"172.21.15.121:6837","nonce":1736241961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/625386978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":625386978},{"type":"v1","addr":"172.21.15.121:6836","nonce":625386978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:08:33.299496+0000","modified":"2024-07-27T03:08:36.330563+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/552629761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":552629761},{"type":"v1","addr":"172.21.15.120:6835","nonce":552629761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4359,"qdb_cluster":[4359]},"id":1}]} 2024-07-27T03:09:02.809 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 8 2024-07-27T03:09:02.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd6a4077010 msgr2=0x7fd6a4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd6a4077010 0x7fd6a4079520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd6b00096c0 tx=0x7fd6b0009260 comp rx=0 tx=0).stop 2024-07-27T03:09:02.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/1490037664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6c00b2110 msgr2=0x7fd6c01f6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6c00b2110 0x7fd6c01f6d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00c3a0 tx=0x7fd6bc00c860 comp rx=0 tx=0).stop 2024-07-27T03:09:02.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/1490037664 shutdown_connections 2024-07-27T03:09:02.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd6a4077010 0x7fd6a4079520 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6c00af140 0x7fd6c00cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6c00b5fe0 0x7fd6c00aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 --2- 172.21.15.120:0/1490037664 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6c00b2110 0x7fd6c01f6d50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/1490037664 >> 172.21.15.120:0/1490037664 conn(0x7fd6c00b3920 msgr2=0x7fd6c01e8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:02.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/1490037664 shutdown_connections 2024-07-27T03:09:02.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.808+0000 7fd6c7b1f640 1 -- 172.21.15.120:0/1490037664 wait complete. 2024-07-27T03:09:02.822 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:09:02.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.932+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/1274753473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc00005250 msgr2=0x7fbc0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.932+0000 7fbc1bfeb640 1 --2- 172.21.15.120:0/1274753473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc00005250 0x7fbc0000b9c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c001dc0 tx=0x7fbc00005830 comp rx=0 tx=0).stop 2024-07-27T03:09:02.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.933+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/1274753473 shutdown_connections 2024-07-27T03:09:02.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.933+0000 7fbc1bfeb640 1 --2- 172.21.15.120:0/1274753473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc00005250 0x7fbc0000b9c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.933+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/1274753473 >> 172.21.15.120:0/1274753473 conn(0x7fbc1406cba0 msgr2=0x7fbc1406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:02.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.933+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/1274753473 shutdown_connections 2024-07-27T03:09:02.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.933+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/1274753473 wait complete. 2024-07-27T03:09:02.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.934+0000 7fbc1bfeb640 1 Processor -- start 2024-07-27T03:09:02.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.934+0000 7fbc1bfeb640 1 -- start start 2024-07-27T03:09:02.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc1bfeb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc00005250 0x7fbc14153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc1bfeb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc14145940 0x7fbc14143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc1bfeb640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc140cf4e0 0x7fbc140cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc1bfeb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbc140b6200 con 0x7fbc00005250 2024-07-27T03:09:02.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc1bfeb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1415c510 con 0x7fbc14145940 2024-07-27T03:09:02.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc1bfeb640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbc140b6380 con 0x7fbc140cf4e0 2024-07-27T03:09:02.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc19d87640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc00005250 0x7fbc14153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:02.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc19d87640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc00005250 0x7fbc14153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56022/0 (socket says 172.21.15.120:56022) 2024-07-27T03:09:02.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc19d87640 1 -- 172.21.15.120:0/2521558008 learned_addr learned my addr 172.21.15.120:0/2521558008 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:02.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc19586640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc14145940 0x7fbc14143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:02.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc19d87640 1 -- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc140cf4e0 msgr2=0x7fbc140cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc19d87640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc140cf4e0 0x7fbc140cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc19d87640 1 -- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc14145940 msgr2=0x7fbc14143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:02.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc19d87640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc14145940 0x7fbc14143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:02.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc19d87640 1 -- 172.21.15.120:0/2521558008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc140cfe30 con 0x7fbc00005250 2024-07-27T03:09:02.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc19d87640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc00005250 0x7fbc14153810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbc100117d0 tx=0x7fbc10011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:02.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc0a7fc640 1 -- 172.21.15.120:0/2521558008 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1001f070 con 0x7fbc00005250 2024-07-27T03:09:02.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc0a7fc640 1 -- 172.21.15.120:0/2521558008 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc1000fe40 con 0x7fbc00005250 2024-07-27T03:09:02.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/2521558008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc141542d0 con 0x7fbc00005250 2024-07-27T03:09:02.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc0a7fc640 1 -- 172.21.15.120:0/2521558008 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc100126b0 con 0x7fbc00005250 2024-07-27T03:09:02.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.936+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/2521558008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc14154890 con 0x7fbc00005250 2024-07-27T03:09:02.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.937+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/2521558008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc14050af0 con 0x7fbc00005250 2024-07-27T03:09:02.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.938+0000 7fbc0a7fc640 1 -- 172.21.15.120:0/2521558008 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fbc10022070 con 0x7fbc00005250 2024-07-27T03:09:02.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.938+0000 7fbc0a7fc640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbbf8077040 0x7fbbf8079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:02.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.939+0000 7fbc0a7fc640 1 -- 172.21.15.120:0/2521558008 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbc10099330 con 0x7fbc00005250 2024-07-27T03:09:02.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.939+0000 7fbc19586640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbbf8077040 0x7fbbf8079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:02.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.939+0000 7fbc19586640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbbf8077040 0x7fbbf8079550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc04000c00 tx=0x7fbc04000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:02.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:02.943+0000 7fbc0a7fc640 1 -- 172.21.15.120:0/2521558008 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fbc14050af0 con 0x7fbc00005250 2024-07-27T03:09:03.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.127+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/2521558008 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc1415ecb0 con 0x7fbc00005250 2024-07-27T03:09:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.128+0000 7fbc0a7fc640 1 -- 172.21.15.120:0/2521558008 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16629 (secure 0 0 0) 0x7fbc140cfe30 con 0x7fbc00005250 2024-07-27T03:09:03.131 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:03.131 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:34.926699+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:08:31.185623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-27T03:08:32.262408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:09:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbbf8077040 msgr2=0x7fbbf8079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbbf8077040 0x7fbbf8079550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc04000c00 tx=0x7fbc04000ed0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/2521558008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc00005250 msgr2=0x7fbc14153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc00005250 0x7fbc14153810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbc100117d0 tx=0x7fbc10011c90 comp rx=0 tx=0).stop 2024-07-27T03:09:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/2521558008 shutdown_connections 2024-07-27T03:09:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbbf8077040 0x7fbbf8079550 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbc140cf4e0 0x7fbc140cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc14145940 0x7fbc14143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 --2- 172.21.15.120:0/2521558008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc00005250 0x7fbc14153810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/2521558008 >> 172.21.15.120:0/2521558008 conn(0x7fbc1406cba0 msgr2=0x7fbc140ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/2521558008 shutdown_connections 2024-07-27T03:09:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.131+0000 7fbc1bfeb640 1 -- 172.21.15.120:0/2521558008 wait complete. 2024-07-27T03:09:03.145 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-07-27T03:09:03.145 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:03.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.257+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2421883326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe790004800 msgr2=0x7fe790004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.257+0000 7fe7ae95d640 1 --2- 172.21.15.120:0/2421883326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe790004800 0x7fe790004c10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c470 tx=0x7fe790005830 comp rx=0 tx=0).stop 2024-07-27T03:09:03.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.257+0000 7fe7acefa640 1 -- 172.21.15.120:0/2421883326 reap_dead start 2024-07-27T03:09:03.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.257+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2421883326 shutdown_connections 2024-07-27T03:09:03.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.257+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2421883326 >> 172.21.15.120:0/2421883326 conn(0x7fe7a80d0f00 msgr2=0x7fe7a80d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:03.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.257+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2421883326 shutdown_connections 2024-07-27T03:09:03.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.257+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2421883326 wait complete. 2024-07-27T03:09:03.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.259+0000 7fe7ae95d640 1 Processor -- start 2024-07-27T03:09:03.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.259+0000 7fe7ae95d640 1 -- start start 2024-07-27T03:09:03.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.260+0000 7fe7ae95d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe790004800 0x7fe7a81f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.260+0000 7fe7ae95d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8143fa0 0x7fe7a815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.260+0000 7fe7ae95d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7a815a710 0x7fe7a8146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.260+0000 7fe7ae95d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a8159130 con 0x7fe7a8143fa0 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.260+0000 7fe7ae95d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a8158fb0 con 0x7fe7a815a710 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.260+0000 7fe7ae95d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a81592b0 con 0x7fe790004800 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.260+0000 7fe7a77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8143fa0 0x7fe7a815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.260+0000 7fe7a77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8143fa0 0x7fe7a815a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56046/0 (socket says 172.21.15.120:56046) 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7a77fe640 1 -- 172.21.15.120:0/2854680751 learned_addr learned my addr 172.21.15.120:0/2854680751 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7acefa640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7a815a710 0x7fe7a8146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7a7fff640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe790004800 0x7fe7a81f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7a77fe640 1 -- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe790004800 msgr2=0x7fe7a81f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7a77fe640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe790004800 0x7fe7a81f5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7a77fe640 1 -- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7a815a710 msgr2=0x7fe7a8146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7a77fe640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7a815a710 0x7fe7a8146880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7a77fe640 1 -- 172.21.15.120:0/2854680751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a81f6200 con 0x7fe7a8143fa0 2024-07-27T03:09:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7a77fe640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8143fa0 0x7fe7a815a1d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c590 tx=0x7fe79c006f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7a4ff9640 1 -- 172.21.15.120:0/2854680751 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c041070 con 0x7fe7a8143fa0 2024-07-27T03:09:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7a4ff9640 1 -- 172.21.15.120:0/2854680751 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe79c02b640 con 0x7fe7a8143fa0 2024-07-27T03:09:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7a4ff9640 1 -- 172.21.15.120:0/2854680751 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c02ba70 con 0x7fe7a8143fa0 2024-07-27T03:09:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2854680751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a815ab20 con 0x7fe7a8143fa0 2024-07-27T03:09:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.261+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2854680751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a80c65d0 con 0x7fe7a8143fa0 2024-07-27T03:09:03.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.262+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2854680751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a80c6060 con 0x7fe7a8143fa0 2024-07-27T03:09:03.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.263+0000 7fe7a4ff9640 1 -- 172.21.15.120:0/2854680751 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe79c044070 con 0x7fe7a8143fa0 2024-07-27T03:09:03.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.263+0000 7fe7a4ff9640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe794077010 0x7fe794079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.263+0000 7fe7a4ff9640 1 -- 172.21.15.120:0/2854680751 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe79c0bb580 con 0x7fe7a8143fa0 2024-07-27T03:09:03.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.263+0000 7fe7a7fff640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe794077010 0x7fe794079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.264+0000 7fe7a7fff640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe794077010 0x7fe794079520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe798009b90 tx=0x7fe798005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:03.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.268+0000 7fe7a4ff9640 1 -- 172.21.15.120:0/2854680751 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fe79c04b030 con 0x7fe7a8143fa0 2024-07-27T03:09:03.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.487+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2854680751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7a8074040 con 0x7fe7a8143fa0 2024-07-27T03:09:03.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.487+0000 7fe7a4ff9640 1 -- 172.21.15.120:0/2854680751 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7fe7a815ab20 con 0x7fe7a8143fa0 2024-07-27T03:09:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:03.490 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":8,"btime":"2024-07-27T03:08:36:963563+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/4223514676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4223514676},{"type":"v1","addr":"172.21.15.120:6834","nonce":4223514676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1736241961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1736241961},{"type":"v1","addr":"172.21.15.121:6837","nonce":1736241961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/625386978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":625386978},{"type":"v1","addr":"172.21.15.121:6836","nonce":625386978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:08:33.299496+0000","modified":"2024-07-27T03:08:36.330563+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/552629761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":552629761},{"type":"v1","addr":"172.21.15.120:6835","nonce":552629761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4359,"qdb_cluster":[4359]},"id":1}]} 2024-07-27T03:09:03.490 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 8 2024-07-27T03:09:03.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.489+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe794077010 msgr2=0x7fe794079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.489+0000 7fe7ae95d640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe794077010 0x7fe794079520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe798009b90 tx=0x7fe798005f90 comp rx=0 tx=0).stop 2024-07-27T03:09:03.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.489+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2854680751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8143fa0 msgr2=0x7fe7a815a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.489+0000 7fe7ae95d640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8143fa0 0x7fe7a815a1d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c590 tx=0x7fe79c006f10 comp rx=0 tx=0).stop 2024-07-27T03:09:03.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.489+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2854680751 shutdown_connections 2024-07-27T03:09:03.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.489+0000 7fe7ae95d640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe794077010 0x7fe794079520 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.489+0000 7fe7ae95d640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8143fa0 0x7fe7a815a1d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.489+0000 7fe7ae95d640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7a815a710 0x7fe7a8146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.489+0000 7fe7ae95d640 1 --2- 172.21.15.120:0/2854680751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe790004800 0x7fe7a81f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.489+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2854680751 >> 172.21.15.120:0/2854680751 conn(0x7fe7a80d0f00 msgr2=0x7fe7a80cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:03.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.489+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2854680751 shutdown_connections 2024-07-27T03:09:03.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.490+0000 7fe7ae95d640 1 -- 172.21.15.120:0/2854680751 wait complete. 2024-07-27T03:09:03.503 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:03.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.615+0000 7f2d9e09a640 1 -- 172.21.15.120:0/3537635177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d980b3dd0 msgr2=0x7f2d980b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.615+0000 7f2d9e09a640 1 --2- 172.21.15.120:0/3537635177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d980b3dd0 0x7f2d980b41e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2d90005fd0 tx=0x7f2d9002a8b0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.615+0000 7f2d9e09a640 1 -- 172.21.15.120:0/3537635177 shutdown_connections 2024-07-27T03:09:03.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.615+0000 7f2d9e09a640 1 --2- 172.21.15.120:0/3537635177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d980b3dd0 0x7f2d980b41e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.615+0000 7f2d9e09a640 1 --2- 172.21.15.120:0/3537635177 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d980cf3d0 0x7f2d980cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.615+0000 7f2d9e09a640 1 -- 172.21.15.120:0/3537635177 >> 172.21.15.120:0/3537635177 conn(0x7f2d980d3f70 msgr2=0x7f2d980d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:03.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.615+0000 7f2d9e09a640 1 -- 172.21.15.120:0/3537635177 shutdown_connections 2024-07-27T03:09:03.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.615+0000 7f2d9e09a640 1 -- 172.21.15.120:0/3537635177 wait complete. 2024-07-27T03:09:03.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.617+0000 7f2d9e09a640 1 Processor -- start 2024-07-27T03:09:03.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.617+0000 7f2d9e09a640 1 -- start start 2024-07-27T03:09:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.618+0000 7f2d9e09a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d980b3dd0 0x7f2d98158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.618+0000 7f2d9e09a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d980b92c0 0x7f2d98146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.618+0000 7f2d9e09a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d980cf3d0 0x7f2d98147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.618+0000 7f2d9e09a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2d980b4ab0 con 0x7f2d980b3dd0 2024-07-27T03:09:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.618+0000 7f2d9e09a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2d980b4930 con 0x7f2d980b92c0 2024-07-27T03:09:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.618+0000 7f2d9e09a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2d980b4c30 con 0x7f2d980cf3d0 2024-07-27T03:09:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.618+0000 7f2d977fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d980b3dd0 0x7f2d98158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.618+0000 7f2d977fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d980b3dd0 0x7f2d98158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56062/0 (socket says 172.21.15.120:56062) 2024-07-27T03:09:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.618+0000 7f2d977fe640 1 -- 172.21.15.120:0/2607813430 learned_addr learned my addr 172.21.15.120:0/2607813430 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d96ffd640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d980b92c0 0x7f2d98146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d97fff640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d980cf3d0 0x7f2d98147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d977fe640 1 -- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d980cf3d0 msgr2=0x7f2d98147500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d977fe640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d980cf3d0 0x7f2d98147500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d977fe640 1 -- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d980b92c0 msgr2=0x7f2d98146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d977fe640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d980b92c0 0x7f2d98146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d977fe640 1 -- 172.21.15.120:0/2607813430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d980ca1c0 con 0x7f2d980b3dd0 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d96ffd640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d980b92c0 0x7f2d98146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d977fe640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d980b3dd0 0x7f2d98158880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c460 tx=0x7f2d8800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d7ffff640 1 -- 172.21.15.120:0/2607813430 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d880052d0 con 0x7f2d980b3dd0 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d7ffff640 1 -- 172.21.15.120:0/2607813430 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d88005490 con 0x7f2d980b3dd0 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d9e09a640 1 -- 172.21.15.120:0/2607813430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d980cb0e0 con 0x7f2d980b3dd0 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d7ffff640 1 -- 172.21.15.120:0/2607813430 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d88012870 con 0x7f2d980b3dd0 2024-07-27T03:09:03.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.619+0000 7f2d9e09a640 1 -- 172.21.15.120:0/2607813430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d98159830 con 0x7f2d980b3dd0 2024-07-27T03:09:03.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.620+0000 7f2d9e09a640 1 -- 172.21.15.120:0/2607813430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d980b41e0 con 0x7f2d980b3dd0 2024-07-27T03:09:03.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.621+0000 7f2d7ffff640 1 -- 172.21.15.120:0/2607813430 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2d88012a10 con 0x7f2d980b3dd0 2024-07-27T03:09:03.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.621+0000 7f2d7ffff640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d84077010 0x7f2d84079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.621+0000 7f2d7ffff640 1 -- 172.21.15.120:0/2607813430 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2d88098520 con 0x7f2d980b3dd0 2024-07-27T03:09:03.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.621+0000 7f2d96ffd640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d84077010 0x7f2d84079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.622+0000 7f2d96ffd640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d84077010 0x7f2d84079520 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d980d4930 tx=0x7f2d8c009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:03.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.626+0000 7f2d7ffff640 1 -- 172.21.15.120:0/2607813430 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f2d88061720 con 0x7f2d980b3dd0 2024-07-27T03:09:03.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.847+0000 7f2d9e09a640 1 -- 172.21.15.120:0/2607813430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d980b4480 con 0x7f2d980b3dd0 2024-07-27T03:09:03.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.847+0000 7f2d7ffff640 1 -- 172.21.15.120:0/2607813430 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7f2d88061020 con 0x7f2d980b3dd0 2024-07-27T03:09:03.850 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:03.850 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":8,"btime":"2024-07-27T03:08:36:963563+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4339,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/4223514676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":4223514676},{"type":"v1","addr":"172.21.15.120:6834","nonce":4223514676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1736241961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":1736241961},{"type":"v1","addr":"172.21.15.121:6837","nonce":1736241961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/625386978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":625386978},{"type":"v1","addr":"172.21.15.121:6836","nonce":625386978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:08:33.299496+0000","modified":"2024-07-27T03:08:36.330563+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/552629761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":552629761},{"type":"v1","addr":"172.21.15.120:6835","nonce":552629761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4359,"qdb_cluster":[4359]},"id":1}]} 2024-07-27T03:09:03.850 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 8 2024-07-27T03:09:03.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 -- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d84077010 msgr2=0x7f2d84079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d84077010 0x7f2d84079520 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d980d4930 tx=0x7f2d8c009260 comp rx=0 tx=0).stop 2024-07-27T03:09:03.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 -- 172.21.15.120:0/2607813430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d980b3dd0 msgr2=0x7f2d98158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d980b3dd0 0x7f2d98158880 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c460 tx=0x7f2d8800c920 comp rx=0 tx=0).stop 2024-07-27T03:09:03.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 -- 172.21.15.120:0/2607813430 shutdown_connections 2024-07-27T03:09:03.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d84077010 0x7f2d84079520 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d980cf3d0 0x7f2d98147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d980b92c0 0x7f2d98146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 --2- 172.21.15.120:0/2607813430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d980b3dd0 0x7f2d98158880 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 -- 172.21.15.120:0/2607813430 >> 172.21.15.120:0/2607813430 conn(0x7f2d980d3f70 msgr2=0x7f2d980d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:03.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 -- 172.21.15.120:0/2607813430 shutdown_connections 2024-07-27T03:09:03.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.849+0000 7f2d9e09a640 1 -- 172.21.15.120:0/2607813430 wait complete. 2024-07-27T03:09:03.863 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:09:03.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.974+0000 7f9a5fb27640 1 -- 172.21.15.120:0/538070755 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a580723d0 msgr2=0x7f9a580727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.974+0000 7f9a5fb27640 1 --2- 172.21.15.120:0/538070755 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a580723d0 0x7f9a580727e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9a58071e80 tx=0x7f9a5002aac0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.974+0000 7f9a5fb27640 1 -- 172.21.15.120:0/538070755 shutdown_connections 2024-07-27T03:09:03.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.974+0000 7f9a5fb27640 1 --2- 172.21.15.120:0/538070755 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a580723d0 0x7f9a580727e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.974+0000 7f9a5fb27640 1 --2- 172.21.15.120:0/538070755 >> v2:172.21.15.121:3300/0 conn(0x7f9a58145390 0x7f9a5806e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.974+0000 7f9a5fb27640 1 -- 172.21.15.120:0/538070755 >> 172.21.15.120:0/538070755 conn(0x7f9a580b1a10 msgr2=0x7f9a580b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:03.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.975+0000 7f9a5fb27640 1 -- 172.21.15.120:0/538070755 shutdown_connections 2024-07-27T03:09:03.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.975+0000 7f9a5fb27640 1 -- 172.21.15.120:0/538070755 wait complete. 2024-07-27T03:09:03.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.976+0000 7f9a5fb27640 1 Processor -- start 2024-07-27T03:09:03.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.976+0000 7f9a5fb27640 1 -- start start 2024-07-27T03:09:03.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.977+0000 7f9a5fb27640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a580723d0 0x7f9a58138280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5fb27640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a580aebf0 0x7f9a5809ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5fb27640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a58145390 0x7f9a5809cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5fb27640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9a58072d20 con 0x7f9a580723d0 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5fb27640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9a581451f0 con 0x7f9a58145390 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5fb27640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9a58072ea0 con 0x7f9a580aebf0 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5d8c3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a580723d0 0x7f9a58138280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5d8c3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a580723d0 0x7f9a58138280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56078/0 (socket says 172.21.15.120:56078) 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5d8c3640 1 -- 172.21.15.120:0/1887047587 learned_addr learned my addr 172.21.15.120:0/1887047587 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5e0c4640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a58145390 0x7f9a5809cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5d0c2640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a580aebf0 0x7f9a5809ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5d8c3640 1 -- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a580aebf0 msgr2=0x7f9a5809ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5d8c3640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a580aebf0 0x7f9a5809ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5d8c3640 1 -- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a58145390 msgr2=0x7f9a5809cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5d8c3640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a58145390 0x7f9a5809cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:03.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5d8c3640 1 -- 172.21.15.120:0/1887047587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a58138f20 con 0x7f9a580723d0 2024-07-27T03:09:03.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5d8c3640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a580723d0 0x7f9a58138280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400d6d0 tx=0x7f9a5400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:03.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a4e7fc640 1 -- 172.21.15.120:0/1887047587 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a54017070 con 0x7f9a580723d0 2024-07-27T03:09:03.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a4e7fc640 1 -- 172.21.15.120:0/1887047587 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a54005330 con 0x7f9a580723d0 2024-07-27T03:09:03.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5fb27640 1 -- 172.21.15.120:0/1887047587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a58139200 con 0x7f9a580723d0 2024-07-27T03:09:03.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a4e7fc640 1 -- 172.21.15.120:0/1887047587 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a54009820 con 0x7f9a580723d0 2024-07-27T03:09:03.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.978+0000 7f9a5fb27640 1 -- 172.21.15.120:0/1887047587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a581397c0 con 0x7f9a580723d0 2024-07-27T03:09:03.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.979+0000 7f9a5fb27640 1 -- 172.21.15.120:0/1887047587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a58073350 con 0x7f9a580723d0 2024-07-27T03:09:03.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.980+0000 7f9a4e7fc640 1 -- 172.21.15.120:0/1887047587 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9a54009bd0 con 0x7f9a580723d0 2024-07-27T03:09:03.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.981+0000 7f9a4e7fc640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9a3c077010 0x7f9a3c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:03.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.981+0000 7f9a4e7fc640 1 -- 172.21.15.120:0/1887047587 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9a54098b30 con 0x7f9a580723d0 2024-07-27T03:09:03.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.981+0000 7f9a5d0c2640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9a3c077010 0x7f9a3c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:03.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.981+0000 7f9a5d0c2640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9a3c077010 0x7f9a3c079520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a5809d9d0 tx=0x7f9a48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:03.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:03.985+0000 7f9a4e7fc640 1 -- 172.21.15.120:0/1887047587 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f9a540616e0 con 0x7f9a580723d0 2024-07-27T03:09:04.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.169+0000 7f9a5fb27640 1 -- 172.21.15.120:0/1887047587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a5813ff30 con 0x7f9a580723d0 2024-07-27T03:09:04.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.170+0000 7f9a4e7fc640 1 -- 172.21.15.120:0/1887047587 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16629 (secure 0 0 0) 0x7f9a54065c30 con 0x7f9a580723d0 2024-07-27T03:09:04.173 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:04.173 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:08:34.926699+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:08:31.185623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-27T03:08:32.262408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:09:04.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.172+0000 7f9a5fb27640 1 -- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9a3c077010 msgr2=0x7f9a3c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:04.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.172+0000 7f9a5fb27640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9a3c077010 0x7f9a3c079520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a5809d9d0 tx=0x7f9a48009040 comp rx=0 tx=0).stop 2024-07-27T03:09:04.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.172+0000 7f9a5fb27640 1 -- 172.21.15.120:0/1887047587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a580723d0 msgr2=0x7f9a58138280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:04.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.172+0000 7f9a5fb27640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a580723d0 0x7f9a58138280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400d6d0 tx=0x7f9a5400db90 comp rx=0 tx=0).stop 2024-07-27T03:09:04.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.172+0000 7f9a5fb27640 1 -- 172.21.15.120:0/1887047587 shutdown_connections 2024-07-27T03:09:04.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.172+0000 7f9a5fb27640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9a3c077010 0x7f9a3c079520 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.173+0000 7f9a5fb27640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a58145390 0x7f9a5809cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.173+0000 7f9a5fb27640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9a580aebf0 0x7f9a5809ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.173+0000 7f9a5fb27640 1 --2- 172.21.15.120:0/1887047587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a580723d0 0x7f9a58138280 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.173+0000 7f9a5fb27640 1 -- 172.21.15.120:0/1887047587 >> 172.21.15.120:0/1887047587 conn(0x7f9a580b1a10 msgr2=0x7f9a580b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:04.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.173+0000 7f9a5fb27640 1 -- 172.21.15.120:0/1887047587 shutdown_connections 2024-07-27T03:09:04.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.173+0000 7f9a5fb27640 1 -- 172.21.15.120:0/1887047587 wait complete. 2024-07-27T03:09:04.187 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-07-27T03:09:04.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.298+0000 7f307fc24640 1 -- 172.21.15.120:0/1327256286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30780d2210 msgr2=0x7f30780d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:04.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.298+0000 7f307fc24640 1 --2- 172.21.15.120:0/1327256286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30780d2210 0x7f30780d0fb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3068009830 tx=0x7f306802a530 comp rx=0 tx=0).stop 2024-07-27T03:09:04.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.298+0000 7f307fc24640 1 -- 172.21.15.120:0/1327256286 shutdown_connections 2024-07-27T03:09:04.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.298+0000 7f307fc24640 1 --2- 172.21.15.120:0/1327256286 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30780d2210 0x7f30780d0fb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.298+0000 7f307fc24640 1 -- 172.21.15.120:0/1327256286 >> 172.21.15.120:0/1327256286 conn(0x7f307809aa30 msgr2=0x7f307809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:04.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.298+0000 7f307fc24640 1 -- 172.21.15.120:0/1327256286 shutdown_connections 2024-07-27T03:09:04.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.298+0000 7f307fc24640 1 -- 172.21.15.120:0/1327256286 wait complete. 2024-07-27T03:09:04.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.300+0000 7f307fc24640 1 Processor -- start 2024-07-27T03:09:04.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.300+0000 7f307fc24640 1 -- start start 2024-07-27T03:09:04.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.301+0000 7f307fc24640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f307806e4b0 0x7f30780af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:04.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.301+0000 7f307fc24640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30780b6e50 0x7f30780afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:04.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.301+0000 7f307fc24640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30780b0290 0x7f30781f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:04.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.301+0000 7f307fc24640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f30780b29b0 con 0x7f30780b6e50 2024-07-27T03:09:04.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.301+0000 7f307fc24640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f30780b13e0 con 0x7f307806e4b0 2024-07-27T03:09:04.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.301+0000 7f307fc24640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f30780b2b30 con 0x7f30780b0290 2024-07-27T03:09:04.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.301+0000 7f307d1bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30780b6e50 0x7f30780afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:04.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.301+0000 7f307d1bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30780b6e50 0x7f30780afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56088/0 (socket says 172.21.15.120:56088) 2024-07-27T03:09:04.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.301+0000 7f307d1bf640 1 -- 172.21.15.120:0/4000349391 learned_addr learned my addr 172.21.15.120:0/4000349391 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:04.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f307d9c0640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f307806e4b0 0x7f30780af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:04.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f307d1bf640 1 -- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30780b0290 msgr2=0x7f30781f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:04.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f307e1c1640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30780b0290 0x7f30781f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:04.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f307d1bf640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30780b0290 0x7f30781f3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f307d1bf640 1 -- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f307806e4b0 msgr2=0x7f30780af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:04.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f307d1bf640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f307806e4b0 0x7f30780af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f307d1bf640 1 -- 172.21.15.120:0/4000349391 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3078161720 con 0x7f30780b6e50 2024-07-27T03:09:04.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f307d9c0640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f307806e4b0 0x7f30780af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:04.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f307d1bf640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30780b6e50 0x7f30780afd50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f306802ab20 tx=0x7f3068033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:04.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f306e7fc640 1 -- 172.21.15.120:0/4000349391 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068031b60 con 0x7f30780b6e50 2024-07-27T03:09:04.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f306e7fc640 1 -- 172.21.15.120:0/4000349391 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3068031df0 con 0x7f30780b6e50 2024-07-27T03:09:04.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f307fc24640 1 -- 172.21.15.120:0/4000349391 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3078161b80 con 0x7f30780b6e50 2024-07-27T03:09:04.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f306e7fc640 1 -- 172.21.15.120:0/4000349391 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068005280 con 0x7f30780b6e50 2024-07-27T03:09:04.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.302+0000 7f307fc24640 1 -- 172.21.15.120:0/4000349391 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307815f220 con 0x7f30780b6e50 2024-07-27T03:09:04.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.303+0000 7f307fc24640 1 -- 172.21.15.120:0/4000349391 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30781618f0 con 0x7f30780b6e50 2024-07-27T03:09:04.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.304+0000 7f306e7fc640 1 -- 172.21.15.120:0/4000349391 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f3068005420 con 0x7f30780b6e50 2024-07-27T03:09:04.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.305+0000 7f306e7fc640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f305c077040 0x7f305c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:04.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.305+0000 7f306e7fc640 1 -- 172.21.15.120:0/4000349391 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f30680b9af0 con 0x7f30780b6e50 2024-07-27T03:09:04.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.305+0000 7f307d9c0640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f305c077040 0x7f305c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:04.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.305+0000 7f307d9c0640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f305c077040 0x7f305c079550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3074007fd0 tx=0x7f3074009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:04.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.309+0000 7f306e7fc640 1 -- 172.21.15.120:0/4000349391 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f306803f030 con 0x7f30780b6e50 2024-07-27T03:09:04.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.529+0000 7f307fc24640 1 -- 172.21.15.120:0/4000349391 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f307815ed30 con 0x7f30780b6e50 2024-07-27T03:09:04.532 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-07-27T03:09:04.530+0000 7fd09694b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-27T03:09:04.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.532+0000 7f306e7fc640 1 -- 172.21.15.120:0/4000349391 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f3068082cf0 con 0x7f30780b6e50 2024-07-27T03:09:04.534 INFO:teuthology.orchestra.run.smithi120.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-07-27T03:09:04.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 -- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f305c077040 msgr2=0x7f305c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:04.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f305c077040 0x7f305c079550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3074007fd0 tx=0x7f3074009040 comp rx=0 tx=0).stop 2024-07-27T03:09:04.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 -- 172.21.15.120:0/4000349391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30780b6e50 msgr2=0x7f30780afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:04.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30780b6e50 0x7f30780afd50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f306802ab20 tx=0x7f3068033c10 comp rx=0 tx=0).stop 2024-07-27T03:09:04.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 -- 172.21.15.120:0/4000349391 shutdown_connections 2024-07-27T03:09:04.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f305c077040 0x7f305c079550 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30780b6e50 0x7f30780afd50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30780b0290 0x7f30781f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 --2- 172.21.15.120:0/4000349391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f307806e4b0 0x7f30780af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 -- 172.21.15.120:0/4000349391 >> 172.21.15.120:0/4000349391 conn(0x7f307809aa30 msgr2=0x7f307815e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:04.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 -- 172.21.15.120:0/4000349391 shutdown_connections 2024-07-27T03:09:04.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.534+0000 7f307fc24640 1 -- 172.21.15.120:0/4000349391 wait complete. 2024-07-27T03:09:04.541 INFO:tasks.ceph.mds.a.smithi120.stderr: -6835> 2024-07-27T03:08:38.868+0000 7fda9f862640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-27T03:09:04.549 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-07-27T03:09:04.597 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-07-27T03:09:04.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.666+0000 7fc2323ea640 1 -- 172.21.15.120:0/1053538818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc214004800 msgr2=0x7fc214004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:04.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.666+0000 7fc2323ea640 1 --2- 172.21.15.120:0/1053538818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc214004800 0x7fc214004c10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc220009b20 tx=0x7fc214005830 comp rx=0 tx=0).stop 2024-07-27T03:09:04.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.666+0000 7fc230987640 1 -- 172.21.15.120:0/1053538818 reap_dead start 2024-07-27T03:09:04.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.666+0000 7fc2323ea640 1 -- 172.21.15.120:0/1053538818 shutdown_connections 2024-07-27T03:09:04.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.666+0000 7fc2323ea640 1 -- 172.21.15.120:0/1053538818 >> 172.21.15.120:0/1053538818 conn(0x7fc22c06cba0 msgr2=0x7fc22c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:04.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.666+0000 7fc2323ea640 1 -- 172.21.15.120:0/1053538818 shutdown_connections 2024-07-27T03:09:04.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.666+0000 7fc2323ea640 1 -- 172.21.15.120:0/1053538818 wait complete. 2024-07-27T03:09:04.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.668+0000 7fc2323ea640 1 Processor -- start 2024-07-27T03:09:04.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.668+0000 7fc2323ea640 1 -- start start 2024-07-27T03:09:04.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc2323ea640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc214004800 0x7fc22c1f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:04.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc2323ea640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc22c13f850 0x7fc22c159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:04.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc2323ea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc22c159970 0x7fc22c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:04.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc2323ea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c1524f0 con 0x7fc22c159970 2024-07-27T03:09:04.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc2323ea640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c152370 con 0x7fc22c13f850 2024-07-27T03:09:04.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc2323ea640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc22c0cd590 con 0x7fc214004800 2024-07-27T03:09:04.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc230987640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc22c159970 0x7fc22c156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:04.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc230987640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc22c159970 0x7fc22c156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56116/0 (socket says 172.21.15.120:56116) 2024-07-27T03:09:04.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc230987640 1 -- 172.21.15.120:0/2672907970 learned_addr learned my addr 172.21.15.120:0/2672907970 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:04.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc22b7fe640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc22c13f850 0x7fc22c159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:04.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc22bfff640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc214004800 0x7fc22c1f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:04.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc230987640 1 -- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc214004800 msgr2=0x7fc22c1f6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:04.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc230987640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc214004800 0x7fc22c1f6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc230987640 1 -- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc22c13f850 msgr2=0x7fc22c159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:04.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc230987640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc22c13f850 0x7fc22c159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:04.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc230987640 1 -- 172.21.15.120:0/2672907970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c1402f0 con 0x7fc22c159970 2024-07-27T03:09:04.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc230987640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc22c159970 0x7fc22c156e20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc22c15bd00 tx=0x7fc224006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:04.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc228ff9640 1 -- 172.21.15.120:0/2672907970 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc224011900 con 0x7fc22c159970 2024-07-27T03:09:04.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc228ff9640 1 -- 172.21.15.120:0/2672907970 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc224018070 con 0x7fc22c159970 2024-07-27T03:09:04.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc228ff9640 1 -- 172.21.15.120:0/2672907970 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc224011d40 con 0x7fc22c159970 2024-07-27T03:09:04.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.670+0000 7fc2323ea640 1 -- 172.21.15.120:0/2672907970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22c1405d0 con 0x7fc22c159970 2024-07-27T03:09:04.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.671+0000 7fc2323ea640 1 -- 172.21.15.120:0/2672907970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc22c1f66a0 con 0x7fc22c159970 2024-07-27T03:09:04.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.671+0000 7fc2323ea640 1 -- 172.21.15.120:0/2672907970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22c1f61b0 con 0x7fc22c159970 2024-07-27T03:09:04.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.672+0000 7fc228ff9640 1 -- 172.21.15.120:0/2672907970 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc22401d460 con 0x7fc22c159970 2024-07-27T03:09:04.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.673+0000 7fc228ff9640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc218077040 0x7fc218079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:04.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.673+0000 7fc228ff9640 1 -- 172.21.15.120:0/2672907970 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7fc224099130 con 0x7fc22c159970 2024-07-27T03:09:04.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.673+0000 7fc22bfff640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc218077040 0x7fc218079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:04.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.673+0000 7fc22bfff640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc218077040 0x7fc218079550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc21c001220 tx=0x7fc21c0067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:04.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.677+0000 7fc228ff9640 1 -- 172.21.15.120:0/2672907970 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc224061c00 con 0x7fc22c159970 2024-07-27T03:09:04.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:04.898+0000 7fc2323ea640 1 -- 172.21.15.120:0/2672907970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc22c0b5cd0 con 0x7fc22c159970 2024-07-27T03:09:05.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.539+0000 7fc228ff9640 1 -- 172.21.15.120:0/2672907970 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fc224066150 con 0x7fc22c159970 2024-07-27T03:09:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 -- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc218077040 msgr2=0x7fc218079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc218077040 0x7fc218079550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc21c001220 tx=0x7fc21c0067a0 comp rx=0 tx=0).stop 2024-07-27T03:09:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 -- 172.21.15.120:0/2672907970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc22c159970 msgr2=0x7fc22c156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc22c159970 0x7fc22c156e20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc22c15bd00 tx=0x7fc224006430 comp rx=0 tx=0).stop 2024-07-27T03:09:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 -- 172.21.15.120:0/2672907970 shutdown_connections 2024-07-27T03:09:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc218077040 0x7fc218079550 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc22c159970 0x7fc22c156e20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc22c13f850 0x7fc22c159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:05.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 --2- 172.21.15.120:0/2672907970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc214004800 0x7fc22c1f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:05.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 -- 172.21.15.120:0/2672907970 >> 172.21.15.120:0/2672907970 conn(0x7fc22c06cba0 msgr2=0x7fc22c0b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:05.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 -- 172.21.15.120:0/2672907970 shutdown_connections 2024-07-27T03:09:05.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.541+0000 7fc2323ea640 1 -- 172.21.15.120:0/2672907970 wait complete. 2024-07-27T03:09:05.557 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-07-27T03:09:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.675+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/1736486438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b240ce410 msgr2=0x7f6b2406ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.675+0000 7f6b2c0d2640 1 --2- 172.21.15.120:0/1736486438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b240ce410 0x7f6b2406ea10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c005fd0 tx=0x7f6b1c02a820 comp rx=0 tx=0).stop 2024-07-27T03:09:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.675+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/1736486438 shutdown_connections 2024-07-27T03:09:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.675+0000 7f6b2c0d2640 1 --2- 172.21.15.120:0/1736486438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b240ce410 0x7f6b2406ea10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.675+0000 7f6b2c0d2640 1 --2- 172.21.15.120:0/1736486438 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b240caef0 0x7f6b240cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.675+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/1736486438 >> 172.21.15.120:0/1736486438 conn(0x7f6b240cfd60 msgr2=0x7f6b240d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.675+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/1736486438 shutdown_connections 2024-07-27T03:09:05.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.675+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/1736486438 wait complete. 2024-07-27T03:09:05.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.677+0000 7f6b2c0d2640 1 Processor -- start 2024-07-27T03:09:05.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.677+0000 7f6b2c0d2640 1 -- start start 2024-07-27T03:09:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.678+0000 7f6b2c0d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b240ce410 0x7f6b241f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.678+0000 7f6b2c0d2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b24154c30 0x7f6b240c2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.678+0000 7f6b2c0d2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b240c2de0 0x7f6b24166420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.678+0000 7f6b2c0d2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2406ef50 con 0x7f6b240c2de0 2024-07-27T03:09:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.678+0000 7f6b2c0d2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6b24070700 con 0x7f6b240ce410 2024-07-27T03:09:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.678+0000 7f6b2c0d2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2406f0d0 con 0x7f6b24154c30 2024-07-27T03:09:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.678+0000 7f6b2a66f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b240c2de0 0x7f6b24166420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.678+0000 7f6b2a66f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b240c2de0 0x7f6b24166420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56130/0 (socket says 172.21.15.120:56130) 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.678+0000 7f6b2a66f640 1 -- 172.21.15.120:0/2975230162 learned_addr learned my addr 172.21.15.120:0/2975230162 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b29e6e640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b240ce410 0x7f6b241f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b2966d640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b24154c30 0x7f6b240c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b2a66f640 1 -- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b24154c30 msgr2=0x7f6b240c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b2a66f640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b24154c30 0x7f6b240c2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b2a66f640 1 -- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b240ce410 msgr2=0x7f6b241f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b2a66f640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b240ce410 0x7f6b241f9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b2a66f640 1 -- 172.21.15.120:0/2975230162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b24150450 con 0x7f6b240c2de0 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b2a66f640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b240c2de0 0x7f6b24166420 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c006010 tx=0x7f6b1c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b1a7fc640 1 -- 172.21.15.120:0/2975230162 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c037040 con 0x7f6b240c2de0 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b1a7fc640 1 -- 172.21.15.120:0/2975230162 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b1c042070 con 0x7f6b240c2de0 2024-07-27T03:09:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/2975230162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b24149950 con 0x7f6b240c2de0 2024-07-27T03:09:05.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b1a7fc640 1 -- 172.21.15.120:0/2975230162 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c003e60 con 0x7f6b240c2de0 2024-07-27T03:09:05.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.679+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/2975230162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b24149c30 con 0x7f6b240c2de0 2024-07-27T03:09:05.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.680+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/2975230162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b24147040 con 0x7f6b240c2de0 2024-07-27T03:09:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.681+0000 7f6b1a7fc640 1 -- 172.21.15.120:0/2975230162 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6b1c004280 con 0x7f6b240c2de0 2024-07-27T03:09:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.681+0000 7f6b1a7fc640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b08077010 0x7f6b08079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.682+0000 7f6b1a7fc640 1 -- 172.21.15.120:0/2975230162 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7f6b1c0b9650 con 0x7f6b240c2de0 2024-07-27T03:09:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.682+0000 7f6b29e6e640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b08077010 0x7f6b08079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.682+0000 7f6b29e6e640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b08077010 0x7f6b08079520 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b20001720 tx=0x7f6b20007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:05.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.686+0000 7f6b1a7fc640 1 -- 172.21.15.120:0/2975230162 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6b1c082120 con 0x7f6b240c2de0 2024-07-27T03:09:05.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:05.869+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/2975230162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6b240cded0 con 0x7f6b240c2de0 2024-07-27T03:09:06.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.540+0000 7f6b1a7fc640 1 -- 172.21.15.120:0/2975230162 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f6b1c086670 con 0x7f6b240c2de0 2024-07-27T03:09:06.543 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' removed 2024-07-27T03:09:06.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b08077010 msgr2=0x7f6b08079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:06.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b08077010 0x7f6b08079520 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b20001720 tx=0x7f6b20007e90 comp rx=0 tx=0).stop 2024-07-27T03:09:06.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/2975230162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b240c2de0 msgr2=0x7f6b24166420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:06.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b240c2de0 0x7f6b24166420 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c006010 tx=0x7f6b1c032d10 comp rx=0 tx=0).stop 2024-07-27T03:09:06.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/2975230162 shutdown_connections 2024-07-27T03:09:06.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6b08077010 0x7f6b08079520 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:06.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b240c2de0 0x7f6b24166420 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:06.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6b24154c30 0x7f6b240c2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:06.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 --2- 172.21.15.120:0/2975230162 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b240ce410 0x7f6b241f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:06.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/2975230162 >> 172.21.15.120:0/2975230162 conn(0x7f6b240cfd60 msgr2=0x7f6b24151180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:06.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/2975230162 shutdown_connections 2024-07-27T03:09:06.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.544+0000 7f6b2c0d2640 1 -- 172.21.15.120:0/2975230162 wait complete. 2024-07-27T03:09:06.561 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-07-27T03:09:06.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.679+0000 7f01bf75d640 1 -- 172.21.15.120:0/3854783914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01a4003a00 msgr2=0x7f01a4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:06.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.679+0000 7f01bf75d640 1 --2- 172.21.15.120:0/3854783914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01a4003a00 0x7f01a4003e70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f01b8072c00 tx=0x7f01a4005830 comp rx=0 tx=0).stop 2024-07-27T03:09:06.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.679+0000 7f01bdcfa640 1 -- 172.21.15.120:0/3854783914 reap_dead start 2024-07-27T03:09:06.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.680+0000 7f01bf75d640 1 -- 172.21.15.120:0/3854783914 shutdown_connections 2024-07-27T03:09:06.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.680+0000 7f01bf75d640 1 -- 172.21.15.120:0/3854783914 >> 172.21.15.120:0/3854783914 conn(0x7f01b806dec0 msgr2=0x7f01b80b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:06.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.680+0000 7f01bf75d640 1 -- 172.21.15.120:0/3854783914 shutdown_connections 2024-07-27T03:09:06.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.680+0000 7f01bf75d640 1 -- 172.21.15.120:0/3854783914 wait complete. 2024-07-27T03:09:06.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.681+0000 7f01bf75d640 1 Processor -- start 2024-07-27T03:09:06.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.681+0000 7f01bf75d640 1 -- start start 2024-07-27T03:09:06.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bf75d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01a4003a00 0x7f01b814a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:06.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bf75d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b81380a0 0x7f01b81f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:06.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bf75d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01b81385c0 0x7f01b81389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:06.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bf75d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f01b80735b0 con 0x7f01b81380a0 2024-07-27T03:09:06.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bf75d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01b8073430 con 0x7f01b81385c0 2024-07-27T03:09:06.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bf75d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f01b8073730 con 0x7f01a4003a00 2024-07-27T03:09:06.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bccf8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b81380a0 0x7f01b81f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:06.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bccf8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b81380a0 0x7f01b81f26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56148/0 (socket says 172.21.15.120:56148) 2024-07-27T03:09:06.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bccf8640 1 -- 172.21.15.120:0/2808436097 learned_addr learned my addr 172.21.15.120:0/2808436097 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:06.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bd4f9640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01a4003a00 0x7f01b814a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:06.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bdcfa640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01b81385c0 0x7f01b81389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:06.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bccf8640 1 -- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01a4003a00 msgr2=0x7f01b814a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:06.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bccf8640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01a4003a00 0x7f01b814a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:06.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bccf8640 1 -- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01b81385c0 msgr2=0x7f01b81389d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:06.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bccf8640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01b81385c0 0x7f01b81389d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:06.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bccf8640 1 -- 172.21.15.120:0/2808436097 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b81498b0 con 0x7f01b81380a0 2024-07-27T03:09:06.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bccf8640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b81380a0 0x7f01b81f26e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f01a8006600 tx=0x7f01a80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:06.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01adffb640 1 -- 172.21.15.120:0/2808436097 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8015070 con 0x7f01b81380a0 2024-07-27T03:09:06.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01adffb640 1 -- 172.21.15.120:0/2808436097 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01a8011920 con 0x7f01b81380a0 2024-07-27T03:09:06.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01bf75d640 1 -- 172.21.15.120:0/2808436097 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b8149b90 con 0x7f01b81380a0 2024-07-27T03:09:06.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.683+0000 7f01adffb640 1 -- 172.21.15.120:0/2808436097 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8011d70 con 0x7f01b81380a0 2024-07-27T03:09:06.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.684+0000 7f01bf75d640 1 -- 172.21.15.120:0/2808436097 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b814a150 con 0x7f01b81380a0 2024-07-27T03:09:06.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.685+0000 7f01bf75d640 1 -- 172.21.15.120:0/2808436097 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b8149620 con 0x7f01b81380a0 2024-07-27T03:09:06.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.685+0000 7f01adffb640 1 -- 172.21.15.120:0/2808436097 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f01a8018070 con 0x7f01b81380a0 2024-07-27T03:09:06.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.686+0000 7f01adffb640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f019c077040 0x7f019c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:06.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.686+0000 7f01adffb640 1 -- 172.21.15.120:0/2808436097 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5357+0+0 (secure 0 0 0) 0x7f01a80993f0 con 0x7f01b81380a0 2024-07-27T03:09:06.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.686+0000 7f01bd4f9640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f019c077040 0x7f019c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:06.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.687+0000 7f01bd4f9640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f019c077040 0x7f019c079550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f01b4036000 tx=0x7f01b40046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:06.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.690+0000 7f01adffb640 1 -- 172.21.15.120:0/2808436097 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f01b8073d80 con 0x7f01b81380a0 2024-07-27T03:09:06.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:06.877+0000 7f01bf75d640 1 -- 172.21.15.120:0/2808436097 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f01b809f0e0 con 0x7f01b81380a0 2024-07-27T03:09:07.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.542+0000 7f01adffb640 1 -- 172.21.15.120:0/2808436097 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f01a8062180 con 0x7f01b81380a0 2024-07-27T03:09:07.544 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' removed 2024-07-27T03:09:07.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 -- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f019c077040 msgr2=0x7f019c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:07.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f019c077040 0x7f019c079550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f01b4036000 tx=0x7f01b40046c0 comp rx=0 tx=0).stop 2024-07-27T03:09:07.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 -- 172.21.15.120:0/2808436097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b81380a0 msgr2=0x7f01b81f26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:07.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b81380a0 0x7f01b81f26e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f01a8006600 tx=0x7f01a80039c0 comp rx=0 tx=0).stop 2024-07-27T03:09:07.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 -- 172.21.15.120:0/2808436097 shutdown_connections 2024-07-27T03:09:07.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f019c077040 0x7f019c079550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:07.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01b81380a0 0x7f01b81f26e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:07.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01b81385c0 0x7f01b81389d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:07.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 --2- 172.21.15.120:0/2808436097 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f01a4003a00 0x7f01b814a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:07.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 -- 172.21.15.120:0/2808436097 >> 172.21.15.120:0/2808436097 conn(0x7f01b806dec0 msgr2=0x7f01b80b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:07.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 -- 172.21.15.120:0/2808436097 shutdown_connections 2024-07-27T03:09:07.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.545+0000 7f01bf75d640 1 -- 172.21.15.120:0/2808436097 wait complete. 2024-07-27T03:09:07.565 INFO:tasks.ceph.mds.a:Restarting daemon 2024-07-27T03:09:07.565 INFO:tasks.ceph.mds.a:Stopping old one... 2024-07-27T03:09:07.566 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-07-27T03:09:07.566 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:09:07.566 INFO:tasks.ceph.mds.c:Restarting daemon 2024-07-27T03:09:07.566 INFO:tasks.ceph.mds.c:Stopping old one... 2024-07-27T03:09:07.567 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-07-27T03:09:07.567 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:09:07.567 INFO:tasks.ceph.mds.b:Restarting daemon 2024-07-27T03:09:07.567 INFO:tasks.ceph.mds.b:Stopping old one... 2024-07-27T03:09:07.567 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-07-27T03:09:07.568 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:09:07.568 INFO:tasks.ceph.mds.d:Restarting daemon 2024-07-27T03:09:07.568 INFO:tasks.ceph.mds.d:Stopping old one... 2024-07-27T03:09:07.568 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-07-27T03:09:07.568 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:09:07.577 INFO:tasks.ceph.mds.c:Stopped 2024-07-27T03:09:07.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-07-27T03:09:07.579 INFO:tasks.ceph.mds.b:Stopped 2024-07-27T03:09:07.579 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-07-27T03:09:07.579 INFO:tasks.ceph.mds.d:Stopped 2024-07-27T03:09:07.580 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-07-27T03:09:07.581 INFO:tasks.ceph.mds.a:Stopped 2024-07-27T03:09:07.581 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-07-27T03:09:07.622 INFO:tasks.ceph.mds.b:Started 2024-07-27T03:09:07.622 DEBUG:teuthology.parallel:result is None 2024-07-27T03:09:07.623 INFO:tasks.ceph.mds.c:Started 2024-07-27T03:09:07.624 INFO:tasks.ceph.mds.d:Started 2024-07-27T03:09:07.624 DEBUG:teuthology.parallel:result is None 2024-07-27T03:09:07.624 DEBUG:teuthology.parallel:result is None 2024-07-27T03:09:07.625 INFO:tasks.ceph.mds.a:Started 2024-07-27T03:09:07.625 DEBUG:teuthology.parallel:result is None 2024-07-27T03:09:07.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-07-27T03:09:07.712 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-07-27T03:09:07.713 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-07-27T03:09:07.714 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-07-27T03:09:07.714 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-07-27T03:09:07.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.746+0000 7faaffbb9640 1 -- 172.21.15.120:0/3495273992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faae4003a00 msgr2=0x7faae4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:07.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.746+0000 7faaffbb9640 1 --2- 172.21.15.120:0/3495273992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faae4003a00 0x7faae4003e70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c4a0 tx=0x7faae4005830 comp rx=0 tx=0).stop 2024-07-27T03:09:07.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.746+0000 7faafe156640 1 -- 172.21.15.120:0/3495273992 reap_dead start 2024-07-27T03:09:07.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.746+0000 7faaffbb9640 1 -- 172.21.15.120:0/3495273992 shutdown_connections 2024-07-27T03:09:07.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.746+0000 7faaffbb9640 1 -- 172.21.15.120:0/3495273992 >> 172.21.15.120:0/3495273992 conn(0x7faaf80d0df0 msgr2=0x7faaf80d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:07.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.746+0000 7faaffbb9640 1 -- 172.21.15.120:0/3495273992 shutdown_connections 2024-07-27T03:09:07.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.746+0000 7faaffbb9640 1 -- 172.21.15.120:0/3495273992 wait complete. 2024-07-27T03:09:07.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.748+0000 7faaffbb9640 1 Processor -- start 2024-07-27T03:09:07.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.748+0000 7faaffbb9640 1 -- start start 2024-07-27T03:09:07.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.749+0000 7faaffbb9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faaf80c7ea0 0x7faaf81f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:07.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.749+0000 7faaffbb9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faaf80cda50 0x7faaf80cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:07.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.749+0000 7faaffbb9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faaf8148830 0x7faaf8148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:07.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.749+0000 7faaffbb9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7faaf815b680 con 0x7faaf80cda50 2024-07-27T03:09:07.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.749+0000 7faaffbb9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8073b20 con 0x7faaf8148830 2024-07-27T03:09:07.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.749+0000 7faaffbb9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7faaf815b800 con 0x7faaf80c7ea0 2024-07-27T03:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.749+0000 7faafd154640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faaf80cda50 0x7faaf80cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.749+0000 7faafd154640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faaf80cda50 0x7faaf80cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56214/0 (socket says 172.21.15.120:56214) 2024-07-27T03:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.749+0000 7faafd955640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faaf80c7ea0 0x7faaf81f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.749+0000 7faafd154640 1 -- 172.21.15.120:0/754728957 learned_addr learned my addr 172.21.15.120:0/754728957 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.749+0000 7faafe156640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faaf8148830 0x7faaf8148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.750+0000 7faafd154640 1 -- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faaf80c7ea0 msgr2=0x7faaf81f5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.750+0000 7faafd154640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faaf80c7ea0 0x7faaf81f5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.750+0000 7faafd154640 1 -- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faaf8148830 msgr2=0x7faaf8148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.750+0000 7faafd154640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faaf8148830 0x7faaf8148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.750+0000 7faafd154640 1 -- 172.21.15.120:0/754728957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf81f61b0 con 0x7faaf80cda50 2024-07-27T03:09:07.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.750+0000 7faafd154640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faaf80cda50 0x7faaf80cde60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faaec011ab0 tx=0x7faaec011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:07.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.750+0000 7faaea7fc640 1 -- 172.21.15.120:0/754728957 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec01e070 con 0x7faaf80cda50 2024-07-27T03:09:07.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.750+0000 7faaea7fc640 1 -- 172.21.15.120:0/754728957 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faaec010ce0 con 0x7faaf80cda50 2024-07-27T03:09:07.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.750+0000 7faaea7fc640 1 -- 172.21.15.120:0/754728957 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec019670 con 0x7faaf80cda50 2024-07-27T03:09:07.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.750+0000 7faaffbb9640 1 -- 172.21.15.120:0/754728957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf80c82b0 con 0x7faaf80cda50 2024-07-27T03:09:07.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.750+0000 7faaffbb9640 1 -- 172.21.15.120:0/754728957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf80af140 con 0x7faaf80cda50 2024-07-27T03:09:07.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.751+0000 7faaffbb9640 1 -- 172.21.15.120:0/754728957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf80718c0 con 0x7faaf80cda50 2024-07-27T03:09:07.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.752+0000 7faaea7fc640 1 -- 172.21.15.120:0/754728957 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7faaec021070 con 0x7faaf80cda50 2024-07-27T03:09:07.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.752+0000 7faaea7fc640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faadc077010 0x7faadc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:07.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.752+0000 7faaea7fc640 1 -- 172.21.15.120:0/754728957 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7faaec098db0 con 0x7faaf80cda50 2024-07-27T03:09:07.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.753+0000 7faafd955640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faadc077010 0x7faadc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:07.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.753+0000 7faafd955640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faadc077010 0x7faadc079520 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faaf4033000 tx=0x7faaf403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:07.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.757+0000 7faaea7fc640 1 -- 172.21.15.120:0/754728957 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7faaf81f61b0 con 0x7faaf80cda50 2024-07-27T03:09:07.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:07.950+0000 7faaffbb9640 1 -- 172.21.15.120:0/754728957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7faaf815a0e0 con 0x7faaf80cda50 2024-07-27T03:09:08.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.565+0000 7faaea7fc640 1 -- 172.21.15.120:0/754728957 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7faaec061ce0 con 0x7faaf80cda50 2024-07-27T03:09:08.568 INFO:teuthology.orchestra.run.smithi120.stderr: removed all blocklist entries 2024-07-27T03:09:08.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 -- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faadc077010 msgr2=0x7faadc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:08.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faadc077010 0x7faadc079520 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faaf4033000 tx=0x7faaf403c040 comp rx=0 tx=0).stop 2024-07-27T03:09:08.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 -- 172.21.15.120:0/754728957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faaf80cda50 msgr2=0x7faaf80cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:08.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faaf80cda50 0x7faaf80cde60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faaec011ab0 tx=0x7faaec011f70 comp rx=0 tx=0).stop 2024-07-27T03:09:08.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 -- 172.21.15.120:0/754728957 shutdown_connections 2024-07-27T03:09:08.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faadc077010 0x7faadc079520 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faaf80cda50 0x7faaf80cde60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faaf8148830 0x7faaf8148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 --2- 172.21.15.120:0/754728957 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faaf80c7ea0 0x7faaf81f5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 -- 172.21.15.120:0/754728957 >> 172.21.15.120:0/754728957 conn(0x7faaf80d0df0 msgr2=0x7faaf80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:08.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 -- 172.21.15.120:0/754728957 shutdown_connections 2024-07-27T03:09:08.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.568+0000 7faaffbb9640 1 -- 172.21.15.120:0/754728957 wait complete. 2024-07-27T03:09:08.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-07-27T03:09:08.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.693+0000 7fb08ab50640 1 -- 172.21.15.120:0/266363136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08415c220 msgr2=0x7fb084152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:08.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.693+0000 7fb08ab50640 1 --2- 172.21.15.120:0/266363136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08415c220 0x7fb084152160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb08415bd00 tx=0x7fb07402aa30 comp rx=0 tx=0).stop 2024-07-27T03:09:08.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.693+0000 7fb08ab50640 1 -- 172.21.15.120:0/266363136 shutdown_connections 2024-07-27T03:09:08.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.693+0000 7fb08ab50640 1 --2- 172.21.15.120:0/266363136 >> v2:172.21.15.121:3300/0 conn(0x7fb0840b5cd0 0x7fb0840b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.693+0000 7fb08ab50640 1 --2- 172.21.15.120:0/266363136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08415c220 0x7fb084152160 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.693+0000 7fb08ab50640 1 -- 172.21.15.120:0/266363136 >> 172.21.15.120:0/266363136 conn(0x7fb08406cba0 msgr2=0x7fb08406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:08.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.693+0000 7fb08ab50640 1 -- 172.21.15.120:0/266363136 shutdown_connections 2024-07-27T03:09:08.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.694+0000 7fb08ab50640 1 -- 172.21.15.120:0/266363136 wait complete. 2024-07-27T03:09:08.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.695+0000 7fb08ab50640 1 Processor -- start 2024-07-27T03:09:08.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.695+0000 7fb08ab50640 1 -- start start 2024-07-27T03:09:08.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb08ab50640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0840b5cd0 0x7fb0841f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:08.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb08ab50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08415c220 0x7fb08413ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:08.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb08ab50640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb08415ec20 0x7fb084150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:08.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb08ab50640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb0840cdb10 con 0x7fb08415c220 2024-07-27T03:09:08.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb08ab50640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb0840cd990 con 0x7fb0840b5cd0 2024-07-27T03:09:08.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb08ab50640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb0840cdc90 con 0x7fb08415ec20 2024-07-27T03:09:08.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb083fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08415c220 0x7fb08413ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:08.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb083fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08415c220 0x7fb08413ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56224/0 (socket says 172.21.15.120:56224) 2024-07-27T03:09:08.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb083fff640 1 -- 172.21.15.120:0/381166885 learned_addr learned my addr 172.21.15.120:0/381166885 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:08.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb0888ec640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0840b5cd0 0x7fb0841f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:08.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb0890ed640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb08415ec20 0x7fb084150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb083fff640 1 -- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb08415ec20 msgr2=0x7fb084150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb083fff640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb08415ec20 0x7fb084150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb083fff640 1 -- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0840b5cd0 msgr2=0x7fb0841f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb083fff640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0840b5cd0 0x7fb0841f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb083fff640 1 -- 172.21.15.120:0/381166885 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0841f30b0 con 0x7fb08415c220 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb083fff640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08415c220 0x7fb08413ffb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb07800bfd0 tx=0x7fb07800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb0817fa640 1 -- 172.21.15.120:0/381166885 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078016070 con 0x7fb08415c220 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb0817fa640 1 -- 172.21.15.120:0/381166885 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb078009a30 con 0x7fb08415c220 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb08ab50640 1 -- 172.21.15.120:0/381166885 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0841404f0 con 0x7fb08415c220 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.697+0000 7fb0817fa640 1 -- 172.21.15.120:0/381166885 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078009e60 con 0x7fb08415c220 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.698+0000 7fb08ab50640 1 -- 172.21.15.120:0/381166885 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0841f6060 con 0x7fb08415c220 2024-07-27T03:09:08.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.699+0000 7fb08ab50640 1 -- 172.21.15.120:0/381166885 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0840ce1b0 con 0x7fb08415c220 2024-07-27T03:09:08.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.699+0000 7fb0817fa640 1 -- 172.21.15.120:0/381166885 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb078004020 con 0x7fb08415c220 2024-07-27T03:09:08.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.700+0000 7fb0817fa640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb070077010 0x7fb070079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:08.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.700+0000 7fb0817fa640 1 -- 172.21.15.120:0/381166885 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fb07809a100 con 0x7fb08415c220 2024-07-27T03:09:08.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.700+0000 7fb0888ec640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb070077010 0x7fb070079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:08.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.700+0000 7fb0888ec640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb070077010 0x7fb070079520 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb074035000 tx=0x7fb07403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:08.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.704+0000 7fb0817fa640 1 -- 172.21.15.120:0/381166885 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb078063090 con 0x7fb08415c220 2024-07-27T03:09:08.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.952+0000 7fb08ab50640 1 -- 172.21.15.120:0/381166885 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb0840b3b20 con 0x7fb08415c220 2024-07-27T03:09:08.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.953+0000 7fb0817fa640 1 -- 172.21.15.120:0/381166885 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7fb0780675e0 con 0x7fb08415c220 2024-07-27T03:09:08.955 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:08.955 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_dump": [ 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.a", 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRm7HVTGBAADA2eiX5COiTN6OTelto+6g==", 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.956 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.b", 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmMfl8JRAA+4W3m5lICDf6dIU1dELj5Q==", 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.c", 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmDnDuHxAAWKoH2jvhBqPNxL7NrtCJuw==", 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.957 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.d", 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmxkcwLRAAMzpPET/zdPCxfhbsMeLJuQ==", 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:09:08.958 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.0", 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCCZKRmtTNTChAAYbSo/j1WO/4nocsPhy8JRw==", 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.959 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.1", 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCFZKRmLRqlCBAAYgYpmzL3If445MkxGxBKHw==", 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.2", 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCIZKRmDhKBBhAAl6K58lvyVrAqfWffwAr1Mg==", 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:09:08.960 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.3", 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCLZKRmUDrLBBAAyUyAP/dCtMZVZpzi7TZIzA==", 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.961 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.4", 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCRZKRmXRMoCRAAcfX7u17DIoxM9dK3/TFu8Q==", 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.5", 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCUZKRmyaL0BxAANbxggtK64zbog9+KDXeOew==", 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:09:08.962 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.6", 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCXZKRmATKrBhAAeEBqJxkOoQozFzw1yeL6lw==", 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.963 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.7", 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCaZKRmCh6nBBAA8Cc+xOuBxqDAUgpweyq23A==", 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.0", 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmI8baMRAArCIL9NNNVlevij0JAWwGwg==", 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:09:08.964 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.1", 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmgOpnORAAkcLaNUd6cnsV/sHwOOI+2w==", 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.2", 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmwOSdNRAALgx82wMQ+5fPOrFL/qhj8g==", 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.3", 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB/ZKRmHh6PARAAZ9nBBam/kVvT6C1aFbNC3g==", 2024-07-27T03:09:08.966 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.admin", 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB9ZKRmpVPmNRAAay22/X8LO2KsI86ehHZ/MA==", 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:09:08.967 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-mds", 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCgZKRmr3DCBxAANi+klDnnXOdK2iT6alCDOA==", 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-mds" 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-mgr", 2024-07-27T03:09:08.968 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCgZKRmwXjCBxAAVs2+4OegPJFhvzKzJ0vS4A==", 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-mgr" 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-osd", 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCgZKRmdIDCBxAAqobZvDOMUVd3fHdiHEuXtQ==", 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-osd" 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-rbd", 2024-07-27T03:09:08.969 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCgZKRmXYfCBxAA9W1bH4ik6aoEhpu6PKYHFA==", 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-rbd" 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCgZKRmoY7CBxAAgPdoAHyPhaI8Vx3HReQtTg==", 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.970 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-rgw", 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCgZKRmIpbCBxAAz2bxd96IglhyXOXRA7ZqMQ==", 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-rgw" 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.x", 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmFsR+FBAA8tKKAi2Y/Yaxxca+ep3BRQ==", 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:09:08.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:08.972 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.y", 2024-07-27T03:09:08.972 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmWLnrDxAAfy1pvcoGJESVPs9k+so+/A==", 2024-07-27T03:09:08.972 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:09:08.972 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:09:08.972 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2024-07-27T03:09:08.972 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:09:08.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:08.972 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-07-27T03:09:08.972 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:09:08.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 -- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb070077010 msgr2=0x7fb070079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:08.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb070077010 0x7fb070079520 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb074035000 tx=0x7fb07403b040 comp rx=0 tx=0).stop 2024-07-27T03:09:08.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 -- 172.21.15.120:0/381166885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08415c220 msgr2=0x7fb08413ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:08.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08415c220 0x7fb08413ffb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb07800bfd0 tx=0x7fb07800dbb0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 -- 172.21.15.120:0/381166885 shutdown_connections 2024-07-27T03:09:08.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb070077010 0x7fb070079520 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb08415c220 0x7fb08413ffb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb08415ec20 0x7fb084150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 --2- 172.21.15.120:0/381166885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0840b5cd0 0x7fb0841f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:08.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 -- 172.21.15.120:0/381166885 >> 172.21.15.120:0/381166885 conn(0x7fb08406cba0 msgr2=0x7fb0840b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:08.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 -- 172.21.15.120:0/381166885 shutdown_connections 2024-07-27T03:09:08.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:08.955+0000 7fb08ab50640 1 -- 172.21.15.120:0/381166885 wait complete. 2024-07-27T03:09:08.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-07-27T03:09:09.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.088+0000 7fc0fd798640 1 -- 172.21.15.120:0/2956586439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0e4004db0 msgr2=0x7fc0e4005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.088+0000 7fc0fd798640 1 --2- 172.21.15.120:0/2956586439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0e4004db0 0x7fc0e4005280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0006fd0 tx=0x7fc0e4005830 comp rx=0 tx=0).stop 2024-07-27T03:09:09.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.088+0000 7fc0f77fe640 1 -- 172.21.15.120:0/2956586439 reap_dead start 2024-07-27T03:09:09.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.088+0000 7fc0fd798640 1 -- 172.21.15.120:0/2956586439 shutdown_connections 2024-07-27T03:09:09.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.088+0000 7fc0fd798640 1 -- 172.21.15.120:0/2956586439 >> 172.21.15.120:0/2956586439 conn(0x7fc0f80d1dd0 msgr2=0x7fc0f80d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:09.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.088+0000 7fc0fd798640 1 -- 172.21.15.120:0/2956586439 shutdown_connections 2024-07-27T03:09:09.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.088+0000 7fc0fd798640 1 -- 172.21.15.120:0/2956586439 wait complete. 2024-07-27T03:09:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.090+0000 7fc0fd798640 1 Processor -- start 2024-07-27T03:09:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.090+0000 7fc0fd798640 1 -- start start 2024-07-27T03:09:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.091+0000 7fc0fd798640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0e4004db0 0x7fc0f815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.091+0000 7fc0fd798640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f815fa80 0x7fc0f815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.091+0000 7fc0fd798640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0f809e260 0x7fc0f809e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.091+0000 7fc0fd798640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f80b1d70 con 0x7fc0e4004db0 2024-07-27T03:09:09.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.091+0000 7fc0fd798640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f80b1bf0 con 0x7fc0f815fa80 2024-07-27T03:09:09.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.091+0000 7fc0fd798640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f80b1ef0 con 0x7fc0f809e260 2024-07-27T03:09:09.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0f6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0e4004db0 0x7fc0f815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0f6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0e4004db0 0x7fc0f815dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56242/0 (socket says 172.21.15.120:56242) 2024-07-27T03:09:09.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0f6ffd640 1 -- 172.21.15.120:0/605606996 learned_addr learned my addr 172.21.15.120:0/605606996 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:09.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0ee7fc640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f815fa80 0x7fc0f815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0f77fe640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0f809e260 0x7fc0f809e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0f6ffd640 1 -- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0f809e260 msgr2=0x7fc0f809e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0f6ffd640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0f809e260 0x7fc0f809e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0f6ffd640 1 -- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f815fa80 msgr2=0x7fc0f815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0f6ffd640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f815fa80 0x7fc0f815bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0f6ffd640 1 -- 172.21.15.120:0/605606996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f809bc40 con 0x7fc0e4004db0 2024-07-27T03:09:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0f6ffd640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0e4004db0 0x7fc0f815dd60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8003f50 tx=0x7fc0e80016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0effff640 1 -- 172.21.15.120:0/605606996 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8011640 con 0x7fc0e4004db0 2024-07-27T03:09:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0effff640 1 -- 172.21.15.120:0/605606996 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0e8016020 con 0x7fc0e4004db0 2024-07-27T03:09:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0fd798640 1 -- 172.21.15.120:0/605606996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f809bf20 con 0x7fc0e4004db0 2024-07-27T03:09:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0effff640 1 -- 172.21.15.120:0/605606996 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8011a60 con 0x7fc0e4004db0 2024-07-27T03:09:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.092+0000 7fc0fd798640 1 -- 172.21.15.120:0/605606996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f815e2a0 con 0x7fc0e4004db0 2024-07-27T03:09:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.093+0000 7fc0fd798640 1 -- 172.21.15.120:0/605606996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f809f7d0 con 0x7fc0e4004db0 2024-07-27T03:09:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.094+0000 7fc0effff640 1 -- 172.21.15.120:0/605606996 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc0e8011c00 con 0x7fc0e4004db0 2024-07-27T03:09:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.094+0000 7fc0effff640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc0d8077010 0x7fc0d8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.094+0000 7fc0effff640 1 -- 172.21.15.120:0/605606996 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fc0e8098f00 con 0x7fc0e4004db0 2024-07-27T03:09:09.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.095+0000 7fc0ee7fc640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc0d8077010 0x7fc0d8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.095+0000 7fc0ee7fc640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc0d8077010 0x7fc0d8079520 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc0f81f13e0 tx=0x7fc0e000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:09.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.099+0000 7fc0effff640 1 -- 172.21.15.120:0/605606996 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc0e8020020 con 0x7fc0e4004db0 2024-07-27T03:09:09.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.353+0000 7fc0fd798640 1 -- 172.21.15.120:0/605606996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fc0f80d0790 con 0x7fc0e4004db0 2024-07-27T03:09:09.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.356+0000 7fc0effff640 1 -- 172.21.15.120:0/605606996 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fc0e8061f20 con 0x7fc0e4004db0 2024-07-27T03:09:09.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 -- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc0d8077010 msgr2=0x7fc0d8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc0d8077010 0x7fc0d8079520 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc0f81f13e0 tx=0x7fc0e000b2e0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 -- 172.21.15.120:0/605606996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0e4004db0 msgr2=0x7fc0f815dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0e4004db0 0x7fc0f815dd60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8003f50 tx=0x7fc0e80016f0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 -- 172.21.15.120:0/605606996 shutdown_connections 2024-07-27T03:09:09.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc0d8077010 0x7fc0d8079520 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc0f809e260 0x7fc0f809e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0f815fa80 0x7fc0f815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 --2- 172.21.15.120:0/605606996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc0e4004db0 0x7fc0f815dd60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 -- 172.21.15.120:0/605606996 >> 172.21.15.120:0/605606996 conn(0x7fc0f80d1dd0 msgr2=0x7fc0f80d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:09.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 -- 172.21.15.120:0/605606996 shutdown_connections 2024-07-27T03:09:09.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.358+0000 7fc0fd798640 1 -- 172.21.15.120:0/605606996 wait complete. 2024-07-27T03:09:09.372 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-07-27T03:09:09.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.485+0000 7f68ed29a640 1 -- 172.21.15.120:0/2462952992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68e80b4740 msgr2=0x7f68e80b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.485+0000 7f68ed29a640 1 --2- 172.21.15.120:0/2462952992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68e80b4740 0x7f68e80b2c40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f68d8005fd0 tx=0x7f68d802a5d0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.485+0000 7f68ed29a640 1 -- 172.21.15.120:0/2462952992 shutdown_connections 2024-07-27T03:09:09.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.485+0000 7f68ed29a640 1 --2- 172.21.15.120:0/2462952992 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f68e80d27e0 0x7f68e80d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.485+0000 7f68ed29a640 1 --2- 172.21.15.120:0/2462952992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68e80b4740 0x7f68e80b2c40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.485+0000 7f68ed29a640 1 -- 172.21.15.120:0/2462952992 >> 172.21.15.120:0/2462952992 conn(0x7f68e808d690 msgr2=0x7f68e809d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:09.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.485+0000 7f68ed29a640 1 -- 172.21.15.120:0/2462952992 shutdown_connections 2024-07-27T03:09:09.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.485+0000 7f68ed29a640 1 -- 172.21.15.120:0/2462952992 wait complete. 2024-07-27T03:09:09.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.486+0000 7f68ed29a640 1 Processor -- start 2024-07-27T03:09:09.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.487+0000 7f68ed29a640 1 -- start start 2024-07-27T03:09:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68ed29a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68e80b4740 0x7f68e81f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68ed29a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f68e80d09c0 0x7f68e80b8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68ed29a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68e80d27e0 0x7f68e8158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68ed29a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f68e80cef70 con 0x7f68e80d27e0 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68ed29a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f68e80cedf0 con 0x7f68e80b4740 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68ed29a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f68e80cf0f0 con 0x7f68e80d09c0 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68e77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68e80d27e0 0x7f68e8158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68e77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68e80d27e0 0x7f68e8158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56268/0 (socket says 172.21.15.120:56268) 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68e77fe640 1 -- 172.21.15.120:0/3875274118 learned_addr learned my addr 172.21.15.120:0/3875274118 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68e6ffd640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68e80b4740 0x7f68e81f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68de7fc640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f68e80d09c0 0x7f68e80b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68e77fe640 1 -- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f68e80d09c0 msgr2=0x7f68e80b8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68e77fe640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f68e80d09c0 0x7f68e80b8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68e77fe640 1 -- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68e80b4740 msgr2=0x7f68e81f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68e77fe640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68e80b4740 0x7f68e81f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68e77fe640 1 -- 172.21.15.120:0/3875274118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e81e76c0 con 0x7f68e80d27e0 2024-07-27T03:09:09.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.488+0000 7f68e77fe640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68e80d27e0 0x7f68e8158de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f68e000c6b0 tx=0x7f68e000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:09.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.489+0000 7f68dffff640 1 -- 172.21.15.120:0/3875274118 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0003b70 con 0x7f68e80d27e0 2024-07-27T03:09:09.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.489+0000 7f68dffff640 1 -- 172.21.15.120:0/3875274118 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68e0003d10 con 0x7f68e80d27e0 2024-07-27T03:09:09.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.489+0000 7f68ed29a640 1 -- 172.21.15.120:0/3875274118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e81e79a0 con 0x7f68e80d27e0 2024-07-27T03:09:09.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.489+0000 7f68dffff640 1 -- 172.21.15.120:0/3875274118 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0005330 con 0x7f68e80d27e0 2024-07-27T03:09:09.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.489+0000 7f68ed29a640 1 -- 172.21.15.120:0/3875274118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e81e7f60 con 0x7f68e80d27e0 2024-07-27T03:09:09.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.490+0000 7f68ed29a640 1 -- 172.21.15.120:0/3875274118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68e81e7430 con 0x7f68e80d27e0 2024-07-27T03:09:09.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.490+0000 7f68dffff640 1 -- 172.21.15.120:0/3875274118 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f68e00054d0 con 0x7f68e80d27e0 2024-07-27T03:09:09.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.491+0000 7f68dffff640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f68c8077040 0x7f68c8079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.491+0000 7f68dffff640 1 -- 172.21.15.120:0/3875274118 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f68e00981e0 con 0x7f68e80d27e0 2024-07-27T03:09:09.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.491+0000 7f68e6ffd640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f68c8077040 0x7f68c8079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.492+0000 7f68e6ffd640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f68c8077040 0x7f68c8079550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68d8033000 tx=0x7f68d8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:09.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.495+0000 7f68dffff640 1 -- 172.21.15.120:0/3875274118 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f68e0061180 con 0x7f68e80d27e0 2024-07-27T03:09:09.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.755+0000 7f68ed29a640 1 -- 172.21.15.120:0/3875274118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f68e80d2bf0 con 0x7f68e80d27e0 2024-07-27T03:09:09.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.760+0000 7f68dffff640 1 -- 172.21.15.120:0/3875274118 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f68e00656d0 con 0x7f68e80d27e0 2024-07-27T03:09:09.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 -- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f68c8077040 msgr2=0x7f68c8079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f68c8077040 0x7f68c8079550 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68d8033000 tx=0x7f68d8004730 comp rx=0 tx=0).stop 2024-07-27T03:09:09.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 -- 172.21.15.120:0/3875274118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68e80d27e0 msgr2=0x7f68e8158de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68e80d27e0 0x7f68e8158de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f68e000c6b0 tx=0x7f68e000cb70 comp rx=0 tx=0).stop 2024-07-27T03:09:09.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 -- 172.21.15.120:0/3875274118 shutdown_connections 2024-07-27T03:09:09.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f68c8077040 0x7f68c8079550 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68e80d27e0 0x7f68e8158de0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f68e80d09c0 0x7f68e80b8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 --2- 172.21.15.120:0/3875274118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68e80b4740 0x7f68e81f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 -- 172.21.15.120:0/3875274118 >> 172.21.15.120:0/3875274118 conn(0x7f68e808d690 msgr2=0x7f68e806e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:09.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 -- 172.21.15.120:0/3875274118 shutdown_connections 2024-07-27T03:09:09.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.762+0000 7f68ed29a640 1 -- 172.21.15.120:0/3875274118 wait complete. 2024-07-27T03:09:09.777 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-07-27T03:09:09.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.895+0000 7fd8b1d50640 1 -- 172.21.15.120:0/2215377290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd894003a30 msgr2=0x7fd894003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.895+0000 7fd8b1d50640 1 --2- 172.21.15.120:0/2215377290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd894003a30 0x7fd894003ea0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009b50 tx=0x7fd894005830 comp rx=0 tx=0).stop 2024-07-27T03:09:09.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.895+0000 7fd8abfff640 1 -- 172.21.15.120:0/2215377290 reap_dead start 2024-07-27T03:09:09.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.895+0000 7fd8b1d50640 1 -- 172.21.15.120:0/2215377290 shutdown_connections 2024-07-27T03:09:09.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.896+0000 7fd8b1d50640 1 -- 172.21.15.120:0/2215377290 >> 172.21.15.120:0/2215377290 conn(0x7fd8ac0b3920 msgr2=0x7fd8ac0b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:09.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.896+0000 7fd8b1d50640 1 -- 172.21.15.120:0/2215377290 shutdown_connections 2024-07-27T03:09:09.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.896+0000 7fd8b1d50640 1 -- 172.21.15.120:0/2215377290 wait complete. 2024-07-27T03:09:09.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.897+0000 7fd8b1d50640 1 Processor -- start 2024-07-27T03:09:09.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.897+0000 7fd8b1d50640 1 -- start start 2024-07-27T03:09:09.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8b1d50640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd894003a30 0x7fd8ac1f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8b1d50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8ac155e70 0x7fd8ac1f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8b1d50640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd8ac06d890 0x7fd8ac06dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8b1d50640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac15f250 con 0x7fd8ac155e70 2024-07-27T03:09:09.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8b1d50640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac15f0d0 con 0x7fd894003a30 2024-07-27T03:09:09.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8b1d50640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ac15f3d0 con 0x7fd8ac06d890 2024-07-27T03:09:09.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8aaffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8ac155e70 0x7fd8ac1f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8aaffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8ac155e70 0x7fd8ac1f82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56274/0 (socket says 172.21.15.120:56274) 2024-07-27T03:09:09.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8aaffd640 1 -- 172.21.15.120:0/1561636365 learned_addr learned my addr 172.21.15.120:0/1561636365 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:09.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8ab7fe640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd894003a30 0x7fd8ac1f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8abfff640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd8ac06d890 0x7fd8ac06dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8aaffd640 1 -- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd8ac06d890 msgr2=0x7fd8ac06dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8aaffd640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd8ac06d890 0x7fd8ac06dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8aaffd640 1 -- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd894003a30 msgr2=0x7fd8ac1f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:09.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8aaffd640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd894003a30 0x7fd8ac1f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:09.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8aaffd640 1 -- 172.21.15.120:0/1561636365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ac1f8e30 con 0x7fd8ac155e70 2024-07-27T03:09:09.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8abfff640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd8ac06d890 0x7fd8ac06dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:09.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd8aaffd640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8ac155e70 0x7fd8ac1f82b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0004e60 tx=0x7fd8a0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:09.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.899+0000 7fd893fff640 1 -- 172.21.15.120:0/1561636365 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0015020 con 0x7fd8ac155e70 2024-07-27T03:09:09.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.900+0000 7fd893fff640 1 -- 172.21.15.120:0/1561636365 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8a0011960 con 0x7fd8ac155e70 2024-07-27T03:09:09.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.900+0000 7fd8b1d50640 1 -- 172.21.15.120:0/1561636365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ac1f9110 con 0x7fd8ac155e70 2024-07-27T03:09:09.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.900+0000 7fd893fff640 1 -- 172.21.15.120:0/1561636365 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0011d10 con 0x7fd8ac155e70 2024-07-27T03:09:09.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.900+0000 7fd8b1d50640 1 -- 172.21.15.120:0/1561636365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ac1f5300 con 0x7fd8ac155e70 2024-07-27T03:09:09.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.901+0000 7fd8b1d50640 1 -- 172.21.15.120:0/1561636365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8ac1f8ba0 con 0x7fd8ac155e70 2024-07-27T03:09:09.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.901+0000 7fd893fff640 1 -- 172.21.15.120:0/1561636365 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd8a0018020 con 0x7fd8ac155e70 2024-07-27T03:09:09.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.902+0000 7fd893fff640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd898077040 0x7fd898079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:09.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.902+0000 7fd893fff640 1 -- 172.21.15.120:0/1561636365 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fd8a0098e70 con 0x7fd8ac155e70 2024-07-27T03:09:09.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.902+0000 7fd8ab7fe640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd898077040 0x7fd898079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:09.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.902+0000 7fd8ab7fe640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd898077040 0x7fd898079550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd89c035000 tx=0x7fd89c02d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:09.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:09.906+0000 7fd893fff640 1 -- 172.21.15.120:0/1561636365 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd8a001f020 con 0x7fd8ac155e70 2024-07-27T03:09:10.017 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:09:10.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:09:10.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.166+0000 7fd8b1d50640 1 -- 172.21.15.120:0/1561636365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fd8ac15f930 con 0x7fd8ac155e70 2024-07-27T03:09:10.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.170+0000 7fd893fff640 1 -- 172.21.15.120:0/1561636365 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fd8a00624e0 con 0x7fd8ac155e70 2024-07-27T03:09:10.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.173+0000 7fd8b1d50640 1 -- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd898077040 msgr2=0x7fd898079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:10.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.173+0000 7fd8b1d50640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd898077040 0x7fd898079550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd89c035000 tx=0x7fd89c02d040 comp rx=0 tx=0).stop 2024-07-27T03:09:10.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.173+0000 7fd8b1d50640 1 -- 172.21.15.120:0/1561636365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8ac155e70 msgr2=0x7fd8ac1f82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:10.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.173+0000 7fd8b1d50640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8ac155e70 0x7fd8ac1f82b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0004e60 tx=0x7fd8a0001630 comp rx=0 tx=0).stop 2024-07-27T03:09:10.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.173+0000 7fd8b1d50640 1 -- 172.21.15.120:0/1561636365 shutdown_connections 2024-07-27T03:09:10.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.174+0000 7fd8b1d50640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd898077040 0x7fd898079550 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.174+0000 7fd8b1d50640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd8ac155e70 0x7fd8ac1f82b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.174+0000 7fd8b1d50640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd8ac06d890 0x7fd8ac06dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.174+0000 7fd8b1d50640 1 --2- 172.21.15.120:0/1561636365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd894003a30 0x7fd8ac1f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.174+0000 7fd8b1d50640 1 -- 172.21.15.120:0/1561636365 >> 172.21.15.120:0/1561636365 conn(0x7fd8ac0b3920 msgr2=0x7fd8ac071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:10.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.174+0000 7fd8b1d50640 1 -- 172.21.15.120:0/1561636365 shutdown_connections 2024-07-27T03:09:10.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.174+0000 7fd8b1d50640 1 -- 172.21.15.120:0/1561636365 wait complete. 2024-07-27T03:09:10.187 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-07-27T03:09:10.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.304+0000 7fc399b93640 1 -- 172.21.15.120:0/1055477580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc380003a00 msgr2=0x7fc380003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:10.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.304+0000 7fc399b93640 1 --2- 172.21.15.120:0/1055477580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc380003a00 0x7fc380003e70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc384009b50 tx=0x7fc380005830 comp rx=0 tx=0).stop 2024-07-27T03:09:10.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.304+0000 7fc393fff640 1 -- 172.21.15.120:0/1055477580 reap_dead start 2024-07-27T03:09:10.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.304+0000 7fc399b93640 1 -- 172.21.15.120:0/1055477580 shutdown_connections 2024-07-27T03:09:10.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.304+0000 7fc399b93640 1 -- 172.21.15.120:0/1055477580 >> 172.21.15.120:0/1055477580 conn(0x7fc3940d0df0 msgr2=0x7fc3940d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:10.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.304+0000 7fc399b93640 1 -- 172.21.15.120:0/1055477580 shutdown_connections 2024-07-27T03:09:10.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.304+0000 7fc399b93640 1 -- 172.21.15.120:0/1055477580 wait complete. 2024-07-27T03:09:10.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.306+0000 7fc399b93640 1 Processor -- start 2024-07-27T03:09:10.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.306+0000 7fc399b93640 1 -- start start 2024-07-27T03:09:10.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc399b93640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc380003a00 0x7fc394158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:10.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc399b93640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3940afc90 0x7fc3940b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:10.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc399b93640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394070a20 0x7fc394070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:10.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc399b93640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc39415b680 con 0x7fc394070a20 2024-07-27T03:09:10.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc399b93640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc394073ad0 con 0x7fc3940afc90 2024-07-27T03:09:10.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc399b93640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc39415b800 con 0x7fc380003a00 2024-07-27T03:09:10.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc393fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394070a20 0x7fc394070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:10.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc393fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394070a20 0x7fc394070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56288/0 (socket says 172.21.15.120:56288) 2024-07-27T03:09:10.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc393fff640 1 -- 172.21.15.120:0/2685381945 learned_addr learned my addr 172.21.15.120:0/2685381945 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:10.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc38affd640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3940afc90 0x7fc3940b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:10.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc3937fe640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc380003a00 0x7fc394158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:10.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc393fff640 1 -- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc380003a00 msgr2=0x7fc394158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:10.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc393fff640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc380003a00 0x7fc394158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc393fff640 1 -- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3940afc90 msgr2=0x7fc3940b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:10.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc393fff640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3940afc90 0x7fc3940b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc393fff640 1 -- 172.21.15.120:0/2685381945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc394071370 con 0x7fc394070a20 2024-07-27T03:09:10.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc38affd640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3940afc90 0x7fc3940b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:10.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.308+0000 7fc393fff640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394070a20 0x7fc394070e30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005fd0 tx=0x7fc38c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:10.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.309+0000 7fc390ff9640 1 -- 172.21.15.120:0/2685381945 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00fd70 con 0x7fc394070a20 2024-07-27T03:09:10.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.309+0000 7fc390ff9640 1 -- 172.21.15.120:0/2685381945 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc38c004b20 con 0x7fc394070a20 2024-07-27T03:09:10.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.309+0000 7fc399b93640 1 -- 172.21.15.120:0/2685381945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3941f57f0 con 0x7fc394070a20 2024-07-27T03:09:10.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.309+0000 7fc390ff9640 1 -- 172.21.15.120:0/2685381945 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c003970 con 0x7fc394070a20 2024-07-27T03:09:10.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.309+0000 7fc399b93640 1 -- 172.21.15.120:0/2685381945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3941f5db0 con 0x7fc394070a20 2024-07-27T03:09:10.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.310+0000 7fc399b93640 1 -- 172.21.15.120:0/2685381945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc39415f6c0 con 0x7fc394070a20 2024-07-27T03:09:10.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.310+0000 7fc390ff9640 1 -- 172.21.15.120:0/2685381945 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc38c020020 con 0x7fc394070a20 2024-07-27T03:09:10.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.311+0000 7fc390ff9640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc374077010 0x7fc374079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:10.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.311+0000 7fc390ff9640 1 -- 172.21.15.120:0/2685381945 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fc38c098d20 con 0x7fc394070a20 2024-07-27T03:09:10.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.311+0000 7fc3937fe640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc374077010 0x7fc374079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:10.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.312+0000 7fc3937fe640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc374077010 0x7fc374079520 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc384035000 tx=0x7fc38402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:10.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.315+0000 7fc390ff9640 1 -- 172.21.15.120:0/2685381945 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc394071370 con 0x7fc394070a20 2024-07-27T03:09:10.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.580+0000 7fc399b93640 1 -- 172.21.15.120:0/2685381945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fc3941f5560 con 0x7fc394070a20 2024-07-27T03:09:10.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.584+0000 7fc390ff9640 1 -- 172.21.15.120:0/2685381945 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fc38c062390 con 0x7fc394070a20 2024-07-27T03:09:10.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 -- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc374077010 msgr2=0x7fc374079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:10.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc374077010 0x7fc374079520 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc384035000 tx=0x7fc38402d040 comp rx=0 tx=0).stop 2024-07-27T03:09:10.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 -- 172.21.15.120:0/2685381945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394070a20 msgr2=0x7fc394070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:10.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394070a20 0x7fc394070e30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005fd0 tx=0x7fc38c011f90 comp rx=0 tx=0).stop 2024-07-27T03:09:10.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 -- 172.21.15.120:0/2685381945 shutdown_connections 2024-07-27T03:09:10.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc374077010 0x7fc374079520 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc394070a20 0x7fc394070e30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3940afc90 0x7fc3940b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 --2- 172.21.15.120:0/2685381945 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc380003a00 0x7fc394158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 -- 172.21.15.120:0/2685381945 >> 172.21.15.120:0/2685381945 conn(0x7fc3940d0df0 msgr2=0x7fc39409eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:10.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 -- 172.21.15.120:0/2685381945 shutdown_connections 2024-07-27T03:09:10.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.586+0000 7fc399b93640 1 -- 172.21.15.120:0/2685381945 wait complete. 2024-07-27T03:09:10.601 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-07-27T03:09:10.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.715+0000 7f6543014640 1 -- 172.21.15.120:0/320611327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f652c004d40 msgr2=0x7f652c0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:10.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.715+0000 7f6543014640 1 --2- 172.21.15.120:0/320611327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f652c004d40 0x7f652c0051f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6534001d30 tx=0x7f652c005830 comp rx=0 tx=0).stop 2024-07-27T03:09:10.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.715+0000 7f65415b1640 1 -- 172.21.15.120:0/320611327 reap_dead start 2024-07-27T03:09:10.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.715+0000 7f6543014640 1 -- 172.21.15.120:0/320611327 shutdown_connections 2024-07-27T03:09:10.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.715+0000 7f6543014640 1 -- 172.21.15.120:0/320611327 >> 172.21.15.120:0/320611327 conn(0x7f653c0b1a10 msgr2=0x7f653c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:10.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.715+0000 7f6543014640 1 -- 172.21.15.120:0/320611327 shutdown_connections 2024-07-27T03:09:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.715+0000 7f6543014640 1 -- 172.21.15.120:0/320611327 wait complete. 2024-07-27T03:09:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.717+0000 7f6543014640 1 Processor -- start 2024-07-27T03:09:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.717+0000 7f6543014640 1 -- start start 2024-07-27T03:09:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.718+0000 7f6543014640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f652c004d40 0x7f653c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.718+0000 7f6543014640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653c0b0d80 0x7f653c0b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.718+0000 7f6543014640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c151c70 0x7f653c152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.718+0000 7f6543014640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0735f0 con 0x7f653c151c70 2024-07-27T03:09:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.718+0000 7f6543014640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0aeca0 con 0x7f652c004d40 2024-07-27T03:09:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.718+0000 7f6543014640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f653c073770 con 0x7f653c0b0d80 2024-07-27T03:09:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65415b1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c151c70 0x7f653c152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65415b1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c151c70 0x7f653c152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56314/0 (socket says 172.21.15.120:56314) 2024-07-27T03:09:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65415b1640 1 -- 172.21.15.120:0/3228913947 learned_addr learned my addr 172.21.15.120:0/3228913947 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f653bfff640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653c0b0d80 0x7f653c0b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f6540db0640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f652c004d40 0x7f653c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65415b1640 1 -- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653c0b0d80 msgr2=0x7f653c0b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65415b1640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653c0b0d80 0x7f653c0b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65415b1640 1 -- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f652c004d40 msgr2=0x7f653c153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65415b1640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f652c004d40 0x7f653c153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:10.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65415b1640 1 -- 172.21.15.120:0/3228913947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c1f5fc0 con 0x7f653c151c70 2024-07-27T03:09:10.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65415b1640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c151c70 0x7f653c152080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f653402ac70 tx=0x7f6534001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:10.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65397fa640 1 -- 172.21.15.120:0/3228913947 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65340060b0 con 0x7f653c151c70 2024-07-27T03:09:10.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65397fa640 1 -- 172.21.15.120:0/3228913947 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6534006250 con 0x7f653c151c70 2024-07-27T03:09:10.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f6543014640 1 -- 172.21.15.120:0/3228913947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c1f62a0 con 0x7f653c151c70 2024-07-27T03:09:10.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.719+0000 7f65397fa640 1 -- 172.21.15.120:0/3228913947 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534006660 con 0x7f653c151c70 2024-07-27T03:09:10.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.720+0000 7f6543014640 1 -- 172.21.15.120:0/3228913947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c1f6860 con 0x7f653c151c70 2024-07-27T03:09:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.721+0000 7f6543014640 1 -- 172.21.15.120:0/3228913947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653c155660 con 0x7f653c151c70 2024-07-27T03:09:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.721+0000 7f65397fa640 1 -- 172.21.15.120:0/3228913947 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6534033480 con 0x7f653c151c70 2024-07-27T03:09:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.722+0000 7f65397fa640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6520077010 0x7f6520079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.722+0000 7f65397fa640 1 -- 172.21.15.120:0/3228913947 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f65340b82d0 con 0x7f653c151c70 2024-07-27T03:09:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.722+0000 7f6540db0640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6520077010 0x7f6520079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.723+0000 7f6540db0640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6520077010 0x7f6520079520 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6530001010 tx=0x7f6530006990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:10.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.730+0000 7f65397fa640 1 -- 172.21.15.120:0/3228913947 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f65340811e0 con 0x7f653c151c70 2024-07-27T03:09:10.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.992+0000 7f6543014640 1 -- 172.21.15.120:0/3228913947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f653c1f6c40 con 0x7f653c151c70 2024-07-27T03:09:10.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.996+0000 7f65397fa640 1 -- 172.21.15.120:0/3228913947 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f6534085730 con 0x7f653c151c70 2024-07-27T03:09:11.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 -- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6520077010 msgr2=0x7f6520079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6520077010 0x7f6520079520 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6530001010 tx=0x7f6530006990 comp rx=0 tx=0).stop 2024-07-27T03:09:11.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 -- 172.21.15.120:0/3228913947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c151c70 msgr2=0x7f653c152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c151c70 0x7f653c152080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f653402ac70 tx=0x7f6534001ab0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 -- 172.21.15.120:0/3228913947 shutdown_connections 2024-07-27T03:09:11.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6520077010 0x7f6520079520 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f653c151c70 0x7f653c152080 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653c0b0d80 0x7f653c0b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 --2- 172.21.15.120:0/3228913947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f652c004d40 0x7f653c153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 -- 172.21.15.120:0/3228913947 >> 172.21.15.120:0/3228913947 conn(0x7f653c0b1a10 msgr2=0x7f653c09d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:11.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 -- 172.21.15.120:0/3228913947 shutdown_connections 2024-07-27T03:09:11.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:10.998+0000 7f6543014640 1 -- 172.21.15.120:0/3228913947 wait complete. 2024-07-27T03:09:11.012 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-07-27T03:09:11.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.126+0000 7f44a4938640 1 -- 172.21.15.120:0/2740140538 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44a00b2c40 msgr2=0x7f44a00d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.126+0000 7f44a4938640 1 --2- 172.21.15.120:0/2740140538 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44a00b2c40 0x7f44a00d09c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4494009830 tx=0x7f449402a510 comp rx=0 tx=0).stop 2024-07-27T03:09:11.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.126+0000 7f44a4938640 1 -- 172.21.15.120:0/2740140538 shutdown_connections 2024-07-27T03:09:11.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.126+0000 7f44a4938640 1 --2- 172.21.15.120:0/2740140538 >> v2:172.21.15.121:3300/0 conn(0x7f44a00d0f00 0x7f44a00cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.126+0000 7f44a4938640 1 --2- 172.21.15.120:0/2740140538 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44a00b2c40 0x7f44a00d09c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.126+0000 7f44a4938640 1 -- 172.21.15.120:0/2740140538 >> 172.21.15.120:0/2740140538 conn(0x7f44a008d690 msgr2=0x7f44a009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:11.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.126+0000 7f44a4938640 1 -- 172.21.15.120:0/2740140538 shutdown_connections 2024-07-27T03:09:11.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.126+0000 7f44a4938640 1 -- 172.21.15.120:0/2740140538 wait complete. 2024-07-27T03:09:11.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.128+0000 7f44a4938640 1 Processor -- start 2024-07-27T03:09:11.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.128+0000 7f44a4938640 1 -- start start 2024-07-27T03:09:11.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.129+0000 7f44a4938640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a00b2c40 0x7f44a01f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.129+0000 7f44a4938640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a00b4740 0x7f44a00cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.129+0000 7f44a4938640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44a00d0f00 0x7f44a0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.129+0000 7f44a4938640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f44a00cf120 con 0x7f44a00b4740 2024-07-27T03:09:11.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.129+0000 7f44a4938640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44a00d3100 con 0x7f44a00b2c40 2024-07-27T03:09:11.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.129+0000 7f44a4938640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f44a00cf2a0 con 0x7f44a00d0f00 2024-07-27T03:09:11.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.129+0000 7f449dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a00b4740 0x7f44a00cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.129+0000 7f449dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a00b4740 0x7f44a00cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56322/0 (socket says 172.21.15.120:56322) 2024-07-27T03:09:11.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.129+0000 7f449dd9b640 1 -- 172.21.15.120:0/3835243516 learned_addr learned my addr 172.21.15.120:0/3835243516 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:11.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f449ed9d640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44a00d0f00 0x7f44a0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f449e59c640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a00b2c40 0x7f44a01f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f449dd9b640 1 -- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44a00d0f00 msgr2=0x7f44a0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f449dd9b640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44a00d0f00 0x7f44a0159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f449dd9b640 1 -- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a00b2c40 msgr2=0x7f44a01f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f449dd9b640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a00b2c40 0x7f44a01f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f449dd9b640 1 -- 172.21.15.120:0/3835243516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a015d050 con 0x7f44a00b4740 2024-07-27T03:09:11.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f449e59c640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a00b2c40 0x7f44a01f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:11.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f449dd9b640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a00b4740 0x7f44a00cd5e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4494009950 tx=0x7f4494033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:11.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f448effd640 1 -- 172.21.15.120:0/3835243516 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494005c90 con 0x7f44a00b4740 2024-07-27T03:09:11.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f448effd640 1 -- 172.21.15.120:0/3835243516 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4494031e50 con 0x7f44a00b4740 2024-07-27T03:09:11.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f44a4938640 1 -- 172.21.15.120:0/3835243516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a015bf10 con 0x7f44a00b4740 2024-07-27T03:09:11.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f448effd640 1 -- 172.21.15.120:0/3835243516 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494005260 con 0x7f44a00b4740 2024-07-27T03:09:11.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.130+0000 7f44a4938640 1 -- 172.21.15.120:0/3835243516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a015c440 con 0x7f44a00b4740 2024-07-27T03:09:11.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.131+0000 7f44a4938640 1 -- 172.21.15.120:0/3835243516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a00d09c0 con 0x7f44a00b4740 2024-07-27T03:09:11.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.132+0000 7f448effd640 1 -- 172.21.15.120:0/3835243516 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4494005400 con 0x7f44a00b4740 2024-07-27T03:09:11.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.132+0000 7f448effd640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4480077010 0x7f4480079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.132+0000 7f448effd640 1 -- 172.21.15.120:0/3835243516 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f44940b95e0 con 0x7f44a00b4740 2024-07-27T03:09:11.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.132+0000 7f449e59c640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4480077010 0x7f4480079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.133+0000 7f449e59c640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4480077010 0x7f4480079520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f44900013f0 tx=0x7f4490009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:11.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.137+0000 7f448effd640 1 -- 172.21.15.120:0/3835243516 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f449403f030 con 0x7f44a00b4740 2024-07-27T03:09:11.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.396+0000 7f44a4938640 1 -- 172.21.15.120:0/3835243516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f44a015c1d0 con 0x7f44a00b4740 2024-07-27T03:09:11.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.401+0000 7f448effd640 1 -- 172.21.15.120:0/3835243516 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f4494082bc0 con 0x7f44a00b4740 2024-07-27T03:09:11.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 -- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4480077010 msgr2=0x7f4480079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4480077010 0x7f4480079520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f44900013f0 tx=0x7f4490009040 comp rx=0 tx=0).stop 2024-07-27T03:09:11.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 -- 172.21.15.120:0/3835243516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a00b4740 msgr2=0x7f44a00cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a00b4740 0x7f44a00cd5e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4494009950 tx=0x7f4494033c20 comp rx=0 tx=0).stop 2024-07-27T03:09:11.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 -- 172.21.15.120:0/3835243516 shutdown_connections 2024-07-27T03:09:11.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4480077010 0x7f4480079520 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44a00b4740 0x7f44a00cd5e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44a00d0f00 0x7f44a0159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 --2- 172.21.15.120:0/3835243516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a00b2c40 0x7f44a01f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 -- 172.21.15.120:0/3835243516 >> 172.21.15.120:0/3835243516 conn(0x7f44a008d690 msgr2=0x7f44a006e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:11.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 -- 172.21.15.120:0/3835243516 shutdown_connections 2024-07-27T03:09:11.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.403+0000 7f44a4938640 1 -- 172.21.15.120:0/3835243516 wait complete. 2024-07-27T03:09:11.417 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-07-27T03:09:11.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.528+0000 7fb283f50640 1 -- 172.21.15.120:0/2134245887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb27c09b140 msgr2=0x7fb27c0b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.528+0000 7fb283f50640 1 --2- 172.21.15.120:0/2134245887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb27c09b140 0x7fb27c0b4ef0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0731b0 tx=0x7fb27402a560 comp rx=0 tx=0).stop 2024-07-27T03:09:11.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.528+0000 7fb283f50640 1 -- 172.21.15.120:0/2134245887 shutdown_connections 2024-07-27T03:09:11.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.528+0000 7fb283f50640 1 --2- 172.21.15.120:0/2134245887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb27c09b140 0x7fb27c0b4ef0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.528+0000 7fb283f50640 1 --2- 172.21.15.120:0/2134245887 >> v2:172.21.15.121:3300/0 conn(0x7fb27c09b640 0x7fb27c0b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.528+0000 7fb283f50640 1 -- 172.21.15.120:0/2134245887 >> 172.21.15.120:0/2134245887 conn(0x7fb27c0d20a0 msgr2=0x7fb27c0d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:11.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.528+0000 7fb283f50640 1 -- 172.21.15.120:0/2134245887 shutdown_connections 2024-07-27T03:09:11.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.528+0000 7fb283f50640 1 -- 172.21.15.120:0/2134245887 wait complete. 2024-07-27T03:09:11.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.530+0000 7fb283f50640 1 Processor -- start 2024-07-27T03:09:11.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.530+0000 7fb283f50640 1 -- start start 2024-07-27T03:09:11.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.531+0000 7fb283f50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb27c09b640 0x7fb27c0b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.531+0000 7fb283f50640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb27c0cf4e0 0x7fb27c1e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.531+0000 7fb283f50640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c0aed80 0x7fb27c0af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.531+0000 7fb283f50640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c0b5a50 con 0x7fb27c09b640 2024-07-27T03:09:11.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.531+0000 7fb283f50640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c0b58d0 con 0x7fb27c0aed80 2024-07-27T03:09:11.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.531+0000 7fb283f50640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb27c0b5bd0 con 0x7fb27c0cf4e0 2024-07-27T03:09:11.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.531+0000 7fb281cec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb27c09b640 0x7fb27c0b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.531+0000 7fb281cec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb27c09b640 0x7fb27c0b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56334/0 (socket says 172.21.15.120:56334) 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.531+0000 7fb281cec640 1 -- 172.21.15.120:0/1767901987 learned_addr learned my addr 172.21.15.120:0/1767901987 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb2824ed640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c0aed80 0x7fb27c0af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb2814eb640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb27c0cf4e0 0x7fb27c1e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb281cec640 1 -- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb27c0cf4e0 msgr2=0x7fb27c1e92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb281cec640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb27c0cf4e0 0x7fb27c1e92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb281cec640 1 -- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c0aed80 msgr2=0x7fb27c0af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb281cec640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c0aed80 0x7fb27c0af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb281cec640 1 -- 172.21.15.120:0/1767901987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27c09c050 con 0x7fb27c09b640 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb2824ed640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c0aed80 0x7fb27c0af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb2814eb640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb27c0cf4e0 0x7fb27c1e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb281cec640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb27c09b640 0x7fb27c0b1570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb27800cce0 tx=0x7fb2780075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb2727fc640 1 -- 172.21.15.120:0/1767901987 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb278004b20 con 0x7fb27c09b640 2024-07-27T03:09:11.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb2727fc640 1 -- 172.21.15.120:0/1767901987 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb278004db0 con 0x7fb27c09b640 2024-07-27T03:09:11.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb283f50640 1 -- 172.21.15.120:0/1767901987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27c09c330 con 0x7fb27c09b640 2024-07-27T03:09:11.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb2727fc640 1 -- 172.21.15.120:0/1767901987 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb278005280 con 0x7fb27c09b640 2024-07-27T03:09:11.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.532+0000 7fb283f50640 1 -- 172.21.15.120:0/1767901987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27c1e9800 con 0x7fb27c09b640 2024-07-27T03:09:11.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.533+0000 7fb283f50640 1 -- 172.21.15.120:0/1767901987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb27c0b60c0 con 0x7fb27c09b640 2024-07-27T03:09:11.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.534+0000 7fb2727fc640 1 -- 172.21.15.120:0/1767901987 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb278005420 con 0x7fb27c09b640 2024-07-27T03:09:11.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.535+0000 7fb2727fc640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb260077010 0x7fb260079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.535+0000 7fb2727fc640 1 -- 172.21.15.120:0/1767901987 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fb278098cd0 con 0x7fb27c09b640 2024-07-27T03:09:11.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.535+0000 7fb2814eb640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb260077010 0x7fb260079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.535+0000 7fb2814eb640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb260077010 0x7fb260079520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0cbb70 tx=0x7fb26c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:11.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.539+0000 7fb2727fc640 1 -- 172.21.15.120:0/1767901987 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb278014030 con 0x7fb27c09b640 2024-07-27T03:09:11.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.725+0000 7fb283f50640 1 -- 172.21.15.120:0/1767901987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb27c0b6ef0 con 0x7fb27c09b640 2024-07-27T03:09:11.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.725+0000 7fb2727fc640 1 -- 172.21.15.120:0/1767901987 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7fb2780622b0 con 0x7fb27c09b640 2024-07-27T03:09:11.728 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:11.728 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-07-27T03:09:11.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:09:11.728 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2024-07-27T03:09:11.728 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2024-07-27T03:09:11.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:09:11.728 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-07-27T03:09:11.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 -- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb260077010 msgr2=0x7fb260079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb260077010 0x7fb260079520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0cbb70 tx=0x7fb26c008040 comp rx=0 tx=0).stop 2024-07-27T03:09:11.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 -- 172.21.15.120:0/1767901987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb27c09b640 msgr2=0x7fb27c0b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb27c09b640 0x7fb27c0b1570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb27800cce0 tx=0x7fb2780075f0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 -- 172.21.15.120:0/1767901987 shutdown_connections 2024-07-27T03:09:11.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb260077010 0x7fb260079520 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c0aed80 0x7fb27c0af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb27c0cf4e0 0x7fb27c1e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 --2- 172.21.15.120:0/1767901987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb27c09b640 0x7fb27c0b1570 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 -- 172.21.15.120:0/1767901987 >> 172.21.15.120:0/1767901987 conn(0x7fb27c0d20a0 msgr2=0x7fb27c09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:11.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 -- 172.21.15.120:0/1767901987 shutdown_connections 2024-07-27T03:09:11.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.727+0000 7fb283f50640 1 -- 172.21.15.120:0/1767901987 wait complete. 2024-07-27T03:09:11.741 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-07-27T03:09:11.741 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-07-27T03:09:11.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.856+0000 7fa3e7850640 1 -- 172.21.15.120:0/1342030761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3cc005150 msgr2=0x7fa3cc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.856+0000 7fa3e7850640 1 --2- 172.21.15.120:0/1342030761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3cc005150 0x7fa3cc00b9c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009ed0 tx=0x7fa3cc005830 comp rx=0 tx=0).stop 2024-07-27T03:09:11.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.856+0000 7fa3e5ded640 1 -- 172.21.15.120:0/1342030761 reap_dead start 2024-07-27T03:09:11.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.856+0000 7fa3e7850640 1 -- 172.21.15.120:0/1342030761 shutdown_connections 2024-07-27T03:09:11.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.856+0000 7fa3e7850640 1 -- 172.21.15.120:0/1342030761 >> 172.21.15.120:0/1342030761 conn(0x7fa3e00cfd60 msgr2=0x7fa3e00d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:11.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.856+0000 7fa3e7850640 1 -- 172.21.15.120:0/1342030761 shutdown_connections 2024-07-27T03:09:11.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.856+0000 7fa3e7850640 1 -- 172.21.15.120:0/1342030761 wait complete. 2024-07-27T03:09:11.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.857+0000 7fa3e7850640 1 Processor -- start 2024-07-27T03:09:11.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.858+0000 7fa3e7850640 1 -- start start 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e7850640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3cc005150 0x7fa3e0157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e7850640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3e0158510 0x7fa3e0073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e7850640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3e0157f30 0x7fa3e00738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e7850640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e00ce4c0 con 0x7fa3e0157f30 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e7850640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e00aedb0 con 0x7fa3cc005150 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e7850640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e01673b0 con 0x7fa3e0158510 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e5ded640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3e0157f30 0x7fa3e00738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e5ded640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3e0157f30 0x7fa3e00738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49766/0 (socket says 172.21.15.120:49766) 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e5ded640 1 -- 172.21.15.120:0/946299686 learned_addr learned my addr 172.21.15.120:0/946299686 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e55ec640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3cc005150 0x7fa3e0157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e4deb640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3e0158510 0x7fa3e0073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e5ded640 1 -- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3e0158510 msgr2=0x7fa3e0073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e5ded640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3e0158510 0x7fa3e0073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e5ded640 1 -- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3cc005150 msgr2=0x7fa3e0157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e5ded640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3cc005150 0x7fa3e0157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e5ded640 1 -- 172.21.15.120:0/946299686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e0074350 con 0x7fa3e0157f30 2024-07-27T03:09:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e4deb640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3e0158510 0x7fa3e0073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.859+0000 7fa3e5ded640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3e0157f30 0x7fa3e00738d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa3d802aed0 tx=0x7fa3d8033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.860+0000 7fa3d5ffb640 1 -- 172.21.15.120:0/946299686 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8042070 con 0x7fa3e0157f30 2024-07-27T03:09:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.860+0000 7fa3d5ffb640 1 -- 172.21.15.120:0/946299686 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3d8003970 con 0x7fa3e0157f30 2024-07-27T03:09:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.860+0000 7fa3e7850640 1 -- 172.21.15.120:0/946299686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e00ccf70 con 0x7fa3e0157f30 2024-07-27T03:09:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.860+0000 7fa3d5ffb640 1 -- 172.21.15.120:0/946299686 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8038040 con 0x7fa3e0157f30 2024-07-27T03:09:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.860+0000 7fa3e7850640 1 -- 172.21.15.120:0/946299686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e0073e10 con 0x7fa3e0157f30 2024-07-27T03:09:11.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.861+0000 7fa3e7850640 1 -- 172.21.15.120:0/946299686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e00740c0 con 0x7fa3e0157f30 2024-07-27T03:09:11.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.861+0000 7fa3d5ffb640 1 -- 172.21.15.120:0/946299686 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fa3d8004030 con 0x7fa3e0157f30 2024-07-27T03:09:11.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.862+0000 7fa3d5ffb640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa3c4077010 0x7fa3c4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:11.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.862+0000 7fa3d5ffb640 1 -- 172.21.15.120:0/946299686 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fa3d80b89d0 con 0x7fa3e0157f30 2024-07-27T03:09:11.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.862+0000 7fa3e55ec640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa3c4077010 0x7fa3c4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:11.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.863+0000 7fa3e55ec640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa3c4077010 0x7fa3c4079520 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc006fd0 tx=0x7fa3dc006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:11.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:11.866+0000 7fa3d5ffb640 1 -- 172.21.15.120:0/946299686 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fa3d8081960 con 0x7fa3e0157f30 2024-07-27T03:09:12.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.050+0000 7fa3e7850640 1 -- 172.21.15.120:0/946299686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa3e006e9e0 con 0x7fa3e0157f30 2024-07-27T03:09:12.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.580+0000 7fa3d5ffb640 1 -- 172.21.15.120:0/946299686 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7fa3d8085eb0 con 0x7fa3e0157f30 2024-07-27T03:09:12.584 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2024-07-27T03:09:12.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 -- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa3c4077010 msgr2=0x7fa3c4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:12.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa3c4077010 0x7fa3c4079520 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc006fd0 tx=0x7fa3dc006b10 comp rx=0 tx=0).stop 2024-07-27T03:09:12.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 -- 172.21.15.120:0/946299686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3e0157f30 msgr2=0x7fa3e00738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:12.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3e0157f30 0x7fa3e00738d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa3d802aed0 tx=0x7fa3d8033c10 comp rx=0 tx=0).stop 2024-07-27T03:09:12.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 -- 172.21.15.120:0/946299686 shutdown_connections 2024-07-27T03:09:12.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa3c4077010 0x7fa3c4079520 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:12.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3e0157f30 0x7fa3e00738d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:12.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3e0158510 0x7fa3e0073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:12.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 --2- 172.21.15.120:0/946299686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3cc005150 0x7fa3e0157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:12.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 -- 172.21.15.120:0/946299686 >> 172.21.15.120:0/946299686 conn(0x7fa3e00cfd60 msgr2=0x7fa3e0161fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:12.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 -- 172.21.15.120:0/946299686 shutdown_connections 2024-07-27T03:09:12.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.583+0000 7fa3e7850640 1 -- 172.21.15.120:0/946299686 wait complete. 2024-07-27T03:09:12.602 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-07-27T03:09:12.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.722+0000 7fda40fe7640 1 -- 172.21.15.120:0/1643438815 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda28004800 msgr2=0x7fda28004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:12.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.722+0000 7fda40fe7640 1 --2- 172.21.15.120:0/1643438815 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda28004800 0x7fda28004c10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda24001660 tx=0x7fda28005830 comp rx=0 tx=0).stop 2024-07-27T03:09:12.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.722+0000 7fda3ad9d640 1 -- 172.21.15.120:0/1643438815 reap_dead start 2024-07-27T03:09:12.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.722+0000 7fda40fe7640 1 -- 172.21.15.120:0/1643438815 shutdown_connections 2024-07-27T03:09:12.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.722+0000 7fda40fe7640 1 -- 172.21.15.120:0/1643438815 >> 172.21.15.120:0/1643438815 conn(0x7fda3c08d690 msgr2=0x7fda3c09d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:12.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.722+0000 7fda40fe7640 1 -- 172.21.15.120:0/1643438815 shutdown_connections 2024-07-27T03:09:12.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.722+0000 7fda40fe7640 1 -- 172.21.15.120:0/1643438815 wait complete. 2024-07-27T03:09:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.724+0000 7fda40fe7640 1 Processor -- start 2024-07-27T03:09:12.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.724+0000 7fda40fe7640 1 -- start start 2024-07-27T03:09:12.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.725+0000 7fda40fe7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fda28004800 0x7fda3c14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:12.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.725+0000 7fda40fe7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3c1605e0 0x7fda3c14d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:12.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.725+0000 7fda40fe7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda3c1609f0 0x7fda3c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.725+0000 7fda40fe7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c0d10d0 con 0x7fda3c1605e0 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.725+0000 7fda40fe7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c0d3150 con 0x7fda3c1609f0 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.725+0000 7fda40fe7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fda3c0d1250 con 0x7fda28004800 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.725+0000 7fda31d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3c1605e0 0x7fda3c14d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda31d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3c1605e0 0x7fda3c14d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49782/0 (socket says 172.21.15.120:49782) 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda31d9b640 1 -- 172.21.15.120:0/3499252832 learned_addr learned my addr 172.21.15.120:0/3499252832 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda3a59c640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fda28004800 0x7fda3c14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda31d9b640 1 -- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fda28004800 msgr2=0x7fda3c14e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda31d9b640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fda28004800 0x7fda3c14e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda31d9b640 1 -- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda3c1609f0 msgr2=0x7fda3c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda3ad9d640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda3c1609f0 0x7fda3c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda31d9b640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda3c1609f0 0x7fda3c0c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda31d9b640 1 -- 172.21.15.120:0/3499252832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3c15f540 con 0x7fda3c1605e0 2024-07-27T03:09:12.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda31d9b640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3c1605e0 0x7fda3c14d770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda240063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:12.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda337fe640 1 -- 172.21.15.120:0/3499252832 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24038070 con 0x7fda3c1605e0 2024-07-27T03:09:12.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda337fe640 1 -- 172.21.15.120:0/3499252832 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda24003af0 con 0x7fda3c1605e0 2024-07-27T03:09:12.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda40fe7640 1 -- 172.21.15.120:0/3499252832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3c15f820 con 0x7fda3c1605e0 2024-07-27T03:09:12.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda337fe640 1 -- 172.21.15.120:0/3499252832 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24033420 con 0x7fda3c1605e0 2024-07-27T03:09:12.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.726+0000 7fda40fe7640 1 -- 172.21.15.120:0/3499252832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3c15fde0 con 0x7fda3c1605e0 2024-07-27T03:09:12.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.727+0000 7fda40fe7640 1 -- 172.21.15.120:0/3499252832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda3c15f2b0 con 0x7fda3c1605e0 2024-07-27T03:09:12.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.728+0000 7fda337fe640 1 -- 172.21.15.120:0/3499252832 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fda24043020 con 0x7fda3c1605e0 2024-07-27T03:09:12.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.728+0000 7fda337fe640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fda1c077040 0x7fda1c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:12.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.728+0000 7fda337fe640 1 -- 172.21.15.120:0/3499252832 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7fda240b7f50 con 0x7fda3c1605e0 2024-07-27T03:09:12.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.729+0000 7fda3a59c640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fda1c077040 0x7fda1c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:12.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.729+0000 7fda3a59c640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fda1c077040 0x7fda1c079550 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fda2c001010 tx=0x7fda2c0067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:12.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.733+0000 7fda337fe640 1 -- 172.21.15.120:0/3499252832 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fda24081330 con 0x7fda3c1605e0 2024-07-27T03:09:12.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:12.917+0000 7fda40fe7640 1 -- 172.21.15.120:0/3499252832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fda3c0c76f0 con 0x7fda3c1605e0 2024-07-27T03:09:13.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.582+0000 7fda337fe640 1 -- 172.21.15.120:0/3499252832 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7fda3c0c76f0 con 0x7fda3c1605e0 2024-07-27T03:09:13.586 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2024-07-27T03:09:13.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 -- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fda1c077040 msgr2=0x7fda1c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:13.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fda1c077040 0x7fda1c079550 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fda2c001010 tx=0x7fda2c0067a0 comp rx=0 tx=0).stop 2024-07-27T03:09:13.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 -- 172.21.15.120:0/3499252832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3c1605e0 msgr2=0x7fda3c14d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:13.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3c1605e0 0x7fda3c14d770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda240063a0 comp rx=0 tx=0).stop 2024-07-27T03:09:13.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 -- 172.21.15.120:0/3499252832 shutdown_connections 2024-07-27T03:09:13.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fda1c077040 0x7fda1c079550 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda3c1605e0 0x7fda3c14d770 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda3c1609f0 0x7fda3c0c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 --2- 172.21.15.120:0/3499252832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fda28004800 0x7fda3c14e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 -- 172.21.15.120:0/3499252832 >> 172.21.15.120:0/3499252832 conn(0x7fda3c08d690 msgr2=0x7fda3c0cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 -- 172.21.15.120:0/3499252832 shutdown_connections 2024-07-27T03:09:13.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.585+0000 7fda40fe7640 1 -- 172.21.15.120:0/3499252832 wait complete. 2024-07-27T03:09:13.615 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-07-27T03:09:13.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.730+0000 7fb3b356f640 1 -- 172.21.15.120:0/4198773084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0d0f00 msgr2=0x7fb3ac0cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:13.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.730+0000 7fb3b356f640 1 --2- 172.21.15.120:0/4198773084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0d0f00 0x7fb3ac0cebe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0d24d0 tx=0x7fb3a402a8b0 comp rx=0 tx=0).stop 2024-07-27T03:09:13.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.730+0000 7fb3b356f640 1 -- 172.21.15.120:0/4198773084 shutdown_connections 2024-07-27T03:09:13.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.730+0000 7fb3b356f640 1 --2- 172.21.15.120:0/4198773084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0d0f00 0x7fb3ac0cebe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:13.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.730+0000 7fb3b356f640 1 --2- 172.21.15.120:0/4198773084 >> v2:172.21.15.121:3300/0 conn(0x7fb3ac0b2c40 0x7fb3ac0d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:13.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.730+0000 7fb3b356f640 1 -- 172.21.15.120:0/4198773084 >> 172.21.15.120:0/4198773084 conn(0x7fb3ac08d690 msgr2=0x7fb3ac09d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:13.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.730+0000 7fb3b356f640 1 -- 172.21.15.120:0/4198773084 shutdown_connections 2024-07-27T03:09:13.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.730+0000 7fb3b356f640 1 -- 172.21.15.120:0/4198773084 wait complete. 2024-07-27T03:09:13.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.732+0000 7fb3b356f640 1 Processor -- start 2024-07-27T03:09:13.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.732+0000 7fb3b356f640 1 -- start start 2024-07-27T03:09:13.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.733+0000 7fb3b356f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0b2c40 0x7fb3ac0caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:13.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.733+0000 7fb3b356f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3ac0b4740 0x7fb3ac151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:13.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.733+0000 7fb3b356f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3ac0d0f00 0x7fb3ac0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.733+0000 7fb3b356f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac0b33c0 con 0x7fb3ac0b2c40 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.733+0000 7fb3b356f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac0d3100 con 0x7fb3ac0d0f00 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.733+0000 7fb3b356f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb3ac0cf120 con 0x7fb3ac0b4740 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.733+0000 7fb3b130b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0b2c40 0x7fb3ac0caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b130b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0b2c40 0x7fb3ac0caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49796/0 (socket says 172.21.15.120:49796) 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b130b640 1 -- 172.21.15.120:0/3587191178 learned_addr learned my addr 172.21.15.120:0/3587191178 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b1b0c640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3ac0d0f00 0x7fb3ac0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b0b0a640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3ac0b4740 0x7fb3ac151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b130b640 1 -- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3ac0b4740 msgr2=0x7fb3ac151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b130b640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3ac0b4740 0x7fb3ac151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b130b640 1 -- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3ac0d0f00 msgr2=0x7fb3ac0c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b130b640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3ac0d0f00 0x7fb3ac0c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:13.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b130b640 1 -- 172.21.15.120:0/3587191178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac151690 con 0x7fb3ac0b2c40 2024-07-27T03:09:13.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b130b640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0b2c40 0x7fb3ac0caff0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800c3a0 tx=0x7fb3a800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:13.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3a1ffb640 1 -- 172.21.15.120:0/3587191178 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8011790 con 0x7fb3ac0b2c40 2024-07-27T03:09:13.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3a1ffb640 1 -- 172.21.15.120:0/3587191178 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3a8017070 con 0x7fb3ac0b2c40 2024-07-27T03:09:13.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b356f640 1 -- 172.21.15.120:0/3587191178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ac0cbde0 con 0x7fb3ac0b2c40 2024-07-27T03:09:13.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3a1ffb640 1 -- 172.21.15.120:0/3587191178 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8011cc0 con 0x7fb3ac0b2c40 2024-07-27T03:09:13.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.734+0000 7fb3b356f640 1 -- 172.21.15.120:0/3587191178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ac0b7ef0 con 0x7fb3ac0b2c40 2024-07-27T03:09:13.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.735+0000 7fb3b356f640 1 -- 172.21.15.120:0/3587191178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ac0d09c0 con 0x7fb3ac0b2c40 2024-07-27T03:09:13.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.736+0000 7fb3a1ffb640 1 -- 172.21.15.120:0/3587191178 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb3a801c460 con 0x7fb3ac0b2c40 2024-07-27T03:09:13.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.736+0000 7fb3a1ffb640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb390077010 0x7fb390079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:13.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.736+0000 7fb3a1ffb640 1 -- 172.21.15.120:0/3587191178 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7fb3a8098740 con 0x7fb3ac0b2c40 2024-07-27T03:09:13.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.737+0000 7fb3b0b0a640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb390077010 0x7fb390079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:13.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.737+0000 7fb3b0b0a640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb390077010 0x7fb390079520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0d05a0 tx=0x7fb39c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:13.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.741+0000 7fb3a1ffb640 1 -- 172.21.15.120:0/3587191178 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb3ac0d1310 con 0x7fb3ac0b2c40 2024-07-27T03:09:13.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:13.962+0000 7fb3b356f640 1 -- 172.21.15.120:0/3587191178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb3ac0c77f0 con 0x7fb3ac0b2c40 2024-07-27T03:09:14.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.607+0000 7fb3a1ffb640 1 -- 172.21.15.120:0/3587191178 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fb3a80619a0 con 0x7fb3ac0b2c40 2024-07-27T03:09:14.612 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 4 and data pool 5 2024-07-27T03:09:14.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.616+0000 7fb3b356f640 1 -- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb390077010 msgr2=0x7fb390079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:14.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.616+0000 7fb3b356f640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb390077010 0x7fb390079520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0d05a0 tx=0x7fb39c005f90 comp rx=0 tx=0).stop 2024-07-27T03:09:14.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.616+0000 7fb3b356f640 1 -- 172.21.15.120:0/3587191178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0b2c40 msgr2=0x7fb3ac0caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:14.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.616+0000 7fb3b356f640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0b2c40 0x7fb3ac0caff0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800c3a0 tx=0x7fb3a800c860 comp rx=0 tx=0).stop 2024-07-27T03:09:14.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.618+0000 7fb3b356f640 1 -- 172.21.15.120:0/3587191178 shutdown_connections 2024-07-27T03:09:14.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.618+0000 7fb3b356f640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb390077010 0x7fb390079520 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.618+0000 7fb3b356f640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3ac0d0f00 0x7fb3ac0c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.618+0000 7fb3b356f640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3ac0b4740 0x7fb3ac151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.618+0000 7fb3b356f640 1 --2- 172.21.15.120:0/3587191178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3ac0b2c40 0x7fb3ac0caff0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.618+0000 7fb3b356f640 1 -- 172.21.15.120:0/3587191178 >> 172.21.15.120:0/3587191178 conn(0x7fb3ac08d690 msgr2=0x7fb3ac15d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:14.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.619+0000 7fb3b356f640 1 -- 172.21.15.120:0/3587191178 shutdown_connections 2024-07-27T03:09:14.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.622+0000 7fb3b356f640 1 -- 172.21.15.120:0/3587191178 wait complete. 2024-07-27T03:09:14.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:09:14.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.751+0000 7fdfa830d640 1 -- 172.21.15.120:0/1987069221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfa00b5cd0 msgr2=0x7fdfa00b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:14.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.751+0000 7fdfa830d640 1 --2- 172.21.15.120:0/1987069221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfa00b5cd0 0x7fdfa00b60e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009830 tx=0x7fdf9002a510 comp rx=0 tx=0).stop 2024-07-27T03:09:14.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.751+0000 7fdfa830d640 1 -- 172.21.15.120:0/1987069221 shutdown_connections 2024-07-27T03:09:14.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.751+0000 7fdfa830d640 1 --2- 172.21.15.120:0/1987069221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfa00b5cd0 0x7fdfa00b60e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.751+0000 7fdfa830d640 1 --2- 172.21.15.120:0/1987069221 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdfa015c220 0x7fdfa0152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.751+0000 7fdfa830d640 1 -- 172.21.15.120:0/1987069221 >> 172.21.15.120:0/1987069221 conn(0x7fdfa006cba0 msgr2=0x7fdfa006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:14.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.751+0000 7fdfa830d640 1 -- 172.21.15.120:0/1987069221 shutdown_connections 2024-07-27T03:09:14.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.751+0000 7fdfa830d640 1 -- 172.21.15.120:0/1987069221 wait complete. 2024-07-27T03:09:14.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.752+0000 7fdfa830d640 1 Processor -- start 2024-07-27T03:09:14.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.753+0000 7fdfa830d640 1 -- start start 2024-07-27T03:09:14.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa830d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfa00b5cd0 0x7fdfa01f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:14.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa830d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdfa015c220 0x7fdfa014de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:14.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa830d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdfa015ec20 0x7fdfa01470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:14.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa830d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa00cdb40 con 0x7fdfa015ec20 2024-07-27T03:09:14.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa830d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa00cd9c0 con 0x7fdfa00b5cd0 2024-07-27T03:09:14.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa830d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa00cdcc0 con 0x7fdfa015c220 2024-07-27T03:09:14.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa68aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdfa015ec20 0x7fdfa01470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:14.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa68aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdfa015ec20 0x7fdfa01470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49804/0 (socket says 172.21.15.120:49804) 2024-07-27T03:09:14.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa68aa640 1 -- 172.21.15.120:0/1387017045 learned_addr learned my addr 172.21.15.120:0/1387017045 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:14.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa60a9640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfa00b5cd0 0x7fdfa01f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:14.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa58a8640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdfa015c220 0x7fdfa014de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:14.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa68aa640 1 -- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdfa015c220 msgr2=0x7fdfa014de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:14.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa68aa640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdfa015c220 0x7fdfa014de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa68aa640 1 -- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfa00b5cd0 msgr2=0x7fdfa01f6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:14.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa68aa640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfa00b5cd0 0x7fdfa01f6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa68aa640 1 -- 172.21.15.120:0/1387017045 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa014e630 con 0x7fdfa015ec20 2024-07-27T03:09:14.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.754+0000 7fdfa68aa640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdfa015ec20 0x7fdfa01470b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800c6c0 tx=0x7fdf9800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:14.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.755+0000 7fdf96ffd640 1 -- 172.21.15.120:0/1387017045 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf98017070 con 0x7fdfa015ec20 2024-07-27T03:09:14.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.755+0000 7fdf96ffd640 1 -- 172.21.15.120:0/1387017045 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf98003c60 con 0x7fdfa015ec20 2024-07-27T03:09:14.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.755+0000 7fdfa830d640 1 -- 172.21.15.120:0/1387017045 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa014e910 con 0x7fdfa015ec20 2024-07-27T03:09:14.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.755+0000 7fdf96ffd640 1 -- 172.21.15.120:0/1387017045 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf980052d0 con 0x7fdfa015ec20 2024-07-27T03:09:14.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.755+0000 7fdfa830d640 1 -- 172.21.15.120:0/1387017045 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa01f6740 con 0x7fdfa015ec20 2024-07-27T03:09:14.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.756+0000 7fdfa830d640 1 -- 172.21.15.120:0/1387017045 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa00cf360 con 0x7fdfa015ec20 2024-07-27T03:09:14.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.756+0000 7fdf96ffd640 1 -- 172.21.15.120:0/1387017045 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fdf9801a070 con 0x7fdfa015ec20 2024-07-27T03:09:14.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.757+0000 7fdf96ffd640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdf84077010 0x7fdf84079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:14.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.757+0000 7fdf96ffd640 1 -- 172.21.15.120:0/1387017045 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fdf98097e60 con 0x7fdfa015ec20 2024-07-27T03:09:14.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.757+0000 7fdfa60a9640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdf84077010 0x7fdf84079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:14.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.758+0000 7fdfa60a9640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdf84077010 0x7fdf84079520 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009530 tx=0x7fdf9c009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:14.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.761+0000 7fdf96ffd640 1 -- 172.21.15.120:0/1387017045 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fdfa00b6620 con 0x7fdfa015ec20 2024-07-27T03:09:14.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.944+0000 7fdfa830d640 1 -- 172.21.15.120:0/1387017045 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfa014e3c0 con 0x7fdfa015ec20 2024-07-27T03:09:14.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.945+0000 7fdf96ffd640 1 -- 172.21.15.120:0/1387017045 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16706 (secure 0 0 0) 0x7fdf98069340 con 0x7fdfa015ec20 2024-07-27T03:09:14.949 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:14.949 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":32,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:09:13.964291+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:09:12.055060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-07-27T03:09:12.922493+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:09:14.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 -- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdf84077010 msgr2=0x7fdf84079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:14.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdf84077010 0x7fdf84079520 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009530 tx=0x7fdf9c009260 comp rx=0 tx=0).stop 2024-07-27T03:09:14.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 -- 172.21.15.120:0/1387017045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdfa015ec20 msgr2=0x7fdfa01470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:14.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdfa015ec20 0x7fdfa01470b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800c6c0 tx=0x7fdf9800cb80 comp rx=0 tx=0).stop 2024-07-27T03:09:14.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 -- 172.21.15.120:0/1387017045 shutdown_connections 2024-07-27T03:09:14.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdf84077010 0x7fdf84079520 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdfa015ec20 0x7fdfa01470b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdfa015c220 0x7fdfa014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 --2- 172.21.15.120:0/1387017045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfa00b5cd0 0x7fdfa01f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:14.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 -- 172.21.15.120:0/1387017045 >> 172.21.15.120:0/1387017045 conn(0x7fdfa006cba0 msgr2=0x7fdfa015d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:14.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 -- 172.21.15.120:0/1387017045 shutdown_connections 2024-07-27T03:09:14.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:14.947+0000 7fdfa830d640 1 -- 172.21.15.120:0/1387017045 wait complete. 2024-07-27T03:09:14.963 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:09:15.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.073+0000 7ff1cb988640 1 -- 172.21.15.120:0/651007125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1b0004d40 msgr2=0x7ff1b00051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:15.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.073+0000 7ff1cb988640 1 --2- 172.21.15.120:0/651007125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1b0004d40 0x7ff1b00051f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40af930 tx=0x7ff1b0005830 comp rx=0 tx=0).stop 2024-07-27T03:09:15.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.073+0000 7ff1c9f25640 1 -- 172.21.15.120:0/651007125 reap_dead start 2024-07-27T03:09:15.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.073+0000 7ff1cb988640 1 -- 172.21.15.120:0/651007125 shutdown_connections 2024-07-27T03:09:15.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.073+0000 7ff1cb988640 1 -- 172.21.15.120:0/651007125 >> 172.21.15.120:0/651007125 conn(0x7ff1c40b1a10 msgr2=0x7ff1c40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:15.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.073+0000 7ff1cb988640 1 -- 172.21.15.120:0/651007125 shutdown_connections 2024-07-27T03:09:15.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.073+0000 7ff1cb988640 1 -- 172.21.15.120:0/651007125 wait complete. 2024-07-27T03:09:15.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.075+0000 7ff1cb988640 1 Processor -- start 2024-07-27T03:09:15.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.075+0000 7ff1cb988640 1 -- start start 2024-07-27T03:09:15.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.076+0000 7ff1cb988640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1b0004d40 0x7ff1c4140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:15.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.076+0000 7ff1cb988640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1c4153520 0x7ff1c415a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:15.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1cb988640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1c4141d10 0x7ff1c4143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:15.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1cb988640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40b3f90 con 0x7ff1b0004d40 2024-07-27T03:09:15.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1cb988640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40b4f90 con 0x7ff1c4141d10 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1cb988640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c40b4110 con 0x7ff1c4153520 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c9724640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1b0004d40 0x7ff1c4140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c9724640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1b0004d40 0x7ff1c4140420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49828/0 (socket says 172.21.15.120:49828) 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c9724640 1 -- 172.21.15.120:0/4087209725 learned_addr learned my addr 172.21.15.120:0/4087209725 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c8f23640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1c4153520 0x7ff1c415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c9f25640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1c4141d10 0x7ff1c4143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c9724640 1 -- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1c4153520 msgr2=0x7ff1c415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c9724640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1c4153520 0x7ff1c415a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c9724640 1 -- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1c4141d10 msgr2=0x7ff1c4143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c9724640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1c4141d10 0x7ff1c4143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c9724640 1 -- 172.21.15.120:0/4087209725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c4140c70 con 0x7ff1b0004d40 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c9f25640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1c4141d10 0x7ff1c4143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:15.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1c9724640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1b0004d40 0x7ff1c4140420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0006680 tx=0x7ff1c0003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:15.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1b9ffb640 1 -- 172.21.15.120:0/4087209725 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0015070 con 0x7ff1b0004d40 2024-07-27T03:09:15.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1b9ffb640 1 -- 172.21.15.120:0/4087209725 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1c000f960 con 0x7ff1b0004d40 2024-07-27T03:09:15.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1b9ffb640 1 -- 172.21.15.120:0/4087209725 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000fdb0 con 0x7ff1b0004d40 2024-07-27T03:09:15.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.077+0000 7ff1cb988640 1 -- 172.21.15.120:0/4087209725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c4140f50 con 0x7ff1b0004d40 2024-07-27T03:09:15.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.078+0000 7ff1cb988640 1 -- 172.21.15.120:0/4087209725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c4141510 con 0x7ff1b0004d40 2024-07-27T03:09:15.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.079+0000 7ff1cb988640 1 -- 172.21.15.120:0/4087209725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c41555d0 con 0x7ff1b0004d40 2024-07-27T03:09:15.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.079+0000 7ff1b9ffb640 1 -- 172.21.15.120:0/4087209725 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff1c0011430 con 0x7ff1b0004d40 2024-07-27T03:09:15.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.080+0000 7ff1b9ffb640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff1a8077010 0x7ff1a8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:15.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.080+0000 7ff1b9ffb640 1 -- 172.21.15.120:0/4087209725 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff1c00997a0 con 0x7ff1b0004d40 2024-07-27T03:09:15.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.080+0000 7ff1c8f23640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff1a8077010 0x7ff1a8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:15.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.080+0000 7ff1c8f23640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff1a8077010 0x7ff1a8079520 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4154bb0 tx=0x7ff1b4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:15.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.084+0000 7ff1b9ffb640 1 -- 172.21.15.120:0/4087209725 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff1c4074230 con 0x7ff1b0004d40 2024-07-27T03:09:15.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.267+0000 7ff1cb988640 1 -- 172.21.15.120:0/4087209725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1c4154ec0 con 0x7ff1b0004d40 2024-07-27T03:09:15.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.268+0000 7ff1b9ffb640 1 -- 172.21.15.120:0/4087209725 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16706 (secure 0 0 0) 0x7ff1c00629a0 con 0x7ff1b0004d40 2024-07-27T03:09:15.272 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:15.272 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":32,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:09:13.964291+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:09:12.055060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-07-27T03:09:12.922493+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:09:15.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 -- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff1a8077010 msgr2=0x7ff1a8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:15.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff1a8077010 0x7ff1a8079520 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4154bb0 tx=0x7ff1b4005f90 comp rx=0 tx=0).stop 2024-07-27T03:09:15.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 -- 172.21.15.120:0/4087209725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1b0004d40 msgr2=0x7ff1c4140420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:15.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1b0004d40 0x7ff1c4140420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0006680 tx=0x7ff1c0003a80 comp rx=0 tx=0).stop 2024-07-27T03:09:15.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 -- 172.21.15.120:0/4087209725 shutdown_connections 2024-07-27T03:09:15.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff1a8077010 0x7ff1a8079520 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:15.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1c4141d10 0x7ff1c4143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:15.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff1c4153520 0x7ff1c415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:15.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 --2- 172.21.15.120:0/4087209725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1b0004d40 0x7ff1c4140420 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:15.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 -- 172.21.15.120:0/4087209725 >> 172.21.15.120:0/4087209725 conn(0x7ff1c40b1a10 msgr2=0x7ff1c4072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:15.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 -- 172.21.15.120:0/4087209725 shutdown_connections 2024-07-27T03:09:15.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.271+0000 7ff1cb988640 1 -- 172.21.15.120:0/4087209725 wait complete. 2024-07-27T03:09:15.286 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-07-27T03:09:15.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.398+0000 7f05568eb640 1 -- 172.21.15.120:0/930012637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05500b4740 msgr2=0x7f05500b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:15.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.398+0000 7f05568eb640 1 --2- 172.21.15.120:0/930012637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05500b4740 0x7f05500b2c40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f05500b9c10 tx=0x7f054002a530 comp rx=0 tx=0).stop 2024-07-27T03:09:15.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.398+0000 7f05568eb640 1 -- 172.21.15.120:0/930012637 shutdown_connections 2024-07-27T03:09:15.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.398+0000 7f05568eb640 1 --2- 172.21.15.120:0/930012637 >> v2:172.21.15.121:3300/0 conn(0x7f05500d27e0 0x7f05500d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:15.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.398+0000 7f05568eb640 1 --2- 172.21.15.120:0/930012637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05500b4740 0x7f05500b2c40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:15.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.398+0000 7f05568eb640 1 -- 172.21.15.120:0/930012637 >> 172.21.15.120:0/930012637 conn(0x7f055008d690 msgr2=0x7f055009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:15.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.398+0000 7f05568eb640 1 -- 172.21.15.120:0/930012637 shutdown_connections 2024-07-27T03:09:15.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.398+0000 7f05568eb640 1 -- 172.21.15.120:0/930012637 wait complete. 2024-07-27T03:09:15.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.400+0000 7f05568eb640 1 Processor -- start 2024-07-27T03:09:15.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.400+0000 7f05568eb640 1 -- start start 2024-07-27T03:09:15.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f05568eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05500b4740 0x7f05500cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:15.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f05568eb640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05500d09c0 0x7f05501f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:15.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f05568eb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05500d27e0 0x7f05501f9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f05568eb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f05500cef70 con 0x7f05500b4740 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f05568eb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f05500cedf0 con 0x7f05500d27e0 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f05568eb640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f05500cf0f0 con 0x7f05500d09c0 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05500b4740 0x7f05500cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05500b4740 0x7f05500cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49842/0 (socket says 172.21.15.120:49842) 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054ffff640 1 -- 172.21.15.120:0/1486500099 learned_addr learned my addr 172.21.15.120:0/1486500099 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f0554e88640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05500d27e0 0x7f05501f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054f7fe640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05500d09c0 0x7f05501f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054ffff640 1 -- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05500d09c0 msgr2=0x7f05501f8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054ffff640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05500d09c0 0x7f05501f8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054ffff640 1 -- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05500d27e0 msgr2=0x7f05501f9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:15.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054ffff640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05500d27e0 0x7f05501f9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054ffff640 1 -- 172.21.15.120:0/1486500099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05500cc960 con 0x7f05500b4740 2024-07-27T03:09:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054ffff640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05500b4740 0x7f05500cd010 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0540009780 tx=0x7f0540033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054cff9640 1 -- 172.21.15.120:0/1486500099 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540031d60 con 0x7f05500b4740 2024-07-27T03:09:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054cff9640 1 -- 172.21.15.120:0/1486500099 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0540033e10 con 0x7f05500b4740 2024-07-27T03:09:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.402+0000 7f054cff9640 1 -- 172.21.15.120:0/1486500099 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540005260 con 0x7f05500b4740 2024-07-27T03:09:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.403+0000 7f05568eb640 1 -- 172.21.15.120:0/1486500099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05500cbba0 con 0x7f05500b4740 2024-07-27T03:09:15.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.403+0000 7f05568eb640 1 -- 172.21.15.120:0/1486500099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05500cc160 con 0x7f05500b4740 2024-07-27T03:09:15.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.404+0000 7f05568eb640 1 -- 172.21.15.120:0/1486500099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05500d2bf0 con 0x7f05500b4740 2024-07-27T03:09:15.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.404+0000 7f054cff9640 1 -- 172.21.15.120:0/1486500099 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0540005400 con 0x7f05500b4740 2024-07-27T03:09:15.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.405+0000 7f054cff9640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f053c077040 0x7f053c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:15.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.405+0000 7f054cff9640 1 -- 172.21.15.120:0/1486500099 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f05400b9a60 con 0x7f05500b4740 2024-07-27T03:09:15.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.405+0000 7f054f7fe640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f053c077040 0x7f053c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:15.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.406+0000 7f054f7fe640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f053c077040 0x7f053c079550 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0544005fd0 tx=0x7f0544005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:15.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.409+0000 7f054cff9640 1 -- 172.21.15.120:0/1486500099 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f054003f030 con 0x7f05500b4740 2024-07-27T03:09:15.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:15.634+0000 7f05568eb640 1 -- 172.21.15.120:0/1486500099 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f055008e050 con 0x7f05500b4740 2024-07-27T03:09:16.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.629+0000 7f054cff9640 1 -- 172.21.15.120:0/1486500099 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f0540082cf0 con 0x7f05500b4740 2024-07-27T03:09:16.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 -- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f053c077040 msgr2=0x7f053c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:16.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f053c077040 0x7f053c079550 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0544005fd0 tx=0x7f0544005850 comp rx=0 tx=0).stop 2024-07-27T03:09:16.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 -- 172.21.15.120:0/1486500099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05500b4740 msgr2=0x7f05500cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:16.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05500b4740 0x7f05500cd010 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0540009780 tx=0x7f0540033c20 comp rx=0 tx=0).stop 2024-07-27T03:09:16.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 -- 172.21.15.120:0/1486500099 shutdown_connections 2024-07-27T03:09:16.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f053c077040 0x7f053c079550 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:16.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05500d27e0 0x7f05501f9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:16.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05500d09c0 0x7f05501f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:16.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 --2- 172.21.15.120:0/1486500099 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05500b4740 0x7f05500cd010 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:16.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 -- 172.21.15.120:0/1486500099 >> 172.21.15.120:0/1486500099 conn(0x7f055008d690 msgr2=0x7f055006ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:16.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 -- 172.21.15.120:0/1486500099 shutdown_connections 2024-07-27T03:09:16.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.632+0000 7f05568eb640 1 -- 172.21.15.120:0/1486500099 wait complete. 2024-07-27T03:09:16.649 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-07-27T03:09:16.649 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-07-27T03:09:16.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.768+0000 7f894335d640 1 -- 172.21.15.120:0/1915199832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89280040b0 msgr2=0x7f8928004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:16.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.768+0000 7f894335d640 1 --2- 172.21.15.120:0/1915199832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89280040b0 0x7f8928004800 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f893c0af550 tx=0x7f8928005830 comp rx=0 tx=0).stop 2024-07-27T03:09:16.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.768+0000 7f89418fa640 1 -- 172.21.15.120:0/1915199832 reap_dead start 2024-07-27T03:09:16.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.768+0000 7f894335d640 1 -- 172.21.15.120:0/1915199832 shutdown_connections 2024-07-27T03:09:16.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.768+0000 7f894335d640 1 -- 172.21.15.120:0/1915199832 >> 172.21.15.120:0/1915199832 conn(0x7f893c0b1a10 msgr2=0x7f893c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:16.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.768+0000 7f894335d640 1 -- 172.21.15.120:0/1915199832 shutdown_connections 2024-07-27T03:09:16.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.768+0000 7f894335d640 1 -- 172.21.15.120:0/1915199832 wait complete. 2024-07-27T03:09:16.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.770+0000 7f894335d640 1 Processor -- start 2024-07-27T03:09:16.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.770+0000 7f894335d640 1 -- start start 2024-07-27T03:09:16.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.771+0000 7f894335d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89280040b0 0x7f893c152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:16.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.771+0000 7f894335d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f893c15ac40 0x7f893c159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:16.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.771+0000 7f894335d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f893c0cfc80 0x7f893c0d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:16.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.771+0000 7f894335d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f893c06e270 con 0x7f893c15ac40 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.771+0000 7f894335d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f893c0aeca0 con 0x7f89280040b0 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.771+0000 7f894335d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f893c06e3f0 con 0x7f893c0cfc80 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.771+0000 7f89408f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f893c15ac40 0x7f893c159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.771+0000 7f89408f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f893c15ac40 0x7f893c159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49866/0 (socket says 172.21.15.120:49866) 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.771+0000 7f89408f8640 1 -- 172.21.15.120:0/1176303498 learned_addr learned my addr 172.21.15.120:0/1176303498 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f89410f9640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89280040b0 0x7f893c152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f89418fa640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f893c0cfc80 0x7f893c0d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f89408f8640 1 -- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f893c0cfc80 msgr2=0x7f893c0d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f89408f8640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f893c0cfc80 0x7f893c0d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f89408f8640 1 -- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89280040b0 msgr2=0x7f893c152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f89408f8640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89280040b0 0x7f893c152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f89408f8640 1 -- 172.21.15.120:0/1176303498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c158de0 con 0x7f893c15ac40 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f89410f9640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89280040b0 0x7f893c152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:16.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f89408f8640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f893c15ac40 0x7f893c159570 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c350 tx=0x7f892c0064a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:16.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f8931ffb640 1 -- 172.21.15.120:0/1176303498 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c003a00 con 0x7f893c15ac40 2024-07-27T03:09:16.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f8931ffb640 1 -- 172.21.15.120:0/1176303498 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f892c003c90 con 0x7f893c15ac40 2024-07-27T03:09:16.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f894335d640 1 -- 172.21.15.120:0/1176303498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893c0d05d0 con 0x7f893c15ac40 2024-07-27T03:09:16.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f8931ffb640 1 -- 172.21.15.120:0/1176303498 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c02e6e0 con 0x7f893c15ac40 2024-07-27T03:09:16.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.772+0000 7f894335d640 1 -- 172.21.15.120:0/1176303498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f893c1f3200 con 0x7f893c15ac40 2024-07-27T03:09:16.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.773+0000 7f894335d640 1 -- 172.21.15.120:0/1176303498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f893c15f4f0 con 0x7f893c15ac40 2024-07-27T03:09:16.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.774+0000 7f8931ffb640 1 -- 172.21.15.120:0/1176303498 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f892c035020 con 0x7f893c15ac40 2024-07-27T03:09:16.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.775+0000 7f8931ffb640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8920077010 0x7f8920079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:16.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.775+0000 7f8931ffb640 1 -- 172.21.15.120:0/1176303498 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f892c0b9660 con 0x7f893c15ac40 2024-07-27T03:09:16.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.775+0000 7f89410f9640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8920077010 0x7f8920079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:16.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.775+0000 7f89410f9640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8920077010 0x7f8920079520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f893c0703b0 tx=0x7f893800b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:16.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.778+0000 7f8931ffb640 1 -- 172.21.15.120:0/1176303498 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f893c15f4f0 con 0x7f893c15ac40 2024-07-27T03:09:16.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:16.996+0000 7f894335d640 1 -- 172.21.15.120:0/1176303498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f893c0735f0 con 0x7f893c15ac40 2024-07-27T03:09:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.633+0000 7f8931ffb640 1 -- 172.21.15.120:0/1176303498 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f892c047030 con 0x7f893c15ac40 2024-07-27T03:09:17.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 -- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8920077010 msgr2=0x7f8920079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:17.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8920077010 0x7f8920079520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f893c0703b0 tx=0x7f893800b260 comp rx=0 tx=0).stop 2024-07-27T03:09:17.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 -- 172.21.15.120:0/1176303498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f893c15ac40 msgr2=0x7f893c159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:17.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f893c15ac40 0x7f893c159570 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c350 tx=0x7f892c0064a0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 -- 172.21.15.120:0/1176303498 shutdown_connections 2024-07-27T03:09:17.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8920077010 0x7f8920079520 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f893c15ac40 0x7f893c159570 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f893c0cfc80 0x7f893c0d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 --2- 172.21.15.120:0/1176303498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89280040b0 0x7f893c152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 -- 172.21.15.120:0/1176303498 >> 172.21.15.120:0/1176303498 conn(0x7f893c0b1a10 msgr2=0x7f893c0b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:17.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 -- 172.21.15.120:0/1176303498 shutdown_connections 2024-07-27T03:09:17.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.635+0000 7f894335d640 1 -- 172.21.15.120:0/1176303498 wait complete. 2024-07-27T03:09:17.651 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-07-27T03:09:17.651 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:17.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.762+0000 7fc85754e640 1 -- 172.21.15.120:0/3427337468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc85015be60 msgr2=0x7fc8500ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:17.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.762+0000 7fc85754e640 1 --2- 172.21.15.120:0/3427337468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc85015be60 0x7fc8500ceed0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc8500710f0 tx=0x7fc84c02a5f0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.762+0000 7fc85754e640 1 -- 172.21.15.120:0/3427337468 shutdown_connections 2024-07-27T03:09:17.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.762+0000 7fc85754e640 1 --2- 172.21.15.120:0/3427337468 >> v2:172.21.15.121:3300/0 conn(0x7fc8501660c0 0x7fc8501684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.762+0000 7fc85754e640 1 --2- 172.21.15.120:0/3427337468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc85015be60 0x7fc8500ceed0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.762+0000 7fc85754e640 1 -- 172.21.15.120:0/3427337468 >> 172.21.15.120:0/3427337468 conn(0x7fc8500d01f0 msgr2=0x7fc8500d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:17.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.763+0000 7fc85754e640 1 -- 172.21.15.120:0/3427337468 shutdown_connections 2024-07-27T03:09:17.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.763+0000 7fc85754e640 1 -- 172.21.15.120:0/3427337468 wait complete. 2024-07-27T03:09:17.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.764+0000 7fc85754e640 1 Processor -- start 2024-07-27T03:09:17.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.764+0000 7fc85754e640 1 -- start start 2024-07-27T03:09:17.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc85754e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc85015be60 0x7fc850151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:17.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc85754e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc850161f50 0x7fc850152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc85754e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8501660c0 0x7fc8501f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc85754e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc8500cf620 con 0x7fc8501660c0 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc85754e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc850168a20 con 0x7fc850161f50 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc85754e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc850168ba0 con 0x7fc85015be60 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc855aeb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8501660c0 0x7fc8501f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc855aeb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8501660c0 0x7fc8501f5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49886/0 (socket says 172.21.15.120:49886) 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc855aeb640 1 -- 172.21.15.120:0/1052293037 learned_addr learned my addr 172.21.15.120:0/1052293037 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc8552ea640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc85015be60 0x7fc850151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc854ae9640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc850161f50 0x7fc850152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc855aeb640 1 -- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc85015be60 msgr2=0x7fc850151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc855aeb640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc85015be60 0x7fc850151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc855aeb640 1 -- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc850161f50 msgr2=0x7fc850152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:17.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc855aeb640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc850161f50 0x7fc850152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc855aeb640 1 -- 172.21.15.120:0/1052293037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8501516d0 con 0x7fc8501660c0 2024-07-27T03:09:17.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc855aeb640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8501660c0 0x7fc8501f5790 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc84800cad0 tx=0x7fc84800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:17.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc845ffb640 1 -- 172.21.15.120:0/1052293037 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84800ae20 con 0x7fc8501660c0 2024-07-27T03:09:17.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc845ffb640 1 -- 172.21.15.120:0/1052293037 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc84800f450 con 0x7fc8501660c0 2024-07-27T03:09:17.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc85754e640 1 -- 172.21.15.120:0/1052293037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc850153340 con 0x7fc8501660c0 2024-07-27T03:09:17.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.766+0000 7fc845ffb640 1 -- 172.21.15.120:0/1052293037 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84800f8c0 con 0x7fc8501660c0 2024-07-27T03:09:17.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.767+0000 7fc85754e640 1 -- 172.21.15.120:0/1052293037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc850153900 con 0x7fc8501660c0 2024-07-27T03:09:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.768+0000 7fc85754e640 1 -- 172.21.15.120:0/1052293037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8500af7b0 con 0x7fc8501660c0 2024-07-27T03:09:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.768+0000 7fc845ffb640 1 -- 172.21.15.120:0/1052293037 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc84800fa60 con 0x7fc8501660c0 2024-07-27T03:09:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.768+0000 7fc845ffb640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc834077040 0x7fc834079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.769+0000 7fc845ffb640 1 -- 172.21.15.120:0/1052293037 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc848099260 con 0x7fc8501660c0 2024-07-27T03:09:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.769+0000 7fc8552ea640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc834077040 0x7fc834079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:17.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.769+0000 7fc8552ea640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc834077040 0x7fc834079550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc84c034000 tx=0x7fc84c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:17.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.773+0000 7fc845ffb640 1 -- 172.21.15.120:0/1052293037 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc848014030 con 0x7fc8501660c0 2024-07-27T03:09:17.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.990+0000 7fc85754e640 1 -- 172.21.15.120:0/1052293037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8501530d0 con 0x7fc8501660c0 2024-07-27T03:09:17.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.990+0000 7fc845ffb640 1 -- 172.21.15.120:0/1052293037 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5232 (secure 0 0 0) 0x7fc848061e10 con 0x7fc8501660c0 2024-07-27T03:09:17.994 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:17.994 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"btime":"2024-07-27T03:09:17:631494+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2961373787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2961373787},{"type":"v1","addr":"172.21.15.121:6836","nonce":2961373787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3538993507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3538993507},{"type":"v1","addr":"172.21.15.121:6837","nonce":3538993507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/503930696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":503930696},{"type":"v1","addr":"172.21.15.120:6834","nonce":503930696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:09:13.964247+0000","modified":"2024-07-27T03:09:16.998522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4860":{"gid":4860,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/1949887551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":1949887551},{"type":"v1","addr":"172.21.15.120:6835","nonce":1949887551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4860,"qdb_cluster":[4860]},"id":2}]} 2024-07-27T03:09:17.994 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 17 2024-07-27T03:09:17.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 -- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc834077040 msgr2=0x7fc834079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:17.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc834077040 0x7fc834079550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc84c034000 tx=0x7fc84c004730 comp rx=0 tx=0).stop 2024-07-27T03:09:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 -- 172.21.15.120:0/1052293037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8501660c0 msgr2=0x7fc8501f5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8501660c0 0x7fc8501f5790 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc84800cad0 tx=0x7fc84800cf90 comp rx=0 tx=0).stop 2024-07-27T03:09:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 -- 172.21.15.120:0/1052293037 shutdown_connections 2024-07-27T03:09:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc834077040 0x7fc834079550 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8501660c0 0x7fc8501f5790 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc850161f50 0x7fc850152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 --2- 172.21.15.120:0/1052293037 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc85015be60 0x7fc850151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 -- 172.21.15.120:0/1052293037 >> 172.21.15.120:0/1052293037 conn(0x7fc8500d01f0 msgr2=0x7fc8500afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 -- 172.21.15.120:0/1052293037 shutdown_connections 2024-07-27T03:09:17.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:17.993+0000 7fc85754e640 1 -- 172.21.15.120:0/1052293037 wait complete. 2024-07-27T03:09:18.010 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:09:18.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.119+0000 7f7110326640 1 -- 172.21.15.120:0/716408595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7108071cf0 msgr2=0x7f7108158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.119+0000 7f7110326640 1 --2- 172.21.15.120:0/716408595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7108071cf0 0x7f7108158da0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7108072230 tx=0x7f70f802a870 comp rx=0 tx=0).stop 2024-07-27T03:09:18.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.119+0000 7f7110326640 1 -- 172.21.15.120:0/716408595 shutdown_connections 2024-07-27T03:09:18.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.119+0000 7f7110326640 1 --2- 172.21.15.120:0/716408595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7108071cf0 0x7f7108158da0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.119+0000 7f7110326640 1 --2- 172.21.15.120:0/716408595 >> v2:172.21.15.121:3300/0 conn(0x7f710815c500 0x7f7108074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.119+0000 7f7110326640 1 -- 172.21.15.120:0/716408595 >> 172.21.15.120:0/716408595 conn(0x7f71080d0f00 msgr2=0x7f71080d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:18.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.119+0000 7f7110326640 1 -- 172.21.15.120:0/716408595 shutdown_connections 2024-07-27T03:09:18.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.119+0000 7f7110326640 1 -- 172.21.15.120:0/716408595 wait complete. 2024-07-27T03:09:18.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.121+0000 7f7110326640 1 Processor -- start 2024-07-27T03:09:18.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.121+0000 7f7110326640 1 -- start start 2024-07-27T03:09:18.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f7110326640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71080b4d30 0x7f71081f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f7110326640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f710815c500 0x7f7108142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f7110326640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7108145ff0 0x7f710806c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f7110326640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7108070380 con 0x7f71080b4d30 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f7110326640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7108070200 con 0x7f7108145ff0 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f7110326640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7108070500 con 0x7f710815c500 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f710e0c2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71080b4d30 0x7f71081f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f710e0c2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71080b4d30 0x7f71081f6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49906/0 (socket says 172.21.15.120:49906) 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f710e0c2640 1 -- 172.21.15.120:0/1486515775 learned_addr learned my addr 172.21.15.120:0/1486515775 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f710e8c3640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7108145ff0 0x7f710806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f710d8c1640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f710815c500 0x7f7108142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f710e0c2640 1 -- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f710815c500 msgr2=0x7f7108142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f710e0c2640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f710815c500 0x7f7108142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f710e0c2640 1 -- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7108145ff0 msgr2=0x7f710806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f710e0c2640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7108145ff0 0x7f710806c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.122+0000 7f710e0c2640 1 -- 172.21.15.120:0/1486515775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71081f6410 con 0x7f71080b4d30 2024-07-27T03:09:18.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.123+0000 7f710e0c2640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71080b4d30 0x7f71081f6e80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f710000d770 tx=0x7f710000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:18.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.123+0000 7f7106ffd640 1 -- 172.21.15.120:0/1486515775 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100017070 con 0x7f71080b4d30 2024-07-27T03:09:18.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.123+0000 7f7106ffd640 1 -- 172.21.15.120:0/1486515775 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7100009d20 con 0x7f71080b4d30 2024-07-27T03:09:18.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.123+0000 7f7110326640 1 -- 172.21.15.120:0/1486515775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71081e64a0 con 0x7f71080b4d30 2024-07-27T03:09:18.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.123+0000 7f7106ffd640 1 -- 172.21.15.120:0/1486515775 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71000106c0 con 0x7f71080b4d30 2024-07-27T03:09:18.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.123+0000 7f7110326640 1 -- 172.21.15.120:0/1486515775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71081f6680 con 0x7f71080b4d30 2024-07-27T03:09:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.124+0000 7f7110326640 1 -- 172.21.15.120:0/1486515775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7108070a20 con 0x7f71080b4d30 2024-07-27T03:09:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.125+0000 7f7106ffd640 1 -- 172.21.15.120:0/1486515775 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f710001a070 con 0x7f71080b4d30 2024-07-27T03:09:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.125+0000 7f7106ffd640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f70f4077010 0x7f70f4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.125+0000 7f7106ffd640 1 -- 172.21.15.120:0/1486515775 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7100098ab0 con 0x7f71080b4d30 2024-07-27T03:09:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.125+0000 7f710d8c1640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f70f4077010 0x7f70f4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.126+0000 7f710d8c1640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f70f4077010 0x7f70f4079520 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0013f0 tx=0x7f70fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:18.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.129+0000 7f7106ffd640 1 -- 172.21.15.120:0/1486515775 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f7100061cb0 con 0x7f71080b4d30 2024-07-27T03:09:18.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.313+0000 7f7110326640 1 -- 172.21.15.120:0/1486515775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f710815ccc0 con 0x7f71080b4d30 2024-07-27T03:09:18.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.314+0000 7f7106ffd640 1 -- 172.21.15.120:0/1486515775 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16693 (secure 0 0 0) 0x7f71000615b0 con 0x7f71080b4d30 2024-07-27T03:09:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:18.318 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":33,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:09:15.605018+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:09:12.055060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-07-27T03:09:12.922493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 -- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f70f4077010 msgr2=0x7f70f4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f70f4077010 0x7f70f4079520 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0013f0 tx=0x7f70fc009040 comp rx=0 tx=0).stop 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 -- 172.21.15.120:0/1486515775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71080b4d30 msgr2=0x7f71081f6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71080b4d30 0x7f71081f6e80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f710000d770 tx=0x7f710000dc30 comp rx=0 tx=0).stop 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 -- 172.21.15.120:0/1486515775 shutdown_connections 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f70f4077010 0x7f70f4079520 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7108145ff0 0x7f710806c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f710815c500 0x7f7108142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 --2- 172.21.15.120:0/1486515775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71080b4d30 0x7f71081f6e80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 -- 172.21.15.120:0/1486515775 >> 172.21.15.120:0/1486515775 conn(0x7f71080d0f00 msgr2=0x7f7108070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 -- 172.21.15.120:0/1486515775 shutdown_connections 2024-07-27T03:09:18.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.317+0000 7f7110326640 1 -- 172.21.15.120:0/1486515775 wait complete. 2024-07-27T03:09:18.332 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-27T03:09:18.332 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:09:18.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.442+0000 7f6d41c8c640 1 -- 172.21.15.120:0/2944088878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d3c0b6210 msgr2=0x7f6d3c15c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.442+0000 7f6d41c8c640 1 --2- 172.21.15.120:0/2944088878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d3c0b6210 0x7f6d3c15c740 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0cd1c0 tx=0x7f6d3402a820 comp rx=0 tx=0).stop 2024-07-27T03:09:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.442+0000 7f6d41c8c640 1 -- 172.21.15.120:0/2944088878 shutdown_connections 2024-07-27T03:09:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.442+0000 7f6d41c8c640 1 --2- 172.21.15.120:0/2944088878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d3c0b6210 0x7f6d3c15c740 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.442+0000 7f6d41c8c640 1 --2- 172.21.15.120:0/2944088878 >> v2:172.21.15.121:3300/0 conn(0x7f6d3c153200 0x7f6d3c0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.442+0000 7f6d41c8c640 1 -- 172.21.15.120:0/2944088878 >> 172.21.15.120:0/2944088878 conn(0x7f6d3c06cba0 msgr2=0x7f6d3c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.442+0000 7f6d41c8c640 1 -- 172.21.15.120:0/2944088878 shutdown_connections 2024-07-27T03:09:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.442+0000 7f6d41c8c640 1 -- 172.21.15.120:0/2944088878 wait complete. 2024-07-27T03:09:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.444+0000 7f6d41c8c640 1 Processor -- start 2024-07-27T03:09:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.444+0000 7f6d41c8c640 1 -- start start 2024-07-27T03:09:18.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d41c8c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d3c0b6210 0x7f6d3c1f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d41c8c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d3c153200 0x7f6d3c15d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d41c8c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d3c160940 0x7f6d3c1f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d41c8c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c15ce00 con 0x7f6d3c0b6210 2024-07-27T03:09:18.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d41c8c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c15cc80 con 0x7f6d3c153200 2024-07-27T03:09:18.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d41c8c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6d3c15cf80 con 0x7f6d3c160940 2024-07-27T03:09:18.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d3b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d3c0b6210 0x7f6d3c1f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d3b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d3c0b6210 0x7f6d3c1f5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49928/0 (socket says 172.21.15.120:49928) 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d3b7fe640 1 -- 172.21.15.120:0/4123910190 learned_addr learned my addr 172.21.15.120:0/4123910190 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d3affd640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d3c153200 0x7f6d3c15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d3bfff640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d3c160940 0x7f6d3c1f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d3b7fe640 1 -- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d3c160940 msgr2=0x7f6d3c1f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d3b7fe640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d3c160940 0x7f6d3c1f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d3b7fe640 1 -- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d3c153200 msgr2=0x7f6d3c15d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.445+0000 7f6d3b7fe640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d3c153200 0x7f6d3c15d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.446+0000 7f6d3b7fe640 1 -- 172.21.15.120:0/4123910190 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3c15e490 con 0x7f6d3c0b6210 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.446+0000 7f6d3b7fe640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d3c0b6210 0x7f6d3c1f5bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00c3f0 tx=0x7f6d2c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.446+0000 7f6d23fff640 1 -- 172.21.15.120:0/4123910190 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c017070 con 0x7f6d3c0b6210 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.446+0000 7f6d23fff640 1 -- 172.21.15.120:0/4123910190 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d2c0035f0 con 0x7f6d3c0b6210 2024-07-27T03:09:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.446+0000 7f6d41c8c640 1 -- 172.21.15.120:0/4123910190 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3c15e770 con 0x7f6d3c0b6210 2024-07-27T03:09:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.446+0000 7f6d23fff640 1 -- 172.21.15.120:0/4123910190 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c003a40 con 0x7f6d3c0b6210 2024-07-27T03:09:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.446+0000 7f6d41c8c640 1 -- 172.21.15.120:0/4123910190 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3c15ed30 con 0x7f6d3c0b6210 2024-07-27T03:09:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.447+0000 7f6d41c8c640 1 -- 172.21.15.120:0/4123910190 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3c15d4a0 con 0x7f6d3c0b6210 2024-07-27T03:09:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.448+0000 7f6d23fff640 1 -- 172.21.15.120:0/4123910190 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6d2c01a070 con 0x7f6d3c0b6210 2024-07-27T03:09:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.448+0000 7f6d23fff640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d28077040 0x7f6d28079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.448+0000 7f6d23fff640 1 -- 172.21.15.120:0/4123910190 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6d2c097cc0 con 0x7f6d3c0b6210 2024-07-27T03:09:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.448+0000 7f6d3affd640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d28077040 0x7f6d28079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.449+0000 7f6d3affd640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d28077040 0x7f6d28079550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6d30005fd0 tx=0x7f6d30005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:18.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.453+0000 7f6d23fff640 1 -- 172.21.15.120:0/4123910190 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6d3c0b6620 con 0x7f6d3c0b6210 2024-07-27T03:09:18.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.633+0000 7f6d41c8c640 1 -- 172.21.15.120:0/4123910190 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d3c069c10 con 0x7f6d28077040 2024-07-27T03:09:18.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.638+0000 7f6d23fff640 1 -- 172.21.15.120:0/4123910190 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244359 (secure 0 0 0) 0x7f6d3000fad0 con 0x7f6d28077040 2024-07-27T03:09:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:18.646 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:09:18.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 -- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d28077040 msgr2=0x7f6d28079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d28077040 0x7f6d28079550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6d30005fd0 tx=0x7f6d30005850 comp rx=0 tx=0).stop 2024-07-27T03:09:18.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 -- 172.21.15.120:0/4123910190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d3c0b6210 msgr2=0x7f6d3c1f5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d3c0b6210 0x7f6d3c1f5bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00c3f0 tx=0x7f6d2c00c8b0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 -- 172.21.15.120:0/4123910190 shutdown_connections 2024-07-27T03:09:18.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d28077040 0x7f6d28079550 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d3c160940 0x7f6d3c1f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d3c153200 0x7f6d3c15d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 --2- 172.21.15.120:0/4123910190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d3c0b6210 0x7f6d3c1f5bb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 -- 172.21.15.120:0/4123910190 >> 172.21.15.120:0/4123910190 conn(0x7f6d3c06cba0 msgr2=0x7f6d3c0b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:18.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 -- 172.21.15.120:0/4123910190 shutdown_connections 2024-07-27T03:09:18.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.641+0000 7f6d41c8c640 1 -- 172.21.15.120:0/4123910190 wait complete. 2024-07-27T03:09:18.656 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-07-27T03:09:18.541994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591076,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224176,"kb_used_data":3836,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750544,"statfs":{"total":773094113280,"available":772864557056,"internally_reserved":0,"allocated":3928064,"data_stored":2198570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.959394"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660642+0000","last_change":"2024-07-27T03:09:14.626088+0000","last_active":"2024-07-27T03:09:15.660642+0000","last_peered":"2024-07-27T03:09:15.660642+0000","last_clean":"2024-07-27T03:09:15.660642+0000","last_became_active":"2024-07-27T03:09:14.624863+0000","last_became_peered":"2024-07-27T03:09:14.624863+0000","last_unstale":"2024-07-27T03:09:15.660642+0000","last_undegraded":"2024-07-27T03:09:15.660642+0000","last_fullsized":"2024-07-27T03:09:15.660642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:06.375815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661489+0000","last_change":"2024-07-27T03:09:14.618632+0000","last_active":"2024-07-27T03:09:15.661489+0000","last_peered":"2024-07-27T03:09:15.661489+0000","last_clean":"2024-07-27T03:09:15.661489+0000","last_became_active":"2024-07-27T03:09:14.618330+0000","last_became_peered":"2024-07-27T03:09:14.618330+0000","last_unstale":"2024-07-27T03:09:15.661489+0000","last_undegraded":"2024-07-27T03:09:15.661489+0000","last_fullsized":"2024-07-27T03:09:15.661489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:23:12.555273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610969+0000","last_change":"2024-07-27T03:09:14.616445+0000","last_active":"2024-07-27T03:09:15.610969+0000","last_peered":"2024-07-27T03:09:15.610969+0000","last_clean":"2024-07-27T03:09:15.610969+0000","last_became_active":"2024-07-27T03:09:14.615819+0000","last_became_peered":"2024-07-27T03:09:14.615819+0000","last_unstale":"2024-07-27T03:09:15.610969+0000","last_undegraded":"2024-07-27T03:09:15.610969+0000","last_fullsized":"2024-07-27T03:09:15.610969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:56.250073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660793+0000","last_change":"2024-07-27T03:09:14.619141+0000","last_active":"2024-07-27T03:09:15.660793+0000","last_peered":"2024-07-27T03:09:15.660793+0000","last_clean":"2024-07-27T03:09:15.660793+0000","last_became_active":"2024-07-27T03:09:14.618846+0000","last_became_peered":"2024-07-27T03:09:14.618846+0000","last_unstale":"2024-07-27T03:09:15.660793+0000","last_undegraded":"2024-07-27T03:09:15.660793+0000","last_fullsized":"2024-07-27T03:09:15.660793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:05.563749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610653+0000","last_change":"2024-07-27T03:09:14.613012+0000","last_active":"2024-07-27T03:09:15.610653+0000","last_peered":"2024-07-27T03:09:15.610653+0000","last_clean":"2024-07-27T03:09:15.610653+0000","last_became_active":"2024-07-27T03:09:14.612684+0000","last_became_peered":"2024-07-27T03:09:14.612684+0000","last_unstale":"2024-07-27T03:09:15.610653+0000","last_undegraded":"2024-07-27T03:09:15.610653+0000","last_fullsized":"2024-07-27T03:09:15.610653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:07:53.511397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610406+0000","last_change":"2024-07-27T03:09:14.617890+0000","last_active":"2024-07-27T03:09:15.610406+0000","last_peered":"2024-07-27T03:09:15.610406+0000","last_clean":"2024-07-27T03:09:15.610406+0000","last_became_active":"2024-07-27T03:09:14.617449+0000","last_became_peered":"2024-07-27T03:09:14.617449+0000","last_unstale":"2024-07-27T03:09:15.610406+0000","last_undegraded":"2024-07-27T03:09:15.610406+0000","last_fullsized":"2024-07-27T03:09:15.610406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:02:44.318459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660650+0000","last_change":"2024-07-27T03:09:14.612567+0000","last_active":"2024-07-27T03:09:15.660650+0000","last_peered":"2024-07-27T03:09:15.660650+0000","last_clean":"2024-07-27T03:09:15.660650+0000","last_became_active":"2024-07-27T03:09:14.612276+0000","last_became_peered":"2024-07-27T03:09:14.612276+0000","last_unstale":"2024-07-27T03:09:15.660650+0000","last_undegraded":"2024-07-27T03:09:15.660650+0000","last_fullsized":"2024-07-27T03:09:15.660650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:56.250073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660790+0000","last_change":"2024-07-27T03:09:14.618014+0000","last_active":"2024-07-27T03:09:15.660790+0000","last_peered":"2024-07-27T03:09:15.660790+0000","last_clean":"2024-07-27T03:09:15.660790+0000","last_became_active":"2024-07-27T03:09:14.617721+0000","last_became_peered":"2024-07-27T03:09:14.617721+0000","last_unstale":"2024-07-27T03:09:15.660790+0000","last_undegraded":"2024-07-27T03:09:15.660790+0000","last_fullsized":"2024-07-27T03:09:15.660790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:23:40.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610673+0000","last_change":"2024-07-27T03:09:14.618738+0000","last_active":"2024-07-27T03:09:15.610673+0000","last_peered":"2024-07-27T03:09:15.610673+0000","last_clean":"2024-07-27T03:09:15.610673+0000","last_became_active":"2024-07-27T03:09:14.618401+0000","last_became_peered":"2024-07-27T03:09:14.618401+0000","last_unstale":"2024-07-27T03:09:15.610673+0000","last_undegraded":"2024-07-27T03:09:15.610673+0000","last_fullsized":"2024-07-27T03:09:15.610673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:16.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660410+0000","last_change":"2024-07-27T03:09:14.624479+0000","last_active":"2024-07-27T03:09:15.660410+0000","last_peered":"2024-07-27T03:09:15.660410+0000","last_clean":"2024-07-27T03:09:15.660410+0000","last_became_active":"2024-07-27T03:09:14.623934+0000","last_became_peered":"2024-07-27T03:09:14.623934+0000","last_unstale":"2024-07-27T03:09:15.660410+0000","last_undegraded":"2024-07-27T03:09:15.660410+0000","last_fullsized":"2024-07-27T03:09:15.660410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:24:00.946497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660781+0000","last_change":"2024-07-27T03:09:13.607927+0000","last_active":"2024-07-27T03:09:15.660781+0000","last_peered":"2024-07-27T03:09:15.660781+0000","last_clean":"2024-07-27T03:09:15.660781+0000","last_became_active":"2024-07-27T03:09:13.607590+0000","last_became_peered":"2024-07-27T03:09:13.607590+0000","last_unstale":"2024-07-27T03:09:15.660781+0000","last_undegraded":"2024-07-27T03:09:15.660781+0000","last_fullsized":"2024-07-27T03:09:15.660781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:28:25.823999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660704+0000","last_change":"2024-07-27T03:09:14.623980+0000","last_active":"2024-07-27T03:09:15.660704+0000","last_peered":"2024-07-27T03:09:15.660704+0000","last_clean":"2024-07-27T03:09:15.660704+0000","last_became_active":"2024-07-27T03:09:14.622593+0000","last_became_peered":"2024-07-27T03:09:14.622593+0000","last_unstale":"2024-07-27T03:09:15.660704+0000","last_undegraded":"2024-07-27T03:09:15.660704+0000","last_fullsized":"2024-07-27T03:09:15.660704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:07:33.124882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.658526+0000","last_change":"2024-07-27T03:09:12.658526+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.658526+0000","last_undegraded":"2024-07-27T03:09:12.658526+0000","last_fullsized":"2024-07-27T03:09:12.658526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611282+0000","last_change":"2024-07-27T03:09:14.619505+0000","last_active":"2024-07-27T03:09:15.611282+0000","last_peered":"2024-07-27T03:09:15.611282+0000","last_clean":"2024-07-27T03:09:15.611282+0000","last_became_active":"2024-07-27T03:09:14.618709+0000","last_became_peered":"2024-07-27T03:09:14.618709+0000","last_unstale":"2024-07-27T03:09:15.611282+0000","last_undegraded":"2024-07-27T03:09:15.611282+0000","last_fullsized":"2024-07-27T03:09:15.611282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:23:40.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588160+0000","last_change":"2024-07-27T03:09:12.588160+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588160+0000","last_undegraded":"2024-07-27T03:09:12.588160+0000","last_fullsized":"2024-07-27T03:09:12.588160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660954+0000","last_change":"2024-07-27T03:09:14.617781+0000","last_active":"2024-07-27T03:09:15.660954+0000","last_peered":"2024-07-27T03:09:15.660954+0000","last_clean":"2024-07-27T03:09:15.660954+0000","last_became_active":"2024-07-27T03:09:14.617337+0000","last_became_peered":"2024-07-27T03:09:14.617337+0000","last_unstale":"2024-07-27T03:09:15.660954+0000","last_undegraded":"2024-07-27T03:09:15.660954+0000","last_fullsized":"2024-07-27T03:09:15.660954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:07:12.274640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.586000+0000","last_change":"2024-07-27T03:09:12.586000+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.586000+0000","last_undegraded":"2024-07-27T03:09:12.586000+0000","last_fullsized":"2024-07-27T03:09:12.586000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610812+0000","last_change":"2024-07-27T03:09:13.602765+0000","last_active":"2024-07-27T03:09:15.610812+0000","last_peered":"2024-07-27T03:09:15.610812+0000","last_clean":"2024-07-27T03:09:15.610812+0000","last_became_active":"2024-07-27T03:09:13.602412+0000","last_became_peered":"2024-07-27T03:09:13.602412+0000","last_unstale":"2024-07-27T03:09:15.610812+0000","last_undegraded":"2024-07-27T03:09:15.610812+0000","last_fullsized":"2024-07-27T03:09:15.610812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:38.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610495+0000","last_change":"2024-07-27T03:09:13.602915+0000","last_active":"2024-07-27T03:09:15.610495+0000","last_peered":"2024-07-27T03:09:15.610495+0000","last_clean":"2024-07-27T03:09:15.610495+0000","last_became_active":"2024-07-27T03:09:13.602529+0000","last_became_peered":"2024-07-27T03:09:13.602529+0000","last_unstale":"2024-07-27T03:09:15.610495+0000","last_undegraded":"2024-07-27T03:09:15.610495+0000","last_fullsized":"2024-07-27T03:09:15.610495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:32:18.241705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610015+0000","last_change":"2024-07-27T03:09:14.616446+0000","last_active":"2024-07-27T03:09:15.610015+0000","last_peered":"2024-07-27T03:09:15.610015+0000","last_clean":"2024-07-27T03:09:15.610015+0000","last_became_active":"2024-07-27T03:09:14.615748+0000","last_became_peered":"2024-07-27T03:09:14.615748+0000","last_unstale":"2024-07-27T03:09:15.610015+0000","last_undegraded":"2024-07-27T03:09:15.610015+0000","last_fullsized":"2024-07-27T03:09:15.610015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:35:57.828278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588717+0000","last_change":"2024-07-27T03:09:12.588717+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588717+0000","last_undegraded":"2024-07-27T03:09:12.588717+0000","last_fullsized":"2024-07-27T03:09:12.588717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660573+0000","last_change":"2024-07-27T03:09:14.622500+0000","last_active":"2024-07-27T03:09:15.660573+0000","last_peered":"2024-07-27T03:09:15.660573+0000","last_clean":"2024-07-27T03:09:15.660573+0000","last_became_active":"2024-07-27T03:09:14.622134+0000","last_became_peered":"2024-07-27T03:09:14.622134+0000","last_unstale":"2024-07-27T03:09:15.660573+0000","last_undegraded":"2024-07-27T03:09:15.660573+0000","last_fullsized":"2024-07-27T03:09:15.660573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:16.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.609956+0000","last_change":"2024-07-27T03:09:13.606250+0000","last_active":"2024-07-27T03:09:15.609956+0000","last_peered":"2024-07-27T03:09:15.609956+0000","last_clean":"2024-07-27T03:09:15.609956+0000","last_became_active":"2024-07-27T03:09:13.604310+0000","last_became_peered":"2024-07-27T03:09:13.604310+0000","last_unstale":"2024-07-27T03:09:15.609956+0000","last_undegraded":"2024-07-27T03:09:15.609956+0000","last_fullsized":"2024-07-27T03:09:15.609956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:46:44.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587748+0000","last_change":"2024-07-27T03:09:12.587748+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587748+0000","last_undegraded":"2024-07-27T03:09:12.587748+0000","last_fullsized":"2024-07-27T03:09:12.587748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657915+0000","last_change":"2024-07-27T03:09:12.657915+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657915+0000","last_undegraded":"2024-07-27T03:09:12.657915+0000","last_fullsized":"2024-07-27T03:09:12.657915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.584920+0000","last_change":"2024-07-27T03:09:12.584920+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.584920+0000","last_undegraded":"2024-07-27T03:09:12.584920+0000","last_fullsized":"2024-07-27T03:09:12.584920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587728+0000","last_change":"2024-07-27T03:09:12.587728+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587728+0000","last_undegraded":"2024-07-27T03:09:12.587728+0000","last_fullsized":"2024-07-27T03:09:12.587728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660636+0000","last_change":"2024-07-27T03:09:14.623159+0000","last_active":"2024-07-27T03:09:15.660636+0000","last_peered":"2024-07-27T03:09:15.660636+0000","last_clean":"2024-07-27T03:09:15.660636+0000","last_became_active":"2024-07-27T03:09:14.622206+0000","last_became_peered":"2024-07-27T03:09:14.622206+0000","last_unstale":"2024-07-27T03:09:15.660636+0000","last_undegraded":"2024-07-27T03:09:15.660636+0000","last_fullsized":"2024-07-27T03:09:15.660636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:12.575517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610834+0000","last_change":"2024-07-27T03:09:13.605927+0000","last_active":"2024-07-27T03:09:15.610834+0000","last_peered":"2024-07-27T03:09:15.610834+0000","last_clean":"2024-07-27T03:09:15.610834+0000","last_became_active":"2024-07-27T03:09:13.604222+0000","last_became_peered":"2024-07-27T03:09:13.604222+0000","last_unstale":"2024-07-27T03:09:15.610834+0000","last_undegraded":"2024-07-27T03:09:15.610834+0000","last_fullsized":"2024-07-27T03:09:15.610834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:05:09.003909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660767+0000","last_change":"2024-07-27T03:09:13.606401+0000","last_active":"2024-07-27T03:09:15.660767+0000","last_peered":"2024-07-27T03:09:15.660767+0000","last_clean":"2024-07-27T03:09:15.660767+0000","last_became_active":"2024-07-27T03:09:13.606094+0000","last_became_peered":"2024-07-27T03:09:13.606094+0000","last_unstale":"2024-07-27T03:09:15.660767+0000","last_undegraded":"2024-07-27T03:09:15.660767+0000","last_fullsized":"2024-07-27T03:09:15.660767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:18:48.224902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587756+0000","last_change":"2024-07-27T03:09:12.587756+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587756+0000","last_undegraded":"2024-07-27T03:09:12.587756+0000","last_fullsized":"2024-07-27T03:09:12.587756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660298+0000","last_change":"2024-07-27T03:09:14.623092+0000","last_active":"2024-07-27T03:09:15.660298+0000","last_peered":"2024-07-27T03:09:15.660298+0000","last_clean":"2024-07-27T03:09:15.660298+0000","last_became_active":"2024-07-27T03:09:14.622749+0000","last_became_peered":"2024-07-27T03:09:14.622749+0000","last_unstale":"2024-07-27T03:09:15.660298+0000","last_undegraded":"2024-07-27T03:09:15.660298+0000","last_fullsized":"2024-07-27T03:09:15.660298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:41:18.671396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588318+0000","last_change":"2024-07-27T03:09:12.588318+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588318+0000","last_undegraded":"2024-07-27T03:09:12.588318+0000","last_fullsized":"2024-07-27T03:09:12.588318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610726+0000","last_change":"2024-07-27T03:09:14.627550+0000","last_active":"2024-07-27T03:09:15.610726+0000","last_peered":"2024-07-27T03:09:15.610726+0000","last_clean":"2024-07-27T03:09:15.610726+0000","last_became_active":"2024-07-27T03:09:14.627173+0000","last_became_peered":"2024-07-27T03:09:14.627173+0000","last_unstale":"2024-07-27T03:09:15.610726+0000","last_undegraded":"2024-07-27T03:09:15.610726+0000","last_fullsized":"2024-07-27T03:09:15.610726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:12.575517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660781+0000","last_change":"2024-07-27T03:09:13.605511+0000","last_active":"2024-07-27T03:09:15.660781+0000","last_peered":"2024-07-27T03:09:15.660781+0000","last_clean":"2024-07-27T03:09:15.660781+0000","last_became_active":"2024-07-27T03:09:13.604979+0000","last_became_peered":"2024-07-27T03:09:13.604979+0000","last_unstale":"2024-07-27T03:09:15.660781+0000","last_undegraded":"2024-07-27T03:09:15.660781+0000","last_fullsized":"2024-07-27T03:09:15.660781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:29:10.340511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610399+0000","last_change":"2024-07-27T03:09:13.605887+0000","last_active":"2024-07-27T03:09:15.610399+0000","last_peered":"2024-07-27T03:09:15.610399+0000","last_clean":"2024-07-27T03:09:15.610399+0000","last_became_active":"2024-07-27T03:09:13.605518+0000","last_became_peered":"2024-07-27T03:09:13.605518+0000","last_unstale":"2024-07-27T03:09:15.610399+0000","last_undegraded":"2024-07-27T03:09:15.610399+0000","last_fullsized":"2024-07-27T03:09:15.610399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:43:24.612891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661674+0000","last_change":"2024-07-27T03:09:14.617479+0000","last_active":"2024-07-27T03:09:15.661674+0000","last_peered":"2024-07-27T03:09:15.661674+0000","last_clean":"2024-07-27T03:09:15.661674+0000","last_became_active":"2024-07-27T03:09:14.617003+0000","last_became_peered":"2024-07-27T03:09:14.617003+0000","last_unstale":"2024-07-27T03:09:15.661674+0000","last_undegraded":"2024-07-27T03:09:15.661674+0000","last_fullsized":"2024-07-27T03:09:15.661674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:59:04.248587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610563+0000","last_change":"2024-07-27T03:09:13.601807+0000","last_active":"2024-07-27T03:09:15.610563+0000","last_peered":"2024-07-27T03:09:15.610563+0000","last_clean":"2024-07-27T03:09:15.610563+0000","last_became_active":"2024-07-27T03:09:13.600603+0000","last_became_peered":"2024-07-27T03:09:13.600603+0000","last_unstale":"2024-07-27T03:09:15.610563+0000","last_undegraded":"2024-07-27T03:09:15.610563+0000","last_fullsized":"2024-07-27T03:09:15.610563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:12:16.902363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611258+0000","last_change":"2024-07-27T03:09:13.603828+0000","last_active":"2024-07-27T03:09:15.611258+0000","last_peered":"2024-07-27T03:09:15.611258+0000","last_clean":"2024-07-27T03:09:15.611258+0000","last_became_active":"2024-07-27T03:09:13.603208+0000","last_became_peered":"2024-07-27T03:09:13.603208+0000","last_unstale":"2024-07-27T03:09:15.611258+0000","last_undegraded":"2024-07-27T03:09:15.611258+0000","last_fullsized":"2024-07-27T03:09:15.611258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:28:25.823999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657824+0000","last_change":"2024-07-27T03:09:12.657824+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657824+0000","last_undegraded":"2024-07-27T03:09:12.657824+0000","last_fullsized":"2024-07-27T03:09:12.657824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660421+0000","last_change":"2024-07-27T03:09:13.609088+0000","last_active":"2024-07-27T03:09:15.660421+0000","last_peered":"2024-07-27T03:09:15.660421+0000","last_clean":"2024-07-27T03:09:15.660421+0000","last_became_active":"2024-07-27T03:09:13.608835+0000","last_became_peered":"2024-07-27T03:09:13.608835+0000","last_unstale":"2024-07-27T03:09:15.660421+0000","last_undegraded":"2024-07-27T03:09:15.660421+0000","last_fullsized":"2024-07-27T03:09:15.660421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:46:44.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610112+0000","last_change":"2024-07-27T03:09:13.601066+0000","last_active":"2024-07-27T03:09:15.610112+0000","last_peered":"2024-07-27T03:09:15.610112+0000","last_clean":"2024-07-27T03:09:15.610112+0000","last_became_active":"2024-07-27T03:09:13.600739+0000","last_became_peered":"2024-07-27T03:09:13.600739+0000","last_unstale":"2024-07-27T03:09:15.610112+0000","last_undegraded":"2024-07-27T03:09:15.610112+0000","last_fullsized":"2024-07-27T03:09:15.610112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:26.159437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.584628+0000","last_change":"2024-07-27T03:09:12.584628+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.584628+0000","last_undegraded":"2024-07-27T03:09:12.584628+0000","last_fullsized":"2024-07-27T03:09:12.584628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660799+0000","last_change":"2024-07-27T03:09:13.606468+0000","last_active":"2024-07-27T03:09:15.660799+0000","last_peered":"2024-07-27T03:09:15.660799+0000","last_clean":"2024-07-27T03:09:15.660799+0000","last_became_active":"2024-07-27T03:09:13.606168+0000","last_became_peered":"2024-07-27T03:09:13.606168+0000","last_unstale":"2024-07-27T03:09:15.660799+0000","last_undegraded":"2024-07-27T03:09:15.660799+0000","last_fullsized":"2024-07-27T03:09:15.660799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:41:17.664971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657307+0000","last_change":"2024-07-27T03:09:12.657307+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657307+0000","last_undegraded":"2024-07-27T03:09:12.657307+0000","last_fullsized":"2024-07-27T03:09:12.657307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661868+0000","last_change":"2024-07-27T03:09:13.608738+0000","last_active":"2024-07-27T03:09:15.661868+0000","last_peered":"2024-07-27T03:09:15.661868+0000","last_clean":"2024-07-27T03:09:15.661868+0000","last_became_active":"2024-07-27T03:09:13.608362+0000","last_became_peered":"2024-07-27T03:09:13.608362+0000","last_unstale":"2024-07-27T03:09:15.661868+0000","last_undegraded":"2024-07-27T03:09:15.661868+0000","last_fullsized":"2024-07-27T03:09:15.661868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:54.757042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660523+0000","last_change":"2024-07-27T03:09:14.614687+0000","last_active":"2024-07-27T03:09:15.660523+0000","last_peered":"2024-07-27T03:09:15.660523+0000","last_clean":"2024-07-27T03:09:15.660523+0000","last_became_active":"2024-07-27T03:09:14.613957+0000","last_became_peered":"2024-07-27T03:09:14.613957+0000","last_unstale":"2024-07-27T03:09:15.660523+0000","last_undegraded":"2024-07-27T03:09:15.660523+0000","last_fullsized":"2024-07-27T03:09:15.660523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:22:49.333753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657354+0000","last_change":"2024-07-27T03:09:12.657354+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657354+0000","last_undegraded":"2024-07-27T03:09:12.657354+0000","last_fullsized":"2024-07-27T03:09:12.657354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660873+0000","last_change":"2024-07-27T03:09:13.607105+0000","last_active":"2024-07-27T03:09:15.660873+0000","last_peered":"2024-07-27T03:09:15.660873+0000","last_clean":"2024-07-27T03:09:15.660873+0000","last_became_active":"2024-07-27T03:09:13.606751+0000","last_became_peered":"2024-07-27T03:09:13.606751+0000","last_unstale":"2024-07-27T03:09:15.660873+0000","last_undegraded":"2024-07-27T03:09:15.660873+0000","last_fullsized":"2024-07-27T03:09:15.660873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:52.773759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611119+0000","last_change":"2024-07-27T03:09:13.600341+0000","last_active":"2024-07-27T03:09:15.611119+0000","last_peered":"2024-07-27T03:09:15.611119+0000","last_clean":"2024-07-27T03:09:15.611119+0000","last_became_active":"2024-07-27T03:09:13.600029+0000","last_became_peered":"2024-07-27T03:09:13.600029+0000","last_unstale":"2024-07-27T03:09:15.611119+0000","last_undegraded":"2024-07-27T03:09:15.611119+0000","last_fullsized":"2024-07-27T03:09:15.611119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:56:01.886146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610031+0000","last_change":"2024-07-27T03:09:14.618278+0000","last_active":"2024-07-27T03:09:15.610031+0000","last_peered":"2024-07-27T03:09:15.610031+0000","last_clean":"2024-07-27T03:09:15.610031+0000","last_became_active":"2024-07-27T03:09:14.617936+0000","last_became_peered":"2024-07-27T03:09:14.617936+0000","last_unstale":"2024-07-27T03:09:15.610031+0000","last_undegraded":"2024-07-27T03:09:15.610031+0000","last_fullsized":"2024-07-27T03:09:15.610031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:49:24.333630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587778+0000","last_change":"2024-07-27T03:09:12.587778+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587778+0000","last_undegraded":"2024-07-27T03:09:12.587778+0000","last_fullsized":"2024-07-27T03:09:12.587778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660132+0000","last_change":"2024-07-27T03:09:13.604580+0000","last_active":"2024-07-27T03:09:15.660132+0000","last_peered":"2024-07-27T03:09:15.660132+0000","last_clean":"2024-07-27T03:09:15.660132+0000","last_became_active":"2024-07-27T03:09:13.604304+0000","last_became_peered":"2024-07-27T03:09:13.604304+0000","last_unstale":"2024-07-27T03:09:15.660132+0000","last_undegraded":"2024-07-27T03:09:15.660132+0000","last_fullsized":"2024-07-27T03:09:15.660132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:56:01.886146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-07-27T03:09:12.589719+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:09:12.589719+0000","last_peered":"2024-07-27T03:09:12.589719+0000","last_clean":"2024-07-27T03:09:12.589719+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:09:12.589719+0000","last_undegraded":"2024-07-27T03:09:12.589719+0000","last_fullsized":"2024-07-27T03:09:12.589719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":141094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":140582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":142112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:09:18.661 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:09:18.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.806+0000 7f0874f4e640 1 -- 172.21.15.120:0/839100162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085c003a30 msgr2=0x7f085c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.806+0000 7f0874f4e640 1 --2- 172.21.15.120:0/839100162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085c003a30 0x7f085c003ea0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f087009e0b0 tx=0x7f085c005830 comp rx=0 tx=0).stop 2024-07-27T03:09:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.806+0000 7f086ed9d640 1 -- 172.21.15.120:0/839100162 reap_dead start 2024-07-27T03:09:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.806+0000 7f0874f4e640 1 -- 172.21.15.120:0/839100162 shutdown_connections 2024-07-27T03:09:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.806+0000 7f0874f4e640 1 -- 172.21.15.120:0/839100162 >> 172.21.15.120:0/839100162 conn(0x7f08700b1a10 msgr2=0x7f08700b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.806+0000 7f0874f4e640 1 -- 172.21.15.120:0/839100162 shutdown_connections 2024-07-27T03:09:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.806+0000 7f0874f4e640 1 -- 172.21.15.120:0/839100162 wait complete. 2024-07-27T03:09:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.808+0000 7f0874f4e640 1 Processor -- start 2024-07-27T03:09:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.808+0000 7f0874f4e640 1 -- start start 2024-07-27T03:09:18.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.809+0000 7f0874f4e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085c003a30 0x7f087014f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.809+0000 7f0874f4e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f087009d080 0x7f08701f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.809+0000 7f0874f4e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08701f6f00 0x7f08701f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.809+0000 7f0874f4e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0870073770 con 0x7f085c003a30 2024-07-27T03:09:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.809+0000 7f0874f4e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f08700735f0 con 0x7f08701f6f00 2024-07-27T03:09:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.809+0000 7f0874f4e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f08700738f0 con 0x7f087009d080 2024-07-27T03:09:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.809+0000 7f086e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085c003a30 0x7f087014f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.809+0000 7f086e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085c003a30 0x7f087014f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49940/0 (socket says 172.21.15.120:49940) 2024-07-27T03:09:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.809+0000 7f086e59c640 1 -- 172.21.15.120:0/4139993593 learned_addr learned my addr 172.21.15.120:0/4139993593 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.809+0000 7f086ed9d640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08701f6f00 0x7f08701f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.809+0000 7f0865d9b640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f087009d080 0x7f08701f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.810+0000 7f086e59c640 1 -- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f087009d080 msgr2=0x7f08701f69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.810+0000 7f086e59c640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f087009d080 0x7f08701f69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.810+0000 7f086e59c640 1 -- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08701f6f00 msgr2=0x7f08701f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.810+0000 7f086e59c640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08701f6f00 0x7f08701f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.810+0000 7f086e59c640 1 -- 172.21.15.120:0/4139993593 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0870150540 con 0x7f085c003a30 2024-07-27T03:09:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.810+0000 7f086e59c640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085c003a30 0x7f087014f2b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0860036040 tx=0x7f08600336d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.810+0000 7f08677fe640 1 -- 172.21.15.120:0/4139993593 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860038040 con 0x7f085c003a30 2024-07-27T03:09:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.810+0000 7f08677fe640 1 -- 172.21.15.120:0/4139993593 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0860033840 con 0x7f085c003a30 2024-07-27T03:09:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.810+0000 7f0874f4e640 1 -- 172.21.15.120:0/4139993593 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0870150820 con 0x7f085c003a30 2024-07-27T03:09:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.810+0000 7f08677fe640 1 -- 172.21.15.120:0/4139993593 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860033c70 con 0x7f085c003a30 2024-07-27T03:09:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.810+0000 7f0874f4e640 1 -- 172.21.15.120:0/4139993593 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0870155180 con 0x7f085c003a30 2024-07-27T03:09:18.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.811+0000 7f0874f4e640 1 -- 172.21.15.120:0/4139993593 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0870150a60 con 0x7f085c003a30 2024-07-27T03:09:18.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.812+0000 7f08677fe640 1 -- 172.21.15.120:0/4139993593 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0860045020 con 0x7f085c003a30 2024-07-27T03:09:18.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.812+0000 7f08677fe640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0850077040 0x7f0850079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:18.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.812+0000 7f08677fe640 1 -- 172.21.15.120:0/4139993593 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f08600b8f00 con 0x7f085c003a30 2024-07-27T03:09:18.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.813+0000 7f0865d9b640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0850077040 0x7f0850079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:18.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.813+0000 7f0865d9b640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0850077040 0x7f0850079550 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f08700cf270 tx=0x7f085800d2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:18.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.817+0000 7f08677fe640 1 -- 172.21.15.120:0/4139993593 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f0870150a60 con 0x7f085c003a30 2024-07-27T03:09:18.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.993+0000 7f0874f4e640 1 -- 172.21.15.120:0/4139993593 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0870154ce0 con 0x7f0850077040 2024-07-27T03:09:19.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:18.998+0000 7f08677fe640 1 -- 172.21.15.120:0/4139993593 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244359 (secure 0 0 0) 0x7f0858003710 con 0x7f0850077040 2024-07-27T03:09:19.004 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:19.005 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:09:19.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 -- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0850077040 msgr2=0x7f0850079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0850077040 0x7f0850079550 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f08700cf270 tx=0x7f085800d2e0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 -- 172.21.15.120:0/4139993593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085c003a30 msgr2=0x7f087014f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085c003a30 0x7f087014f2b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0860036040 tx=0x7f08600336d0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 -- 172.21.15.120:0/4139993593 shutdown_connections 2024-07-27T03:09:19.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0850077040 0x7f0850079550 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08701f6f00 0x7f08701f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f087009d080 0x7f08701f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 --2- 172.21.15.120:0/4139993593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085c003a30 0x7f087014f2b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 -- 172.21.15.120:0/4139993593 >> 172.21.15.120:0/4139993593 conn(0x7f08700b1a10 msgr2=0x7f08700b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:19.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 -- 172.21.15.120:0/4139993593 shutdown_connections 2024-07-27T03:09:19.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.001+0000 7f0874f4e640 1 -- 172.21.15.120:0/4139993593 wait complete. 2024-07-27T03:09:19.015 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-07-27T03:09:18.541994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591076,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224176,"kb_used_data":3836,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750544,"statfs":{"total":773094113280,"available":772864557056,"internally_reserved":0,"allocated":3928064,"data_stored":2198570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.959394"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660642+0000","last_change":"2024-07-27T03:09:14.626088+0000","last_active":"2024-07-27T03:09:15.660642+0000","last_peered":"2024-07-27T03:09:15.660642+0000","last_clean":"2024-07-27T03:09:15.660642+0000","last_became_active":"2024-07-27T03:09:14.624863+0000","last_became_peered":"2024-07-27T03:09:14.624863+0000","last_unstale":"2024-07-27T03:09:15.660642+0000","last_undegraded":"2024-07-27T03:09:15.660642+0000","last_fullsized":"2024-07-27T03:09:15.660642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:06.375815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661489+0000","last_change":"2024-07-27T03:09:14.618632+0000","last_active":"2024-07-27T03:09:15.661489+0000","last_peered":"2024-07-27T03:09:15.661489+0000","last_clean":"2024-07-27T03:09:15.661489+0000","last_became_active":"2024-07-27T03:09:14.618330+0000","last_became_peered":"2024-07-27T03:09:14.618330+0000","last_unstale":"2024-07-27T03:09:15.661489+0000","last_undegraded":"2024-07-27T03:09:15.661489+0000","last_fullsized":"2024-07-27T03:09:15.661489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:23:12.555273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610969+0000","last_change":"2024-07-27T03:09:14.616445+0000","last_active":"2024-07-27T03:09:15.610969+0000","last_peered":"2024-07-27T03:09:15.610969+0000","last_clean":"2024-07-27T03:09:15.610969+0000","last_became_active":"2024-07-27T03:09:14.615819+0000","last_became_peered":"2024-07-27T03:09:14.615819+0000","last_unstale":"2024-07-27T03:09:15.610969+0000","last_undegraded":"2024-07-27T03:09:15.610969+0000","last_fullsized":"2024-07-27T03:09:15.610969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:56.250073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660793+0000","last_change":"2024-07-27T03:09:14.619141+0000","last_active":"2024-07-27T03:09:15.660793+0000","last_peered":"2024-07-27T03:09:15.660793+0000","last_clean":"2024-07-27T03:09:15.660793+0000","last_became_active":"2024-07-27T03:09:14.618846+0000","last_became_peered":"2024-07-27T03:09:14.618846+0000","last_unstale":"2024-07-27T03:09:15.660793+0000","last_undegraded":"2024-07-27T03:09:15.660793+0000","last_fullsized":"2024-07-27T03:09:15.660793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:05.563749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610653+0000","last_change":"2024-07-27T03:09:14.613012+0000","last_active":"2024-07-27T03:09:15.610653+0000","last_peered":"2024-07-27T03:09:15.610653+0000","last_clean":"2024-07-27T03:09:15.610653+0000","last_became_active":"2024-07-27T03:09:14.612684+0000","last_became_peered":"2024-07-27T03:09:14.612684+0000","last_unstale":"2024-07-27T03:09:15.610653+0000","last_undegraded":"2024-07-27T03:09:15.610653+0000","last_fullsized":"2024-07-27T03:09:15.610653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:07:53.511397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610406+0000","last_change":"2024-07-27T03:09:14.617890+0000","last_active":"2024-07-27T03:09:15.610406+0000","last_peered":"2024-07-27T03:09:15.610406+0000","last_clean":"2024-07-27T03:09:15.610406+0000","last_became_active":"2024-07-27T03:09:14.617449+0000","last_became_peered":"2024-07-27T03:09:14.617449+0000","last_unstale":"2024-07-27T03:09:15.610406+0000","last_undegraded":"2024-07-27T03:09:15.610406+0000","last_fullsized":"2024-07-27T03:09:15.610406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:02:44.318459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660650+0000","last_change":"2024-07-27T03:09:14.612567+0000","last_active":"2024-07-27T03:09:15.660650+0000","last_peered":"2024-07-27T03:09:15.660650+0000","last_clean":"2024-07-27T03:09:15.660650+0000","last_became_active":"2024-07-27T03:09:14.612276+0000","last_became_peered":"2024-07-27T03:09:14.612276+0000","last_unstale":"2024-07-27T03:09:15.660650+0000","last_undegraded":"2024-07-27T03:09:15.660650+0000","last_fullsized":"2024-07-27T03:09:15.660650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:56.250073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660790+0000","last_change":"2024-07-27T03:09:14.618014+0000","last_active":"2024-07-27T03:09:15.660790+0000","last_peered":"2024-07-27T03:09:15.660790+0000","last_clean":"2024-07-27T03:09:15.660790+0000","last_became_active":"2024-07-27T03:09:14.617721+0000","last_became_peered":"2024-07-27T03:09:14.617721+0000","last_unstale":"2024-07-27T03:09:15.660790+0000","last_undegraded":"2024-07-27T03:09:15.660790+0000","last_fullsized":"2024-07-27T03:09:15.660790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:23:40.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610673+0000","last_change":"2024-07-27T03:09:14.618738+0000","last_active":"2024-07-27T03:09:15.610673+0000","last_peered":"2024-07-27T03:09:15.610673+0000","last_clean":"2024-07-27T03:09:15.610673+0000","last_became_active":"2024-07-27T03:09:14.618401+0000","last_became_peered":"2024-07-27T03:09:14.618401+0000","last_unstale":"2024-07-27T03:09:15.610673+0000","last_undegraded":"2024-07-27T03:09:15.610673+0000","last_fullsized":"2024-07-27T03:09:15.610673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:16.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660410+0000","last_change":"2024-07-27T03:09:14.624479+0000","last_active":"2024-07-27T03:09:15.660410+0000","last_peered":"2024-07-27T03:09:15.660410+0000","last_clean":"2024-07-27T03:09:15.660410+0000","last_became_active":"2024-07-27T03:09:14.623934+0000","last_became_peered":"2024-07-27T03:09:14.623934+0000","last_unstale":"2024-07-27T03:09:15.660410+0000","last_undegraded":"2024-07-27T03:09:15.660410+0000","last_fullsized":"2024-07-27T03:09:15.660410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:24:00.946497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660781+0000","last_change":"2024-07-27T03:09:13.607927+0000","last_active":"2024-07-27T03:09:15.660781+0000","last_peered":"2024-07-27T03:09:15.660781+0000","last_clean":"2024-07-27T03:09:15.660781+0000","last_became_active":"2024-07-27T03:09:13.607590+0000","last_became_peered":"2024-07-27T03:09:13.607590+0000","last_unstale":"2024-07-27T03:09:15.660781+0000","last_undegraded":"2024-07-27T03:09:15.660781+0000","last_fullsized":"2024-07-27T03:09:15.660781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:28:25.823999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660704+0000","last_change":"2024-07-27T03:09:14.623980+0000","last_active":"2024-07-27T03:09:15.660704+0000","last_peered":"2024-07-27T03:09:15.660704+0000","last_clean":"2024-07-27T03:09:15.660704+0000","last_became_active":"2024-07-27T03:09:14.622593+0000","last_became_peered":"2024-07-27T03:09:14.622593+0000","last_unstale":"2024-07-27T03:09:15.660704+0000","last_undegraded":"2024-07-27T03:09:15.660704+0000","last_fullsized":"2024-07-27T03:09:15.660704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:07:33.124882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.658526+0000","last_change":"2024-07-27T03:09:12.658526+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.658526+0000","last_undegraded":"2024-07-27T03:09:12.658526+0000","last_fullsized":"2024-07-27T03:09:12.658526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611282+0000","last_change":"2024-07-27T03:09:14.619505+0000","last_active":"2024-07-27T03:09:15.611282+0000","last_peered":"2024-07-27T03:09:15.611282+0000","last_clean":"2024-07-27T03:09:15.611282+0000","last_became_active":"2024-07-27T03:09:14.618709+0000","last_became_peered":"2024-07-27T03:09:14.618709+0000","last_unstale":"2024-07-27T03:09:15.611282+0000","last_undegraded":"2024-07-27T03:09:15.611282+0000","last_fullsized":"2024-07-27T03:09:15.611282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:23:40.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588160+0000","last_change":"2024-07-27T03:09:12.588160+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588160+0000","last_undegraded":"2024-07-27T03:09:12.588160+0000","last_fullsized":"2024-07-27T03:09:12.588160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660954+0000","last_change":"2024-07-27T03:09:14.617781+0000","last_active":"2024-07-27T03:09:15.660954+0000","last_peered":"2024-07-27T03:09:15.660954+0000","last_clean":"2024-07-27T03:09:15.660954+0000","last_became_active":"2024-07-27T03:09:14.617337+0000","last_became_peered":"2024-07-27T03:09:14.617337+0000","last_unstale":"2024-07-27T03:09:15.660954+0000","last_undegraded":"2024-07-27T03:09:15.660954+0000","last_fullsized":"2024-07-27T03:09:15.660954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:07:12.274640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.586000+0000","last_change":"2024-07-27T03:09:12.586000+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.586000+0000","last_undegraded":"2024-07-27T03:09:12.586000+0000","last_fullsized":"2024-07-27T03:09:12.586000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610812+0000","last_change":"2024-07-27T03:09:13.602765+0000","last_active":"2024-07-27T03:09:15.610812+0000","last_peered":"2024-07-27T03:09:15.610812+0000","last_clean":"2024-07-27T03:09:15.610812+0000","last_became_active":"2024-07-27T03:09:13.602412+0000","last_became_peered":"2024-07-27T03:09:13.602412+0000","last_unstale":"2024-07-27T03:09:15.610812+0000","last_undegraded":"2024-07-27T03:09:15.610812+0000","last_fullsized":"2024-07-27T03:09:15.610812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:38.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610495+0000","last_change":"2024-07-27T03:09:13.602915+0000","last_active":"2024-07-27T03:09:15.610495+0000","last_peered":"2024-07-27T03:09:15.610495+0000","last_clean":"2024-07-27T03:09:15.610495+0000","last_became_active":"2024-07-27T03:09:13.602529+0000","last_became_peered":"2024-07-27T03:09:13.602529+0000","last_unstale":"2024-07-27T03:09:15.610495+0000","last_undegraded":"2024-07-27T03:09:15.610495+0000","last_fullsized":"2024-07-27T03:09:15.610495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:32:18.241705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610015+0000","last_change":"2024-07-27T03:09:14.616446+0000","last_active":"2024-07-27T03:09:15.610015+0000","last_peered":"2024-07-27T03:09:15.610015+0000","last_clean":"2024-07-27T03:09:15.610015+0000","last_became_active":"2024-07-27T03:09:14.615748+0000","last_became_peered":"2024-07-27T03:09:14.615748+0000","last_unstale":"2024-07-27T03:09:15.610015+0000","last_undegraded":"2024-07-27T03:09:15.610015+0000","last_fullsized":"2024-07-27T03:09:15.610015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:35:57.828278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588717+0000","last_change":"2024-07-27T03:09:12.588717+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588717+0000","last_undegraded":"2024-07-27T03:09:12.588717+0000","last_fullsized":"2024-07-27T03:09:12.588717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660573+0000","last_change":"2024-07-27T03:09:14.622500+0000","last_active":"2024-07-27T03:09:15.660573+0000","last_peered":"2024-07-27T03:09:15.660573+0000","last_clean":"2024-07-27T03:09:15.660573+0000","last_became_active":"2024-07-27T03:09:14.622134+0000","last_became_peered":"2024-07-27T03:09:14.622134+0000","last_unstale":"2024-07-27T03:09:15.660573+0000","last_undegraded":"2024-07-27T03:09:15.660573+0000","last_fullsized":"2024-07-27T03:09:15.660573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:16.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.609956+0000","last_change":"2024-07-27T03:09:13.606250+0000","last_active":"2024-07-27T03:09:15.609956+0000","last_peered":"2024-07-27T03:09:15.609956+0000","last_clean":"2024-07-27T03:09:15.609956+0000","last_became_active":"2024-07-27T03:09:13.604310+0000","last_became_peered":"2024-07-27T03:09:13.604310+0000","last_unstale":"2024-07-27T03:09:15.609956+0000","last_undegraded":"2024-07-27T03:09:15.609956+0000","last_fullsized":"2024-07-27T03:09:15.609956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:46:44.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587748+0000","last_change":"2024-07-27T03:09:12.587748+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587748+0000","last_undegraded":"2024-07-27T03:09:12.587748+0000","last_fullsized":"2024-07-27T03:09:12.587748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657915+0000","last_change":"2024-07-27T03:09:12.657915+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657915+0000","last_undegraded":"2024-07-27T03:09:12.657915+0000","last_fullsized":"2024-07-27T03:09:12.657915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.584920+0000","last_change":"2024-07-27T03:09:12.584920+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.584920+0000","last_undegraded":"2024-07-27T03:09:12.584920+0000","last_fullsized":"2024-07-27T03:09:12.584920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587728+0000","last_change":"2024-07-27T03:09:12.587728+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587728+0000","last_undegraded":"2024-07-27T03:09:12.587728+0000","last_fullsized":"2024-07-27T03:09:12.587728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660636+0000","last_change":"2024-07-27T03:09:14.623159+0000","last_active":"2024-07-27T03:09:15.660636+0000","last_peered":"2024-07-27T03:09:15.660636+0000","last_clean":"2024-07-27T03:09:15.660636+0000","last_became_active":"2024-07-27T03:09:14.622206+0000","last_became_peered":"2024-07-27T03:09:14.622206+0000","last_unstale":"2024-07-27T03:09:15.660636+0000","last_undegraded":"2024-07-27T03:09:15.660636+0000","last_fullsized":"2024-07-27T03:09:15.660636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:12.575517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610834+0000","last_change":"2024-07-27T03:09:13.605927+0000","last_active":"2024-07-27T03:09:15.610834+0000","last_peered":"2024-07-27T03:09:15.610834+0000","last_clean":"2024-07-27T03:09:15.610834+0000","last_became_active":"2024-07-27T03:09:13.604222+0000","last_became_peered":"2024-07-27T03:09:13.604222+0000","last_unstale":"2024-07-27T03:09:15.610834+0000","last_undegraded":"2024-07-27T03:09:15.610834+0000","last_fullsized":"2024-07-27T03:09:15.610834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:05:09.003909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660767+0000","last_change":"2024-07-27T03:09:13.606401+0000","last_active":"2024-07-27T03:09:15.660767+0000","last_peered":"2024-07-27T03:09:15.660767+0000","last_clean":"2024-07-27T03:09:15.660767+0000","last_became_active":"2024-07-27T03:09:13.606094+0000","last_became_peered":"2024-07-27T03:09:13.606094+0000","last_unstale":"2024-07-27T03:09:15.660767+0000","last_undegraded":"2024-07-27T03:09:15.660767+0000","last_fullsized":"2024-07-27T03:09:15.660767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:18:48.224902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587756+0000","last_change":"2024-07-27T03:09:12.587756+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587756+0000","last_undegraded":"2024-07-27T03:09:12.587756+0000","last_fullsized":"2024-07-27T03:09:12.587756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660298+0000","last_change":"2024-07-27T03:09:14.623092+0000","last_active":"2024-07-27T03:09:15.660298+0000","last_peered":"2024-07-27T03:09:15.660298+0000","last_clean":"2024-07-27T03:09:15.660298+0000","last_became_active":"2024-07-27T03:09:14.622749+0000","last_became_peered":"2024-07-27T03:09:14.622749+0000","last_unstale":"2024-07-27T03:09:15.660298+0000","last_undegraded":"2024-07-27T03:09:15.660298+0000","last_fullsized":"2024-07-27T03:09:15.660298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:41:18.671396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588318+0000","last_change":"2024-07-27T03:09:12.588318+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588318+0000","last_undegraded":"2024-07-27T03:09:12.588318+0000","last_fullsized":"2024-07-27T03:09:12.588318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610726+0000","last_change":"2024-07-27T03:09:14.627550+0000","last_active":"2024-07-27T03:09:15.610726+0000","last_peered":"2024-07-27T03:09:15.610726+0000","last_clean":"2024-07-27T03:09:15.610726+0000","last_became_active":"2024-07-27T03:09:14.627173+0000","last_became_peered":"2024-07-27T03:09:14.627173+0000","last_unstale":"2024-07-27T03:09:15.610726+0000","last_undegraded":"2024-07-27T03:09:15.610726+0000","last_fullsized":"2024-07-27T03:09:15.610726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:12.575517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660781+0000","last_change":"2024-07-27T03:09:13.605511+0000","last_active":"2024-07-27T03:09:15.660781+0000","last_peered":"2024-07-27T03:09:15.660781+0000","last_clean":"2024-07-27T03:09:15.660781+0000","last_became_active":"2024-07-27T03:09:13.604979+0000","last_became_peered":"2024-07-27T03:09:13.604979+0000","last_unstale":"2024-07-27T03:09:15.660781+0000","last_undegraded":"2024-07-27T03:09:15.660781+0000","last_fullsized":"2024-07-27T03:09:15.660781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:29:10.340511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610399+0000","last_change":"2024-07-27T03:09:13.605887+0000","last_active":"2024-07-27T03:09:15.610399+0000","last_peered":"2024-07-27T03:09:15.610399+0000","last_clean":"2024-07-27T03:09:15.610399+0000","last_became_active":"2024-07-27T03:09:13.605518+0000","last_became_peered":"2024-07-27T03:09:13.605518+0000","last_unstale":"2024-07-27T03:09:15.610399+0000","last_undegraded":"2024-07-27T03:09:15.610399+0000","last_fullsized":"2024-07-27T03:09:15.610399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:43:24.612891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661674+0000","last_change":"2024-07-27T03:09:14.617479+0000","last_active":"2024-07-27T03:09:15.661674+0000","last_peered":"2024-07-27T03:09:15.661674+0000","last_clean":"2024-07-27T03:09:15.661674+0000","last_became_active":"2024-07-27T03:09:14.617003+0000","last_became_peered":"2024-07-27T03:09:14.617003+0000","last_unstale":"2024-07-27T03:09:15.661674+0000","last_undegraded":"2024-07-27T03:09:15.661674+0000","last_fullsized":"2024-07-27T03:09:15.661674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:59:04.248587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610563+0000","last_change":"2024-07-27T03:09:13.601807+0000","last_active":"2024-07-27T03:09:15.610563+0000","last_peered":"2024-07-27T03:09:15.610563+0000","last_clean":"2024-07-27T03:09:15.610563+0000","last_became_active":"2024-07-27T03:09:13.600603+0000","last_became_peered":"2024-07-27T03:09:13.600603+0000","last_unstale":"2024-07-27T03:09:15.610563+0000","last_undegraded":"2024-07-27T03:09:15.610563+0000","last_fullsized":"2024-07-27T03:09:15.610563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:12:16.902363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611258+0000","last_change":"2024-07-27T03:09:13.603828+0000","last_active":"2024-07-27T03:09:15.611258+0000","last_peered":"2024-07-27T03:09:15.611258+0000","last_clean":"2024-07-27T03:09:15.611258+0000","last_became_active":"2024-07-27T03:09:13.603208+0000","last_became_peered":"2024-07-27T03:09:13.603208+0000","last_unstale":"2024-07-27T03:09:15.611258+0000","last_undegraded":"2024-07-27T03:09:15.611258+0000","last_fullsized":"2024-07-27T03:09:15.611258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:28:25.823999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657824+0000","last_change":"2024-07-27T03:09:12.657824+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657824+0000","last_undegraded":"2024-07-27T03:09:12.657824+0000","last_fullsized":"2024-07-27T03:09:12.657824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660421+0000","last_change":"2024-07-27T03:09:13.609088+0000","last_active":"2024-07-27T03:09:15.660421+0000","last_peered":"2024-07-27T03:09:15.660421+0000","last_clean":"2024-07-27T03:09:15.660421+0000","last_became_active":"2024-07-27T03:09:13.608835+0000","last_became_peered":"2024-07-27T03:09:13.608835+0000","last_unstale":"2024-07-27T03:09:15.660421+0000","last_undegraded":"2024-07-27T03:09:15.660421+0000","last_fullsized":"2024-07-27T03:09:15.660421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:46:44.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610112+0000","last_change":"2024-07-27T03:09:13.601066+0000","last_active":"2024-07-27T03:09:15.610112+0000","last_peered":"2024-07-27T03:09:15.610112+0000","last_clean":"2024-07-27T03:09:15.610112+0000","last_became_active":"2024-07-27T03:09:13.600739+0000","last_became_peered":"2024-07-27T03:09:13.600739+0000","last_unstale":"2024-07-27T03:09:15.610112+0000","last_undegraded":"2024-07-27T03:09:15.610112+0000","last_fullsized":"2024-07-27T03:09:15.610112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:26.159437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.584628+0000","last_change":"2024-07-27T03:09:12.584628+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.584628+0000","last_undegraded":"2024-07-27T03:09:12.584628+0000","last_fullsized":"2024-07-27T03:09:12.584628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660799+0000","last_change":"2024-07-27T03:09:13.606468+0000","last_active":"2024-07-27T03:09:15.660799+0000","last_peered":"2024-07-27T03:09:15.660799+0000","last_clean":"2024-07-27T03:09:15.660799+0000","last_became_active":"2024-07-27T03:09:13.606168+0000","last_became_peered":"2024-07-27T03:09:13.606168+0000","last_unstale":"2024-07-27T03:09:15.660799+0000","last_undegraded":"2024-07-27T03:09:15.660799+0000","last_fullsized":"2024-07-27T03:09:15.660799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:41:17.664971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657307+0000","last_change":"2024-07-27T03:09:12.657307+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657307+0000","last_undegraded":"2024-07-27T03:09:12.657307+0000","last_fullsized":"2024-07-27T03:09:12.657307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661868+0000","last_change":"2024-07-27T03:09:13.608738+0000","last_active":"2024-07-27T03:09:15.661868+0000","last_peered":"2024-07-27T03:09:15.661868+0000","last_clean":"2024-07-27T03:09:15.661868+0000","last_became_active":"2024-07-27T03:09:13.608362+0000","last_became_peered":"2024-07-27T03:09:13.608362+0000","last_unstale":"2024-07-27T03:09:15.661868+0000","last_undegraded":"2024-07-27T03:09:15.661868+0000","last_fullsized":"2024-07-27T03:09:15.661868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:54.757042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660523+0000","last_change":"2024-07-27T03:09:14.614687+0000","last_active":"2024-07-27T03:09:15.660523+0000","last_peered":"2024-07-27T03:09:15.660523+0000","last_clean":"2024-07-27T03:09:15.660523+0000","last_became_active":"2024-07-27T03:09:14.613957+0000","last_became_peered":"2024-07-27T03:09:14.613957+0000","last_unstale":"2024-07-27T03:09:15.660523+0000","last_undegraded":"2024-07-27T03:09:15.660523+0000","last_fullsized":"2024-07-27T03:09:15.660523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:22:49.333753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657354+0000","last_change":"2024-07-27T03:09:12.657354+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657354+0000","last_undegraded":"2024-07-27T03:09:12.657354+0000","last_fullsized":"2024-07-27T03:09:12.657354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660873+0000","last_change":"2024-07-27T03:09:13.607105+0000","last_active":"2024-07-27T03:09:15.660873+0000","last_peered":"2024-07-27T03:09:15.660873+0000","last_clean":"2024-07-27T03:09:15.660873+0000","last_became_active":"2024-07-27T03:09:13.606751+0000","last_became_peered":"2024-07-27T03:09:13.606751+0000","last_unstale":"2024-07-27T03:09:15.660873+0000","last_undegraded":"2024-07-27T03:09:15.660873+0000","last_fullsized":"2024-07-27T03:09:15.660873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:52.773759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611119+0000","last_change":"2024-07-27T03:09:13.600341+0000","last_active":"2024-07-27T03:09:15.611119+0000","last_peered":"2024-07-27T03:09:15.611119+0000","last_clean":"2024-07-27T03:09:15.611119+0000","last_became_active":"2024-07-27T03:09:13.600029+0000","last_became_peered":"2024-07-27T03:09:13.600029+0000","last_unstale":"2024-07-27T03:09:15.611119+0000","last_undegraded":"2024-07-27T03:09:15.611119+0000","last_fullsized":"2024-07-27T03:09:15.611119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:56:01.886146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610031+0000","last_change":"2024-07-27T03:09:14.618278+0000","last_active":"2024-07-27T03:09:15.610031+0000","last_peered":"2024-07-27T03:09:15.610031+0000","last_clean":"2024-07-27T03:09:15.610031+0000","last_became_active":"2024-07-27T03:09:14.617936+0000","last_became_peered":"2024-07-27T03:09:14.617936+0000","last_unstale":"2024-07-27T03:09:15.610031+0000","last_undegraded":"2024-07-27T03:09:15.610031+0000","last_fullsized":"2024-07-27T03:09:15.610031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:49:24.333630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587778+0000","last_change":"2024-07-27T03:09:12.587778+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587778+0000","last_undegraded":"2024-07-27T03:09:12.587778+0000","last_fullsized":"2024-07-27T03:09:12.587778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660132+0000","last_change":"2024-07-27T03:09:13.604580+0000","last_active":"2024-07-27T03:09:15.660132+0000","last_peered":"2024-07-27T03:09:15.660132+0000","last_clean":"2024-07-27T03:09:15.660132+0000","last_became_active":"2024-07-27T03:09:13.604304+0000","last_became_peered":"2024-07-27T03:09:13.604304+0000","last_unstale":"2024-07-27T03:09:15.660132+0000","last_undegraded":"2024-07-27T03:09:15.660132+0000","last_fullsized":"2024-07-27T03:09:15.660132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:56:01.886146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-07-27T03:09:12.589719+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:09:12.589719+0000","last_peered":"2024-07-27T03:09:12.589719+0000","last_clean":"2024-07-27T03:09:12.589719+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:09:12.589719+0000","last_undegraded":"2024-07-27T03:09:12.589719+0000","last_fullsized":"2024-07-27T03:09:12.589719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":141094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":140582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":142112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:09:19.019 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:09:19.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.165+0000 7f23886d9640 1 -- 172.21.15.120:0/2195201016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f238015c500 msgr2=0x7f2380074040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.165+0000 7f23886d9640 1 --2- 172.21.15.120:0/2195201016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f238015c500 0x7f2380074040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f237c005fd0 tx=0x7f237c02a970 comp rx=0 tx=0).stop 2024-07-27T03:09:19.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.165+0000 7f23886d9640 1 -- 172.21.15.120:0/2195201016 shutdown_connections 2024-07-27T03:09:19.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.165+0000 7f23886d9640 1 --2- 172.21.15.120:0/2195201016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2380071cf0 0x7f2380158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.165+0000 7f23886d9640 1 --2- 172.21.15.120:0/2195201016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f238015c500 0x7f2380074040 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.165+0000 7f23886d9640 1 -- 172.21.15.120:0/2195201016 >> 172.21.15.120:0/2195201016 conn(0x7f23800d0f00 msgr2=0x7f23800d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:19.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.165+0000 7f23886d9640 1 -- 172.21.15.120:0/2195201016 shutdown_connections 2024-07-27T03:09:19.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.165+0000 7f23886d9640 1 -- 172.21.15.120:0/2195201016 wait complete. 2024-07-27T03:09:19.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.167+0000 7f23886d9640 1 Processor -- start 2024-07-27T03:09:19.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.167+0000 7f23886d9640 1 -- start start 2024-07-27T03:09:19.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.168+0000 7f23886d9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f23800b4d30 0x7f2380144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.168+0000 7f23886d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f238015c500 0x7f23801f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.168+0000 7f23886d9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23801f61a0 0x7f2380157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.168+0000 7f23886d9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f23800703e0 con 0x7f238015c500 2024-07-27T03:09:19.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.168+0000 7f23886d9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2380070260 con 0x7f23801f61a0 2024-07-27T03:09:19.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.168+0000 7f23886d9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2380070560 con 0x7f23800b4d30 2024-07-27T03:09:19.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.168+0000 7f2385c74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f238015c500 0x7f23801f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.168+0000 7f2385c74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f238015c500 0x7f23801f1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49958/0 (socket says 172.21.15.120:49958) 2024-07-27T03:09:19.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.168+0000 7f2385c74640 1 -- 172.21.15.120:0/1381829407 learned_addr learned my addr 172.21.15.120:0/1381829407 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:19.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.168+0000 7f2386475640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f23800b4d30 0x7f2380144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.168+0000 7f2386c76640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23801f61a0 0x7f2380157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f2385c74640 1 -- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f23800b4d30 msgr2=0x7f2380144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f2385c74640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f23800b4d30 0x7f2380144480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f2385c74640 1 -- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23801f61a0 msgr2=0x7f2380157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f2385c74640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23801f61a0 0x7f2380157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f2385c74640 1 -- 172.21.15.120:0/1381829407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23801449c0 con 0x7f238015c500 2024-07-27T03:09:19.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f2386c76640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23801f61a0 0x7f2380157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:19.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f2385c74640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f238015c500 0x7f23801f1ef0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f237000b3c0 tx=0x7f237000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:19.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f2376ffd640 1 -- 172.21.15.120:0/1381829407 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237000f8a0 con 0x7f238015c500 2024-07-27T03:09:19.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f2376ffd640 1 -- 172.21.15.120:0/1381829407 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f237000fb30 con 0x7f238015c500 2024-07-27T03:09:19.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f23886d9640 1 -- 172.21.15.120:0/1381829407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23801f2bd0 con 0x7f238015c500 2024-07-27T03:09:19.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f2376ffd640 1 -- 172.21.15.120:0/1381829407 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370010470 con 0x7f238015c500 2024-07-27T03:09:19.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.169+0000 7f23886d9640 1 -- 172.21.15.120:0/1381829407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23801f59a0 con 0x7f238015c500 2024-07-27T03:09:19.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.170+0000 7f23886d9640 1 -- 172.21.15.120:0/1381829407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23801f2940 con 0x7f238015c500 2024-07-27T03:09:19.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.171+0000 7f2376ffd640 1 -- 172.21.15.120:0/1381829407 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2370010610 con 0x7f238015c500 2024-07-27T03:09:19.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.171+0000 7f2376ffd640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2364077010 0x7f2364079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.171+0000 7f2376ffd640 1 -- 172.21.15.120:0/1381829407 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f237009a730 con 0x7f238015c500 2024-07-27T03:09:19.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.171+0000 7f2386475640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2364077010 0x7f2364079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.172+0000 7f2386475640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2364077010 0x7f2364079520 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f237c035000 tx=0x7f237c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:19.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.176+0000 7f2376ffd640 1 -- 172.21.15.120:0/1381829407 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f23801449c0 con 0x7f238015c500 2024-07-27T03:09:19.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.352+0000 7f23886d9640 1 -- 172.21.15.120:0/1381829407 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23800cd740 con 0x7f2364077010 2024-07-27T03:09:19.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.357+0000 7f2376ffd640 1 -- 172.21.15.120:0/1381829407 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244359 (secure 0 0 0) 0x7f23800cd740 con 0x7f2364077010 2024-07-27T03:09:19.362 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:19.363 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:09:19.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.359+0000 7f23886d9640 1 -- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2364077010 msgr2=0x7f2364079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.359+0000 7f23886d9640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2364077010 0x7f2364079520 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f237c035000 tx=0x7f237c03c040 comp rx=0 tx=0).stop 2024-07-27T03:09:19.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.359+0000 7f23886d9640 1 -- 172.21.15.120:0/1381829407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f238015c500 msgr2=0x7f23801f1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.359+0000 7f23886d9640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f238015c500 0x7f23801f1ef0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f237000b3c0 tx=0x7f237000b880 comp rx=0 tx=0).stop 2024-07-27T03:09:19.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.359+0000 7f23886d9640 1 -- 172.21.15.120:0/1381829407 shutdown_connections 2024-07-27T03:09:19.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.359+0000 7f23886d9640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2364077010 0x7f2364079520 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.359+0000 7f23886d9640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f238015c500 0x7f23801f1ef0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.359+0000 7f23886d9640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23801f61a0 0x7f2380157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.359+0000 7f23886d9640 1 --2- 172.21.15.120:0/1381829407 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f23800b4d30 0x7f2380144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.359+0000 7f23886d9640 1 -- 172.21.15.120:0/1381829407 >> 172.21.15.120:0/1381829407 conn(0x7f23800d0f00 msgr2=0x7f23801552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:19.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.360+0000 7f23886d9640 1 -- 172.21.15.120:0/1381829407 shutdown_connections 2024-07-27T03:09:19.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.360+0000 7f23886d9640 1 -- 172.21.15.120:0/1381829407 wait complete. 2024-07-27T03:09:19.374 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-07-27T03:09:18.541994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591076,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224176,"kb_used_data":3836,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750544,"statfs":{"total":773094113280,"available":772864557056,"internally_reserved":0,"allocated":3928064,"data_stored":2198570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.959394"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660642+0000","last_change":"2024-07-27T03:09:14.626088+0000","last_active":"2024-07-27T03:09:15.660642+0000","last_peered":"2024-07-27T03:09:15.660642+0000","last_clean":"2024-07-27T03:09:15.660642+0000","last_became_active":"2024-07-27T03:09:14.624863+0000","last_became_peered":"2024-07-27T03:09:14.624863+0000","last_unstale":"2024-07-27T03:09:15.660642+0000","last_undegraded":"2024-07-27T03:09:15.660642+0000","last_fullsized":"2024-07-27T03:09:15.660642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:06.375815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661489+0000","last_change":"2024-07-27T03:09:14.618632+0000","last_active":"2024-07-27T03:09:15.661489+0000","last_peered":"2024-07-27T03:09:15.661489+0000","last_clean":"2024-07-27T03:09:15.661489+0000","last_became_active":"2024-07-27T03:09:14.618330+0000","last_became_peered":"2024-07-27T03:09:14.618330+0000","last_unstale":"2024-07-27T03:09:15.661489+0000","last_undegraded":"2024-07-27T03:09:15.661489+0000","last_fullsized":"2024-07-27T03:09:15.661489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:23:12.555273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610969+0000","last_change":"2024-07-27T03:09:14.616445+0000","last_active":"2024-07-27T03:09:15.610969+0000","last_peered":"2024-07-27T03:09:15.610969+0000","last_clean":"2024-07-27T03:09:15.610969+0000","last_became_active":"2024-07-27T03:09:14.615819+0000","last_became_peered":"2024-07-27T03:09:14.615819+0000","last_unstale":"2024-07-27T03:09:15.610969+0000","last_undegraded":"2024-07-27T03:09:15.610969+0000","last_fullsized":"2024-07-27T03:09:15.610969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:56.250073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660793+0000","last_change":"2024-07-27T03:09:14.619141+0000","last_active":"2024-07-27T03:09:15.660793+0000","last_peered":"2024-07-27T03:09:15.660793+0000","last_clean":"2024-07-27T03:09:15.660793+0000","last_became_active":"2024-07-27T03:09:14.618846+0000","last_became_peered":"2024-07-27T03:09:14.618846+0000","last_unstale":"2024-07-27T03:09:15.660793+0000","last_undegraded":"2024-07-27T03:09:15.660793+0000","last_fullsized":"2024-07-27T03:09:15.660793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:05.563749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610653+0000","last_change":"2024-07-27T03:09:14.613012+0000","last_active":"2024-07-27T03:09:15.610653+0000","last_peered":"2024-07-27T03:09:15.610653+0000","last_clean":"2024-07-27T03:09:15.610653+0000","last_became_active":"2024-07-27T03:09:14.612684+0000","last_became_peered":"2024-07-27T03:09:14.612684+0000","last_unstale":"2024-07-27T03:09:15.610653+0000","last_undegraded":"2024-07-27T03:09:15.610653+0000","last_fullsized":"2024-07-27T03:09:15.610653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:07:53.511397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610406+0000","last_change":"2024-07-27T03:09:14.617890+0000","last_active":"2024-07-27T03:09:15.610406+0000","last_peered":"2024-07-27T03:09:15.610406+0000","last_clean":"2024-07-27T03:09:15.610406+0000","last_became_active":"2024-07-27T03:09:14.617449+0000","last_became_peered":"2024-07-27T03:09:14.617449+0000","last_unstale":"2024-07-27T03:09:15.610406+0000","last_undegraded":"2024-07-27T03:09:15.610406+0000","last_fullsized":"2024-07-27T03:09:15.610406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:02:44.318459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660650+0000","last_change":"2024-07-27T03:09:14.612567+0000","last_active":"2024-07-27T03:09:15.660650+0000","last_peered":"2024-07-27T03:09:15.660650+0000","last_clean":"2024-07-27T03:09:15.660650+0000","last_became_active":"2024-07-27T03:09:14.612276+0000","last_became_peered":"2024-07-27T03:09:14.612276+0000","last_unstale":"2024-07-27T03:09:15.660650+0000","last_undegraded":"2024-07-27T03:09:15.660650+0000","last_fullsized":"2024-07-27T03:09:15.660650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:56.250073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660790+0000","last_change":"2024-07-27T03:09:14.618014+0000","last_active":"2024-07-27T03:09:15.660790+0000","last_peered":"2024-07-27T03:09:15.660790+0000","last_clean":"2024-07-27T03:09:15.660790+0000","last_became_active":"2024-07-27T03:09:14.617721+0000","last_became_peered":"2024-07-27T03:09:14.617721+0000","last_unstale":"2024-07-27T03:09:15.660790+0000","last_undegraded":"2024-07-27T03:09:15.660790+0000","last_fullsized":"2024-07-27T03:09:15.660790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:23:40.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610673+0000","last_change":"2024-07-27T03:09:14.618738+0000","last_active":"2024-07-27T03:09:15.610673+0000","last_peered":"2024-07-27T03:09:15.610673+0000","last_clean":"2024-07-27T03:09:15.610673+0000","last_became_active":"2024-07-27T03:09:14.618401+0000","last_became_peered":"2024-07-27T03:09:14.618401+0000","last_unstale":"2024-07-27T03:09:15.610673+0000","last_undegraded":"2024-07-27T03:09:15.610673+0000","last_fullsized":"2024-07-27T03:09:15.610673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:16.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660410+0000","last_change":"2024-07-27T03:09:14.624479+0000","last_active":"2024-07-27T03:09:15.660410+0000","last_peered":"2024-07-27T03:09:15.660410+0000","last_clean":"2024-07-27T03:09:15.660410+0000","last_became_active":"2024-07-27T03:09:14.623934+0000","last_became_peered":"2024-07-27T03:09:14.623934+0000","last_unstale":"2024-07-27T03:09:15.660410+0000","last_undegraded":"2024-07-27T03:09:15.660410+0000","last_fullsized":"2024-07-27T03:09:15.660410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:24:00.946497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660781+0000","last_change":"2024-07-27T03:09:13.607927+0000","last_active":"2024-07-27T03:09:15.660781+0000","last_peered":"2024-07-27T03:09:15.660781+0000","last_clean":"2024-07-27T03:09:15.660781+0000","last_became_active":"2024-07-27T03:09:13.607590+0000","last_became_peered":"2024-07-27T03:09:13.607590+0000","last_unstale":"2024-07-27T03:09:15.660781+0000","last_undegraded":"2024-07-27T03:09:15.660781+0000","last_fullsized":"2024-07-27T03:09:15.660781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:28:25.823999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660704+0000","last_change":"2024-07-27T03:09:14.623980+0000","last_active":"2024-07-27T03:09:15.660704+0000","last_peered":"2024-07-27T03:09:15.660704+0000","last_clean":"2024-07-27T03:09:15.660704+0000","last_became_active":"2024-07-27T03:09:14.622593+0000","last_became_peered":"2024-07-27T03:09:14.622593+0000","last_unstale":"2024-07-27T03:09:15.660704+0000","last_undegraded":"2024-07-27T03:09:15.660704+0000","last_fullsized":"2024-07-27T03:09:15.660704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:07:33.124882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.658526+0000","last_change":"2024-07-27T03:09:12.658526+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.658526+0000","last_undegraded":"2024-07-27T03:09:12.658526+0000","last_fullsized":"2024-07-27T03:09:12.658526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611282+0000","last_change":"2024-07-27T03:09:14.619505+0000","last_active":"2024-07-27T03:09:15.611282+0000","last_peered":"2024-07-27T03:09:15.611282+0000","last_clean":"2024-07-27T03:09:15.611282+0000","last_became_active":"2024-07-27T03:09:14.618709+0000","last_became_peered":"2024-07-27T03:09:14.618709+0000","last_unstale":"2024-07-27T03:09:15.611282+0000","last_undegraded":"2024-07-27T03:09:15.611282+0000","last_fullsized":"2024-07-27T03:09:15.611282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:23:40.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588160+0000","last_change":"2024-07-27T03:09:12.588160+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588160+0000","last_undegraded":"2024-07-27T03:09:12.588160+0000","last_fullsized":"2024-07-27T03:09:12.588160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660954+0000","last_change":"2024-07-27T03:09:14.617781+0000","last_active":"2024-07-27T03:09:15.660954+0000","last_peered":"2024-07-27T03:09:15.660954+0000","last_clean":"2024-07-27T03:09:15.660954+0000","last_became_active":"2024-07-27T03:09:14.617337+0000","last_became_peered":"2024-07-27T03:09:14.617337+0000","last_unstale":"2024-07-27T03:09:15.660954+0000","last_undegraded":"2024-07-27T03:09:15.660954+0000","last_fullsized":"2024-07-27T03:09:15.660954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:07:12.274640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.586000+0000","last_change":"2024-07-27T03:09:12.586000+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.586000+0000","last_undegraded":"2024-07-27T03:09:12.586000+0000","last_fullsized":"2024-07-27T03:09:12.586000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610812+0000","last_change":"2024-07-27T03:09:13.602765+0000","last_active":"2024-07-27T03:09:15.610812+0000","last_peered":"2024-07-27T03:09:15.610812+0000","last_clean":"2024-07-27T03:09:15.610812+0000","last_became_active":"2024-07-27T03:09:13.602412+0000","last_became_peered":"2024-07-27T03:09:13.602412+0000","last_unstale":"2024-07-27T03:09:15.610812+0000","last_undegraded":"2024-07-27T03:09:15.610812+0000","last_fullsized":"2024-07-27T03:09:15.610812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:38.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610495+0000","last_change":"2024-07-27T03:09:13.602915+0000","last_active":"2024-07-27T03:09:15.610495+0000","last_peered":"2024-07-27T03:09:15.610495+0000","last_clean":"2024-07-27T03:09:15.610495+0000","last_became_active":"2024-07-27T03:09:13.602529+0000","last_became_peered":"2024-07-27T03:09:13.602529+0000","last_unstale":"2024-07-27T03:09:15.610495+0000","last_undegraded":"2024-07-27T03:09:15.610495+0000","last_fullsized":"2024-07-27T03:09:15.610495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:32:18.241705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610015+0000","last_change":"2024-07-27T03:09:14.616446+0000","last_active":"2024-07-27T03:09:15.610015+0000","last_peered":"2024-07-27T03:09:15.610015+0000","last_clean":"2024-07-27T03:09:15.610015+0000","last_became_active":"2024-07-27T03:09:14.615748+0000","last_became_peered":"2024-07-27T03:09:14.615748+0000","last_unstale":"2024-07-27T03:09:15.610015+0000","last_undegraded":"2024-07-27T03:09:15.610015+0000","last_fullsized":"2024-07-27T03:09:15.610015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:35:57.828278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588717+0000","last_change":"2024-07-27T03:09:12.588717+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588717+0000","last_undegraded":"2024-07-27T03:09:12.588717+0000","last_fullsized":"2024-07-27T03:09:12.588717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660573+0000","last_change":"2024-07-27T03:09:14.622500+0000","last_active":"2024-07-27T03:09:15.660573+0000","last_peered":"2024-07-27T03:09:15.660573+0000","last_clean":"2024-07-27T03:09:15.660573+0000","last_became_active":"2024-07-27T03:09:14.622134+0000","last_became_peered":"2024-07-27T03:09:14.622134+0000","last_unstale":"2024-07-27T03:09:15.660573+0000","last_undegraded":"2024-07-27T03:09:15.660573+0000","last_fullsized":"2024-07-27T03:09:15.660573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:16.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.609956+0000","last_change":"2024-07-27T03:09:13.606250+0000","last_active":"2024-07-27T03:09:15.609956+0000","last_peered":"2024-07-27T03:09:15.609956+0000","last_clean":"2024-07-27T03:09:15.609956+0000","last_became_active":"2024-07-27T03:09:13.604310+0000","last_became_peered":"2024-07-27T03:09:13.604310+0000","last_unstale":"2024-07-27T03:09:15.609956+0000","last_undegraded":"2024-07-27T03:09:15.609956+0000","last_fullsized":"2024-07-27T03:09:15.609956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:46:44.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587748+0000","last_change":"2024-07-27T03:09:12.587748+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587748+0000","last_undegraded":"2024-07-27T03:09:12.587748+0000","last_fullsized":"2024-07-27T03:09:12.587748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657915+0000","last_change":"2024-07-27T03:09:12.657915+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657915+0000","last_undegraded":"2024-07-27T03:09:12.657915+0000","last_fullsized":"2024-07-27T03:09:12.657915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.584920+0000","last_change":"2024-07-27T03:09:12.584920+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.584920+0000","last_undegraded":"2024-07-27T03:09:12.584920+0000","last_fullsized":"2024-07-27T03:09:12.584920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587728+0000","last_change":"2024-07-27T03:09:12.587728+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587728+0000","last_undegraded":"2024-07-27T03:09:12.587728+0000","last_fullsized":"2024-07-27T03:09:12.587728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660636+0000","last_change":"2024-07-27T03:09:14.623159+0000","last_active":"2024-07-27T03:09:15.660636+0000","last_peered":"2024-07-27T03:09:15.660636+0000","last_clean":"2024-07-27T03:09:15.660636+0000","last_became_active":"2024-07-27T03:09:14.622206+0000","last_became_peered":"2024-07-27T03:09:14.622206+0000","last_unstale":"2024-07-27T03:09:15.660636+0000","last_undegraded":"2024-07-27T03:09:15.660636+0000","last_fullsized":"2024-07-27T03:09:15.660636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:12.575517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610834+0000","last_change":"2024-07-27T03:09:13.605927+0000","last_active":"2024-07-27T03:09:15.610834+0000","last_peered":"2024-07-27T03:09:15.610834+0000","last_clean":"2024-07-27T03:09:15.610834+0000","last_became_active":"2024-07-27T03:09:13.604222+0000","last_became_peered":"2024-07-27T03:09:13.604222+0000","last_unstale":"2024-07-27T03:09:15.610834+0000","last_undegraded":"2024-07-27T03:09:15.610834+0000","last_fullsized":"2024-07-27T03:09:15.610834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:05:09.003909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660767+0000","last_change":"2024-07-27T03:09:13.606401+0000","last_active":"2024-07-27T03:09:15.660767+0000","last_peered":"2024-07-27T03:09:15.660767+0000","last_clean":"2024-07-27T03:09:15.660767+0000","last_became_active":"2024-07-27T03:09:13.606094+0000","last_became_peered":"2024-07-27T03:09:13.606094+0000","last_unstale":"2024-07-27T03:09:15.660767+0000","last_undegraded":"2024-07-27T03:09:15.660767+0000","last_fullsized":"2024-07-27T03:09:15.660767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:18:48.224902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587756+0000","last_change":"2024-07-27T03:09:12.587756+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587756+0000","last_undegraded":"2024-07-27T03:09:12.587756+0000","last_fullsized":"2024-07-27T03:09:12.587756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660298+0000","last_change":"2024-07-27T03:09:14.623092+0000","last_active":"2024-07-27T03:09:15.660298+0000","last_peered":"2024-07-27T03:09:15.660298+0000","last_clean":"2024-07-27T03:09:15.660298+0000","last_became_active":"2024-07-27T03:09:14.622749+0000","last_became_peered":"2024-07-27T03:09:14.622749+0000","last_unstale":"2024-07-27T03:09:15.660298+0000","last_undegraded":"2024-07-27T03:09:15.660298+0000","last_fullsized":"2024-07-27T03:09:15.660298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:41:18.671396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588318+0000","last_change":"2024-07-27T03:09:12.588318+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588318+0000","last_undegraded":"2024-07-27T03:09:12.588318+0000","last_fullsized":"2024-07-27T03:09:12.588318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610726+0000","last_change":"2024-07-27T03:09:14.627550+0000","last_active":"2024-07-27T03:09:15.610726+0000","last_peered":"2024-07-27T03:09:15.610726+0000","last_clean":"2024-07-27T03:09:15.610726+0000","last_became_active":"2024-07-27T03:09:14.627173+0000","last_became_peered":"2024-07-27T03:09:14.627173+0000","last_unstale":"2024-07-27T03:09:15.610726+0000","last_undegraded":"2024-07-27T03:09:15.610726+0000","last_fullsized":"2024-07-27T03:09:15.610726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:12.575517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660781+0000","last_change":"2024-07-27T03:09:13.605511+0000","last_active":"2024-07-27T03:09:15.660781+0000","last_peered":"2024-07-27T03:09:15.660781+0000","last_clean":"2024-07-27T03:09:15.660781+0000","last_became_active":"2024-07-27T03:09:13.604979+0000","last_became_peered":"2024-07-27T03:09:13.604979+0000","last_unstale":"2024-07-27T03:09:15.660781+0000","last_undegraded":"2024-07-27T03:09:15.660781+0000","last_fullsized":"2024-07-27T03:09:15.660781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:29:10.340511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610399+0000","last_change":"2024-07-27T03:09:13.605887+0000","last_active":"2024-07-27T03:09:15.610399+0000","last_peered":"2024-07-27T03:09:15.610399+0000","last_clean":"2024-07-27T03:09:15.610399+0000","last_became_active":"2024-07-27T03:09:13.605518+0000","last_became_peered":"2024-07-27T03:09:13.605518+0000","last_unstale":"2024-07-27T03:09:15.610399+0000","last_undegraded":"2024-07-27T03:09:15.610399+0000","last_fullsized":"2024-07-27T03:09:15.610399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:43:24.612891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661674+0000","last_change":"2024-07-27T03:09:14.617479+0000","last_active":"2024-07-27T03:09:15.661674+0000","last_peered":"2024-07-27T03:09:15.661674+0000","last_clean":"2024-07-27T03:09:15.661674+0000","last_became_active":"2024-07-27T03:09:14.617003+0000","last_became_peered":"2024-07-27T03:09:14.617003+0000","last_unstale":"2024-07-27T03:09:15.661674+0000","last_undegraded":"2024-07-27T03:09:15.661674+0000","last_fullsized":"2024-07-27T03:09:15.661674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:59:04.248587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610563+0000","last_change":"2024-07-27T03:09:13.601807+0000","last_active":"2024-07-27T03:09:15.610563+0000","last_peered":"2024-07-27T03:09:15.610563+0000","last_clean":"2024-07-27T03:09:15.610563+0000","last_became_active":"2024-07-27T03:09:13.600603+0000","last_became_peered":"2024-07-27T03:09:13.600603+0000","last_unstale":"2024-07-27T03:09:15.610563+0000","last_undegraded":"2024-07-27T03:09:15.610563+0000","last_fullsized":"2024-07-27T03:09:15.610563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:12:16.902363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611258+0000","last_change":"2024-07-27T03:09:13.603828+0000","last_active":"2024-07-27T03:09:15.611258+0000","last_peered":"2024-07-27T03:09:15.611258+0000","last_clean":"2024-07-27T03:09:15.611258+0000","last_became_active":"2024-07-27T03:09:13.603208+0000","last_became_peered":"2024-07-27T03:09:13.603208+0000","last_unstale":"2024-07-27T03:09:15.611258+0000","last_undegraded":"2024-07-27T03:09:15.611258+0000","last_fullsized":"2024-07-27T03:09:15.611258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:28:25.823999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657824+0000","last_change":"2024-07-27T03:09:12.657824+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657824+0000","last_undegraded":"2024-07-27T03:09:12.657824+0000","last_fullsized":"2024-07-27T03:09:12.657824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660421+0000","last_change":"2024-07-27T03:09:13.609088+0000","last_active":"2024-07-27T03:09:15.660421+0000","last_peered":"2024-07-27T03:09:15.660421+0000","last_clean":"2024-07-27T03:09:15.660421+0000","last_became_active":"2024-07-27T03:09:13.608835+0000","last_became_peered":"2024-07-27T03:09:13.608835+0000","last_unstale":"2024-07-27T03:09:15.660421+0000","last_undegraded":"2024-07-27T03:09:15.660421+0000","last_fullsized":"2024-07-27T03:09:15.660421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:46:44.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610112+0000","last_change":"2024-07-27T03:09:13.601066+0000","last_active":"2024-07-27T03:09:15.610112+0000","last_peered":"2024-07-27T03:09:15.610112+0000","last_clean":"2024-07-27T03:09:15.610112+0000","last_became_active":"2024-07-27T03:09:13.600739+0000","last_became_peered":"2024-07-27T03:09:13.600739+0000","last_unstale":"2024-07-27T03:09:15.610112+0000","last_undegraded":"2024-07-27T03:09:15.610112+0000","last_fullsized":"2024-07-27T03:09:15.610112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:26.159437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.584628+0000","last_change":"2024-07-27T03:09:12.584628+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.584628+0000","last_undegraded":"2024-07-27T03:09:12.584628+0000","last_fullsized":"2024-07-27T03:09:12.584628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660799+0000","last_change":"2024-07-27T03:09:13.606468+0000","last_active":"2024-07-27T03:09:15.660799+0000","last_peered":"2024-07-27T03:09:15.660799+0000","last_clean":"2024-07-27T03:09:15.660799+0000","last_became_active":"2024-07-27T03:09:13.606168+0000","last_became_peered":"2024-07-27T03:09:13.606168+0000","last_unstale":"2024-07-27T03:09:15.660799+0000","last_undegraded":"2024-07-27T03:09:15.660799+0000","last_fullsized":"2024-07-27T03:09:15.660799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:41:17.664971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657307+0000","last_change":"2024-07-27T03:09:12.657307+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657307+0000","last_undegraded":"2024-07-27T03:09:12.657307+0000","last_fullsized":"2024-07-27T03:09:12.657307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661868+0000","last_change":"2024-07-27T03:09:13.608738+0000","last_active":"2024-07-27T03:09:15.661868+0000","last_peered":"2024-07-27T03:09:15.661868+0000","last_clean":"2024-07-27T03:09:15.661868+0000","last_became_active":"2024-07-27T03:09:13.608362+0000","last_became_peered":"2024-07-27T03:09:13.608362+0000","last_unstale":"2024-07-27T03:09:15.661868+0000","last_undegraded":"2024-07-27T03:09:15.661868+0000","last_fullsized":"2024-07-27T03:09:15.661868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:54.757042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660523+0000","last_change":"2024-07-27T03:09:14.614687+0000","last_active":"2024-07-27T03:09:15.660523+0000","last_peered":"2024-07-27T03:09:15.660523+0000","last_clean":"2024-07-27T03:09:15.660523+0000","last_became_active":"2024-07-27T03:09:14.613957+0000","last_became_peered":"2024-07-27T03:09:14.613957+0000","last_unstale":"2024-07-27T03:09:15.660523+0000","last_undegraded":"2024-07-27T03:09:15.660523+0000","last_fullsized":"2024-07-27T03:09:15.660523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:22:49.333753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657354+0000","last_change":"2024-07-27T03:09:12.657354+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657354+0000","last_undegraded":"2024-07-27T03:09:12.657354+0000","last_fullsized":"2024-07-27T03:09:12.657354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660873+0000","last_change":"2024-07-27T03:09:13.607105+0000","last_active":"2024-07-27T03:09:15.660873+0000","last_peered":"2024-07-27T03:09:15.660873+0000","last_clean":"2024-07-27T03:09:15.660873+0000","last_became_active":"2024-07-27T03:09:13.606751+0000","last_became_peered":"2024-07-27T03:09:13.606751+0000","last_unstale":"2024-07-27T03:09:15.660873+0000","last_undegraded":"2024-07-27T03:09:15.660873+0000","last_fullsized":"2024-07-27T03:09:15.660873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:52.773759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611119+0000","last_change":"2024-07-27T03:09:13.600341+0000","last_active":"2024-07-27T03:09:15.611119+0000","last_peered":"2024-07-27T03:09:15.611119+0000","last_clean":"2024-07-27T03:09:15.611119+0000","last_became_active":"2024-07-27T03:09:13.600029+0000","last_became_peered":"2024-07-27T03:09:13.600029+0000","last_unstale":"2024-07-27T03:09:15.611119+0000","last_undegraded":"2024-07-27T03:09:15.611119+0000","last_fullsized":"2024-07-27T03:09:15.611119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:56:01.886146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610031+0000","last_change":"2024-07-27T03:09:14.618278+0000","last_active":"2024-07-27T03:09:15.610031+0000","last_peered":"2024-07-27T03:09:15.610031+0000","last_clean":"2024-07-27T03:09:15.610031+0000","last_became_active":"2024-07-27T03:09:14.617936+0000","last_became_peered":"2024-07-27T03:09:14.617936+0000","last_unstale":"2024-07-27T03:09:15.610031+0000","last_undegraded":"2024-07-27T03:09:15.610031+0000","last_fullsized":"2024-07-27T03:09:15.610031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:49:24.333630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587778+0000","last_change":"2024-07-27T03:09:12.587778+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587778+0000","last_undegraded":"2024-07-27T03:09:12.587778+0000","last_fullsized":"2024-07-27T03:09:12.587778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660132+0000","last_change":"2024-07-27T03:09:13.604580+0000","last_active":"2024-07-27T03:09:15.660132+0000","last_peered":"2024-07-27T03:09:15.660132+0000","last_clean":"2024-07-27T03:09:15.660132+0000","last_became_active":"2024-07-27T03:09:13.604304+0000","last_became_peered":"2024-07-27T03:09:13.604304+0000","last_unstale":"2024-07-27T03:09:15.660132+0000","last_undegraded":"2024-07-27T03:09:15.660132+0000","last_fullsized":"2024-07-27T03:09:15.660132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:56:01.886146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-07-27T03:09:12.589719+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:09:12.589719+0000","last_peered":"2024-07-27T03:09:12.589719+0000","last_clean":"2024-07-27T03:09:12.589719+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:09:12.589719+0000","last_undegraded":"2024-07-27T03:09:12.589719+0000","last_fullsized":"2024-07-27T03:09:12.589719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":141094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":140582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":142112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:09:19.377 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-07-27T03:09:19.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.377 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-07-27T03:09:19.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.378 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-07-27T03:09:19.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.378 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-07-27T03:09:19.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.378 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-07-27T03:09:19.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.378 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-07-27T03:09:19.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.378 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-07-27T03:09:19.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-07-27T03:09:19.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.380 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-07-27T03:09:19.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.380 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-07-27T03:09:19.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.380 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-07-27T03:09:19.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.380 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-07-27T03:09:19.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.380 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-07-27T03:09:19.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.380 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-07-27T03:09:19.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.381 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-07-27T03:09:19.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.381 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-07-27T03:09:19.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.381 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-07-27T03:09:19.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.381 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-07-27T03:09:19.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.381 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-07-27T03:09:19.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.658526+0000', 'last_change': '2024-07-27T03:09:12.658526+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.658526+0000', 'last_undegraded': '2024-07-27T03:09:12.658526+0000', 'last_fullsized': '2024-07-27T03:09:12.658526+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:09:19.382 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-07-27T03:09:19.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.588160+0000', 'last_change': '2024-07-27T03:09:12.588160+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.588160+0000', 'last_undegraded': '2024-07-27T03:09:12.588160+0000', 'last_fullsized': '2024-07-27T03:09:12.588160+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:09:19.382 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-07-27T03:09:19.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.586000+0000', 'last_change': '2024-07-27T03:09:12.586000+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.586000+0000', 'last_undegraded': '2024-07-27T03:09:12.586000+0000', 'last_fullsized': '2024-07-27T03:09:12.586000+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-27T03:09:19.382 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-07-27T03:09:19.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.382 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-07-27T03:09:19.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.382 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-07-27T03:09:19.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.588717+0000', 'last_change': '2024-07-27T03:09:12.588717+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.588717+0000', 'last_undegraded': '2024-07-27T03:09:12.588717+0000', 'last_fullsized': '2024-07-27T03:09:12.588717+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:09:19.382 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-07-27T03:09:19.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.383 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-07-27T03:09:19.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.587748+0000', 'last_change': '2024-07-27T03:09:12.587748+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.587748+0000', 'last_undegraded': '2024-07-27T03:09:12.587748+0000', 'last_fullsized': '2024-07-27T03:09:12.587748+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:09:19.383 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-07-27T03:09:19.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.383 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-07-27T03:09:19.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.657915+0000', 'last_change': '2024-07-27T03:09:12.657915+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.657915+0000', 'last_undegraded': '2024-07-27T03:09:12.657915+0000', 'last_fullsized': '2024-07-27T03:09:12.657915+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:09:19.383 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-07-27T03:09:19.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.383 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-07-27T03:09:19.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.584920+0000', 'last_change': '2024-07-27T03:09:12.584920+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.584920+0000', 'last_undegraded': '2024-07-27T03:09:12.584920+0000', 'last_fullsized': '2024-07-27T03:09:12.584920+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.587728+0000', 'last_change': '2024-07-27T03:09:12.587728+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.587728+0000', 'last_undegraded': '2024-07-27T03:09:12.587728+0000', 'last_fullsized': '2024-07-27T03:09:12.587728+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.587756+0000', 'last_change': '2024-07-27T03:09:12.587756+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.587756+0000', 'last_undegraded': '2024-07-27T03:09:12.587756+0000', 'last_fullsized': '2024-07-27T03:09:12.587756+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-07-27T03:09:19.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.588318+0000', 'last_change': '2024-07-27T03:09:12.588318+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.588318+0000', 'last_undegraded': '2024-07-27T03:09:12.588318+0000', 'last_fullsized': '2024-07-27T03:09:12.588318+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.657824+0000', 'last_change': '2024-07-27T03:09:12.657824+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.657824+0000', 'last_undegraded': '2024-07-27T03:09:12.657824+0000', 'last_fullsized': '2024-07-27T03:09:12.657824+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-07-27T03:09:19.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.386 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-07-27T03:09:19.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.386 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-07-27T03:09:19.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.584628+0000', 'last_change': '2024-07-27T03:09:12.584628+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.584628+0000', 'last_undegraded': '2024-07-27T03:09:12.584628+0000', 'last_fullsized': '2024-07-27T03:09:12.584628+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:09:19.386 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-07-27T03:09:19.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.386 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-07-27T03:09:19.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.386 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-07-27T03:09:19.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.657307+0000', 'last_change': '2024-07-27T03:09:12.657307+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.657307+0000', 'last_undegraded': '2024-07-27T03:09:12.657307+0000', 'last_fullsized': '2024-07-27T03:09:12.657307+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:09:19.386 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-07-27T03:09:19.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.387 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-07-27T03:09:19.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.657354+0000', 'last_change': '2024-07-27T03:09:12.657354+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.657354+0000', 'last_undegraded': '2024-07-27T03:09:12.657354+0000', 'last_fullsized': '2024-07-27T03:09:12.657354+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:09:19.387 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-07-27T03:09:19.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.387 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-07-27T03:09:19.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.387 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-07-27T03:09:19.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:09:12.587778+0000', 'last_change': '2024-07-27T03:09:12.587778+0000', 'last_active': '2024-07-27T03:09:12.575189+0000', 'last_peered': '2024-07-27T03:09:12.575189+0000', 'last_clean': '2024-07-27T03:09:12.575189+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:12.587778+0000', 'last_undegraded': '2024-07-27T03:09:12.587778+0000', 'last_fullsized': '2024-07-27T03:09:12.587778+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:12.575189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:09:19.387 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-07-27T03:09:19.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:09:13.581614+0000', 'last_change': '2024-07-27T03:09:13.581614+0000', 'last_active': '2024-07-27T03:09:13.581614+0000', 'last_peered': '2024-07-27T03:09:13.581614+0000', 'last_clean': '2024-07-27T03:09:13.581614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:09:13.581614+0000', 'last_undegraded': '2024-07-27T03:09:13.581614+0000', 'last_fullsized': '2024-07-27T03:09:13.581614+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'last_clean_scrub_stamp': '2024-07-27T03:09:13.581614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:09:19.388 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-07-27T03:09:19.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.524+0000 7f914e935640 1 -- 172.21.15.120:0/2903406598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9130003a00 msgr2=0x7f9130003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.524+0000 7f914e935640 1 --2- 172.21.15.120:0/2903406598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9130003a00 0x7f9130003e70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f913800c2c0 tx=0x7f9130005830 comp rx=0 tx=0).stop 2024-07-27T03:09:19.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.524+0000 7f914ced2640 1 -- 172.21.15.120:0/2903406598 reap_dead start 2024-07-27T03:09:19.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.524+0000 7f914e935640 1 -- 172.21.15.120:0/2903406598 shutdown_connections 2024-07-27T03:09:19.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.524+0000 7f914e935640 1 -- 172.21.15.120:0/2903406598 >> 172.21.15.120:0/2903406598 conn(0x7f91480b3920 msgr2=0x7f91480b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:19.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.524+0000 7f914e935640 1 -- 172.21.15.120:0/2903406598 shutdown_connections 2024-07-27T03:09:19.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.524+0000 7f914e935640 1 -- 172.21.15.120:0/2903406598 wait complete. 2024-07-27T03:09:19.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.526+0000 7f914e935640 1 Processor -- start 2024-07-27T03:09:19.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.526+0000 7f914e935640 1 -- start start 2024-07-27T03:09:19.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.527+0000 7f914e935640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9130003a00 0x7f9148159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914e935640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f91480c8ec0 0x7f91480b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914e935640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91480b1bf0 0x7f9148150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914e935640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f914815ef40 con 0x7f91480b1bf0 2024-07-27T03:09:19.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914e935640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f914815edc0 con 0x7f9130003a00 2024-07-27T03:09:19.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914e935640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f914815f0c0 con 0x7f91480c8ec0 2024-07-27T03:09:19.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914ced2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91480b1bf0 0x7f9148150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914ced2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91480b1bf0 0x7f9148150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49974/0 (socket says 172.21.15.120:49974) 2024-07-27T03:09:19.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914ced2640 1 -- 172.21.15.120:0/3555670421 learned_addr learned my addr 172.21.15.120:0/3555670421 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:19.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f91477fe640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f91480c8ec0 0x7f91480b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f9147fff640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9130003a00 0x7f9148159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914ced2640 1 -- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f91480c8ec0 msgr2=0x7f91480b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914ced2640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f91480c8ec0 0x7f91480b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914ced2640 1 -- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9130003a00 msgr2=0x7f9148159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914ced2640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9130003a00 0x7f9148159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914ced2640 1 -- 172.21.15.120:0/3555670421 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91480c9630 con 0x7f91480b1bf0 2024-07-27T03:09:19.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914ced2640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91480b1bf0 0x7f9148150d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9140005fd0 tx=0x7f9140010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:19.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f9144ff9640 1 -- 172.21.15.120:0/3555670421 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914000edc0 con 0x7f91480b1bf0 2024-07-27T03:09:19.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f9144ff9640 1 -- 172.21.15.120:0/3555670421 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9140015070 con 0x7f91480b1bf0 2024-07-27T03:09:19.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914e935640 1 -- 172.21.15.120:0/3555670421 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91480c9910 con 0x7f91480b1bf0 2024-07-27T03:09:19.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f9144ff9640 1 -- 172.21.15.120:0/3555670421 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9140003d00 con 0x7f91480b1bf0 2024-07-27T03:09:19.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.528+0000 7f914e935640 1 -- 172.21.15.120:0/3555670421 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91480c9ed0 con 0x7f91480b1bf0 2024-07-27T03:09:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.529+0000 7f914e935640 1 -- 172.21.15.120:0/3555670421 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91480c93a0 con 0x7f91480b1bf0 2024-07-27T03:09:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.530+0000 7f9144ff9640 1 -- 172.21.15.120:0/3555670421 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9140004030 con 0x7f91480b1bf0 2024-07-27T03:09:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.531+0000 7f9144ff9640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9134077010 0x7f9134079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.531+0000 7f9144ff9640 1 -- 172.21.15.120:0/3555670421 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9140099280 con 0x7f91480b1bf0 2024-07-27T03:09:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.531+0000 7f9147fff640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9134077010 0x7f9134079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.531+0000 7f9147fff640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9134077010 0x7f9134079520 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9138033000 tx=0x7f9138038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:19.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.535+0000 7f9144ff9640 1 -- 172.21.15.120:0/3555670421 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f9140061ec0 con 0x7f91480b1bf0 2024-07-27T03:09:19.577 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-07-27T03:09:19.573+0000 7f70df2ac640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-27T03:09:19.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.789+0000 7f914e935640 1 -- 172.21.15.120:0/3555670421 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f91480b2520 con 0x7f91480b1bf0 2024-07-27T03:09:19.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.790+0000 7f9144ff9640 1 -- 172.21.15.120:0/3555670421 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3411 (secure 0 0 0) 0x7f9140066410 con 0x7f91480b1bf0 2024-07-27T03:09:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:19.793 INFO:teuthology.orchestra.run.smithi120.stdout:{"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":63,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1722049707,"num_in_osds":8,"osd_in_since":1722049699,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":43},{"state_name":"active+clean","count":39},{"state_name":"creating+peering","count":15}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":591076,"bytes_used":229556224,"bytes_avail":772864557056,"bytes_total":773094113280,"unknown_pgs_ratio":0.44329896569252014,"inactive_pgs_ratio":0.15463916957378387,"write_bytes_sec":1718,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":17,"btime":"2024-07-27T03:09:17:631494+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4860}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-07-27T03:09:04.539443+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-07-27T03:09:19.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 -- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9134077010 msgr2=0x7f9134079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9134077010 0x7f9134079520 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9138033000 tx=0x7f9138038040 comp rx=0 tx=0).stop 2024-07-27T03:09:19.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 -- 172.21.15.120:0/3555670421 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91480b1bf0 msgr2=0x7f9148150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91480b1bf0 0x7f9148150d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9140005fd0 tx=0x7f9140010e80 comp rx=0 tx=0).stop 2024-07-27T03:09:19.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 -- 172.21.15.120:0/3555670421 shutdown_connections 2024-07-27T03:09:19.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9134077010 0x7f9134079520 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91480b1bf0 0x7f9148150d90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f91480c8ec0 0x7f91480b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 --2- 172.21.15.120:0/3555670421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9130003a00 0x7f9148159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 -- 172.21.15.120:0/3555670421 >> 172.21.15.120:0/3555670421 conn(0x7f91480b3920 msgr2=0x7f914815c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:19.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 -- 172.21.15.120:0/3555670421 shutdown_connections 2024-07-27T03:09:19.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.792+0000 7f914e935640 1 -- 172.21.15.120:0/3555670421 wait complete. 2024-07-27T03:09:19.806 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-07-27T03:09:19.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:09:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.917+0000 7f653fd96640 1 -- 172.21.15.120:0/1090264332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6538071cf0 msgr2=0x7f6538158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.917+0000 7f653fd96640 1 --2- 172.21.15.120:0/1090264332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6538071cf0 0x7f6538158da0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6530005fd0 tx=0x7f653002a840 comp rx=0 tx=0).stop 2024-07-27T03:09:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.917+0000 7f653fd96640 1 -- 172.21.15.120:0/1090264332 shutdown_connections 2024-07-27T03:09:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.917+0000 7f653fd96640 1 --2- 172.21.15.120:0/1090264332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6538071cf0 0x7f6538158da0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.917+0000 7f653fd96640 1 --2- 172.21.15.120:0/1090264332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653815c500 0x7f6538074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.917+0000 7f653fd96640 1 -- 172.21.15.120:0/1090264332 >> 172.21.15.120:0/1090264332 conn(0x7f65380d0f00 msgr2=0x7f65380d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.917+0000 7f653fd96640 1 -- 172.21.15.120:0/1090264332 shutdown_connections 2024-07-27T03:09:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.917+0000 7f653fd96640 1 -- 172.21.15.120:0/1090264332 wait complete. 2024-07-27T03:09:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.918+0000 7f653fd96640 1 Processor -- start 2024-07-27T03:09:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.919+0000 7f653fd96640 1 -- start start 2024-07-27T03:09:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653fd96640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65380b4d30 0x7f6538158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653fd96640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653815c500 0x7f65380c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653fd96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65380c5ea0 0x7f65380cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653fd96640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f65380703e0 con 0x7f65380b4d30 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653fd96640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6538070260 con 0x7f65380c5ea0 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653fd96640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6538070560 con 0x7f653815c500 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653db32640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65380b4d30 0x7f6538158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653db32640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65380b4d30 0x7f6538158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49990/0 (socket says 172.21.15.120:49990) 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653db32640 1 -- 172.21.15.120:0/3458226874 learned_addr learned my addr 172.21.15.120:0/3458226874 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653e333640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65380c5ea0 0x7f65380cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653db32640 1 -- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653815c500 msgr2=0x7f65380c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653d331640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653815c500 0x7f65380c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653db32640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653815c500 0x7f65380c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653db32640 1 -- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65380c5ea0 msgr2=0x7f65380cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653db32640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65380c5ea0 0x7f65380cfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:19.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653db32640 1 -- 172.21.15.120:0/3458226874 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6538158690 con 0x7f65380b4d30 2024-07-27T03:09:19.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653e333640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65380c5ea0 0x7f65380cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:19.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653d331640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653815c500 0x7f65380c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:19.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.920+0000 7f653db32640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65380b4d30 0x7f6538158150 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6534007870 tx=0x7f6534007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:19.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.921+0000 7f652e7fc640 1 -- 172.21.15.120:0/3458226874 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534019020 con 0x7f65380b4d30 2024-07-27T03:09:19.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.921+0000 7f652e7fc640 1 -- 172.21.15.120:0/3458226874 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6534005020 con 0x7f65380b4d30 2024-07-27T03:09:19.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.921+0000 7f653fd96640 1 -- 172.21.15.120:0/3458226874 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65381f52b0 con 0x7f65380b4d30 2024-07-27T03:09:19.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.921+0000 7f652e7fc640 1 -- 172.21.15.120:0/3458226874 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534005470 con 0x7f65380b4d30 2024-07-27T03:09:19.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.921+0000 7f653fd96640 1 -- 172.21.15.120:0/3458226874 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65381f5a90 con 0x7f65380b4d30 2024-07-27T03:09:19.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.922+0000 7f653fd96640 1 -- 172.21.15.120:0/3458226874 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6538070a80 con 0x7f65380b4d30 2024-07-27T03:09:19.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.922+0000 7f652e7fc640 1 -- 172.21.15.120:0/3458226874 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f65340047a0 con 0x7f65380b4d30 2024-07-27T03:09:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.923+0000 7f652e7fc640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f651c077010 0x7f651c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.923+0000 7f652e7fc640 1 -- 172.21.15.120:0/3458226874 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f653409a4d0 con 0x7f65380b4d30 2024-07-27T03:09:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.923+0000 7f653d331640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f651c077010 0x7f651c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.924+0000 7f653d331640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f651c077010 0x7f651c079520 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6528000f60 tx=0x7f6528009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:19.927+0000 7f652e7fc640 1 -- 172.21.15.120:0/3458226874 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6534023020 con 0x7f65380b4d30 2024-07-27T03:09:20.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.107+0000 7f653fd96640 1 -- 172.21.15.120:0/3458226874 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65380b4410 con 0x7f651c077010 2024-07-27T03:09:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.112+0000 7f652e7fc640 1 -- 172.21.15.120:0/3458226874 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244359 (secure 0 0 0) 0x7f65380b4410 con 0x7f651c077010 2024-07-27T03:09:20.117 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:20.118 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:09:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 -- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f651c077010 msgr2=0x7f651c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f651c077010 0x7f651c079520 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6528000f60 tx=0x7f6528009040 comp rx=0 tx=0).stop 2024-07-27T03:09:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 -- 172.21.15.120:0/3458226874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65380b4d30 msgr2=0x7f6538158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65380b4d30 0x7f6538158150 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6534007870 tx=0x7f6534007d30 comp rx=0 tx=0).stop 2024-07-27T03:09:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 -- 172.21.15.120:0/3458226874 shutdown_connections 2024-07-27T03:09:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f651c077010 0x7f651c079520 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65380c5ea0 0x7f65380cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f653815c500 0x7f65380c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 --2- 172.21.15.120:0/3458226874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65380b4d30 0x7f6538158150 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 -- 172.21.15.120:0/3458226874 >> 172.21.15.120:0/3458226874 conn(0x7f65380d0f00 msgr2=0x7f6538154aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:20.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 -- 172.21.15.120:0/3458226874 shutdown_connections 2024-07-27T03:09:20.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:20.114+0000 7f653fd96640 1 -- 172.21.15.120:0/3458226874 wait complete. 2024-07-27T03:09:20.129 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-07-27T03:09:18.541994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591076,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224176,"kb_used_data":3836,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750544,"statfs":{"total":773094113280,"available":772864557056,"internally_reserved":0,"allocated":3928064,"data_stored":2198570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.959394"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660642+0000","last_change":"2024-07-27T03:09:14.626088+0000","last_active":"2024-07-27T03:09:15.660642+0000","last_peered":"2024-07-27T03:09:15.660642+0000","last_clean":"2024-07-27T03:09:15.660642+0000","last_became_active":"2024-07-27T03:09:14.624863+0000","last_became_peered":"2024-07-27T03:09:14.624863+0000","last_unstale":"2024-07-27T03:09:15.660642+0000","last_undegraded":"2024-07-27T03:09:15.660642+0000","last_fullsized":"2024-07-27T03:09:15.660642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:06.375815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661489+0000","last_change":"2024-07-27T03:09:14.618632+0000","last_active":"2024-07-27T03:09:15.661489+0000","last_peered":"2024-07-27T03:09:15.661489+0000","last_clean":"2024-07-27T03:09:15.661489+0000","last_became_active":"2024-07-27T03:09:14.618330+0000","last_became_peered":"2024-07-27T03:09:14.618330+0000","last_unstale":"2024-07-27T03:09:15.661489+0000","last_undegraded":"2024-07-27T03:09:15.661489+0000","last_fullsized":"2024-07-27T03:09:15.661489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:23:12.555273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610969+0000","last_change":"2024-07-27T03:09:14.616445+0000","last_active":"2024-07-27T03:09:15.610969+0000","last_peered":"2024-07-27T03:09:15.610969+0000","last_clean":"2024-07-27T03:09:15.610969+0000","last_became_active":"2024-07-27T03:09:14.615819+0000","last_became_peered":"2024-07-27T03:09:14.615819+0000","last_unstale":"2024-07-27T03:09:15.610969+0000","last_undegraded":"2024-07-27T03:09:15.610969+0000","last_fullsized":"2024-07-27T03:09:15.610969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:56.250073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660793+0000","last_change":"2024-07-27T03:09:14.619141+0000","last_active":"2024-07-27T03:09:15.660793+0000","last_peered":"2024-07-27T03:09:15.660793+0000","last_clean":"2024-07-27T03:09:15.660793+0000","last_became_active":"2024-07-27T03:09:14.618846+0000","last_became_peered":"2024-07-27T03:09:14.618846+0000","last_unstale":"2024-07-27T03:09:15.660793+0000","last_undegraded":"2024-07-27T03:09:15.660793+0000","last_fullsized":"2024-07-27T03:09:15.660793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:05.563749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610653+0000","last_change":"2024-07-27T03:09:14.613012+0000","last_active":"2024-07-27T03:09:15.610653+0000","last_peered":"2024-07-27T03:09:15.610653+0000","last_clean":"2024-07-27T03:09:15.610653+0000","last_became_active":"2024-07-27T03:09:14.612684+0000","last_became_peered":"2024-07-27T03:09:14.612684+0000","last_unstale":"2024-07-27T03:09:15.610653+0000","last_undegraded":"2024-07-27T03:09:15.610653+0000","last_fullsized":"2024-07-27T03:09:15.610653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:07:53.511397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610406+0000","last_change":"2024-07-27T03:09:14.617890+0000","last_active":"2024-07-27T03:09:15.610406+0000","last_peered":"2024-07-27T03:09:15.610406+0000","last_clean":"2024-07-27T03:09:15.610406+0000","last_became_active":"2024-07-27T03:09:14.617449+0000","last_became_peered":"2024-07-27T03:09:14.617449+0000","last_unstale":"2024-07-27T03:09:15.610406+0000","last_undegraded":"2024-07-27T03:09:15.610406+0000","last_fullsized":"2024-07-27T03:09:15.610406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:02:44.318459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660650+0000","last_change":"2024-07-27T03:09:14.612567+0000","last_active":"2024-07-27T03:09:15.660650+0000","last_peered":"2024-07-27T03:09:15.660650+0000","last_clean":"2024-07-27T03:09:15.660650+0000","last_became_active":"2024-07-27T03:09:14.612276+0000","last_became_peered":"2024-07-27T03:09:14.612276+0000","last_unstale":"2024-07-27T03:09:15.660650+0000","last_undegraded":"2024-07-27T03:09:15.660650+0000","last_fullsized":"2024-07-27T03:09:15.660650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:56.250073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660790+0000","last_change":"2024-07-27T03:09:14.618014+0000","last_active":"2024-07-27T03:09:15.660790+0000","last_peered":"2024-07-27T03:09:15.660790+0000","last_clean":"2024-07-27T03:09:15.660790+0000","last_became_active":"2024-07-27T03:09:14.617721+0000","last_became_peered":"2024-07-27T03:09:14.617721+0000","last_unstale":"2024-07-27T03:09:15.660790+0000","last_undegraded":"2024-07-27T03:09:15.660790+0000","last_fullsized":"2024-07-27T03:09:15.660790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:23:40.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610673+0000","last_change":"2024-07-27T03:09:14.618738+0000","last_active":"2024-07-27T03:09:15.610673+0000","last_peered":"2024-07-27T03:09:15.610673+0000","last_clean":"2024-07-27T03:09:15.610673+0000","last_became_active":"2024-07-27T03:09:14.618401+0000","last_became_peered":"2024-07-27T03:09:14.618401+0000","last_unstale":"2024-07-27T03:09:15.610673+0000","last_undegraded":"2024-07-27T03:09:15.610673+0000","last_fullsized":"2024-07-27T03:09:15.610673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:16.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660410+0000","last_change":"2024-07-27T03:09:14.624479+0000","last_active":"2024-07-27T03:09:15.660410+0000","last_peered":"2024-07-27T03:09:15.660410+0000","last_clean":"2024-07-27T03:09:15.660410+0000","last_became_active":"2024-07-27T03:09:14.623934+0000","last_became_peered":"2024-07-27T03:09:14.623934+0000","last_unstale":"2024-07-27T03:09:15.660410+0000","last_undegraded":"2024-07-27T03:09:15.660410+0000","last_fullsized":"2024-07-27T03:09:15.660410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:24:00.946497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660781+0000","last_change":"2024-07-27T03:09:13.607927+0000","last_active":"2024-07-27T03:09:15.660781+0000","last_peered":"2024-07-27T03:09:15.660781+0000","last_clean":"2024-07-27T03:09:15.660781+0000","last_became_active":"2024-07-27T03:09:13.607590+0000","last_became_peered":"2024-07-27T03:09:13.607590+0000","last_unstale":"2024-07-27T03:09:15.660781+0000","last_undegraded":"2024-07-27T03:09:15.660781+0000","last_fullsized":"2024-07-27T03:09:15.660781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:28:25.823999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660704+0000","last_change":"2024-07-27T03:09:14.623980+0000","last_active":"2024-07-27T03:09:15.660704+0000","last_peered":"2024-07-27T03:09:15.660704+0000","last_clean":"2024-07-27T03:09:15.660704+0000","last_became_active":"2024-07-27T03:09:14.622593+0000","last_became_peered":"2024-07-27T03:09:14.622593+0000","last_unstale":"2024-07-27T03:09:15.660704+0000","last_undegraded":"2024-07-27T03:09:15.660704+0000","last_fullsized":"2024-07-27T03:09:15.660704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:07:33.124882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.658526+0000","last_change":"2024-07-27T03:09:12.658526+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.658526+0000","last_undegraded":"2024-07-27T03:09:12.658526+0000","last_fullsized":"2024-07-27T03:09:12.658526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611282+0000","last_change":"2024-07-27T03:09:14.619505+0000","last_active":"2024-07-27T03:09:15.611282+0000","last_peered":"2024-07-27T03:09:15.611282+0000","last_clean":"2024-07-27T03:09:15.611282+0000","last_became_active":"2024-07-27T03:09:14.618709+0000","last_became_peered":"2024-07-27T03:09:14.618709+0000","last_unstale":"2024-07-27T03:09:15.611282+0000","last_undegraded":"2024-07-27T03:09:15.611282+0000","last_fullsized":"2024-07-27T03:09:15.611282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:23:40.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588160+0000","last_change":"2024-07-27T03:09:12.588160+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588160+0000","last_undegraded":"2024-07-27T03:09:12.588160+0000","last_fullsized":"2024-07-27T03:09:12.588160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660954+0000","last_change":"2024-07-27T03:09:14.617781+0000","last_active":"2024-07-27T03:09:15.660954+0000","last_peered":"2024-07-27T03:09:15.660954+0000","last_clean":"2024-07-27T03:09:15.660954+0000","last_became_active":"2024-07-27T03:09:14.617337+0000","last_became_peered":"2024-07-27T03:09:14.617337+0000","last_unstale":"2024-07-27T03:09:15.660954+0000","last_undegraded":"2024-07-27T03:09:15.660954+0000","last_fullsized":"2024-07-27T03:09:15.660954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:07:12.274640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.586000+0000","last_change":"2024-07-27T03:09:12.586000+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.586000+0000","last_undegraded":"2024-07-27T03:09:12.586000+0000","last_fullsized":"2024-07-27T03:09:12.586000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610812+0000","last_change":"2024-07-27T03:09:13.602765+0000","last_active":"2024-07-27T03:09:15.610812+0000","last_peered":"2024-07-27T03:09:15.610812+0000","last_clean":"2024-07-27T03:09:15.610812+0000","last_became_active":"2024-07-27T03:09:13.602412+0000","last_became_peered":"2024-07-27T03:09:13.602412+0000","last_unstale":"2024-07-27T03:09:15.610812+0000","last_undegraded":"2024-07-27T03:09:15.610812+0000","last_fullsized":"2024-07-27T03:09:15.610812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:38.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610495+0000","last_change":"2024-07-27T03:09:13.602915+0000","last_active":"2024-07-27T03:09:15.610495+0000","last_peered":"2024-07-27T03:09:15.610495+0000","last_clean":"2024-07-27T03:09:15.610495+0000","last_became_active":"2024-07-27T03:09:13.602529+0000","last_became_peered":"2024-07-27T03:09:13.602529+0000","last_unstale":"2024-07-27T03:09:15.610495+0000","last_undegraded":"2024-07-27T03:09:15.610495+0000","last_fullsized":"2024-07-27T03:09:15.610495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:32:18.241705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610015+0000","last_change":"2024-07-27T03:09:14.616446+0000","last_active":"2024-07-27T03:09:15.610015+0000","last_peered":"2024-07-27T03:09:15.610015+0000","last_clean":"2024-07-27T03:09:15.610015+0000","last_became_active":"2024-07-27T03:09:14.615748+0000","last_became_peered":"2024-07-27T03:09:14.615748+0000","last_unstale":"2024-07-27T03:09:15.610015+0000","last_undegraded":"2024-07-27T03:09:15.610015+0000","last_fullsized":"2024-07-27T03:09:15.610015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:35:57.828278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588717+0000","last_change":"2024-07-27T03:09:12.588717+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588717+0000","last_undegraded":"2024-07-27T03:09:12.588717+0000","last_fullsized":"2024-07-27T03:09:12.588717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660573+0000","last_change":"2024-07-27T03:09:14.622500+0000","last_active":"2024-07-27T03:09:15.660573+0000","last_peered":"2024-07-27T03:09:15.660573+0000","last_clean":"2024-07-27T03:09:15.660573+0000","last_became_active":"2024-07-27T03:09:14.622134+0000","last_became_peered":"2024-07-27T03:09:14.622134+0000","last_unstale":"2024-07-27T03:09:15.660573+0000","last_undegraded":"2024-07-27T03:09:15.660573+0000","last_fullsized":"2024-07-27T03:09:15.660573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:16.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.609956+0000","last_change":"2024-07-27T03:09:13.606250+0000","last_active":"2024-07-27T03:09:15.609956+0000","last_peered":"2024-07-27T03:09:15.609956+0000","last_clean":"2024-07-27T03:09:15.609956+0000","last_became_active":"2024-07-27T03:09:13.604310+0000","last_became_peered":"2024-07-27T03:09:13.604310+0000","last_unstale":"2024-07-27T03:09:15.609956+0000","last_undegraded":"2024-07-27T03:09:15.609956+0000","last_fullsized":"2024-07-27T03:09:15.609956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:46:44.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587748+0000","last_change":"2024-07-27T03:09:12.587748+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587748+0000","last_undegraded":"2024-07-27T03:09:12.587748+0000","last_fullsized":"2024-07-27T03:09:12.587748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657915+0000","last_change":"2024-07-27T03:09:12.657915+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657915+0000","last_undegraded":"2024-07-27T03:09:12.657915+0000","last_fullsized":"2024-07-27T03:09:12.657915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.584920+0000","last_change":"2024-07-27T03:09:12.584920+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.584920+0000","last_undegraded":"2024-07-27T03:09:12.584920+0000","last_fullsized":"2024-07-27T03:09:12.584920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587728+0000","last_change":"2024-07-27T03:09:12.587728+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587728+0000","last_undegraded":"2024-07-27T03:09:12.587728+0000","last_fullsized":"2024-07-27T03:09:12.587728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660636+0000","last_change":"2024-07-27T03:09:14.623159+0000","last_active":"2024-07-27T03:09:15.660636+0000","last_peered":"2024-07-27T03:09:15.660636+0000","last_clean":"2024-07-27T03:09:15.660636+0000","last_became_active":"2024-07-27T03:09:14.622206+0000","last_became_peered":"2024-07-27T03:09:14.622206+0000","last_unstale":"2024-07-27T03:09:15.660636+0000","last_undegraded":"2024-07-27T03:09:15.660636+0000","last_fullsized":"2024-07-27T03:09:15.660636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:12.575517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610834+0000","last_change":"2024-07-27T03:09:13.605927+0000","last_active":"2024-07-27T03:09:15.610834+0000","last_peered":"2024-07-27T03:09:15.610834+0000","last_clean":"2024-07-27T03:09:15.610834+0000","last_became_active":"2024-07-27T03:09:13.604222+0000","last_became_peered":"2024-07-27T03:09:13.604222+0000","last_unstale":"2024-07-27T03:09:15.610834+0000","last_undegraded":"2024-07-27T03:09:15.610834+0000","last_fullsized":"2024-07-27T03:09:15.610834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:05:09.003909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660767+0000","last_change":"2024-07-27T03:09:13.606401+0000","last_active":"2024-07-27T03:09:15.660767+0000","last_peered":"2024-07-27T03:09:15.660767+0000","last_clean":"2024-07-27T03:09:15.660767+0000","last_became_active":"2024-07-27T03:09:13.606094+0000","last_became_peered":"2024-07-27T03:09:13.606094+0000","last_unstale":"2024-07-27T03:09:15.660767+0000","last_undegraded":"2024-07-27T03:09:15.660767+0000","last_fullsized":"2024-07-27T03:09:15.660767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:18:48.224902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587756+0000","last_change":"2024-07-27T03:09:12.587756+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587756+0000","last_undegraded":"2024-07-27T03:09:12.587756+0000","last_fullsized":"2024-07-27T03:09:12.587756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660298+0000","last_change":"2024-07-27T03:09:14.623092+0000","last_active":"2024-07-27T03:09:15.660298+0000","last_peered":"2024-07-27T03:09:15.660298+0000","last_clean":"2024-07-27T03:09:15.660298+0000","last_became_active":"2024-07-27T03:09:14.622749+0000","last_became_peered":"2024-07-27T03:09:14.622749+0000","last_unstale":"2024-07-27T03:09:15.660298+0000","last_undegraded":"2024-07-27T03:09:15.660298+0000","last_fullsized":"2024-07-27T03:09:15.660298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:41:18.671396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.588318+0000","last_change":"2024-07-27T03:09:12.588318+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.588318+0000","last_undegraded":"2024-07-27T03:09:12.588318+0000","last_fullsized":"2024-07-27T03:09:12.588318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610726+0000","last_change":"2024-07-27T03:09:14.627550+0000","last_active":"2024-07-27T03:09:15.610726+0000","last_peered":"2024-07-27T03:09:15.610726+0000","last_clean":"2024-07-27T03:09:15.610726+0000","last_became_active":"2024-07-27T03:09:14.627173+0000","last_became_peered":"2024-07-27T03:09:14.627173+0000","last_unstale":"2024-07-27T03:09:15.610726+0000","last_undegraded":"2024-07-27T03:09:15.610726+0000","last_fullsized":"2024-07-27T03:09:15.610726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:12.575517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660781+0000","last_change":"2024-07-27T03:09:13.605511+0000","last_active":"2024-07-27T03:09:15.660781+0000","last_peered":"2024-07-27T03:09:15.660781+0000","last_clean":"2024-07-27T03:09:15.660781+0000","last_became_active":"2024-07-27T03:09:13.604979+0000","last_became_peered":"2024-07-27T03:09:13.604979+0000","last_unstale":"2024-07-27T03:09:15.660781+0000","last_undegraded":"2024-07-27T03:09:15.660781+0000","last_fullsized":"2024-07-27T03:09:15.660781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:29:10.340511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610399+0000","last_change":"2024-07-27T03:09:13.605887+0000","last_active":"2024-07-27T03:09:15.610399+0000","last_peered":"2024-07-27T03:09:15.610399+0000","last_clean":"2024-07-27T03:09:15.610399+0000","last_became_active":"2024-07-27T03:09:13.605518+0000","last_became_peered":"2024-07-27T03:09:13.605518+0000","last_unstale":"2024-07-27T03:09:15.610399+0000","last_undegraded":"2024-07-27T03:09:15.610399+0000","last_fullsized":"2024-07-27T03:09:15.610399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:43:24.612891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661674+0000","last_change":"2024-07-27T03:09:14.617479+0000","last_active":"2024-07-27T03:09:15.661674+0000","last_peered":"2024-07-27T03:09:15.661674+0000","last_clean":"2024-07-27T03:09:15.661674+0000","last_became_active":"2024-07-27T03:09:14.617003+0000","last_became_peered":"2024-07-27T03:09:14.617003+0000","last_unstale":"2024-07-27T03:09:15.661674+0000","last_undegraded":"2024-07-27T03:09:15.661674+0000","last_fullsized":"2024-07-27T03:09:15.661674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:59:04.248587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610563+0000","last_change":"2024-07-27T03:09:13.601807+0000","last_active":"2024-07-27T03:09:15.610563+0000","last_peered":"2024-07-27T03:09:15.610563+0000","last_clean":"2024-07-27T03:09:15.610563+0000","last_became_active":"2024-07-27T03:09:13.600603+0000","last_became_peered":"2024-07-27T03:09:13.600603+0000","last_unstale":"2024-07-27T03:09:15.610563+0000","last_undegraded":"2024-07-27T03:09:15.610563+0000","last_fullsized":"2024-07-27T03:09:15.610563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:12:16.902363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611258+0000","last_change":"2024-07-27T03:09:13.603828+0000","last_active":"2024-07-27T03:09:15.611258+0000","last_peered":"2024-07-27T03:09:15.611258+0000","last_clean":"2024-07-27T03:09:15.611258+0000","last_became_active":"2024-07-27T03:09:13.603208+0000","last_became_peered":"2024-07-27T03:09:13.603208+0000","last_unstale":"2024-07-27T03:09:15.611258+0000","last_undegraded":"2024-07-27T03:09:15.611258+0000","last_fullsized":"2024-07-27T03:09:15.611258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:28:25.823999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657824+0000","last_change":"2024-07-27T03:09:12.657824+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657824+0000","last_undegraded":"2024-07-27T03:09:12.657824+0000","last_fullsized":"2024-07-27T03:09:12.657824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660421+0000","last_change":"2024-07-27T03:09:13.609088+0000","last_active":"2024-07-27T03:09:15.660421+0000","last_peered":"2024-07-27T03:09:15.660421+0000","last_clean":"2024-07-27T03:09:15.660421+0000","last_became_active":"2024-07-27T03:09:13.608835+0000","last_became_peered":"2024-07-27T03:09:13.608835+0000","last_unstale":"2024-07-27T03:09:15.660421+0000","last_undegraded":"2024-07-27T03:09:15.660421+0000","last_fullsized":"2024-07-27T03:09:15.660421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:46:44.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610112+0000","last_change":"2024-07-27T03:09:13.601066+0000","last_active":"2024-07-27T03:09:15.610112+0000","last_peered":"2024-07-27T03:09:15.610112+0000","last_clean":"2024-07-27T03:09:15.610112+0000","last_became_active":"2024-07-27T03:09:13.600739+0000","last_became_peered":"2024-07-27T03:09:13.600739+0000","last_unstale":"2024-07-27T03:09:15.610112+0000","last_undegraded":"2024-07-27T03:09:15.610112+0000","last_fullsized":"2024-07-27T03:09:15.610112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:26.159437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.584628+0000","last_change":"2024-07-27T03:09:12.584628+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.584628+0000","last_undegraded":"2024-07-27T03:09:12.584628+0000","last_fullsized":"2024-07-27T03:09:12.584628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660799+0000","last_change":"2024-07-27T03:09:13.606468+0000","last_active":"2024-07-27T03:09:15.660799+0000","last_peered":"2024-07-27T03:09:15.660799+0000","last_clean":"2024-07-27T03:09:15.660799+0000","last_became_active":"2024-07-27T03:09:13.606168+0000","last_became_peered":"2024-07-27T03:09:13.606168+0000","last_unstale":"2024-07-27T03:09:15.660799+0000","last_undegraded":"2024-07-27T03:09:15.660799+0000","last_fullsized":"2024-07-27T03:09:15.660799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:41:17.664971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657307+0000","last_change":"2024-07-27T03:09:12.657307+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657307+0000","last_undegraded":"2024-07-27T03:09:12.657307+0000","last_fullsized":"2024-07-27T03:09:12.657307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661868+0000","last_change":"2024-07-27T03:09:13.608738+0000","last_active":"2024-07-27T03:09:15.661868+0000","last_peered":"2024-07-27T03:09:15.661868+0000","last_clean":"2024-07-27T03:09:15.661868+0000","last_became_active":"2024-07-27T03:09:13.608362+0000","last_became_peered":"2024-07-27T03:09:13.608362+0000","last_unstale":"2024-07-27T03:09:15.661868+0000","last_undegraded":"2024-07-27T03:09:15.661868+0000","last_fullsized":"2024-07-27T03:09:15.661868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:54.757042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660523+0000","last_change":"2024-07-27T03:09:14.614687+0000","last_active":"2024-07-27T03:09:15.660523+0000","last_peered":"2024-07-27T03:09:15.660523+0000","last_clean":"2024-07-27T03:09:15.660523+0000","last_became_active":"2024-07-27T03:09:14.613957+0000","last_became_peered":"2024-07-27T03:09:14.613957+0000","last_unstale":"2024-07-27T03:09:15.660523+0000","last_undegraded":"2024-07-27T03:09:15.660523+0000","last_fullsized":"2024-07-27T03:09:15.660523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:22:49.333753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.657354+0000","last_change":"2024-07-27T03:09:12.657354+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.657354+0000","last_undegraded":"2024-07-27T03:09:12.657354+0000","last_fullsized":"2024-07-27T03:09:12.657354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660873+0000","last_change":"2024-07-27T03:09:13.607105+0000","last_active":"2024-07-27T03:09:15.660873+0000","last_peered":"2024-07-27T03:09:15.660873+0000","last_clean":"2024-07-27T03:09:15.660873+0000","last_became_active":"2024-07-27T03:09:13.606751+0000","last_became_peered":"2024-07-27T03:09:13.606751+0000","last_unstale":"2024-07-27T03:09:15.660873+0000","last_undegraded":"2024-07-27T03:09:15.660873+0000","last_fullsized":"2024-07-27T03:09:15.660873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:52.773759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611119+0000","last_change":"2024-07-27T03:09:13.600341+0000","last_active":"2024-07-27T03:09:15.611119+0000","last_peered":"2024-07-27T03:09:15.611119+0000","last_clean":"2024-07-27T03:09:15.611119+0000","last_became_active":"2024-07-27T03:09:13.600029+0000","last_became_peered":"2024-07-27T03:09:13.600029+0000","last_unstale":"2024-07-27T03:09:15.611119+0000","last_undegraded":"2024-07-27T03:09:15.611119+0000","last_fullsized":"2024-07-27T03:09:15.611119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:56:01.886146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610031+0000","last_change":"2024-07-27T03:09:14.618278+0000","last_active":"2024-07-27T03:09:15.610031+0000","last_peered":"2024-07-27T03:09:15.610031+0000","last_clean":"2024-07-27T03:09:15.610031+0000","last_became_active":"2024-07-27T03:09:14.617936+0000","last_became_peered":"2024-07-27T03:09:14.617936+0000","last_unstale":"2024-07-27T03:09:15.610031+0000","last_undegraded":"2024-07-27T03:09:15.610031+0000","last_fullsized":"2024-07-27T03:09:15.610031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:49:24.333630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-07-27T03:09:12.587778+0000","last_change":"2024-07-27T03:09:12.587778+0000","last_active":"2024-07-27T03:09:12.575189+0000","last_peered":"2024-07-27T03:09:12.575189+0000","last_clean":"2024-07-27T03:09:12.575189+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:12.587778+0000","last_undegraded":"2024-07-27T03:09:12.587778+0000","last_fullsized":"2024-07-27T03:09:12.587778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:09:13.581614+0000","last_change":"2024-07-27T03:09:13.581614+0000","last_active":"2024-07-27T03:09:13.581614+0000","last_peered":"2024-07-27T03:09:13.581614+0000","last_clean":"2024-07-27T03:09:13.581614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:09:13.581614+0000","last_undegraded":"2024-07-27T03:09:13.581614+0000","last_fullsized":"2024-07-27T03:09:13.581614+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660132+0000","last_change":"2024-07-27T03:09:13.604580+0000","last_active":"2024-07-27T03:09:15.660132+0000","last_peered":"2024-07-27T03:09:15.660132+0000","last_clean":"2024-07-27T03:09:15.660132+0000","last_became_active":"2024-07-27T03:09:13.604304+0000","last_became_peered":"2024-07-27T03:09:13.604304+0000","last_unstale":"2024-07-27T03:09:15.660132+0000","last_undegraded":"2024-07-27T03:09:15.660132+0000","last_fullsized":"2024-07-27T03:09:15.660132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:56:01.886146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":124,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-07-27T03:09:12.589719+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:09:12.589719+0000","last_peered":"2024-07-27T03:09:12.589719+0000","last_clean":"2024-07-27T03:09:12.589719+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:09:12.589719+0000","last_undegraded":"2024-07-27T03:09:12.589719+0000","last_fullsized":"2024-07-27T03:09:12.589719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":121136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":141094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":140582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":142112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:09:23.134 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:09:23.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.260+0000 7fbfd0043640 1 -- 172.21.15.120:0/2748136252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc80723d0 msgr2=0x7fbfc80727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:23.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.260+0000 7fbfd0043640 1 --2- 172.21.15.120:0/2748136252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc80723d0 0x7fbfc80727e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0005fd0 tx=0x7fbfc002aa90 comp rx=0 tx=0).stop 2024-07-27T03:09:23.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.260+0000 7fbfd0043640 1 -- 172.21.15.120:0/2748136252 shutdown_connections 2024-07-27T03:09:23.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.260+0000 7fbfd0043640 1 --2- 172.21.15.120:0/2748136252 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc80723d0 0x7fbfc80727e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.260+0000 7fbfd0043640 1 --2- 172.21.15.120:0/2748136252 >> v2:172.21.15.121:3300/0 conn(0x7fbfc80aebf0 0x7fbfc80af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.260+0000 7fbfd0043640 1 -- 172.21.15.120:0/2748136252 >> 172.21.15.120:0/2748136252 conn(0x7fbfc80b1a10 msgr2=0x7fbfc80b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:23.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.260+0000 7fbfd0043640 1 -- 172.21.15.120:0/2748136252 shutdown_connections 2024-07-27T03:09:23.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.260+0000 7fbfd0043640 1 -- 172.21.15.120:0/2748136252 wait complete. 2024-07-27T03:09:23.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.261+0000 7fbfd0043640 1 Processor -- start 2024-07-27T03:09:23.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.261+0000 7fbfd0043640 1 -- start start 2024-07-27T03:09:23.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfd0043640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc80723d0 0x7fbfc8153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:23.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfd0043640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfc80aebf0 0x7fbfc81502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:23.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfd0043640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc8145390 0x7fbfc81f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfd0043640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc806fcd0 con 0x7fbfc80aebf0 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfd0043640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc81451f0 con 0x7fbfc80723d0 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfd0043640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc8072d20 con 0x7fbfc8145390 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfcd5de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfc80aebf0 0x7fbfc81502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfcd5de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfc80aebf0 0x7fbfc81502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51088/0 (socket says 172.21.15.120:51088) 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfcd5de640 1 -- 172.21.15.120:0/2374880132 learned_addr learned my addr 172.21.15.120:0/2374880132 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfcdddf640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc80723d0 0x7fbfc8153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfce5e0640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc8145390 0x7fbfc81f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfcd5de640 1 -- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc8145390 msgr2=0x7fbfc81f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfcd5de640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc8145390 0x7fbfc81f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfcd5de640 1 -- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc80723d0 msgr2=0x7fbfc8153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfcd5de640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc80723d0 0x7fbfc8153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfcd5de640 1 -- 172.21.15.120:0/2374880132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc8153ba0 con 0x7fbfc80aebf0 2024-07-27T03:09:23.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.263+0000 7fbfcd5de640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfc80aebf0 0x7fbfc81502a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800ea20 tx=0x7fbfb800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:23.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.264+0000 7fbfbe7fc640 1 -- 172.21.15.120:0/2374880132 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb800ce40 con 0x7fbfc80aebf0 2024-07-27T03:09:23.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.264+0000 7fbfd0043640 1 -- 172.21.15.120:0/2374880132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc8141c70 con 0x7fbfc80aebf0 2024-07-27T03:09:23.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.264+0000 7fbfbe7fc640 1 -- 172.21.15.120:0/2374880132 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfb8004020 con 0x7fbfc80aebf0 2024-07-27T03:09:23.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.264+0000 7fbfbe7fc640 1 -- 172.21.15.120:0/2374880132 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8004470 con 0x7fbfc80aebf0 2024-07-27T03:09:23.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.264+0000 7fbfd0043640 1 -- 172.21.15.120:0/2374880132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc8142230 con 0x7fbfc80aebf0 2024-07-27T03:09:23.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.265+0000 7fbfd0043640 1 -- 172.21.15.120:0/2374880132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc80adc50 con 0x7fbfc80aebf0 2024-07-27T03:09:23.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.266+0000 7fbfbe7fc640 1 -- 172.21.15.120:0/2374880132 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fbfb80035f0 con 0x7fbfc80aebf0 2024-07-27T03:09:23.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.266+0000 7fbfbe7fc640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbfac077010 0x7fbfac079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:23.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.266+0000 7fbfbe7fc640 1 -- 172.21.15.120:0/2374880132 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbfb8099110 con 0x7fbfc80aebf0 2024-07-27T03:09:23.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.266+0000 7fbfcdddf640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbfac077010 0x7fbfac079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:23.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.267+0000 7fbfcdddf640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbfac077010 0x7fbfac079520 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4007fd0 tx=0x7fbfc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:23.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.271+0000 7fbfbe7fc640 1 -- 172.21.15.120:0/2374880132 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fbfc80adc50 con 0x7fbfc80aebf0 2024-07-27T03:09:23.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.448+0000 7fbfd0043640 1 -- 172.21.15.120:0/2374880132 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbfc80ad970 con 0x7fbfac077010 2024-07-27T03:09:23.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.453+0000 7fbfbe7fc640 1 -- 172.21.15.120:0/2374880132 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251940 (secure 0 0 0) 0x7fbfc80ad970 con 0x7fbfac077010 2024-07-27T03:09:23.458 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:23.459 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:09:23.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.455+0000 7fbfd0043640 1 -- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbfac077010 msgr2=0x7fbfac079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:23.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.455+0000 7fbfd0043640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbfac077010 0x7fbfac079520 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4007fd0 tx=0x7fbfc4009040 comp rx=0 tx=0).stop 2024-07-27T03:09:23.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.455+0000 7fbfd0043640 1 -- 172.21.15.120:0/2374880132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfc80aebf0 msgr2=0x7fbfc81502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:23.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.455+0000 7fbfd0043640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfc80aebf0 0x7fbfc81502a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800ea20 tx=0x7fbfb800eee0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.455+0000 7fbfd0043640 1 -- 172.21.15.120:0/2374880132 shutdown_connections 2024-07-27T03:09:23.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.455+0000 7fbfd0043640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbfac077010 0x7fbfac079520 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.455+0000 7fbfd0043640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfc80aebf0 0x7fbfc81502a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.455+0000 7fbfd0043640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbfc8145390 0x7fbfc81f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.455+0000 7fbfd0043640 1 --2- 172.21.15.120:0/2374880132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc80723d0 0x7fbfc8153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.455+0000 7fbfd0043640 1 -- 172.21.15.120:0/2374880132 >> 172.21.15.120:0/2374880132 conn(0x7fbfc80b1a10 msgr2=0x7fbfc8142c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:23.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.456+0000 7fbfd0043640 1 -- 172.21.15.120:0/2374880132 shutdown_connections 2024-07-27T03:09:23.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.456+0000 7fbfd0043640 1 -- 172.21.15.120:0/2374880132 wait complete. 2024-07-27T03:09:23.470 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-07-27T03:09:22.542870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224416,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750304,"statfs":{"total":773094113280,"available":772864311296,"internally_reserved":0,"allocated":4169728,"data_stored":2309380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001620"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660642+0000","last_change":"2024-07-27T03:09:14.626088+0000","last_active":"2024-07-27T03:09:15.660642+0000","last_peered":"2024-07-27T03:09:15.660642+0000","last_clean":"2024-07-27T03:09:15.660642+0000","last_became_active":"2024-07-27T03:09:14.624863+0000","last_became_peered":"2024-07-27T03:09:14.624863+0000","last_unstale":"2024-07-27T03:09:15.660642+0000","last_undegraded":"2024-07-27T03:09:15.660642+0000","last_fullsized":"2024-07-27T03:09:15.660642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:06.375815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.613314+0000","last_change":"2024-07-27T03:09:14.614095+0000","last_active":"2024-07-27T03:09:15.613314+0000","last_peered":"2024-07-27T03:09:15.613314+0000","last_clean":"2024-07-27T03:09:15.613314+0000","last_became_active":"2024-07-27T03:09:14.613764+0000","last_became_peered":"2024-07-27T03:09:14.613764+0000","last_unstale":"2024-07-27T03:09:15.613314+0000","last_undegraded":"2024-07-27T03:09:15.613314+0000","last_fullsized":"2024-07-27T03:09:15.613314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:42:08.647128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611844+0000","last_change":"2024-07-27T03:09:14.615423+0000","last_active":"2024-07-27T03:09:15.611844+0000","last_peered":"2024-07-27T03:09:15.611844+0000","last_clean":"2024-07-27T03:09:15.611844+0000","last_became_active":"2024-07-27T03:09:14.615119+0000","last_became_peered":"2024-07-27T03:09:14.615119+0000","last_unstale":"2024-07-27T03:09:15.611844+0000","last_undegraded":"2024-07-27T03:09:15.611844+0000","last_fullsized":"2024-07-27T03:09:15.611844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:27:26.269351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661489+0000","last_change":"2024-07-27T03:09:14.618632+0000","last_active":"2024-07-27T03:09:15.661489+0000","last_peered":"2024-07-27T03:09:15.661489+0000","last_clean":"2024-07-27T03:09:15.661489+0000","last_became_active":"2024-07-27T03:09:14.618330+0000","last_became_peered":"2024-07-27T03:09:14.618330+0000","last_unstale":"2024-07-27T03:09:15.661489+0000","last_undegraded":"2024-07-27T03:09:15.661489+0000","last_fullsized":"2024-07-27T03:09:15.661489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:23:12.555273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661635+0000","last_change":"2024-07-27T03:09:14.620045+0000","last_active":"2024-07-27T03:09:15.661635+0000","last_peered":"2024-07-27T03:09:15.661635+0000","last_clean":"2024-07-27T03:09:15.661635+0000","last_became_active":"2024-07-27T03:09:14.618705+0000","last_became_peered":"2024-07-27T03:09:14.618705+0000","last_unstale":"2024-07-27T03:09:15.661635+0000","last_undegraded":"2024-07-27T03:09:15.661635+0000","last_fullsized":"2024-07-27T03:09:15.661635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:28:51.883218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.612976+0000","last_change":"2024-07-27T03:09:14.624455+0000","last_active":"2024-07-27T03:09:15.612976+0000","last_peered":"2024-07-27T03:09:15.612976+0000","last_clean":"2024-07-27T03:09:15.612976+0000","last_became_active":"2024-07-27T03:09:14.624152+0000","last_became_peered":"2024-07-27T03:09:14.624152+0000","last_unstale":"2024-07-27T03:09:15.612976+0000","last_undegraded":"2024-07-27T03:09:15.612976+0000","last_fullsized":"2024-07-27T03:09:15.612976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:23:29.870556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660703+0000","last_change":"2024-07-27T03:09:14.617302+0000","last_active":"2024-07-27T03:09:15.660703+0000","last_peered":"2024-07-27T03:09:15.660703+0000","last_clean":"2024-07-27T03:09:15.660703+0000","last_became_active":"2024-07-27T03:09:14.616982+0000","last_became_peered":"2024-07-27T03:09:14.616982+0000","last_unstale":"2024-07-27T03:09:15.660703+0000","last_undegraded":"2024-07-27T03:09:15.660703+0000","last_fullsized":"2024-07-27T03:09:15.660703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:59:40.904637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660190+0000","last_change":"2024-07-27T03:09:14.619790+0000","last_active":"2024-07-27T03:09:15.660190+0000","last_peered":"2024-07-27T03:09:15.660190+0000","last_clean":"2024-07-27T03:09:15.660190+0000","last_became_active":"2024-07-27T03:09:14.619487+0000","last_became_peered":"2024-07-27T03:09:14.619487+0000","last_unstale":"2024-07-27T03:09:15.660190+0000","last_undegraded":"2024-07-27T03:09:15.660190+0000","last_fullsized":"2024-07-27T03:09:15.660190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:10:38.780086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610969+0000","last_change":"2024-07-27T03:09:14.616445+0000","last_active":"2024-07-27T03:09:15.610969+0000","last_peered":"2024-07-27T03:09:15.610969+0000","last_clean":"2024-07-27T03:09:15.610969+0000","last_became_active":"2024-07-27T03:09:14.615819+0000","last_became_peered":"2024-07-27T03:09:14.615819+0000","last_unstale":"2024-07-27T03:09:15.610969+0000","last_undegraded":"2024-07-27T03:09:15.610969+0000","last_fullsized":"2024-07-27T03:09:15.610969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:56.250073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660793+0000","last_change":"2024-07-27T03:09:14.619141+0000","last_active":"2024-07-27T03:09:15.660793+0000","last_peered":"2024-07-27T03:09:15.660793+0000","last_clean":"2024-07-27T03:09:15.660793+0000","last_became_active":"2024-07-27T03:09:14.618846+0000","last_became_peered":"2024-07-27T03:09:14.618846+0000","last_unstale":"2024-07-27T03:09:15.660793+0000","last_undegraded":"2024-07-27T03:09:15.660793+0000","last_fullsized":"2024-07-27T03:09:15.660793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:05.563749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660817+0000","last_change":"2024-07-27T03:09:14.615287+0000","last_active":"2024-07-27T03:09:15.660817+0000","last_peered":"2024-07-27T03:09:15.660817+0000","last_clean":"2024-07-27T03:09:15.660817+0000","last_became_active":"2024-07-27T03:09:14.614976+0000","last_became_peered":"2024-07-27T03:09:14.614976+0000","last_unstale":"2024-07-27T03:09:15.660817+0000","last_undegraded":"2024-07-27T03:09:15.660817+0000","last_fullsized":"2024-07-27T03:09:15.660817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:49:59.755174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611669+0000","last_change":"2024-07-27T03:09:14.614832+0000","last_active":"2024-07-27T03:09:15.611669+0000","last_peered":"2024-07-27T03:09:15.611669+0000","last_clean":"2024-07-27T03:09:15.611669+0000","last_became_active":"2024-07-27T03:09:14.614439+0000","last_became_peered":"2024-07-27T03:09:14.614439+0000","last_unstale":"2024-07-27T03:09:15.611669+0000","last_undegraded":"2024-07-27T03:09:15.611669+0000","last_fullsized":"2024-07-27T03:09:15.611669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:59:40.904637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661622+0000","last_change":"2024-07-27T03:09:14.618780+0000","last_active":"2024-07-27T03:09:15.661622+0000","last_peered":"2024-07-27T03:09:15.661622+0000","last_clean":"2024-07-27T03:09:15.661622+0000","last_became_active":"2024-07-27T03:09:14.616934+0000","last_became_peered":"2024-07-27T03:09:14.616934+0000","last_unstale":"2024-07-27T03:09:15.661622+0000","last_undegraded":"2024-07-27T03:09:15.661622+0000","last_fullsized":"2024-07-27T03:09:15.661622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:13:25.386711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.612959+0000","last_change":"2024-07-27T03:09:14.612110+0000","last_active":"2024-07-27T03:09:15.612959+0000","last_peered":"2024-07-27T03:09:15.612959+0000","last_clean":"2024-07-27T03:09:15.612959+0000","last_became_active":"2024-07-27T03:09:14.611697+0000","last_became_peered":"2024-07-27T03:09:14.611697+0000","last_unstale":"2024-07-27T03:09:15.612959+0000","last_undegraded":"2024-07-27T03:09:15.612959+0000","last_fullsized":"2024-07-27T03:09:15.612959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:22:13.311146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611253+0000","last_change":"2024-07-27T03:09:14.617078+0000","last_active":"2024-07-27T03:09:15.611253+0000","last_peered":"2024-07-27T03:09:15.611253+0000","last_clean":"2024-07-27T03:09:15.611253+0000","last_became_active":"2024-07-27T03:09:14.616782+0000","last_became_peered":"2024-07-27T03:09:14.616782+0000","last_unstale":"2024-07-27T03:09:15.611253+0000","last_undegraded":"2024-07-27T03:09:15.611253+0000","last_fullsized":"2024-07-27T03:09:15.611253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:29:37.875296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661054+0000","last_change":"2024-07-27T03:09:14.626637+0000","last_active":"2024-07-27T03:09:15.661054+0000","last_peered":"2024-07-27T03:09:15.661054+0000","last_clean":"2024-07-27T03:09:15.661054+0000","last_became_active":"2024-07-27T03:09:14.626252+0000","last_became_peered":"2024-07-27T03:09:14.626252+0000","last_unstale":"2024-07-27T03:09:15.661054+0000","last_undegraded":"2024-07-27T03:09:15.661054+0000","last_fullsized":"2024-07-27T03:09:15.661054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:36:32.361248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661149+0000","last_change":"2024-07-27T03:09:14.616519+0000","last_active":"2024-07-27T03:09:15.661149+0000","last_peered":"2024-07-27T03:09:15.661149+0000","last_clean":"2024-07-27T03:09:15.661149+0000","last_became_active":"2024-07-27T03:09:14.616208+0000","last_became_peered":"2024-07-27T03:09:14.616208+0000","last_unstale":"2024-07-27T03:09:15.661149+0000","last_undegraded":"2024-07-27T03:09:15.661149+0000","last_fullsized":"2024-07-27T03:09:15.661149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:39:57.302132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.613379+0000","last_change":"2024-07-27T03:09:14.613011+0000","last_active":"2024-07-27T03:09:15.613379+0000","last_peered":"2024-07-27T03:09:15.613379+0000","last_clean":"2024-07-27T03:09:15.613379+0000","last_became_active":"2024-07-27T03:09:14.612725+0000","last_became_peered":"2024-07-27T03:09:14.612725+0000","last_unstale":"2024-07-27T03:09:15.613379+0000","last_undegraded":"2024-07-27T03:09:15.613379+0000","last_fullsized":"2024-07-27T03:09:15.613379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:15:44.803936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.612933+0000","last_change":"2024-07-27T03:09:14.615790+0000","last_active":"2024-07-27T03:09:15.612933+0000","last_peered":"2024-07-27T03:09:15.612933+0000","last_clean":"2024-07-27T03:09:15.612933+0000","last_became_active":"2024-07-27T03:09:14.615439+0000","last_became_peered":"2024-07-27T03:09:14.615439+0000","last_unstale":"2024-07-27T03:09:15.612933+0000","last_undegraded":"2024-07-27T03:09:15.612933+0000","last_fullsized":"2024-07-27T03:09:15.612933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:41:30.602901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661297+0000","last_change":"2024-07-27T03:09:14.605358+0000","last_active":"2024-07-27T03:09:15.661297+0000","last_peered":"2024-07-27T03:09:15.661297+0000","last_clean":"2024-07-27T03:09:15.661297+0000","last_became_active":"2024-07-27T03:09:14.605053+0000","last_became_peered":"2024-07-27T03:09:14.605053+0000","last_unstale":"2024-07-27T03:09:15.661297+0000","last_undegraded":"2024-07-27T03:09:15.661297+0000","last_fullsized":"2024-07-27T03:09:15.661297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:21:44.614395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610653+0000","last_change":"2024-07-27T03:09:14.613012+0000","last_active":"2024-07-27T03:09:15.610653+0000","last_peered":"2024-07-27T03:09:15.610653+0000","last_clean":"2024-07-27T03:09:15.610653+0000","last_became_active":"2024-07-27T03:09:14.612684+0000","last_became_peered":"2024-07-27T03:09:14.612684+0000","last_unstale":"2024-07-27T03:09:15.610653+0000","last_undegraded":"2024-07-27T03:09:15.610653+0000","last_fullsized":"2024-07-27T03:09:15.610653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:07:53.511397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610406+0000","last_change":"2024-07-27T03:09:14.617890+0000","last_active":"2024-07-27T03:09:15.610406+0000","last_peered":"2024-07-27T03:09:15.610406+0000","last_clean":"2024-07-27T03:09:15.610406+0000","last_became_active":"2024-07-27T03:09:14.617449+0000","last_became_peered":"2024-07-27T03:09:14.617449+0000","last_unstale":"2024-07-27T03:09:15.610406+0000","last_undegraded":"2024-07-27T03:09:15.610406+0000","last_fullsized":"2024-07-27T03:09:15.610406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:02:44.318459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660202+0000","last_change":"2024-07-27T03:09:14.613775+0000","last_active":"2024-07-27T03:09:15.660202+0000","last_peered":"2024-07-27T03:09:15.660202+0000","last_clean":"2024-07-27T03:09:15.660202+0000","last_became_active":"2024-07-27T03:09:14.613464+0000","last_became_peered":"2024-07-27T03:09:14.613464+0000","last_unstale":"2024-07-27T03:09:15.660202+0000","last_undegraded":"2024-07-27T03:09:15.660202+0000","last_fullsized":"2024-07-27T03:09:15.660202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:02:02.306321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610842+0000","last_change":"2024-07-27T03:09:14.614378+0000","last_active":"2024-07-27T03:09:15.610842+0000","last_peered":"2024-07-27T03:09:15.610842+0000","last_clean":"2024-07-27T03:09:15.610842+0000","last_became_active":"2024-07-27T03:09:14.610741+0000","last_became_peered":"2024-07-27T03:09:14.610741+0000","last_unstale":"2024-07-27T03:09:15.610842+0000","last_undegraded":"2024-07-27T03:09:15.610842+0000","last_fullsized":"2024-07-27T03:09:15.610842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:42:40.105824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660650+0000","last_change":"2024-07-27T03:09:14.612567+0000","last_active":"2024-07-27T03:09:15.660650+0000","last_peered":"2024-07-27T03:09:15.660650+0000","last_clean":"2024-07-27T03:09:15.660650+0000","last_became_active":"2024-07-27T03:09:14.612276+0000","last_became_peered":"2024-07-27T03:09:14.612276+0000","last_unstale":"2024-07-27T03:09:15.660650+0000","last_undegraded":"2024-07-27T03:09:15.660650+0000","last_fullsized":"2024-07-27T03:09:15.660650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:56.250073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.613485+0000","last_change":"2024-07-27T03:09:14.623298+0000","last_active":"2024-07-27T03:09:15.613485+0000","last_peered":"2024-07-27T03:09:15.613485+0000","last_clean":"2024-07-27T03:09:15.613485+0000","last_became_active":"2024-07-27T03:09:14.622010+0000","last_became_peered":"2024-07-27T03:09:14.622010+0000","last_unstale":"2024-07-27T03:09:15.613485+0000","last_undegraded":"2024-07-27T03:09:15.613485+0000","last_fullsized":"2024-07-27T03:09:15.613485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:52:18.769058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660790+0000","last_change":"2024-07-27T03:09:14.618014+0000","last_active":"2024-07-27T03:09:15.660790+0000","last_peered":"2024-07-27T03:09:15.660790+0000","last_clean":"2024-07-27T03:09:15.660790+0000","last_became_active":"2024-07-27T03:09:14.617721+0000","last_became_peered":"2024-07-27T03:09:14.617721+0000","last_unstale":"2024-07-27T03:09:15.660790+0000","last_undegraded":"2024-07-27T03:09:15.660790+0000","last_fullsized":"2024-07-27T03:09:15.660790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:23:40.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611877+0000","last_change":"2024-07-27T03:09:14.609307+0000","last_active":"2024-07-27T03:09:15.611877+0000","last_peered":"2024-07-27T03:09:15.611877+0000","last_clean":"2024-07-27T03:09:15.611877+0000","last_became_active":"2024-07-27T03:09:14.608857+0000","last_became_peered":"2024-07-27T03:09:14.608857+0000","last_unstale":"2024-07-27T03:09:15.611877+0000","last_undegraded":"2024-07-27T03:09:15.611877+0000","last_fullsized":"2024-07-27T03:09:15.611877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:01:58.568752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610673+0000","last_change":"2024-07-27T03:09:14.618738+0000","last_active":"2024-07-27T03:09:15.610673+0000","last_peered":"2024-07-27T03:09:15.610673+0000","last_clean":"2024-07-27T03:09:15.610673+0000","last_became_active":"2024-07-27T03:09:14.618401+0000","last_became_peered":"2024-07-27T03:09:14.618401+0000","last_unstale":"2024-07-27T03:09:15.610673+0000","last_undegraded":"2024-07-27T03:09:15.610673+0000","last_fullsized":"2024-07-27T03:09:15.610673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:16.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660935+0000","last_change":"2024-07-27T03:09:14.614870+0000","last_active":"2024-07-27T03:09:15.660935+0000","last_peered":"2024-07-27T03:09:15.660935+0000","last_clean":"2024-07-27T03:09:15.660935+0000","last_became_active":"2024-07-27T03:09:14.614539+0000","last_became_peered":"2024-07-27T03:09:14.614539+0000","last_unstale":"2024-07-27T03:09:15.660935+0000","last_undegraded":"2024-07-27T03:09:15.660935+0000","last_fullsized":"2024-07-27T03:09:15.660935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:05.352746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660410+0000","last_change":"2024-07-27T03:09:14.624479+0000","last_active":"2024-07-27T03:09:15.660410+0000","last_peered":"2024-07-27T03:09:15.660410+0000","last_clean":"2024-07-27T03:09:15.660410+0000","last_became_active":"2024-07-27T03:09:14.623934+0000","last_became_peered":"2024-07-27T03:09:14.623934+0000","last_unstale":"2024-07-27T03:09:15.660410+0000","last_undegraded":"2024-07-27T03:09:15.660410+0000","last_fullsized":"2024-07-27T03:09:15.660410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:24:00.946497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660410+0000","last_change":"2024-07-27T03:09:14.620501+0000","last_active":"2024-07-27T03:09:15.660410+0000","last_peered":"2024-07-27T03:09:15.660410+0000","last_clean":"2024-07-27T03:09:15.660410+0000","last_became_active":"2024-07-27T03:09:14.620179+0000","last_became_peered":"2024-07-27T03:09:14.620179+0000","last_unstale":"2024-07-27T03:09:15.660410+0000","last_undegraded":"2024-07-27T03:09:15.660410+0000","last_fullsized":"2024-07-27T03:09:15.660410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:29:37.875296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661654+0000","last_change":"2024-07-27T03:09:14.614526+0000","last_active":"2024-07-27T03:09:15.661654+0000","last_peered":"2024-07-27T03:09:15.661654+0000","last_clean":"2024-07-27T03:09:15.661654+0000","last_became_active":"2024-07-27T03:09:14.614196+0000","last_became_peered":"2024-07-27T03:09:14.614196+0000","last_unstale":"2024-07-27T03:09:15.661654+0000","last_undegraded":"2024-07-27T03:09:15.661654+0000","last_fullsized":"2024-07-27T03:09:15.661654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:18:44.152519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660781+0000","last_change":"2024-07-27T03:09:13.607927+0000","last_active":"2024-07-27T03:09:15.660781+0000","last_peered":"2024-07-27T03:09:15.660781+0000","last_clean":"2024-07-27T03:09:15.660781+0000","last_became_active":"2024-07-27T03:09:13.607590+0000","last_became_peered":"2024-07-27T03:09:13.607590+0000","last_unstale":"2024-07-27T03:09:15.660781+0000","last_undegraded":"2024-07-27T03:09:15.660781+0000","last_fullsized":"2024-07-27T03:09:15.660781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:28:25.823999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660704+0000","last_change":"2024-07-27T03:09:14.623980+0000","last_active":"2024-07-27T03:09:15.660704+0000","last_peered":"2024-07-27T03:09:15.660704+0000","last_clean":"2024-07-27T03:09:15.660704+0000","last_became_active":"2024-07-27T03:09:14.622593+0000","last_became_peered":"2024-07-27T03:09:14.622593+0000","last_unstale":"2024-07-27T03:09:15.660704+0000","last_undegraded":"2024-07-27T03:09:15.660704+0000","last_fullsized":"2024-07-27T03:09:15.660704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:07:33.124882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661562+0000","last_change":"2024-07-27T03:09:13.602196+0000","last_active":"2024-07-27T03:09:15.661562+0000","last_peered":"2024-07-27T03:09:15.661562+0000","last_clean":"2024-07-27T03:09:15.661562+0000","last_became_active":"2024-07-27T03:09:13.601915+0000","last_became_peered":"2024-07-27T03:09:13.601915+0000","last_unstale":"2024-07-27T03:09:15.661562+0000","last_undegraded":"2024-07-27T03:09:15.661562+0000","last_fullsized":"2024-07-27T03:09:15.661562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:45:23.574023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611282+0000","last_change":"2024-07-27T03:09:14.619505+0000","last_active":"2024-07-27T03:09:15.611282+0000","last_peered":"2024-07-27T03:09:15.611282+0000","last_clean":"2024-07-27T03:09:15.611282+0000","last_became_active":"2024-07-27T03:09:14.618709+0000","last_became_peered":"2024-07-27T03:09:14.618709+0000","last_unstale":"2024-07-27T03:09:15.611282+0000","last_undegraded":"2024-07-27T03:09:15.611282+0000","last_fullsized":"2024-07-27T03:09:15.611282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:23:40.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.613048+0000","last_change":"2024-07-27T03:09:13.599941+0000","last_active":"2024-07-27T03:09:15.613048+0000","last_peered":"2024-07-27T03:09:15.613048+0000","last_clean":"2024-07-27T03:09:15.613048+0000","last_became_active":"2024-07-27T03:09:13.599596+0000","last_became_peered":"2024-07-27T03:09:13.599596+0000","last_unstale":"2024-07-27T03:09:15.613048+0000","last_undegraded":"2024-07-27T03:09:15.613048+0000","last_fullsized":"2024-07-27T03:09:15.613048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:02:43.312034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660954+0000","last_change":"2024-07-27T03:09:14.617781+0000","last_active":"2024-07-27T03:09:15.660954+0000","last_peered":"2024-07-27T03:09:15.660954+0000","last_clean":"2024-07-27T03:09:15.660954+0000","last_became_active":"2024-07-27T03:09:14.617337+0000","last_became_peered":"2024-07-27T03:09:14.617337+0000","last_unstale":"2024-07-27T03:09:15.660954+0000","last_undegraded":"2024-07-27T03:09:15.660954+0000","last_fullsized":"2024-07-27T03:09:15.660954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:07:12.274640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661358+0000","last_change":"2024-07-27T03:09:13.609797+0000","last_active":"2024-07-27T03:09:15.661358+0000","last_peered":"2024-07-27T03:09:15.661358+0000","last_clean":"2024-07-27T03:09:15.661358+0000","last_became_active":"2024-07-27T03:09:13.609486+0000","last_became_peered":"2024-07-27T03:09:13.609486+0000","last_unstale":"2024-07-27T03:09:15.661358+0000","last_undegraded":"2024-07-27T03:09:15.661358+0000","last_fullsized":"2024-07-27T03:09:15.661358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:10:05.583490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661014+0000","last_change":"2024-07-27T03:09:14.620521+0000","last_active":"2024-07-27T03:09:15.661014+0000","last_peered":"2024-07-27T03:09:15.661014+0000","last_clean":"2024-07-27T03:09:15.661014+0000","last_became_active":"2024-07-27T03:09:14.620196+0000","last_became_peered":"2024-07-27T03:09:14.620196+0000","last_unstale":"2024-07-27T03:09:15.661014+0000","last_undegraded":"2024-07-27T03:09:15.661014+0000","last_fullsized":"2024-07-27T03:09:15.661014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:01:58.568752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610812+0000","last_change":"2024-07-27T03:09:13.602765+0000","last_active":"2024-07-27T03:09:15.610812+0000","last_peered":"2024-07-27T03:09:15.610812+0000","last_clean":"2024-07-27T03:09:15.610812+0000","last_became_active":"2024-07-27T03:09:13.602412+0000","last_became_peered":"2024-07-27T03:09:13.602412+0000","last_unstale":"2024-07-27T03:09:15.610812+0000","last_undegraded":"2024-07-27T03:09:15.610812+0000","last_fullsized":"2024-07-27T03:09:15.610812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:38.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611543+0000","last_change":"2024-07-27T03:09:14.609234+0000","last_active":"2024-07-27T03:09:15.611543+0000","last_peered":"2024-07-27T03:09:15.611543+0000","last_clean":"2024-07-27T03:09:15.611543+0000","last_became_active":"2024-07-27T03:09:14.608895+0000","last_became_peered":"2024-07-27T03:09:14.608895+0000","last_unstale":"2024-07-27T03:09:15.611543+0000","last_undegraded":"2024-07-27T03:09:15.611543+0000","last_fullsized":"2024-07-27T03:09:15.611543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:44:35.263661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610495+0000","last_change":"2024-07-27T03:09:13.602915+0000","last_active":"2024-07-27T03:09:15.610495+0000","last_peered":"2024-07-27T03:09:15.610495+0000","last_clean":"2024-07-27T03:09:15.610495+0000","last_became_active":"2024-07-27T03:09:13.602529+0000","last_became_peered":"2024-07-27T03:09:13.602529+0000","last_unstale":"2024-07-27T03:09:15.610495+0000","last_undegraded":"2024-07-27T03:09:15.610495+0000","last_fullsized":"2024-07-27T03:09:15.610495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:32:18.241705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610015+0000","last_change":"2024-07-27T03:09:14.616446+0000","last_active":"2024-07-27T03:09:15.610015+0000","last_peered":"2024-07-27T03:09:15.610015+0000","last_clean":"2024-07-27T03:09:15.610015+0000","last_became_active":"2024-07-27T03:09:14.615748+0000","last_became_peered":"2024-07-27T03:09:14.615748+0000","last_unstale":"2024-07-27T03:09:15.610015+0000","last_undegraded":"2024-07-27T03:09:15.610015+0000","last_fullsized":"2024-07-27T03:09:15.610015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:35:57.828278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.612453+0000","last_change":"2024-07-27T03:09:13.602959+0000","last_active":"2024-07-27T03:09:15.612453+0000","last_peered":"2024-07-27T03:09:15.612453+0000","last_clean":"2024-07-27T03:09:15.612453+0000","last_became_active":"2024-07-27T03:09:13.602579+0000","last_became_peered":"2024-07-27T03:09:13.602579+0000","last_unstale":"2024-07-27T03:09:15.612453+0000","last_undegraded":"2024-07-27T03:09:15.612453+0000","last_fullsized":"2024-07-27T03:09:15.612453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:35:56.821853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660573+0000","last_change":"2024-07-27T03:09:14.622500+0000","last_active":"2024-07-27T03:09:15.660573+0000","last_peered":"2024-07-27T03:09:15.660573+0000","last_clean":"2024-07-27T03:09:15.660573+0000","last_became_active":"2024-07-27T03:09:14.622134+0000","last_became_peered":"2024-07-27T03:09:14.622134+0000","last_unstale":"2024-07-27T03:09:15.660573+0000","last_undegraded":"2024-07-27T03:09:15.660573+0000","last_fullsized":"2024-07-27T03:09:15.660573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:16.035797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.609956+0000","last_change":"2024-07-27T03:09:13.606250+0000","last_active":"2024-07-27T03:09:15.609956+0000","last_peered":"2024-07-27T03:09:15.609956+0000","last_clean":"2024-07-27T03:09:15.609956+0000","last_became_active":"2024-07-27T03:09:13.604310+0000","last_became_peered":"2024-07-27T03:09:13.604310+0000","last_unstale":"2024-07-27T03:09:15.609956+0000","last_undegraded":"2024-07-27T03:09:15.609956+0000","last_fullsized":"2024-07-27T03:09:15.609956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:46:44.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611812+0000","last_change":"2024-07-27T03:09:14.615612+0000","last_active":"2024-07-27T03:09:15.611812+0000","last_peered":"2024-07-27T03:09:15.611812+0000","last_clean":"2024-07-27T03:09:15.611812+0000","last_became_active":"2024-07-27T03:09:14.615304+0000","last_became_peered":"2024-07-27T03:09:14.615304+0000","last_unstale":"2024-07-27T03:09:15.611812+0000","last_undegraded":"2024-07-27T03:09:15.611812+0000","last_fullsized":"2024-07-27T03:09:15.611812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:05.352746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.612895+0000","last_change":"2024-07-27T03:09:13.603979+0000","last_active":"2024-07-27T03:09:15.612895+0000","last_peered":"2024-07-27T03:09:15.612895+0000","last_clean":"2024-07-27T03:09:15.612895+0000","last_became_active":"2024-07-27T03:09:13.603396+0000","last_became_peered":"2024-07-27T03:09:13.603396+0000","last_unstale":"2024-07-27T03:09:15.612895+0000","last_undegraded":"2024-07-27T03:09:15.612895+0000","last_fullsized":"2024-07-27T03:09:15.612895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:05.369390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.613074+0000","last_change":"2024-07-27T03:09:14.615023+0000","last_active":"2024-07-27T03:09:15.613074+0000","last_peered":"2024-07-27T03:09:15.613074+0000","last_clean":"2024-07-27T03:09:15.613074+0000","last_became_active":"2024-07-27T03:09:14.614697+0000","last_became_peered":"2024-07-27T03:09:14.614697+0000","last_unstale":"2024-07-27T03:09:15.613074+0000","last_undegraded":"2024-07-27T03:09:15.613074+0000","last_fullsized":"2024-07-27T03:09:15.613074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:09:02.622103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661675+0000","last_change":"2024-07-27T03:09:13.595841+0000","last_active":"2024-07-27T03:09:15.661675+0000","last_peered":"2024-07-27T03:09:15.661675+0000","last_clean":"2024-07-27T03:09:15.661675+0000","last_became_active":"2024-07-27T03:09:13.595509+0000","last_became_peered":"2024-07-27T03:09:13.595509+0000","last_unstale":"2024-07-27T03:09:15.661675+0000","last_undegraded":"2024-07-27T03:09:15.661675+0000","last_fullsized":"2024-07-27T03:09:15.661675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:28:50.876793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.613072+0000","last_change":"2024-07-27T03:09:14.620580+0000","last_active":"2024-07-27T03:09:15.613072+0000","last_peered":"2024-07-27T03:09:15.613072+0000","last_clean":"2024-07-27T03:09:15.613072+0000","last_became_active":"2024-07-27T03:09:14.620291+0000","last_became_peered":"2024-07-27T03:09:14.620291+0000","last_unstale":"2024-07-27T03:09:15.613072+0000","last_undegraded":"2024-07-27T03:09:15.613072+0000","last_fullsized":"2024-07-27T03:09:15.613072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:19:02.980592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611760+0000","last_change":"2024-07-27T03:09:13.602291+0000","last_active":"2024-07-27T03:09:15.611760+0000","last_peered":"2024-07-27T03:09:15.611760+0000","last_clean":"2024-07-27T03:09:15.611760+0000","last_became_active":"2024-07-27T03:09:13.601998+0000","last_became_peered":"2024-07-27T03:09:13.601998+0000","last_unstale":"2024-07-27T03:09:15.611760+0000","last_undegraded":"2024-07-27T03:09:15.611760+0000","last_fullsized":"2024-07-27T03:09:15.611760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:31:03.884581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611669+0000","last_change":"2024-07-27T03:09:14.616244+0000","last_active":"2024-07-27T03:09:15.611669+0000","last_peered":"2024-07-27T03:09:15.611669+0000","last_clean":"2024-07-27T03:09:15.611669+0000","last_became_active":"2024-07-27T03:09:14.615958+0000","last_became_peered":"2024-07-27T03:09:14.615958+0000","last_unstale":"2024-07-27T03:09:15.611669+0000","last_undegraded":"2024-07-27T03:09:15.611669+0000","last_fullsized":"2024-07-27T03:09:15.611669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:49:59.755174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.613135+0000","last_change":"2024-07-27T03:09:13.598773+0000","last_active":"2024-07-27T03:09:15.613135+0000","last_peered":"2024-07-27T03:09:15.613135+0000","last_clean":"2024-07-27T03:09:15.613135+0000","last_became_active":"2024-07-27T03:09:13.597687+0000","last_became_peered":"2024-07-27T03:09:13.597687+0000","last_unstale":"2024-07-27T03:09:15.613135+0000","last_undegraded":"2024-07-27T03:09:15.613135+0000","last_fullsized":"2024-07-27T03:09:15.613135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:07:32.118457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660636+0000","last_change":"2024-07-27T03:09:14.623159+0000","last_active":"2024-07-27T03:09:15.660636+0000","last_peered":"2024-07-27T03:09:15.660636+0000","last_clean":"2024-07-27T03:09:15.660636+0000","last_became_active":"2024-07-27T03:09:14.622206+0000","last_became_peered":"2024-07-27T03:09:14.622206+0000","last_unstale":"2024-07-27T03:09:15.660636+0000","last_undegraded":"2024-07-27T03:09:15.660636+0000","last_fullsized":"2024-07-27T03:09:15.660636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:12.575517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610834+0000","last_change":"2024-07-27T03:09:13.605927+0000","last_active":"2024-07-27T03:09:15.610834+0000","last_peered":"2024-07-27T03:09:15.610834+0000","last_clean":"2024-07-27T03:09:15.610834+0000","last_became_active":"2024-07-27T03:09:13.604222+0000","last_became_peered":"2024-07-27T03:09:13.604222+0000","last_unstale":"2024-07-27T03:09:15.610834+0000","last_undegraded":"2024-07-27T03:09:15.610834+0000","last_fullsized":"2024-07-27T03:09:15.610834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:05:09.003909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.613098+0000","last_change":"2024-07-27T03:09:14.614092+0000","last_active":"2024-07-27T03:09:15.613098+0000","last_peered":"2024-07-27T03:09:15.613098+0000","last_clean":"2024-07-27T03:09:15.613098+0000","last_became_active":"2024-07-27T03:09:14.613793+0000","last_became_peered":"2024-07-27T03:09:14.613793+0000","last_unstale":"2024-07-27T03:09:15.613098+0000","last_undegraded":"2024-07-27T03:09:15.613098+0000","last_fullsized":"2024-07-27T03:09:15.613098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:42:43.119346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660767+0000","last_change":"2024-07-27T03:09:13.606401+0000","last_active":"2024-07-27T03:09:15.660767+0000","last_peered":"2024-07-27T03:09:15.660767+0000","last_clean":"2024-07-27T03:09:15.660767+0000","last_became_active":"2024-07-27T03:09:13.606094+0000","last_became_peered":"2024-07-27T03:09:13.606094+0000","last_unstale":"2024-07-27T03:09:15.660767+0000","last_undegraded":"2024-07-27T03:09:15.660767+0000","last_fullsized":"2024-07-27T03:09:15.660767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:18:48.224902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660642+0000","last_change":"2024-07-27T03:09:14.628703+0000","last_active":"2024-07-27T03:09:15.660642+0000","last_peered":"2024-07-27T03:09:15.660642+0000","last_clean":"2024-07-27T03:09:15.660642+0000","last_became_active":"2024-07-27T03:09:14.628369+0000","last_became_peered":"2024-07-27T03:09:14.628369+0000","last_unstale":"2024-07-27T03:09:15.660642+0000","last_undegraded":"2024-07-27T03:09:15.660642+0000","last_fullsized":"2024-07-27T03:09:15.660642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:44:35.263661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.612586+0000","last_change":"2024-07-27T03:09:13.604635+0000","last_active":"2024-07-27T03:09:15.612586+0000","last_peered":"2024-07-27T03:09:15.612586+0000","last_clean":"2024-07-27T03:09:15.612586+0000","last_became_active":"2024-07-27T03:09:13.604333+0000","last_became_peered":"2024-07-27T03:09:13.604333+0000","last_unstale":"2024-07-27T03:09:15.612586+0000","last_undegraded":"2024-07-27T03:09:15.612586+0000","last_fullsized":"2024-07-27T03:09:15.612586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:49:23.327205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660298+0000","last_change":"2024-07-27T03:09:14.623092+0000","last_active":"2024-07-27T03:09:15.660298+0000","last_peered":"2024-07-27T03:09:15.660298+0000","last_clean":"2024-07-27T03:09:15.660298+0000","last_became_active":"2024-07-27T03:09:14.622749+0000","last_became_peered":"2024-07-27T03:09:14.622749+0000","last_unstale":"2024-07-27T03:09:15.660298+0000","last_undegraded":"2024-07-27T03:09:15.660298+0000","last_fullsized":"2024-07-27T03:09:15.660298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:41:18.671396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.612475+0000","last_change":"2024-07-27T03:09:13.607058+0000","last_active":"2024-07-27T03:09:15.612475+0000","last_peered":"2024-07-27T03:09:15.612475+0000","last_clean":"2024-07-27T03:09:15.612475+0000","last_became_active":"2024-07-27T03:09:13.606718+0000","last_became_peered":"2024-07-27T03:09:13.606718+0000","last_unstale":"2024-07-27T03:09:15.612475+0000","last_undegraded":"2024-07-27T03:09:15.612475+0000","last_fullsized":"2024-07-27T03:09:15.612475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:23:59.940072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610726+0000","last_change":"2024-07-27T03:09:14.627550+0000","last_active":"2024-07-27T03:09:15.610726+0000","last_peered":"2024-07-27T03:09:15.610726+0000","last_clean":"2024-07-27T03:09:15.610726+0000","last_became_active":"2024-07-27T03:09:14.627173+0000","last_became_peered":"2024-07-27T03:09:14.627173+0000","last_unstale":"2024-07-27T03:09:15.610726+0000","last_undegraded":"2024-07-27T03:09:15.610726+0000","last_fullsized":"2024-07-27T03:09:15.610726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:12.575517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660781+0000","last_change":"2024-07-27T03:09:13.605511+0000","last_active":"2024-07-27T03:09:15.660781+0000","last_peered":"2024-07-27T03:09:15.660781+0000","last_clean":"2024-07-27T03:09:15.660781+0000","last_became_active":"2024-07-27T03:09:13.604979+0000","last_became_peered":"2024-07-27T03:09:13.604979+0000","last_unstale":"2024-07-27T03:09:15.660781+0000","last_undegraded":"2024-07-27T03:09:15.660781+0000","last_fullsized":"2024-07-27T03:09:15.660781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:29:10.340511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.612048+0000","last_change":"2024-07-27T03:09:14.621376+0000","last_active":"2024-07-27T03:09:15.612048+0000","last_peered":"2024-07-27T03:09:15.612048+0000","last_clean":"2024-07-27T03:09:15.612048+0000","last_became_active":"2024-07-27T03:09:14.620779+0000","last_became_peered":"2024-07-27T03:09:14.620779+0000","last_unstale":"2024-07-27T03:09:15.612048+0000","last_undegraded":"2024-07-27T03:09:15.612048+0000","last_fullsized":"2024-07-27T03:09:15.612048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:36:32.361248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610399+0000","last_change":"2024-07-27T03:09:13.605887+0000","last_active":"2024-07-27T03:09:15.610399+0000","last_peered":"2024-07-27T03:09:15.610399+0000","last_clean":"2024-07-27T03:09:15.610399+0000","last_became_active":"2024-07-27T03:09:13.605518+0000","last_became_peered":"2024-07-27T03:09:13.605518+0000","last_unstale":"2024-07-27T03:09:15.610399+0000","last_undegraded":"2024-07-27T03:09:15.610399+0000","last_fullsized":"2024-07-27T03:09:15.610399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:43:24.612891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661674+0000","last_change":"2024-07-27T03:09:14.617479+0000","last_active":"2024-07-27T03:09:15.661674+0000","last_peered":"2024-07-27T03:09:15.661674+0000","last_clean":"2024-07-27T03:09:15.661674+0000","last_became_active":"2024-07-27T03:09:14.617003+0000","last_became_peered":"2024-07-27T03:09:14.617003+0000","last_unstale":"2024-07-27T03:09:15.661674+0000","last_undegraded":"2024-07-27T03:09:15.661674+0000","last_fullsized":"2024-07-27T03:09:15.661674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:59:04.248587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610563+0000","last_change":"2024-07-27T03:09:13.601807+0000","last_active":"2024-07-27T03:09:15.610563+0000","last_peered":"2024-07-27T03:09:15.610563+0000","last_clean":"2024-07-27T03:09:15.610563+0000","last_became_active":"2024-07-27T03:09:13.600603+0000","last_became_peered":"2024-07-27T03:09:13.600603+0000","last_unstale":"2024-07-27T03:09:15.610563+0000","last_undegraded":"2024-07-27T03:09:15.610563+0000","last_fullsized":"2024-07-27T03:09:15.610563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:12:16.902363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661293+0000","last_change":"2024-07-27T03:09:14.615661+0000","last_active":"2024-07-27T03:09:15.661293+0000","last_peered":"2024-07-27T03:09:15.661293+0000","last_clean":"2024-07-27T03:09:15.661293+0000","last_became_active":"2024-07-27T03:09:14.615352+0000","last_became_peered":"2024-07-27T03:09:14.615352+0000","last_unstale":"2024-07-27T03:09:15.661293+0000","last_undegraded":"2024-07-27T03:09:15.661293+0000","last_fullsized":"2024-07-27T03:09:15.661293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:19:40.590136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611258+0000","last_change":"2024-07-27T03:09:13.603828+0000","last_active":"2024-07-27T03:09:15.611258+0000","last_peered":"2024-07-27T03:09:15.611258+0000","last_clean":"2024-07-27T03:09:15.611258+0000","last_became_active":"2024-07-27T03:09:13.603208+0000","last_became_peered":"2024-07-27T03:09:13.603208+0000","last_unstale":"2024-07-27T03:09:15.611258+0000","last_undegraded":"2024-07-27T03:09:15.611258+0000","last_fullsized":"2024-07-27T03:09:15.611258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:28:25.823999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661204+0000","last_change":"2024-07-27T03:09:14.620713+0000","last_active":"2024-07-27T03:09:15.661204+0000","last_peered":"2024-07-27T03:09:15.661204+0000","last_clean":"2024-07-27T03:09:15.661204+0000","last_became_active":"2024-07-27T03:09:14.618734+0000","last_became_peered":"2024-07-27T03:09:14.618734+0000","last_unstale":"2024-07-27T03:09:15.661204+0000","last_undegraded":"2024-07-27T03:09:15.661204+0000","last_fullsized":"2024-07-27T03:09:15.661204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:21:12.395212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660765+0000","last_change":"2024-07-27T03:09:13.600909+0000","last_active":"2024-07-27T03:09:15.660765+0000","last_peered":"2024-07-27T03:09:15.660765+0000","last_clean":"2024-07-27T03:09:15.660765+0000","last_became_active":"2024-07-27T03:09:13.600591+0000","last_became_peered":"2024-07-27T03:09:13.600591+0000","last_unstale":"2024-07-27T03:09:15.660765+0000","last_undegraded":"2024-07-27T03:09:15.660765+0000","last_fullsized":"2024-07-27T03:09:15.660765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:21:43.607970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661823+0000","last_change":"2024-07-27T03:09:14.609501+0000","last_active":"2024-07-27T03:09:15.661823+0000","last_peered":"2024-07-27T03:09:15.661823+0000","last_clean":"2024-07-27T03:09:15.661823+0000","last_became_active":"2024-07-27T03:09:14.609186+0000","last_became_peered":"2024-07-27T03:09:14.609186+0000","last_unstale":"2024-07-27T03:09:15.661823+0000","last_undegraded":"2024-07-27T03:09:15.661823+0000","last_fullsized":"2024-07-27T03:09:15.661823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:45:42.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660421+0000","last_change":"2024-07-27T03:09:13.609088+0000","last_active":"2024-07-27T03:09:15.660421+0000","last_peered":"2024-07-27T03:09:15.660421+0000","last_clean":"2024-07-27T03:09:15.660421+0000","last_became_active":"2024-07-27T03:09:13.608835+0000","last_became_peered":"2024-07-27T03:09:13.608835+0000","last_unstale":"2024-07-27T03:09:15.660421+0000","last_undegraded":"2024-07-27T03:09:15.660421+0000","last_fullsized":"2024-07-27T03:09:15.660421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:46:44.952880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661203+0000","last_change":"2024-07-27T03:09:14.608627+0000","last_active":"2024-07-27T03:09:15.661203+0000","last_peered":"2024-07-27T03:09:15.661203+0000","last_clean":"2024-07-27T03:09:15.661203+0000","last_became_active":"2024-07-27T03:09:14.608373+0000","last_became_peered":"2024-07-27T03:09:14.608373+0000","last_unstale":"2024-07-27T03:09:15.661203+0000","last_undegraded":"2024-07-27T03:09:15.661203+0000","last_fullsized":"2024-07-27T03:09:15.661203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:36:58.946328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610112+0000","last_change":"2024-07-27T03:09:13.601066+0000","last_active":"2024-07-27T03:09:15.610112+0000","last_peered":"2024-07-27T03:09:15.610112+0000","last_clean":"2024-07-27T03:09:15.610112+0000","last_became_active":"2024-07-27T03:09:13.600739+0000","last_became_peered":"2024-07-27T03:09:13.600739+0000","last_unstale":"2024-07-27T03:09:15.610112+0000","last_undegraded":"2024-07-27T03:09:15.610112+0000","last_fullsized":"2024-07-27T03:09:15.610112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:26.159437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660398+0000","last_change":"2024-07-27T03:09:14.616081+0000","last_active":"2024-07-27T03:09:15.660398+0000","last_peered":"2024-07-27T03:09:15.660398+0000","last_clean":"2024-07-27T03:09:15.660398+0000","last_became_active":"2024-07-27T03:09:14.615714+0000","last_became_peered":"2024-07-27T03:09:14.615714+0000","last_unstale":"2024-07-27T03:09:15.660398+0000","last_undegraded":"2024-07-27T03:09:15.660398+0000","last_fullsized":"2024-07-27T03:09:15.660398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:42:40.105824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610930+0000","last_change":"2024-07-27T03:09:13.604819+0000","last_active":"2024-07-27T03:09:15.610930+0000","last_peered":"2024-07-27T03:09:15.610930+0000","last_clean":"2024-07-27T03:09:15.610930+0000","last_became_active":"2024-07-27T03:09:13.604357+0000","last_became_peered":"2024-07-27T03:09:13.604357+0000","last_unstale":"2024-07-27T03:09:15.610930+0000","last_undegraded":"2024-07-27T03:09:15.610930+0000","last_fullsized":"2024-07-27T03:09:15.610930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:28:42.605173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661409+0000","last_change":"2024-07-27T03:09:14.621834+0000","last_active":"2024-07-27T03:09:15.661409+0000","last_peered":"2024-07-27T03:09:15.661409+0000","last_clean":"2024-07-27T03:09:15.661409+0000","last_became_active":"2024-07-27T03:09:14.621528+0000","last_became_peered":"2024-07-27T03:09:14.621528+0000","last_unstale":"2024-07-27T03:09:15.661409+0000","last_undegraded":"2024-07-27T03:09:15.661409+0000","last_fullsized":"2024-07-27T03:09:15.661409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:45:24.580448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660799+0000","last_change":"2024-07-27T03:09:13.606468+0000","last_active":"2024-07-27T03:09:15.660799+0000","last_peered":"2024-07-27T03:09:15.660799+0000","last_clean":"2024-07-27T03:09:15.660799+0000","last_became_active":"2024-07-27T03:09:13.606168+0000","last_became_peered":"2024-07-27T03:09:13.606168+0000","last_unstale":"2024-07-27T03:09:15.660799+0000","last_undegraded":"2024-07-27T03:09:15.660799+0000","last_fullsized":"2024-07-27T03:09:15.660799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:41:17.664971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.612060+0000","last_change":"2024-07-27T03:09:14.614611+0000","last_active":"2024-07-27T03:09:15.612060+0000","last_peered":"2024-07-27T03:09:15.612060+0000","last_clean":"2024-07-27T03:09:15.612060+0000","last_became_active":"2024-07-27T03:09:14.614178+0000","last_became_peered":"2024-07-27T03:09:14.614178+0000","last_unstale":"2024-07-27T03:09:15.612060+0000","last_undegraded":"2024-07-27T03:09:15.612060+0000","last_fullsized":"2024-07-27T03:09:15.612060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:39:57.302132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661774+0000","last_change":"2024-07-27T03:09:13.600443+0000","last_active":"2024-07-27T03:09:15.661774+0000","last_peered":"2024-07-27T03:09:15.661774+0000","last_clean":"2024-07-27T03:09:15.661774+0000","last_became_active":"2024-07-27T03:09:13.600100+0000","last_became_peered":"2024-07-27T03:09:13.600100+0000","last_unstale":"2024-07-27T03:09:15.661774+0000","last_undegraded":"2024-07-27T03:09:15.661774+0000","last_fullsized":"2024-07-27T03:09:15.661774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:45:41.711135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660265+0000","last_change":"2024-07-27T03:09:14.605863+0000","last_active":"2024-07-27T03:09:15.660265+0000","last_peered":"2024-07-27T03:09:15.660265+0000","last_clean":"2024-07-27T03:09:15.660265+0000","last_became_active":"2024-07-27T03:09:14.605561+0000","last_became_peered":"2024-07-27T03:09:14.605561+0000","last_unstale":"2024-07-27T03:09:15.660265+0000","last_undegraded":"2024-07-27T03:09:15.660265+0000","last_fullsized":"2024-07-27T03:09:15.660265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:28:43.611598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.661868+0000","last_change":"2024-07-27T03:09:13.608738+0000","last_active":"2024-07-27T03:09:15.661868+0000","last_peered":"2024-07-27T03:09:15.661868+0000","last_clean":"2024-07-27T03:09:15.661868+0000","last_became_active":"2024-07-27T03:09:13.608362+0000","last_became_peered":"2024-07-27T03:09:13.608362+0000","last_unstale":"2024-07-27T03:09:15.661868+0000","last_undegraded":"2024-07-27T03:09:15.661868+0000","last_fullsized":"2024-07-27T03:09:15.661868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:54.757042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660523+0000","last_change":"2024-07-27T03:09:14.614687+0000","last_active":"2024-07-27T03:09:15.660523+0000","last_peered":"2024-07-27T03:09:15.660523+0000","last_clean":"2024-07-27T03:09:15.660523+0000","last_became_active":"2024-07-27T03:09:14.613957+0000","last_became_peered":"2024-07-27T03:09:14.613957+0000","last_unstale":"2024-07-27T03:09:15.660523+0000","last_undegraded":"2024-07-27T03:09:15.660523+0000","last_fullsized":"2024-07-27T03:09:15.660523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:22:49.333753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660913+0000","last_change":"2024-07-27T03:09:13.592382+0000","last_active":"2024-07-27T03:09:15.660913+0000","last_peered":"2024-07-27T03:09:15.660913+0000","last_clean":"2024-07-27T03:09:15.660913+0000","last_became_active":"2024-07-27T03:09:13.592005+0000","last_became_peered":"2024-07-27T03:09:13.592005+0000","last_unstale":"2024-07-27T03:09:15.660913+0000","last_undegraded":"2024-07-27T03:09:15.660913+0000","last_fullsized":"2024-07-27T03:09:15.660913+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:13:24.380286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660702+0000","last_change":"2024-07-27T03:09:14.616304+0000","last_active":"2024-07-27T03:09:15.660702+0000","last_peered":"2024-07-27T03:09:15.660702+0000","last_clean":"2024-07-27T03:09:15.660702+0000","last_became_active":"2024-07-27T03:09:14.616005+0000","last_became_peered":"2024-07-27T03:09:14.616005+0000","last_unstale":"2024-07-27T03:09:15.660702+0000","last_undegraded":"2024-07-27T03:09:15.660702+0000","last_fullsized":"2024-07-27T03:09:15.660702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:31:04.891006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660873+0000","last_change":"2024-07-27T03:09:13.607105+0000","last_active":"2024-07-27T03:09:15.660873+0000","last_peered":"2024-07-27T03:09:15.660873+0000","last_clean":"2024-07-27T03:09:15.660873+0000","last_became_active":"2024-07-27T03:09:13.606751+0000","last_became_peered":"2024-07-27T03:09:13.606751+0000","last_unstale":"2024-07-27T03:09:15.660873+0000","last_undegraded":"2024-07-27T03:09:15.660873+0000","last_fullsized":"2024-07-27T03:09:15.660873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:26:52.773759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.612510+0000","last_change":"2024-07-27T03:09:14.611941+0000","last_active":"2024-07-27T03:09:15.612510+0000","last_peered":"2024-07-27T03:09:15.612510+0000","last_clean":"2024-07-27T03:09:15.612510+0000","last_became_active":"2024-07-27T03:09:14.611603+0000","last_became_peered":"2024-07-27T03:09:14.611603+0000","last_unstale":"2024-07-27T03:09:15.612510+0000","last_undegraded":"2024-07-27T03:09:15.612510+0000","last_fullsized":"2024-07-27T03:09:15.612510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:33:16.286289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.611119+0000","last_change":"2024-07-27T03:09:13.600341+0000","last_active":"2024-07-27T03:09:15.611119+0000","last_peered":"2024-07-27T03:09:15.611119+0000","last_clean":"2024-07-27T03:09:15.611119+0000","last_became_active":"2024-07-27T03:09:13.600029+0000","last_became_peered":"2024-07-27T03:09:13.600029+0000","last_unstale":"2024-07-27T03:09:15.611119+0000","last_undegraded":"2024-07-27T03:09:15.611119+0000","last_fullsized":"2024-07-27T03:09:15.611119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:56:01.886146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.610031+0000","last_change":"2024-07-27T03:09:14.618278+0000","last_active":"2024-07-27T03:09:15.610031+0000","last_peered":"2024-07-27T03:09:15.610031+0000","last_clean":"2024-07-27T03:09:15.610031+0000","last_became_active":"2024-07-27T03:09:14.617936+0000","last_became_peered":"2024-07-27T03:09:14.617936+0000","last_unstale":"2024-07-27T03:09:15.610031+0000","last_undegraded":"2024-07-27T03:09:15.610031+0000","last_fullsized":"2024-07-27T03:09:15.610031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:49:24.333630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.612569+0000","last_change":"2024-07-27T03:09:13.603881+0000","last_active":"2024-07-27T03:09:15.612569+0000","last_peered":"2024-07-27T03:09:15.612569+0000","last_clean":"2024-07-27T03:09:15.612569+0000","last_became_active":"2024-07-27T03:09:13.603554+0000","last_became_peered":"2024-07-27T03:09:13.603554+0000","last_unstale":"2024-07-27T03:09:15.612569+0000","last_undegraded":"2024-07-27T03:09:15.612569+0000","last_fullsized":"2024-07-27T03:09:15.612569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:22:48.327328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660962+0000","last_change":"2024-07-27T03:09:14.618263+0000","last_active":"2024-07-27T03:09:15.660962+0000","last_peered":"2024-07-27T03:09:15.660962+0000","last_clean":"2024-07-27T03:09:15.660962+0000","last_became_active":"2024-07-27T03:09:14.617964+0000","last_became_peered":"2024-07-27T03:09:14.617964+0000","last_unstale":"2024-07-27T03:09:15.660962+0000","last_undegraded":"2024-07-27T03:09:15.660962+0000","last_fullsized":"2024-07-27T03:09:15.660962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:13.581614+0000","last_clean_scrub_stamp":"2024-07-27T03:09:13.581614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:27:26.269351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660132+0000","last_change":"2024-07-27T03:09:13.604580+0000","last_active":"2024-07-27T03:09:15.660132+0000","last_peered":"2024-07-27T03:09:15.660132+0000","last_clean":"2024-07-27T03:09:15.660132+0000","last_became_active":"2024-07-27T03:09:13.604304+0000","last_became_peered":"2024-07-27T03:09:13.604304+0000","last_unstale":"2024-07-27T03:09:15.660132+0000","last_undegraded":"2024-07-27T03:09:15.660132+0000","last_fullsized":"2024-07-27T03:09:15.660132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:09:12.575189+0000","last_clean_scrub_stamp":"2024-07-27T03:09:12.575189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:56:01.886146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-07-27T03:09:15.660908+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:09:15.660908+0000","last_peered":"2024-07-27T03:09:15.660908+0000","last_clean":"2024-07-27T03:09:15.660908+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:09:15.660908+0000","last_undegraded":"2024-07-27T03:09:15.660908+0000","last_fullsized":"2024-07-27T03:09:15.660908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":962560,"data_stored":730936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":141150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":142112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":958464,"data_stored":730846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":141094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":140582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":142112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:09:23.474 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-27T03:09:23.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-07-27T03:09:23.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.629+0000 7fee3dc5a640 1 -- 172.21.15.120:0/493793873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee380b4d30 msgr2=0x7fee38158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:23.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.629+0000 7fee3dc5a640 1 --2- 172.21.15.120:0/493793873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee380b4d30 0x7fee38158da0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fee380b3ca0 tx=0x7fee3002a870 comp rx=0 tx=0).stop 2024-07-27T03:09:23.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.629+0000 7fee3dc5a640 1 -- 172.21.15.120:0/493793873 shutdown_connections 2024-07-27T03:09:23.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.629+0000 7fee3dc5a640 1 --2- 172.21.15.120:0/493793873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee380b4d30 0x7fee38158da0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.629+0000 7fee3dc5a640 1 --2- 172.21.15.120:0/493793873 >> v2:172.21.15.121:3300/0 conn(0x7fee38071cf0 0x7fee38074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.629+0000 7fee3dc5a640 1 -- 172.21.15.120:0/493793873 >> 172.21.15.120:0/493793873 conn(0x7fee380d0f00 msgr2=0x7fee380d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:23.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.630+0000 7fee3dc5a640 1 -- 172.21.15.120:0/493793873 shutdown_connections 2024-07-27T03:09:23.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.630+0000 7fee3dc5a640 1 -- 172.21.15.120:0/493793873 wait complete. 2024-07-27T03:09:23.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.631+0000 7fee3dc5a640 1 Processor -- start 2024-07-27T03:09:23.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.632+0000 7fee3dc5a640 1 -- start start 2024-07-27T03:09:23.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee3dc5a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee380b4d30 0x7fee3815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:23.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee3dc5a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee3815c500 0x7fee381555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee3dc5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee38155af0 0x7fee380cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee3dc5a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fee38070330 con 0x7fee38155af0 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee3dc5a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee380701b0 con 0x7fee3815c500 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee3dc5a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fee380704b0 con 0x7fee380b4d30 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee37fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee38155af0 0x7fee380cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee37fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee38155af0 0x7fee380cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51094/0 (socket says 172.21.15.120:51094) 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee37fff640 1 -- 172.21.15.120:0/513854952 learned_addr learned my addr 172.21.15.120:0/513854952 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee36ffd640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee3815c500 0x7fee381555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee377fe640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee380b4d30 0x7fee3815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee37fff640 1 -- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee380b4d30 msgr2=0x7fee3815aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee37fff640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee380b4d30 0x7fee3815aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee37fff640 1 -- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee3815c500 msgr2=0x7fee381555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:23.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee37fff640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee3815c500 0x7fee381555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee37fff640 1 -- 172.21.15.120:0/513854952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3815b400 con 0x7fee38155af0 2024-07-27T03:09:23.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee377fe640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee380b4d30 0x7fee3815aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:23.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.633+0000 7fee37fff640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee38155af0 0x7fee380cbc60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fee30005fd0 tx=0x7fee30033ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:23.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.634+0000 7fee1ffff640 1 -- 172.21.15.120:0/513854952 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30042020 con 0x7fee38155af0 2024-07-27T03:09:23.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.634+0000 7fee1ffff640 1 -- 172.21.15.120:0/513854952 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee30033cc0 con 0x7fee38155af0 2024-07-27T03:09:23.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.634+0000 7fee3dc5a640 1 -- 172.21.15.120:0/513854952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee381f8cf0 con 0x7fee38155af0 2024-07-27T03:09:23.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.634+0000 7fee1ffff640 1 -- 172.21.15.120:0/513854952 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30037040 con 0x7fee38155af0 2024-07-27T03:09:23.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.634+0000 7fee3dc5a640 1 -- 172.21.15.120:0/513854952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee381f92b0 con 0x7fee38155af0 2024-07-27T03:09:23.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.635+0000 7fee3dc5a640 1 -- 172.21.15.120:0/513854952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee3815d570 con 0x7fee38155af0 2024-07-27T03:09:23.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.635+0000 7fee1ffff640 1 -- 172.21.15.120:0/513854952 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fee30045020 con 0x7fee38155af0 2024-07-27T03:09:23.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.636+0000 7fee1ffff640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee24077010 0x7fee24079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:23.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.636+0000 7fee1ffff640 1 -- 172.21.15.120:0/513854952 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fee300b97d0 con 0x7fee38155af0 2024-07-27T03:09:23.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.636+0000 7fee377fe640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee24077010 0x7fee24079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:23.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.637+0000 7fee377fe640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee24077010 0x7fee24079520 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee280013f0 tx=0x7fee28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:23.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.640+0000 7fee1ffff640 1 -- 172.21.15.120:0/513854952 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fee3815d570 con 0x7fee38155af0 2024-07-27T03:09:23.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.895+0000 7fee3dc5a640 1 -- 172.21.15.120:0/513854952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fee381f8a80 con 0x7fee38155af0 2024-07-27T03:09:23.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.898+0000 7fee1ffff640 1 -- 172.21.15.120:0/513854952 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fee3004c030 con 0x7fee38155af0 2024-07-27T03:09:23.902 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-07-27T03:09:23.902 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmI8baMRAArCIL9NNNVlevij0JAWwGwg== 2024-07-27T03:09:23.902 INFO:teuthology.orchestra.run.smithi120.stdout: caps mds = "allow" 2024-07-27T03:09:23.902 INFO:teuthology.orchestra.run.smithi120.stdout: caps mon = "allow r" 2024-07-27T03:09:23.902 INFO:teuthology.orchestra.run.smithi120.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-07-27T03:09:23.902 INFO:teuthology.orchestra.run.smithi120.stderr:updated caps for client.0 2024-07-27T03:09:23.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.900+0000 7fee3dc5a640 1 -- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee24077010 msgr2=0x7fee24079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:23.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.900+0000 7fee3dc5a640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee24077010 0x7fee24079520 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee280013f0 tx=0x7fee28009040 comp rx=0 tx=0).stop 2024-07-27T03:09:23.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.900+0000 7fee3dc5a640 1 -- 172.21.15.120:0/513854952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee38155af0 msgr2=0x7fee380cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:23.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.900+0000 7fee3dc5a640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee38155af0 0x7fee380cbc60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fee30005fd0 tx=0x7fee30033ad0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.900+0000 7fee3dc5a640 1 -- 172.21.15.120:0/513854952 shutdown_connections 2024-07-27T03:09:23.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.900+0000 7fee3dc5a640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fee24077010 0x7fee24079520 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.900+0000 7fee3dc5a640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee38155af0 0x7fee380cbc60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.900+0000 7fee3dc5a640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee3815c500 0x7fee381555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.900+0000 7fee3dc5a640 1 --2- 172.21.15.120:0/513854952 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fee380b4d30 0x7fee3815aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:23.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.900+0000 7fee3dc5a640 1 -- 172.21.15.120:0/513854952 >> 172.21.15.120:0/513854952 conn(0x7fee380d0f00 msgr2=0x7fee38158430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:23.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.901+0000 7fee3dc5a640 1 -- 172.21.15.120:0/513854952 shutdown_connections 2024-07-27T03:09:23.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:23.901+0000 7fee3dc5a640 1 -- 172.21.15.120:0/513854952 wait complete. 2024-07-27T03:09:23.916 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:24.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.026+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/487532834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b8415ec20 msgr2=0x7f5b8415f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.026+0000 7f5b8a5c3640 1 --2- 172.21.15.120:0/487532834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b8415ec20 0x7f5b8415f030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5b8415bd00 tx=0x7f5b7c02a820 comp rx=0 tx=0).stop 2024-07-27T03:09:24.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.026+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/487532834 shutdown_connections 2024-07-27T03:09:24.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.026+0000 7f5b8a5c3640 1 --2- 172.21.15.120:0/487532834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b8415ec20 0x7f5b8415f030 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.026+0000 7f5b8a5c3640 1 --2- 172.21.15.120:0/487532834 >> v2:172.21.15.121:3300/0 conn(0x7f5b840b63e0 0x7f5b84152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.026+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/487532834 >> 172.21.15.120:0/487532834 conn(0x7f5b8406cba0 msgr2=0x7f5b8406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:24.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.026+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/487532834 shutdown_connections 2024-07-27T03:09:24.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.026+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/487532834 wait complete. 2024-07-27T03:09:24.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.027+0000 7f5b8a5c3640 1 Processor -- start 2024-07-27T03:09:24.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.028+0000 7f5b8a5c3640 1 -- start start 2024-07-27T03:09:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b8a5c3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b8415c220 0x7f5b8414bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b8a5c3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b8415ec20 0x7f5b8414da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b8a5c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8414df40 0x7f5b84072d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b8a5c3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5b840cdac0 con 0x7f5b8415c220 2024-07-27T03:09:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b8a5c3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5b840cd940 con 0x7f5b8414df40 2024-07-27T03:09:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b8a5c3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5b840cdc40 con 0x7f5b8415ec20 2024-07-27T03:09:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b83fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b8415c220 0x7f5b8414bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b83fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b8415c220 0x7f5b8414bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51098/0 (socket says 172.21.15.120:51098) 2024-07-27T03:09:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b83fff640 1 -- 172.21.15.120:0/552904195 learned_addr learned my addr 172.21.15.120:0/552904195 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b88b60640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8414df40 0x7f5b84072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b837fe640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b8415ec20 0x7f5b8414da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b83fff640 1 -- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b8415ec20 msgr2=0x7f5b8414da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b83fff640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b8415ec20 0x7f5b8414da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b83fff640 1 -- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8414df40 msgr2=0x7f5b84072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b83fff640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8414df40 0x7f5b84072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.029+0000 7f5b83fff640 1 -- 172.21.15.120:0/552904195 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b841f6440 con 0x7f5b8415c220 2024-07-27T03:09:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.030+0000 7f5b83fff640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b8415c220 0x7f5b8414bc20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400c3c0 tx=0x7f5b7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.030+0000 7f5b80ff9640 1 -- 172.21.15.120:0/552904195 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74017070 con 0x7f5b8415c220 2024-07-27T03:09:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.030+0000 7f5b80ff9640 1 -- 172.21.15.120:0/552904195 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b740035f0 con 0x7f5b8415c220 2024-07-27T03:09:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.030+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/552904195 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b841f6720 con 0x7f5b8415c220 2024-07-27T03:09:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.030+0000 7f5b80ff9640 1 -- 172.21.15.120:0/552904195 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74003a20 con 0x7f5b8415c220 2024-07-27T03:09:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.030+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/552904195 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b841f6ce0 con 0x7f5b8415c220 2024-07-27T03:09:24.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.031+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/552904195 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b840ce160 con 0x7f5b8415c220 2024-07-27T03:09:24.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.032+0000 7f5b80ff9640 1 -- 172.21.15.120:0/552904195 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5b7401a070 con 0x7f5b8415c220 2024-07-27T03:09:24.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.032+0000 7f5b80ff9640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5b70077010 0x7f5b70079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.032+0000 7f5b80ff9640 1 -- 172.21.15.120:0/552904195 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5b74097c20 con 0x7f5b8415c220 2024-07-27T03:09:24.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.032+0000 7f5b837fe640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5b70077010 0x7f5b70079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.033+0000 7f5b837fe640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5b70077010 0x7f5b70079520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5b840b2c80 tx=0x7f5b7800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:24.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.037+0000 7f5b80ff9640 1 -- 172.21.15.120:0/552904195 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5b74060750 con 0x7f5b8415c220 2024-07-27T03:09:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.256+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/552904195 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b841592f0 con 0x7f5b8415c220 2024-07-27T03:09:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.256+0000 7f5b80ff9640 1 -- 172.21.15.120:0/552904195 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5232 (secure 0 0 0) 0x7f5b74064ca0 con 0x7f5b8415c220 2024-07-27T03:09:24.260 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:24.260 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"btime":"2024-07-27T03:09:17:631494+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2961373787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2961373787},{"type":"v1","addr":"172.21.15.121:6836","nonce":2961373787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3538993507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3538993507},{"type":"v1","addr":"172.21.15.121:6837","nonce":3538993507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4857,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/503930696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":503930696},{"type":"v1","addr":"172.21.15.120:6834","nonce":503930696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:09:13.964247+0000","modified":"2024-07-27T03:09:16.998522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4860":{"gid":4860,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/1949887551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":1949887551},{"type":"v1","addr":"172.21.15.120:6835","nonce":1949887551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4860,"qdb_cluster":[4860]},"id":2}]} 2024-07-27T03:09:24.261 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 17 2024-07-27T03:09:24.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5b70077010 msgr2=0x7f5b70079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5b70077010 0x7f5b70079520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5b840b2c80 tx=0x7f5b7800b2e0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/552904195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b8415c220 msgr2=0x7f5b8414bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b8415c220 0x7f5b8414bc20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400c3c0 tx=0x7f5b7400c880 comp rx=0 tx=0).stop 2024-07-27T03:09:24.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/552904195 shutdown_connections 2024-07-27T03:09:24.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5b70077010 0x7f5b70079520 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b8414df40 0x7f5b84072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b8415ec20 0x7f5b8414da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 --2- 172.21.15.120:0/552904195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b8415c220 0x7f5b8414bc20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/552904195 >> 172.21.15.120:0/552904195 conn(0x7f5b8406cba0 msgr2=0x7f5b840b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:24.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/552904195 shutdown_connections 2024-07-27T03:09:24.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.258+0000 7f5b8a5c3640 1 -- 172.21.15.120:0/552904195 wait complete. 2024-07-27T03:09:24.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:09:13.964247+0000', 'modified': '2024-07-27T03:09:16.998522+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4860}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4860': {'gid': 4860, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6835/1949887551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6833', 'nonce': 1949887551}, {'type': 'v1', 'addr': '172.21.15.120:6835', 'nonce': 1949887551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4860, 'qdb_cluster': [4860]} 2024-07-27T03:09:24.677 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-27T03:09:24.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-07-27T03:09:24.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.790+0000 7f7f74758640 1 -- 172.21.15.120:0/426943337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f6c15c220 msgr2=0x7f7f6c152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.790+0000 7f7f74758640 1 --2- 172.21.15.120:0/426943337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f6c15c220 0x7f7f6c152160 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7f68005fd0 tx=0x7f7f6802a820 comp rx=0 tx=0).stop 2024-07-27T03:09:24.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.790+0000 7f7f74758640 1 -- 172.21.15.120:0/426943337 shutdown_connections 2024-07-27T03:09:24.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.790+0000 7f7f74758640 1 --2- 172.21.15.120:0/426943337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f6c15c220 0x7f7f6c152160 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.790+0000 7f7f74758640 1 -- 172.21.15.120:0/426943337 >> 172.21.15.120:0/426943337 conn(0x7f7f6c06cba0 msgr2=0x7f7f6c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:24.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.790+0000 7f7f74758640 1 -- 172.21.15.120:0/426943337 shutdown_connections 2024-07-27T03:09:24.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.790+0000 7f7f74758640 1 -- 172.21.15.120:0/426943337 wait complete. 2024-07-27T03:09:24.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.792+0000 7f7f74758640 1 Processor -- start 2024-07-27T03:09:24.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.792+0000 7f7f74758640 1 -- start start 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.793+0000 7f7f74758640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c0b5cd0 0x7f7f6c1421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.793+0000 7f7f74758640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c15c220 0x7f7f6c0c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.793+0000 7f7f74758640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f6c15ec20 0x7f7f6c072d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.793+0000 7f7f74758640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c0cdd40 con 0x7f7f6c15ec20 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.793+0000 7f7f74758640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c0cdbc0 con 0x7f7f6c15c220 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.793+0000 7f7f74758640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6c0cdec0 con 0x7f7f6c0b5cd0 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.793+0000 7f7f72cf5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f6c15ec20 0x7f7f6c072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.793+0000 7f7f72cf5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f6c15ec20 0x7f7f6c072d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51110/0 (socket says 172.21.15.120:51110) 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.793+0000 7f7f72cf5640 1 -- 172.21.15.120:0/2979531352 learned_addr learned my addr 172.21.15.120:0/2979531352 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.793+0000 7f7f724f4640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c0b5cd0 0x7f7f6c1421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.793+0000 7f7f71cf3640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c15c220 0x7f7f6c0c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f72cf5640 1 -- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c0b5cd0 msgr2=0x7f7f6c1421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f72cf5640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c0b5cd0 0x7f7f6c1421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f72cf5640 1 -- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c15c220 msgr2=0x7f7f6c0c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f72cf5640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c15c220 0x7f7f6c0c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f72cf5640 1 -- 172.21.15.120:0/2979531352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c0c75f0 con 0x7f7f6c15ec20 2024-07-27T03:09:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f724f4640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c0b5cd0 0x7f7f6c1421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f72cf5640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f6c15ec20 0x7f7f6c072d00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400b410 tx=0x7f7f6400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f62ffd640 1 -- 172.21.15.120:0/2979531352 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64015030 con 0x7f7f6c15ec20 2024-07-27T03:09:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f62ffd640 1 -- 172.21.15.120:0/2979531352 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f64004020 con 0x7f7f6c15ec20 2024-07-27T03:09:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f62ffd640 1 -- 172.21.15.120:0/2979531352 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64011630 con 0x7f7f6c15ec20 2024-07-27T03:09:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f74758640 1 -- 172.21.15.120:0/2979531352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6c142730 con 0x7f7f6c15ec20 2024-07-27T03:09:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.794+0000 7f7f74758640 1 -- 172.21.15.120:0/2979531352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6c1f3880 con 0x7f7f6c15ec20 2024-07-27T03:09:24.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.796+0000 7f7f62ffd640 1 -- 172.21.15.120:0/2979531352 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f7f64018070 con 0x7f7f6c15ec20 2024-07-27T03:09:24.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.796+0000 7f7f62ffd640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f50077010 0x7f7f50079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.797+0000 7f7f62ffd640 1 -- 172.21.15.120:0/2979531352 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7f640984e0 con 0x7f7f6c15ec20 2024-07-27T03:09:24.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.797+0000 7f7f724f4640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f50077010 0x7f7f50079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.797+0000 7f7f7b66a740 1 Processor -- start 2024-07-27T03:09:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.797+0000 7f7f724f4640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f50077010 0x7f7f50079520 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7f68034000 tx=0x7f7f68004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.798+0000 7f7f7b66a740 1 -- start start 2024-07-27T03:09:24.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x557552562270 0x55755294f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5575525393b0 0x557552931e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55755287a360 con 0x557552541590 2024-07-27T03:09:24.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557552869860 con 0x5575525393b0 2024-07-27T03:09:24.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55755286d8a0 con 0x557552562270 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f72cf5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f72cf5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51122/0 (socket says 172.21.15.120:51122) 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f72cf5640 1 -- 172.21.15.120:0/3423806710 learned_addr learned my addr 172.21.15.120:0/3423806710 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f724f4640 1 --2- 172.21.15.120:0/3423806710 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x557552562270 0x55755294f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f71cf3640 1 --2- 172.21.15.120:0/3423806710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5575525393b0 0x557552931e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f72cf5640 1 -- 172.21.15.120:0/3423806710 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x557552562270 msgr2=0x55755294f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f72cf5640 1 --2- 172.21.15.120:0/3423806710 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x557552562270 0x55755294f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f72cf5640 1 -- 172.21.15.120:0/3423806710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5575525393b0 msgr2=0x557552931e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f72cf5640 1 --2- 172.21.15.120:0/3423806710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5575525393b0 0x557552931e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f72cf5640 1 -- 172.21.15.120:0/3423806710 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575527f9360 con 0x557552541590 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f71cf3640 1 --2- 172.21.15.120:0/3423806710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5575525393b0 0x557552931e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f72cf5640 1 --2- 172.21.15.120:0/3423806710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932380 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7f6405d580 tx=0x7f7f64060e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4295f9527df0943f server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:24.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.799+0000 7f7f4ffff640 1 -- 172.21.15.120:0/3423806710 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64065590 con 0x557552541590 2024-07-27T03:09:24.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.800+0000 7f7f4ffff640 1 -- 172.21.15.120:0/3423806710 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f64069fb0 con 0x557552541590 2024-07-27T03:09:24.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.800+0000 7f7f4ffff640 1 -- 172.21.15.120:0/3423806710 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f640982b0 con 0x557552541590 2024-07-27T03:09:24.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.800+0000 7f7f7b66a740 1 -- 172.21.15.120:0/3423806710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 msgr2=0x557552932380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.800+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/3423806710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932380 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7f6405d580 tx=0x7f7f64060e90 comp rx=0 tx=0).stop 2024-07-27T03:09:24.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.800+0000 7f7f7b66a740 1 -- 172.21.15.120:0/3423806710 shutdown_connections 2024-07-27T03:09:24.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.800+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/3423806710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932380 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.800+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/3423806710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5575525393b0 0x557552931e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.800+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/3423806710 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x557552562270 0x55755294f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.800+0000 7f7f7b66a740 1 -- 172.21.15.120:0/3423806710 >> 172.21.15.120:0/3423806710 conn(0x5575525563c0 msgr2=0x557552908060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:24.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.800+0000 7f7f7b66a740 1 -- 172.21.15.120:0/3423806710 shutdown_connections 2024-07-27T03:09:24.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.801+0000 7f7f7b66a740 1 -- 172.21.15.120:0/3423806710 wait complete. 2024-07-27T03:09:24.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.801+0000 7f7f7b66a740 1 -- start start 2024-07-27T03:09:24.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.801+0000 7f7f7b66a740 1 Processor -- start 2024-07-27T03:09:24.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x55755291ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552541590 0x557552907bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552562270 0x557552908130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5575525dc620 con 0x557552562270 2024-07-27T03:09:24.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557552805140 con 0x557552541590 2024-07-27T03:09:24.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55755287a360 con 0x5575525393b0 2024-07-27T03:09:24.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f7b66a740 10 client.0 _ll_register_callbacks cb 0x557552862c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:09:24.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f72cf5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552562270 0x557552908130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f72cf5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552562270 0x557552908130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51138/0 (socket says 172.21.15.120:51138) 2024-07-27T03:09:24.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f72cf5640 1 -- 172.21.15.120:0/4243966123 learned_addr learned my addr 172.21.15.120:0/4243966123 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:24.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f71cf3640 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552541590 0x557552907bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f724f4640 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x55755291ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f72cf5640 1 -- 172.21.15.120:0/4243966123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 msgr2=0x55755291ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f72cf5640 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x55755291ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f72cf5640 1 -- 172.21.15.120:0/4243966123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552541590 msgr2=0x557552907bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f72cf5640 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552541590 0x557552907bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.803+0000 7f7f72cf5640 1 -- 172.21.15.120:0/4243966123 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575525cd850 con 0x557552562270 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f72cf5640 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552562270 0x557552908130 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7f64004730 tx=0x7f7f640610f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600c1e62f70edabc server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/4243966123 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f640982c0 con 0x557552562270 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/4243966123 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7f6408fb50 con 0x557552562270 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f7b66a740 1 -- 172.21.15.120:0/4243966123 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f64069fb0 con 0x557552562270 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/4243966123 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7f64096050 con 0x557552562270 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f7b66a740 10 client.5052 fetch_fsmap learned FSMap version 17 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f7b66a740 1 -- 172.21.15.120:0/4243966123 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5575526446b0 con 0x557552562270 2024-07-27T03:09:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/4243966123 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f64069fb0 con 0x557552562270 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/4243966123 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f7f64022060 con 0x557552562270 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f7b66a740 10 client.5052 fetch_fsmap finished waiting for FSMap version 17 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f7b66a740 10 client.5052 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f7b66a740 20 client.5052 populate_metadata read hostname 'smithi120' 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x557552520e40 0x557552920310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f7b66a740 4 client.5052 mds_command: new command op to 4860 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f7b66a740 1 -- 172.21.15.120:0/4243966123 --> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55755287c2b0 con 0x557552520e40 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.804+0000 7f7f724f4640 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x557552520e40 0x557552920310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.805+0000 7f7f4d7fa640 10 client.5052 ms_handle_connect on v2:172.21.15.120:6833/1949887551 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.805+0000 7f7f724f4640 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x557552520e40 0x557552920310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f778bbd8d10a27b5 server_cookie=44757babe841173 in_seq=0 out_seq=0 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.805+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/4243966123 <== mds.0 v2:172.21.15.120:6833/1949887551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55755287c2b0 con 0x557552520e40 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.805+0000 7f7f4d7fa640 10 client.5052 handle_command_reply: tid=0 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.805+0000 7f7f7b66a740 1 client.5052 shutdown 2024-07-27T03:09:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f7b66a740 1 -- 172.21.15.120:0/4243966123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552562270 msgr2=0x557552908130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552562270 0x557552908130 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7f64004730 tx=0x7f7f640610f0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f7b66a740 1 -- 172.21.15.120:0/4243966123 shutdown_connections 2024-07-27T03:09:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x557552520e40 0x557552920310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552562270 0x557552908130 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552541590 0x557552907bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/4243966123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x55755291ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f4d7fa640 0 client.5052 ms_handle_reset on v2:172.21.15.120:6833/1949887551 2024-07-27T03:09:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f7b66a740 1 -- 172.21.15.120:0/4243966123 >> 172.21.15.120:0/4243966123 conn(0x5575525563c0 msgr2=0x557552922110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f7b66a740 1 -- 172.21.15.120:0/4243966123 shutdown_connections 2024-07-27T03:09:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f7b66a740 1 -- 172.21.15.120:0/4243966123 wait complete. 2024-07-27T03:09:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.806+0000 7f7f7b66a740 20 client.5052 trim_cache size 0 max 16384 2024-07-27T03:09:24.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f7b66a740 1 Processor -- start 2024-07-27T03:09:24.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f7b66a740 1 -- start start 2024-07-27T03:09:24.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x557552948ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552562270 0x557552932740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c0c7330 con 0x557552541590 2024-07-27T03:09:24.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c0c6690 con 0x557552562270 2024-07-27T03:09:24.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6c0c6ce0 con 0x5575525393b0 2024-07-27T03:09:24.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f71cf3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f71cf3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51152/0 (socket says 172.21.15.120:51152) 2024-07-27T03:09:24.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f71cf3640 1 -- 172.21.15.120:0/1523378605 learned_addr learned my addr 172.21.15.120:0/1523378605 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:24.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f72cf5640 1 --2- 172.21.15.120:0/1523378605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552562270 0x557552932740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f724f4640 1 --2- 172.21.15.120:0/1523378605 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x557552948ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f71cf3640 1 -- 172.21.15.120:0/1523378605 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 msgr2=0x557552948ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:24.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f71cf3640 1 --2- 172.21.15.120:0/1523378605 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x557552948ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f71cf3640 1 -- 172.21.15.120:0/1523378605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552562270 msgr2=0x557552932740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:24.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f71cf3640 1 --2- 172.21.15.120:0/1523378605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552562270 0x557552932740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.826+0000 7f7f71cf3640 1 -- 172.21.15.120:0/1523378605 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55755295f6d0 con 0x557552541590 2024-07-27T03:09:24.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.827+0000 7f7f71cf3640 1 --2- 172.21.15.120:0/1523378605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932200 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c005440 tx=0x7f7f5c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fa0b3eac09df14 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:24.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.827+0000 7f7f4f7fe640 1 -- 172.21.15.120:0/1523378605 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c01c070 con 0x557552541590 2024-07-27T03:09:24.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.827+0000 7f7f4f7fe640 1 -- 172.21.15.120:0/1523378605 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f5c013760 con 0x557552541590 2024-07-27T03:09:24.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.827+0000 7f7f4f7fe640 1 -- 172.21.15.120:0/1523378605 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c010040 con 0x557552541590 2024-07-27T03:09:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.827+0000 7f7f7b66a740 1 -- 172.21.15.120:0/1523378605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 msgr2=0x557552932200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.827+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/1523378605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932200 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c005440 tx=0x7f7f5c0039c0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.828+0000 7f7f7b66a740 1 -- 172.21.15.120:0/1523378605 shutdown_connections 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.828+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/1523378605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x557552932200 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.828+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/1523378605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552562270 0x557552932740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.828+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/1523378605 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x557552948ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.828+0000 7f7f7b66a740 1 -- 172.21.15.120:0/1523378605 >> 172.21.15.120:0/1523378605 conn(0x5575525563c0 msgr2=0x557552920310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.828+0000 7f7f7b66a740 1 -- 172.21.15.120:0/1523378605 shutdown_connections 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.828+0000 7f7f7b66a740 1 -- 172.21.15.120:0/1523378605 wait complete. 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.828+0000 7f7f7b66a740 1 -- start start 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.828+0000 7f7f7b66a740 1 Processor -- start 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x5575529cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x55755295e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552562270 0x55755295e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5575525dc620 con 0x557552541590 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557552805140 con 0x557552562270 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x557552947420 con 0x5575525393b0 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 10 client.0 _ll_register_callbacks cb 0x7f7f6407a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f71cf3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x55755295e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f71cf3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x55755295e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51162/0 (socket says 172.21.15.120:51162) 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f71cf3640 1 -- 172.21.15.120:0/2887048482 learned_addr learned my addr 172.21.15.120:0/2887048482 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f72cf5640 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552562270 0x55755295e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f724f4640 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x5575529cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f71cf3640 1 -- 172.21.15.120:0/2887048482 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 msgr2=0x5575529cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f71cf3640 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x5575529cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f71cf3640 1 -- 172.21.15.120:0/2887048482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552562270 msgr2=0x55755295e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f71cf3640 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552562270 0x55755295e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f71cf3640 1 -- 172.21.15.120:0/2887048482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575529041f0 con 0x557552541590 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f71cf3640 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x55755295e110 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c007fd0 tx=0x7f7f5c013530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ef9b0a7f99d8b2 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/2887048482 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c027060 con 0x557552541590 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/2887048482 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7f5c016880 con 0x557552541590 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 1 -- 172.21.15.120:0/2887048482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f5c013760 con 0x557552541590 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/2887048482 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f7f5c02d050 con 0x557552541590 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 10 client.5058 fetch_fsmap learned FSMap version 17 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 1 -- 172.21.15.120:0/2887048482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55755292df20 con 0x557552541590 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/2887048482 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f5c013760 con 0x557552541590 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/2887048482 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f7f5c030020 con 0x557552541590 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 10 client.5058 fetch_fsmap finished waiting for FSMap version 17 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 10 client.5058 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 20 client.5058 populate_metadata read hostname 'smithi120' 2024-07-27T03:09:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x557552907c10 0x55755296e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 4 client.5058 mds_command: new command op to 4860 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f7b66a740 1 -- 172.21.15.120:0/2887048482 --> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] -- command(tid 0: {"prefix": "status"}) -- 0x557552877d50 con 0x557552907c10 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.831+0000 7f7f724f4640 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x557552907c10 0x55755296e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f4d7fa640 10 client.5058 ms_handle_connect on v2:172.21.15.120:6833/1949887551 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f724f4640 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x557552907c10 0x55755296e660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b4e88f814e0a98 server_cookie=e503c9fc237813e4 in_seq=0 out_seq=0 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f4d7fa640 1 -- 172.21.15.120:0/2887048482 <== mds.0 v2:172.21.15.120:6833/1949887551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x557552877d50 con 0x557552907c10 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f4d7fa640 10 client.5058 handle_command_reply: tid=0 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 1 client.5058 shutdown 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 1 -- 172.21.15.120:0/2887048482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 msgr2=0x55755295e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x55755295e110 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c007fd0 tx=0x7f7f5c013530 comp rx=0 tx=0).stop 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 1 -- 172.21.15.120:0/2887048482 shutdown_connections 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x557552907c10 0x55755296e660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557552541590 0x55755295e110 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557552562270 0x55755295e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 1 --2- 172.21.15.120:0/2887048482 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5575525393b0 0x5575529cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f4d7fa640 0 client.5058 ms_handle_reset on v2:172.21.15.120:6833/1949887551 2024-07-27T03:09:24.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 1 -- 172.21.15.120:0/2887048482 >> 172.21.15.120:0/2887048482 conn(0x5575525563c0 msgr2=0x557552932030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:24.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 1 -- 172.21.15.120:0/2887048482 shutdown_connections 2024-07-27T03:09:24.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 1 -- 172.21.15.120:0/2887048482 wait complete. 2024-07-27T03:09:24.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.832+0000 7f7f7b66a740 20 client.5058 trim_cache size 0 max 16384 2024-07-27T03:09:24.841 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:09:24.841 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:09:24.841 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-07-27T03:09:24.841 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4860, 2024-07-27T03:09:24.842 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:09:24.842 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:09:24.842 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:09:24.842 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 10.227841980999999, 2024-07-27T03:09:24.842 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 17, 2024-07-27T03:09:24.842 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 33, 2024-07-27T03:09:24.842 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 33, 2024-07-27T03:09:24.842 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 17.121261387000001 2024-07-27T03:09:24.842 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:09:24.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 -- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f50077010 msgr2=0x7f7f50079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f50077010 0x7f7f50079520 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7f68034000 tx=0x7f7f68004ab0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 -- 172.21.15.120:0/2979531352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f6c15ec20 msgr2=0x7f7f6c072d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f6c15ec20 0x7f7f6c072d00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400b410 tx=0x7f7f6400b8d0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 -- 172.21.15.120:0/2979531352 shutdown_connections 2024-07-27T03:09:24.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f50077010 0x7f7f50079520 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f6c15ec20 0x7f7f6c072d00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c15c220 0x7f7f6c0c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 --2- 172.21.15.120:0/2979531352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f6c0b5cd0 0x7f7f6c1421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 -- 172.21.15.120:0/2979531352 >> 172.21.15.120:0/2979531352 conn(0x7f7f6c06cba0 msgr2=0x7f7f6c15d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:24.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 -- 172.21.15.120:0/2979531352 shutdown_connections 2024-07-27T03:09:24.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.833+0000 7f7f74758640 1 -- 172.21.15.120:0/2979531352 wait complete. 2024-07-27T03:09:24.847 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-27T03:09:24.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.957+0000 7f103b8eb640 1 -- 172.21.15.120:0/481021984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034071cf0 msgr2=0x7f1034074040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.957+0000 7f103b8eb640 1 --2- 172.21.15.120:0/481021984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034071cf0 0x7f1034074040 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1028009830 tx=0x7f102802a480 comp rx=0 tx=0).stop 2024-07-27T03:09:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.957+0000 7f103b8eb640 1 -- 172.21.15.120:0/481021984 shutdown_connections 2024-07-27T03:09:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.957+0000 7f103b8eb640 1 --2- 172.21.15.120:0/481021984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034071cf0 0x7f1034074040 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.957+0000 7f103b8eb640 1 -- 172.21.15.120:0/481021984 >> 172.21.15.120:0/481021984 conn(0x7f10340d0f00 msgr2=0x7f10340d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.957+0000 7f103b8eb640 1 -- 172.21.15.120:0/481021984 shutdown_connections 2024-07-27T03:09:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.957+0000 7f103b8eb640 1 -- 172.21.15.120:0/481021984 wait complete. 2024-07-27T03:09:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.959+0000 7f103b8eb640 1 Processor -- start 2024-07-27T03:09:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.959+0000 7f103b8eb640 1 -- start start 2024-07-27T03:09:24.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.960+0000 7f103b8eb640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10340b4d30 0x7f1034151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.960+0000 7f103b8eb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103415c500 0x7f1034146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.960+0000 7f103b8eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f103406c960 0x7f103406cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.960+0000 7f103b8eb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1034070690 con 0x7f103406c960 2024-07-27T03:09:24.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.960+0000 7f103b8eb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1034070510 con 0x7f103415c500 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.960+0000 7f103b8eb640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1034070810 con 0x7f10340b4d30 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.960+0000 7f1039e88640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f103406c960 0x7f103406cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.960+0000 7f1039e88640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f103406c960 0x7f103406cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51176/0 (socket says 172.21.15.120:51176) 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.960+0000 7f1039e88640 1 -- 172.21.15.120:0/3633549796 learned_addr learned my addr 172.21.15.120:0/3633549796 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1039e88640 1 -- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10340b4d30 msgr2=0x7f1034151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1038e86640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103415c500 0x7f1034146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1039687640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10340b4d30 0x7f1034151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1039e88640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10340b4d30 0x7f1034151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1039e88640 1 -- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103415c500 msgr2=0x7f1034146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1039e88640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103415c500 0x7f1034146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1039e88640 1 -- 172.21.15.120:0/3633549796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10341f87d0 con 0x7f103406c960 2024-07-27T03:09:24.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1038e86640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103415c500 0x7f1034146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:24.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1039687640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10340b4d30 0x7f1034151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:24.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1039e88640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f103406c960 0x7f103406cd70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f102c00b9a0 tx=0x7f102c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:24.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1031ffb640 1 -- 172.21.15.120:0/3633549796 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c019070 con 0x7f103406c960 2024-07-27T03:09:24.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1031ffb640 1 -- 172.21.15.120:0/3633549796 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f102c00cc90 con 0x7f103406c960 2024-07-27T03:09:24.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f103b8eb640 1 -- 172.21.15.120:0/3633549796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10341f8ab0 con 0x7f103406c960 2024-07-27T03:09:24.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f1031ffb640 1 -- 172.21.15.120:0/3633549796 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c0146a0 con 0x7f103406c960 2024-07-27T03:09:24.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.961+0000 7f103b8eb640 1 -- 172.21.15.120:0/3633549796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1034152560 con 0x7f103406c960 2024-07-27T03:09:24.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.963+0000 7f103b8eb640 1 -- 172.21.15.120:0/3633549796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1034074040 con 0x7f103406c960 2024-07-27T03:09:24.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.963+0000 7f1031ffb640 1 -- 172.21.15.120:0/3633549796 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f102c01c070 con 0x7f103406c960 2024-07-27T03:09:24.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.963+0000 7f1031ffb640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077010 0x7f1020079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:24.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.963+0000 7f1031ffb640 1 -- 172.21.15.120:0/3633549796 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f102c0985a0 con 0x7f103406c960 2024-07-27T03:09:24.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.964+0000 7f1039687640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077010 0x7f1020079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:24.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.964+0000 7f1039687640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077010 0x7f1020079520 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1024000f60 tx=0x7f1024009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:24.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:24.968+0000 7f1031ffb640 1 -- 172.21.15.120:0/3633549796 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f102c0618c0 con 0x7f103406c960 2024-07-27T03:09:25.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.185+0000 7f103b8eb640 1 -- 172.21.15.120:0/3633549796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f10341f8560 con 0x7f103406c960 2024-07-27T03:09:25.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.185+0000 7f1031ffb640 1 -- 172.21.15.120:0/3633549796 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f102c0611c0 con 0x7f103406c960 2024-07-27T03:09:25.189 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-27T03:09:25.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.187+0000 7f103b8eb640 1 -- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077010 msgr2=0x7f1020079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:25.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.187+0000 7f103b8eb640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077010 0x7f1020079520 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1024000f60 tx=0x7f1024009040 comp rx=0 tx=0).stop 2024-07-27T03:09:25.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.187+0000 7f103b8eb640 1 -- 172.21.15.120:0/3633549796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f103406c960 msgr2=0x7f103406cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:25.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.187+0000 7f103b8eb640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f103406c960 0x7f103406cd70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f102c00b9a0 tx=0x7f102c00be60 comp rx=0 tx=0).stop 2024-07-27T03:09:25.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.187+0000 7f103b8eb640 1 -- 172.21.15.120:0/3633549796 shutdown_connections 2024-07-27T03:09:25.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.187+0000 7f103b8eb640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077010 0x7f1020079520 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:25.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.187+0000 7f103b8eb640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f103406c960 0x7f103406cd70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:25.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.187+0000 7f103b8eb640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f103415c500 0x7f1034146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:25.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.187+0000 7f103b8eb640 1 --2- 172.21.15.120:0/3633549796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10340b4d30 0x7f1034151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:25.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.187+0000 7f103b8eb640 1 -- 172.21.15.120:0/3633549796 >> 172.21.15.120:0/3633549796 conn(0x7f10340d0f00 msgr2=0x7f1034154aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:25.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.187+0000 7f103b8eb640 1 -- 172.21.15.120:0/3633549796 shutdown_connections 2024-07-27T03:09:25.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25.188+0000 7f103b8eb640 1 -- 172.21.15.120:0/3633549796 wait complete. 2024-07-27T03:09:25.203 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-07-27T03:09:25.203 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-27T03:09:25.203 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-07-27T03:09:25.203 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-07-27T03:09:25.203 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-27T03:09:25.203 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-07-27T03:09:25.203 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-07-27T03:09:25.203 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-27T03:09:25.203 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:09:25.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:25.204 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-07-27T03:09:25.221 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:09:25.221 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:09:25.221 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:09:25.221 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-27T03:09:25.222 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42712sec preferred_lft 42712sec 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 1a:04:15:6c:cf:e1 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::d44a:78ff:feef:fe4e/64 scope link 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether d2:ac:2a:c4:e4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::d0ac:2aff:fec4:e45e/64 scope link 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-27T03:09:25.223 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 1a:04:15:6c:cf:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-07-27T03:09:25.224 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::1804:15ff:fe6c:cfe1/64 scope link 2024-07-27T03:09:25.224 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:09:25.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:25.224 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-27T03:09:25.285 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-07-27T03:09:25.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:25.286 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-07-27T03:09:25.343 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-07-27T03:09:25.343 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-27T03:09:25.343 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-27T03:09:25.343 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-27T03:09:25.343 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-27T03:09:25.343 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:09:25.343 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:09:25.343 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-27T03:09:25.344 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-27T03:09:25.344 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-27T03:09:25.344 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:09:25.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:09:25.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:25.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:25.470 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-07-27T03:09:25.486 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-07-27T03:09:25.486 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-27T03:09:25.486 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:09:25.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:25.487 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-07-27T03:09:25.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:09:25.552 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-07-27T03:09:25.607 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:09:25.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:09:25.608 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-07-27T03:09:25.663 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-07-27T03:09:25.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:25.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:09:25.758 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:09:25.758 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:09:25.766 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:09:25.766 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:09:25.766 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-07-27T03:09:25.766 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: trying mount with new device syntax: 0@81c6fc84-d59a-4d77-bf87-f698cf0d6963.cephfs=/ 2024-07-27T03:09:25.766 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.120:3300/172.21.15.121:3300/172.21.15.121:3301" will pass to kernel 2024-07-27T03:09:25.767 INFO:teuthology.orchestra.run.smithi120.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-07-27T03:09:25.767 INFO:teuthology.orchestra.run.smithi120.stdout: You just mounted a file system that supports labels which does not 2024-07-27T03:09:25.767 INFO:teuthology.orchestra.run.smithi120.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-27T03:09:25.767 INFO:teuthology.orchestra.run.smithi120.stdout: applications will generate AVC messages and not be allowed access to 2024-07-27T03:09:25.767 INFO:teuthology.orchestra.run.smithi120.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-27T03:09:25.768 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-27T03:09:25.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:25.769 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-07-27T03:09:25.794 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:09:25.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:25.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:25.896 INFO:teuthology.orchestra.run.smithi120.stdout:client4942 2024-07-27T03:09:25.897 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:25.897 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:25.912 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-07-27T03:09:26.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.066+0000 7efce1ee2640 1 -- 172.21.15.120:0/436953142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcdc0b5200 msgr2=0x7efcdc0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:26.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.066+0000 7efce1ee2640 1 --2- 172.21.15.120:0/436953142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcdc0b5200 0x7efcdc0b3590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efcdc068bb0 tx=0x7efcd402a4d0 comp rx=0 tx=0).stop 2024-07-27T03:09:26.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.067+0000 7efce1ee2640 1 -- 172.21.15.120:0/436953142 shutdown_connections 2024-07-27T03:09:26.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.067+0000 7efce1ee2640 1 --2- 172.21.15.120:0/436953142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcdc0b5200 0x7efcdc0b3590 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:26.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.067+0000 7efce1ee2640 1 --2- 172.21.15.120:0/436953142 >> v2:172.21.15.121:3300/0 conn(0x7efcdc06f490 0x7efcdc0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:26.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.067+0000 7efce1ee2640 1 -- 172.21.15.120:0/436953142 >> 172.21.15.120:0/436953142 conn(0x7efcdc06c780 msgr2=0x7efcdc06cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:26.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.067+0000 7efce1ee2640 1 -- 172.21.15.120:0/436953142 shutdown_connections 2024-07-27T03:09:26.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.067+0000 7efce1ee2640 1 -- 172.21.15.120:0/436953142 wait complete. 2024-07-27T03:09:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.068+0000 7efce1ee2640 1 Processor -- start 2024-07-27T03:09:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.069+0000 7efce1ee2640 1 -- start start 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efce1ee2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcdc0b5200 0x7efcdc1f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efce1ee2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcdc1520d0 0x7efcdc147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efce1ee2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcdc14fdf0 0x7efcdc150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efce1ee2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc0b3e60 con 0x7efcdc0b5200 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efce1ee2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc0b3ce0 con 0x7efcdc14fdf0 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efce1ee2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efcdc0b3fe0 con 0x7efcdc1520d0 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efcdb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcdc0b5200 0x7efcdc1f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efcdb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcdc0b5200 0x7efcdc1f6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51192/0 (socket says 172.21.15.120:51192) 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efcdb7fe640 1 -- 172.21.15.120:0/4009385251 learned_addr learned my addr 172.21.15.120:0/4009385251 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efcdbfff640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcdc14fdf0 0x7efcdc150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efcdaffd640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcdc1520d0 0x7efcdc147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efcdb7fe640 1 -- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcdc1520d0 msgr2=0x7efcdc147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efcdb7fe640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcdc1520d0 0x7efcdc147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efcdb7fe640 1 -- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcdc14fdf0 msgr2=0x7efcdc150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efcdb7fe640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcdc14fdf0 0x7efcdc150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.070+0000 7efcdb7fe640 1 -- 172.21.15.120:0/4009385251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcdc150740 con 0x7efcdc0b5200 2024-07-27T03:09:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.071+0000 7efcdb7fe640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcdc0b5200 0x7efcdc1f6ec0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efccc00ba80 tx=0x7efccc00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.071+0000 7efcc3fff640 1 -- 172.21.15.120:0/4009385251 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc00cc00 con 0x7efcdc0b5200 2024-07-27T03:09:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.071+0000 7efcc3fff640 1 -- 172.21.15.120:0/4009385251 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efccc003970 con 0x7efcdc0b5200 2024-07-27T03:09:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.071+0000 7efcc3fff640 1 -- 172.21.15.120:0/4009385251 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc003e00 con 0x7efcdc0b5200 2024-07-27T03:09:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.071+0000 7efce1ee2640 1 -- 172.21.15.120:0/4009385251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcdc1f2ec0 con 0x7efcdc0b5200 2024-07-27T03:09:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.071+0000 7efce1ee2640 1 -- 172.21.15.120:0/4009385251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcdc0cc270 con 0x7efcdc0b5200 2024-07-27T03:09:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.072+0000 7efce1ee2640 1 -- 172.21.15.120:0/4009385251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcdc075ea0 con 0x7efcdc0b5200 2024-07-27T03:09:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.072+0000 7efcc3fff640 1 -- 172.21.15.120:0/4009385251 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7efccc004000 con 0x7efcdc0b5200 2024-07-27T03:09:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.073+0000 7efcc3fff640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efcc8077010 0x7efcc8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.073+0000 7efcc3fff640 1 -- 172.21.15.120:0/4009385251 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7efccc098880 con 0x7efcdc0b5200 2024-07-27T03:09:26.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.073+0000 7efcdaffd640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efcc8077010 0x7efcc8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:26.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.074+0000 7efcdaffd640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efcc8077010 0x7efcc8079520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0ccd80 tx=0x7efcd000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:26.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.077+0000 7efcc3fff640 1 -- 172.21.15.120:0/4009385251 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7efcdc075ea0 con 0x7efcdc0b5200 2024-07-27T03:09:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.296+0000 7efce1ee2640 1 -- 172.21.15.120:0/4009385251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7efcdc0b4490 con 0x7efcdc0b5200 2024-07-27T03:09:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.909+0000 7efcc3fff640 1 -- 172.21.15.120:0/4009385251 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7efcdc150740 con 0x7efcdc0b5200 2024-07-27T03:09:26.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.911+0000 7efce1ee2640 1 -- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efcc8077010 msgr2=0x7efcc8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:26.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.911+0000 7efce1ee2640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efcc8077010 0x7efcc8079520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0ccd80 tx=0x7efcd000b2e0 comp rx=0 tx=0).stop 2024-07-27T03:09:26.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.911+0000 7efce1ee2640 1 -- 172.21.15.120:0/4009385251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcdc0b5200 msgr2=0x7efcdc1f6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:26.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.911+0000 7efce1ee2640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcdc0b5200 0x7efcdc1f6ec0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efccc00ba80 tx=0x7efccc00bf40 comp rx=0 tx=0).stop 2024-07-27T03:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.912+0000 7efce1ee2640 1 -- 172.21.15.120:0/4009385251 shutdown_connections 2024-07-27T03:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.912+0000 7efce1ee2640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efcc8077010 0x7efcc8079520 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.912+0000 7efce1ee2640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcdc14fdf0 0x7efcdc150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.912+0000 7efce1ee2640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcdc1520d0 0x7efcdc147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.912+0000 7efce1ee2640 1 --2- 172.21.15.120:0/4009385251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcdc0b5200 0x7efcdc1f6ec0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.912+0000 7efce1ee2640 1 -- 172.21.15.120:0/4009385251 >> 172.21.15.120:0/4009385251 conn(0x7efcdc06c780 msgr2=0x7efcdc15d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.912+0000 7efce1ee2640 1 -- 172.21.15.120:0/4009385251 shutdown_connections 2024-07-27T03:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:26.912+0000 7efce1ee2640 1 -- 172.21.15.120:0/4009385251 wait complete. 2024-07-27T03:09:26.931 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:27.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.045+0000 7f40285ea640 1 -- 172.21.15.120:0/3269435000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4020073e20 msgr2=0x7f40201554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:27.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.045+0000 7f40285ea640 1 --2- 172.21.15.120:0/3269435000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4020073e20 0x7f40201554a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4010009830 tx=0x7f401002a480 comp rx=0 tx=0).stop 2024-07-27T03:09:27.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.045+0000 7f40285ea640 1 -- 172.21.15.120:0/3269435000 shutdown_connections 2024-07-27T03:09:27.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.045+0000 7f40285ea640 1 --2- 172.21.15.120:0/3269435000 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f402015eb40 0x7f402015ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:27.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.045+0000 7f40285ea640 1 --2- 172.21.15.120:0/3269435000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4020073e20 0x7f40201554a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:27.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.045+0000 7f40285ea640 1 -- 172.21.15.120:0/3269435000 >> 172.21.15.120:0/3269435000 conn(0x7f40200b1a10 msgr2=0x7f40200b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:27.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.045+0000 7f40285ea640 1 -- 172.21.15.120:0/3269435000 shutdown_connections 2024-07-27T03:09:27.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.045+0000 7f40285ea640 1 -- 172.21.15.120:0/3269435000 wait complete. 2024-07-27T03:09:27.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.047+0000 7f40285ea640 1 Processor -- start 2024-07-27T03:09:27.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.047+0000 7f40285ea640 1 -- start start 2024-07-27T03:09:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.048+0000 7f40285ea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f402006e270 0x7f40201539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.048+0000 7f40285ea640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4020073e20 0x7f402006f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.048+0000 7f40285ea640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f402015eb40 0x7f4020159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.048+0000 7f40285ea640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f402015f820 con 0x7f402006e270 2024-07-27T03:09:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.048+0000 7f40285ea640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f402015f6a0 con 0x7f4020073e20 2024-07-27T03:09:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.048+0000 7f40285ea640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f40201f8770 con 0x7f402015eb40 2024-07-27T03:09:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.048+0000 7f4026386640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f402006e270 0x7f40201539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.048+0000 7f4026386640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f402006e270 0x7f40201539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51196/0 (socket says 172.21.15.120:51196) 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.048+0000 7f4026386640 1 -- 172.21.15.120:0/2227126358 learned_addr learned my addr 172.21.15.120:0/2227126358 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4026b87640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f402015eb40 0x7f4020159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4025b85640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4020073e20 0x7f402006f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4026386640 1 -- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f402015eb40 msgr2=0x7f4020159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4026386640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f402015eb40 0x7f4020159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4026386640 1 -- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4020073e20 msgr2=0x7f402006f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4026386640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4020073e20 0x7f402006f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4026386640 1 -- 172.21.15.120:0/2227126358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40201f89c0 con 0x7f402006e270 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4025b85640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4020073e20 0x7f402006f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4026b87640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f402015eb40 0x7f4020159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4026386640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f402006e270 0x7f40201539c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f401c00c3a0 tx=0x7f401c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4016ffd640 1 -- 172.21.15.120:0/2227126358 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c017070 con 0x7f402006e270 2024-07-27T03:09:27.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4016ffd640 1 -- 172.21.15.120:0/2227126358 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f401c0053c0 con 0x7f402006e270 2024-07-27T03:09:27.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f40285ea640 1 -- 172.21.15.120:0/2227126358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40201f8ca0 con 0x7f402006e270 2024-07-27T03:09:27.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f4016ffd640 1 -- 172.21.15.120:0/2227126358 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c003850 con 0x7f402006e270 2024-07-27T03:09:27.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.049+0000 7f40285ea640 1 -- 172.21.15.120:0/2227126358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f402014e6f0 con 0x7f402006e270 2024-07-27T03:09:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.050+0000 7f40285ea640 1 -- 172.21.15.120:0/2227126358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40201554a0 con 0x7f402006e270 2024-07-27T03:09:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.051+0000 7f4016ffd640 1 -- 172.21.15.120:0/2227126358 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f401c01a070 con 0x7f402006e270 2024-07-27T03:09:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.051+0000 7f4016ffd640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4004077010 0x7f4004079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.052+0000 7f4016ffd640 1 -- 172.21.15.120:0/2227126358 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f401c097db0 con 0x7f402006e270 2024-07-27T03:09:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.052+0000 7f4025b85640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4004077010 0x7f4004079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.052+0000 7f4025b85640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4004077010 0x7f4004079520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4010034000 tx=0x7f4010004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.056+0000 7f4016ffd640 1 -- 172.21.15.120:0/2227126358 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f4020074230 con 0x7f402006e270 2024-07-27T03:09:27.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.273+0000 7f40285ea640 1 -- 172.21.15.120:0/2227126358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40200b3da0 con 0x7f402006e270 2024-07-27T03:09:27.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.273+0000 7f4016ffd640 1 -- 172.21.15.120:0/2227126358 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5248 (secure 0 0 0) 0x7f401c069020 con 0x7f402006e270 2024-07-27T03:09:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:27.276 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":19,"btime":"2024-07-27T03:09:26:912889+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2961373787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2961373787},{"type":"v1","addr":"172.21.15.121:6836","nonce":2961373787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3538993507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3538993507},{"type":"v1","addr":"172.21.15.121:6837","nonce":3538993507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:09:13.964247+0000","modified":"2024-07-27T03:09:26.912872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4860,"mds_1":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"c","rank":1,"incarnation":19,"state":"up:creating","state_seq":1,"addr":"172.21.15.120:6834/503930696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":503930696},{"type":"v1","addr":"172.21.15.120:6834","nonce":503930696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4860":{"gid":4860,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/1949887551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":1949887551},{"type":"v1","addr":"172.21.15.120:6835","nonce":1949887551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4860,"qdb_cluster":[4860]},"id":2}]} 2024-07-27T03:09:27.277 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 19 2024-07-27T03:09:27.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.275+0000 7f40285ea640 1 -- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4004077010 msgr2=0x7f4004079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:27.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.275+0000 7f40285ea640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4004077010 0x7f4004079520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4010034000 tx=0x7f4010004730 comp rx=0 tx=0).stop 2024-07-27T03:09:27.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.275+0000 7f40285ea640 1 -- 172.21.15.120:0/2227126358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f402006e270 msgr2=0x7f40201539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.275+0000 7f40285ea640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f402006e270 0x7f40201539c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f401c00c3a0 tx=0x7f401c00c860 comp rx=0 tx=0).stop 2024-07-27T03:09:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.276+0000 7f40285ea640 1 -- 172.21.15.120:0/2227126358 shutdown_connections 2024-07-27T03:09:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.276+0000 7f40285ea640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4004077010 0x7f4004079520 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.276+0000 7f40285ea640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f402015eb40 0x7f4020159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.276+0000 7f40285ea640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4020073e20 0x7f402006f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.276+0000 7f40285ea640 1 --2- 172.21.15.120:0/2227126358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f402006e270 0x7f40201539c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.276+0000 7f40285ea640 1 -- 172.21.15.120:0/2227126358 >> 172.21.15.120:0/2227126358 conn(0x7f40200b1a10 msgr2=0x7f402015bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.276+0000 7f40285ea640 1 -- 172.21.15.120:0/2227126358 shutdown_connections 2024-07-27T03:09:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:27.276+0000 7f40285ea640 1 -- 172.21.15.120:0/2227126358 wait complete. 2024-07-27T03:09:27.692 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:09:13.964247+0000', 'modified': '2024-07-27T03:09:26.912872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 4860, 'mds_1': 4857}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4857': {'gid': 4857, 'name': 'c', 'rank': 1, 'incarnation': 19, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.120:6834/503930696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6832', 'nonce': 503930696}, {'type': 'v1', 'addr': '172.21.15.120:6834', 'nonce': 503930696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4860': {'gid': 4860, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6835/1949887551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6833', 'nonce': 1949887551}, {'type': 'v1', 'addr': '172.21.15.120:6835', 'nonce': 1949887551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4860, 'qdb_cluster': [4860]} 2024-07-27T03:09:27.693 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4857:up:creating 2024-07-27T03:09:28.694 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:28.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.818+0000 7fb152205640 1 -- 172.21.15.120:0/1072894437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb14c0b75b0 msgr2=0x7fb14c0d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.818+0000 7fb152205640 1 --2- 172.21.15.120:0/1072894437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb14c0b75b0 0x7fb14c0d0790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0b7000 tx=0x7fb13c02a4d0 comp rx=0 tx=0).stop 2024-07-27T03:09:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.819+0000 7fb152205640 1 -- 172.21.15.120:0/1072894437 shutdown_connections 2024-07-27T03:09:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.819+0000 7fb152205640 1 --2- 172.21.15.120:0/1072894437 >> v2:172.21.15.121:3300/0 conn(0x7fb14c0cd940 0x7fb14c0b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.819+0000 7fb152205640 1 --2- 172.21.15.120:0/1072894437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb14c0b75b0 0x7fb14c0d0790 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.819+0000 7fb152205640 1 -- 172.21.15.120:0/1072894437 >> 172.21.15.120:0/1072894437 conn(0x7fb14c0d1dd0 msgr2=0x7fb14c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.819+0000 7fb152205640 1 -- 172.21.15.120:0/1072894437 shutdown_connections 2024-07-27T03:09:28.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.819+0000 7fb152205640 1 -- 172.21.15.120:0/1072894437 wait complete. 2024-07-27T03:09:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.820+0000 7fb152205640 1 Processor -- start 2024-07-27T03:09:28.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.821+0000 7fb152205640 1 -- start start 2024-07-27T03:09:28.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb152205640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14c0b75b0 0x7fb14c1f9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:28.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb152205640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb14c0cd940 0x7fb14c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:28.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb152205640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb14c0d28f0 0x7fb14c06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:28.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb152205640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c0b1f50 con 0x7fb14c0cd940 2024-07-27T03:09:28.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb152205640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c0b1dd0 con 0x7fb14c0b75b0 2024-07-27T03:09:28.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb152205640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c166aa0 con 0x7fb14c0d28f0 2024-07-27T03:09:28.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb14affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb14c0cd940 0x7fb14c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:28.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb14affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb14c0cd940 0x7fb14c15aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51220/0 (socket says 172.21.15.120:51220) 2024-07-27T03:09:28.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb14b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14c0b75b0 0x7fb14c1f9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:28.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb14affd640 1 -- 172.21.15.120:0/3234118912 learned_addr learned my addr 172.21.15.120:0/3234118912 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:28.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb14bfff640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb14c0d28f0 0x7fb14c06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:28.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb14affd640 1 -- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb14c0d28f0 msgr2=0x7fb14c06e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb14affd640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb14c0d28f0 0x7fb14c06e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb14affd640 1 -- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14c0b75b0 msgr2=0x7fb14c1f9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb14affd640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14c0b75b0 0x7fb14c1f9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.822+0000 7fb14affd640 1 -- 172.21.15.120:0/3234118912 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c15b3f0 con 0x7fb14c0cd940 2024-07-27T03:09:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.823+0000 7fb14affd640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb14c0cd940 0x7fb14c15aeb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb14000b3f0 tx=0x7fb14000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.823+0000 7fb133fff640 1 -- 172.21.15.120:0/3234118912 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140015020 con 0x7fb14c0cd940 2024-07-27T03:09:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.823+0000 7fb133fff640 1 -- 172.21.15.120:0/3234118912 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb140011920 con 0x7fb14c0cd940 2024-07-27T03:09:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.823+0000 7fb152205640 1 -- 172.21.15.120:0/3234118912 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c06f6d0 con 0x7fb14c0cd940 2024-07-27T03:09:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.823+0000 7fb133fff640 1 -- 172.21.15.120:0/3234118912 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140011d70 con 0x7fb14c0cd940 2024-07-27T03:09:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.823+0000 7fb152205640 1 -- 172.21.15.120:0/3234118912 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c06ddc0 con 0x7fb14c0cd940 2024-07-27T03:09:28.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.824+0000 7fb152205640 1 -- 172.21.15.120:0/3234118912 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb14c0d0790 con 0x7fb14c0cd940 2024-07-27T03:09:28.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.825+0000 7fb133fff640 1 -- 172.21.15.120:0/3234118912 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb140018020 con 0x7fb14c0cd940 2024-07-27T03:09:28.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.825+0000 7fb133fff640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb138077010 0x7fb138079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:28.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.825+0000 7fb133fff640 1 -- 172.21.15.120:0/3234118912 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb140098750 con 0x7fb14c0cd940 2024-07-27T03:09:28.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.825+0000 7fb14b7fe640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb138077010 0x7fb138079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.826+0000 7fb14b7fe640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb138077010 0x7fb138079520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb13c033000 tx=0x7fb13c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:28.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:28.830+0000 7fb133fff640 1 -- 172.21.15.120:0/3234118912 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb14001f020 con 0x7fb14c0cd940 2024-07-27T03:09:29.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.051+0000 7fb152205640 1 -- 172.21.15.120:0/3234118912 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb14c06f460 con 0x7fb14c0cd940 2024-07-27T03:09:29.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.051+0000 7fb133fff640 1 -- 172.21.15.120:0/3234118912 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5270 (secure 0 0 0) 0x7fb140061390 con 0x7fb14c0cd940 2024-07-27T03:09:29.054 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:29.054 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"btime":"2024-07-27T03:09:28:925811+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2961373787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2961373787},{"type":"v1","addr":"172.21.15.121:6836","nonce":2961373787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:09:13.964247+0000","modified":"2024-07-27T03:09:28.925805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4860,"mds_1":4857,"mds_2":4640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4640":{"gid":4640,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6837/3538993507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3538993507},{"type":"v1","addr":"172.21.15.121:6837","nonce":3538993507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4857":{"gid":4857,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/503930696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":503930696},{"type":"v1","addr":"172.21.15.120:6834","nonce":503930696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4860":{"gid":4860,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/1949887551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":1949887551},{"type":"v1","addr":"172.21.15.120:6835","nonce":1949887551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4860,"qdb_cluster":[4640,4857,4860]},"id":2}]} 2024-07-27T03:09:29.055 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 22 2024-07-27T03:09:29.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 -- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb138077010 msgr2=0x7fb138079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb138077010 0x7fb138079520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb13c033000 tx=0x7fb13c004730 comp rx=0 tx=0).stop 2024-07-27T03:09:29.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 -- 172.21.15.120:0/3234118912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb14c0cd940 msgr2=0x7fb14c15aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb14c0cd940 0x7fb14c15aeb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb14000b3f0 tx=0x7fb14000b8b0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 -- 172.21.15.120:0/3234118912 shutdown_connections 2024-07-27T03:09:29.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb138077010 0x7fb138079520 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb14c0cd940 0x7fb14c15aeb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb14c0d28f0 0x7fb14c06e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 --2- 172.21.15.120:0/3234118912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb14c0b75b0 0x7fb14c1f9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 -- 172.21.15.120:0/3234118912 >> 172.21.15.120:0/3234118912 conn(0x7fb14c0d1dd0 msgr2=0x7fb14c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 -- 172.21.15.120:0/3234118912 shutdown_connections 2024-07-27T03:09:29.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.054+0000 7fb152205640 1 -- 172.21.15.120:0/3234118912 wait complete. 2024-07-27T03:09:29.473 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:09:13.964247+0000', 'modified': '2024-07-27T03:09:28.925805+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4860, 'mds_1': 4857, 'mds_2': 4640}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4640': {'gid': 4640, 'name': 'd', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.121:6837/3538993507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6835', 'nonce': 3538993507}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 3538993507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4857': {'gid': 4857, 'name': 'c', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.120:6834/503930696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6832', 'nonce': 503930696}, {'type': 'v1', 'addr': '172.21.15.120:6834', 'nonce': 503930696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4860': {'gid': 4860, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6835/1949887551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6833', 'nonce': 1949887551}, {'type': 'v1', 'addr': '172.21.15.120:6835', 'nonce': 1949887551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4860, 'qdb_cluster': [4640, 4857, 4860]} 2024-07-27T03:09:29.473 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-07-27T03:09:29.473 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-07-27T03:09:29.578 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-07-27T03:09:29.575+0000 7f70df2ac640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-27T03:09:29.578 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-07-27T03:09:29.575+0000 7f70df2ac640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-07-27T03:09:29.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.591+0000 7f16a6a61640 1 -- 172.21.15.120:0/1339798991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16a0073d00 msgr2=0x7f16a0154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.591+0000 7f16a6a61640 1 --2- 172.21.15.120:0/1339798991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16a0073d00 0x7f16a0154f00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1698005fd0 tx=0x7f169802a8b0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.591+0000 7f16a6a61640 1 -- 172.21.15.120:0/1339798991 shutdown_connections 2024-07-27T03:09:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.591+0000 7f16a6a61640 1 --2- 172.21.15.120:0/1339798991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16a0073d00 0x7f16a0154f00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.591+0000 7f16a6a61640 1 -- 172.21.15.120:0/1339798991 >> 172.21.15.120:0/1339798991 conn(0x7f16a00b1a10 msgr2=0x7f16a00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.591+0000 7f16a6a61640 1 -- 172.21.15.120:0/1339798991 shutdown_connections 2024-07-27T03:09:29.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.591+0000 7f16a6a61640 1 -- 172.21.15.120:0/1339798991 wait complete. 2024-07-27T03:09:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.593+0000 7f16a6a61640 1 Processor -- start 2024-07-27T03:09:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.593+0000 7f16a6a61640 1 -- start start 2024-07-27T03:09:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.594+0000 7f16a6a61640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16a00cf480 0x7f16a0151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.594+0000 7f16a6a61640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f16a015f760 0x7f16a01455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.594+0000 7f16a6a61640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16a01530f0 0x7f16a006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.594+0000 7f16a6a61640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0155440 con 0x7f16a00cf480 2024-07-27T03:09:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.594+0000 7f16a6a61640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f16a00aed90 con 0x7f16a01530f0 2024-07-27T03:09:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.594+0000 7f16a6a61640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f16a01555c0 con 0x7f16a015f760 2024-07-27T03:09:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.594+0000 7f169ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16a00cf480 0x7f16a0151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16a00cf480 0x7f16a0151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51234/0 (socket says 172.21.15.120:51234) 2024-07-27T03:09:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169ffff640 1 -- 172.21.15.120:0/1107092464 learned_addr learned my addr 172.21.15.120:0/1107092464 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169f7fe640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f16a015f760 0x7f16a01455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f16a4ffe640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16a01530f0 0x7f16a006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169ffff640 1 -- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f16a015f760 msgr2=0x7f16a01455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169ffff640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f16a015f760 0x7f16a01455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169ffff640 1 -- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16a01530f0 msgr2=0x7f16a006eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169ffff640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16a01530f0 0x7f16a006eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169ffff640 1 -- 172.21.15.120:0/1107092464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a0148950 con 0x7f16a00cf480 2024-07-27T03:09:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f16a4ffe640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16a01530f0 0x7f16a006eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169ffff640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16a00cf480 0x7f16a0151e10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f169000c340 tx=0x7f169000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169cff9640 1 -- 172.21.15.120:0/1107092464 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690011790 con 0x7f16a00cf480 2024-07-27T03:09:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169cff9640 1 -- 172.21.15.120:0/1107092464 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1690017070 con 0x7f16a00cf480 2024-07-27T03:09:29.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f16a6a61640 1 -- 172.21.15.120:0/1107092464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a0148c30 con 0x7f16a00cf480 2024-07-27T03:09:29.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f169cff9640 1 -- 172.21.15.120:0/1107092464 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690011cc0 con 0x7f16a00cf480 2024-07-27T03:09:29.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.595+0000 7f16a6a61640 1 -- 172.21.15.120:0/1107092464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a00c4f60 con 0x7f16a00cf480 2024-07-27T03:09:29.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.597+0000 7f169cff9640 1 -- 172.21.15.120:0/1107092464 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f169001c460 con 0x7f16a00cf480 2024-07-27T03:09:29.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.598+0000 7f169cff9640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f168c077040 0x7f168c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.598+0000 7f169cff9640 1 -- 172.21.15.120:0/1107092464 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f16900985e0 con 0x7f16a00cf480 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.598+0000 7f169f7fe640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f168c077040 0x7f168c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.598+0000 7f16ad97c740 1 Processor -- start 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.599+0000 7f16ad97c740 1 -- start start 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.599+0000 7f169f7fe640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f168c077040 0x7f168c079550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1694006fd0 tx=0x7f1694009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e794270 0x55d83eb81170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e76b3b0 0x55d83eb63e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e773590 0x55d83eb64380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f16ad97c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d83eaac360 con 0x55d83e794270 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f16ad97c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d83ea9b860 con 0x55d83e76b3b0 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f16ad97c740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55d83ea9f8a0 con 0x55d83e773590 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f169ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e794270 0x55d83eb81170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f169ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e794270 0x55d83eb81170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51238/0 (socket says 172.21.15.120:51238) 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f169ffff640 1 -- 172.21.15.120:0/2209447000 learned_addr learned my addr 172.21.15.120:0/2209447000 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f169f7fe640 1 --2- 172.21.15.120:0/2209447000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e76b3b0 0x55d83eb63e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f16a4ffe640 1 --2- 172.21.15.120:0/2209447000 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e773590 0x55d83eb64380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f169ffff640 1 -- 172.21.15.120:0/2209447000 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e773590 msgr2=0x55d83eb64380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f169ffff640 1 --2- 172.21.15.120:0/2209447000 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e773590 0x55d83eb64380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f169ffff640 1 -- 172.21.15.120:0/2209447000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e76b3b0 msgr2=0x55d83eb63e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f169ffff640 1 --2- 172.21.15.120:0/2209447000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e76b3b0 0x55d83eb63e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f169ffff640 1 -- 172.21.15.120:0/2209447000 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d83ea2b360 con 0x55d83e794270 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.600+0000 7f16a4ffe640 1 --2- 172.21.15.120:0/2209447000 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e773590 0x55d83eb64380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.601+0000 7f169ffff640 1 --2- 172.21.15.120:0/2209447000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e794270 0x55d83eb81170 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1690096b30 tx=0x7f16900609a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975b25aae4a1cb3a server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.601+0000 7f1685ffb640 1 -- 172.21.15.120:0/2209447000 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690061170 con 0x55d83e794270 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.601+0000 7f1685ffb640 1 -- 172.21.15.120:0/2209447000 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1690065770 con 0x55d83e794270 2024-07-27T03:09:29.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.601+0000 7f1685ffb640 1 -- 172.21.15.120:0/2209447000 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900605f0 con 0x55d83e794270 2024-07-27T03:09:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.602+0000 7f16ad97c740 1 -- 172.21.15.120:0/2209447000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e794270 msgr2=0x55d83eb81170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.602+0000 7f16ad97c740 1 --2- 172.21.15.120:0/2209447000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e794270 0x55d83eb81170 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1690096b30 tx=0x7f16900609a0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.602+0000 7f16ad97c740 1 -- 172.21.15.120:0/2209447000 shutdown_connections 2024-07-27T03:09:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.602+0000 7f16ad97c740 1 --2- 172.21.15.120:0/2209447000 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e773590 0x55d83eb64380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.602+0000 7f16ad97c740 1 --2- 172.21.15.120:0/2209447000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e76b3b0 0x55d83eb63e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.602+0000 7f16ad97c740 1 --2- 172.21.15.120:0/2209447000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e794270 0x55d83eb81170 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.602+0000 7f16ad97c740 1 -- 172.21.15.120:0/2209447000 >> 172.21.15.120:0/2209447000 conn(0x55d83e7883c0 msgr2=0x55d83eb3a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.602+0000 7f16ad97c740 1 -- 172.21.15.120:0/2209447000 shutdown_connections 2024-07-27T03:09:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.602+0000 7f16ad97c740 1 -- 172.21.15.120:0/2209447000 wait complete. 2024-07-27T03:09:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.603+0000 7f16ad97c740 1 -- start start 2024-07-27T03:09:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.603+0000 7f16ad97c740 1 Processor -- start 2024-07-27T03:09:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.604+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e76b3b0 0x55d83eb5e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.604+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e773590 0x55d83eb43d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.604+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e794270 0x55d83eb5fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.604+0000 7f16ad97c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d83e80e620 con 0x55d83e76b3b0 2024-07-27T03:09:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.604+0000 7f16ad97c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d83ea37140 con 0x55d83e773590 2024-07-27T03:09:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.604+0000 7f16ad97c740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55d83eb44840 con 0x55d83e794270 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.604+0000 7f16ad97c740 10 client.0 _ll_register_callbacks cb 0x55d83ea94c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.604+0000 7f169ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e76b3b0 0x55d83eb5e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f169ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e76b3b0 0x55d83eb5e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51240/0 (socket says 172.21.15.120:51240) 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f169ffff640 1 -- 172.21.15.120:0/4238638263 learned_addr learned my addr 172.21.15.120:0/4238638263 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f16a4ffe640 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e794270 0x55d83eb5fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f169f7fe640 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e773590 0x55d83eb43d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f169ffff640 1 -- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e794270 msgr2=0x55d83eb5fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f169ffff640 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e794270 0x55d83eb5fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f169ffff640 1 -- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e773590 msgr2=0x55d83eb43d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f169ffff640 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e773590 0x55d83eb43d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f169ffff640 1 -- 172.21.15.120:0/4238638263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d83e7ff850 con 0x55d83e76b3b0 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f169ffff640 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e76b3b0 0x55d83eb5e280 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1690061100 tx=0x7f16900010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6871486628f8acc server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f167effd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f167effd640 1 -- 172.21.15.120:0/4238638263 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900605d0 con 0x55d83e76b3b0 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f167effd640 1 -- 172.21.15.120:0/4238638263 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f16900980c0 con 0x55d83e76b3b0 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f16ad97c740 1 -- 172.21.15.120:0/4238638263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1690065770 con 0x55d83e76b3b0 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f167effd640 1 -- 172.21.15.120:0/4238638263 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1690061170 con 0x55d83e76b3b0 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f16ad97c740 10 client.5097 fetch_fsmap learned FSMap version 22 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.605+0000 7f16ad97c740 1 -- 172.21.15.120:0/4238638263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55d83e8766b0 con 0x55d83e76b3b0 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.606+0000 7f167effd640 1 -- 172.21.15.120:0/4238638263 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1690065770 con 0x55d83e76b3b0 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.606+0000 7f167effd640 1 -- 172.21.15.120:0/4238638263 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 22) ==== 3542+0+0 (secure 0 0 0) 0x7f16900982c0 con 0x55d83e76b3b0 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.606+0000 7f16ad97c740 10 client.5097 fetch_fsmap finished waiting for FSMap version 22 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.606+0000 7f16ad97c740 10 client.5097 resolve_mds: resolved name 'd' to daemon mds.d 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.606+0000 7f16ad97c740 20 client.5097 populate_metadata read hostname 'smithi120' 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.606+0000 7f16ad97c740 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:6835/3538993507,v1:172.21.15.121:6837/3538993507] conn(0x55d83e752e40 0x55d83eb9b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.606+0000 7f16ad97c740 4 client.5097 mds_command: new command op to 4640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:09:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.606+0000 7f16ad97c740 1 -- 172.21.15.120:0/4238638263 --> [v2:172.21.15.121:6835/3538993507,v1:172.21.15.121:6837/3538993507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d83eaae2b0 con 0x55d83e752e40 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.606+0000 7f169f7fe640 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:6835/3538993507,v1:172.21.15.121:6837/3538993507] conn(0x55d83e752e40 0x55d83eb9b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.607+0000 7f167effd640 10 client.5097 ms_handle_connect on v2:172.21.15.121:6835/3538993507 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.607+0000 7f169f7fe640 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:6835/3538993507,v1:172.21.15.121:6837/3538993507] conn(0x55d83e752e40 0x55d83eb9b0c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b942ed36ccc73a3 server_cookie=aad1439cf6199eca in_seq=0 out_seq=0 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.607+0000 7f167effd640 1 -- 172.21.15.120:0/4238638263 <== mds.2 v2:172.21.15.121:6835/3538993507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d83eaae2b0 con 0x55d83e752e40 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.607+0000 7f167effd640 10 client.5097 handle_command_reply: tid=0 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.607+0000 7f16ad97c740 1 client.5097 shutdown 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f16ad97c740 1 -- 172.21.15.120:0/4238638263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e76b3b0 msgr2=0x55d83eb5e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f16ad97c740 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e76b3b0 0x55d83eb5e280 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1690061100 tx=0x7f16900010a0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f16ad97c740 1 -- 172.21.15.120:0/4238638263 shutdown_connections 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f16ad97c740 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:6835/3538993507,v1:172.21.15.121:6837/3538993507] conn(0x55d83e752e40 0x55d83eb9b0c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f16ad97c740 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e794270 0x55d83eb5fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f16ad97c740 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e773590 0x55d83eb43d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f167effd640 0 client.5097 ms_handle_reset on v2:172.21.15.121:6835/3538993507 2024-07-27T03:09:29.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f16ad97c740 1 --2- 172.21.15.120:0/4238638263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e76b3b0 0x55d83eb5e280 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f16ad97c740 1 -- 172.21.15.120:0/4238638263 >> 172.21.15.120:0/4238638263 conn(0x55d83e7883c0 msgr2=0x55d83eb33760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f16ad97c740 1 -- 172.21.15.120:0/4238638263 shutdown_connections 2024-07-27T03:09:29.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f16ad97c740 1 -- 172.21.15.120:0/4238638263 wait complete. 2024-07-27T03:09:29.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.608+0000 7f16ad97c740 20 client.5097 trim_cache size 0 max 16384 2024-07-27T03:09:29.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.627+0000 7f16ad97c740 1 Processor -- start 2024-07-27T03:09:29.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.627+0000 7f16ad97c740 1 -- start start 2024-07-27T03:09:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.628+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e752e40 0x55d83eb52690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.628+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e76b3b0 0x55d83eb641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.628+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb60960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.628+0000 7f16ad97c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0201050 con 0x55d83e773590 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.628+0000 7f16ad97c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0201720 con 0x55d83e76b3b0 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.628+0000 7f16ad97c740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f16a015a290 con 0x55d83e752e40 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.628+0000 7f16a4ffe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb60960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.628+0000 7f16a4ffe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb60960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51250/0 (socket says 172.21.15.120:51250) 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.628+0000 7f16a4ffe640 1 -- 172.21.15.120:0/151724971 learned_addr learned my addr 172.21.15.120:0/151724971 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f169ffff640 1 --2- 172.21.15.120:0/151724971 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e752e40 0x55d83eb52690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f169f7fe640 1 --2- 172.21.15.120:0/151724971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e76b3b0 0x55d83eb641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f16a4ffe640 1 -- 172.21.15.120:0/151724971 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e752e40 msgr2=0x55d83eb52690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f16a4ffe640 1 --2- 172.21.15.120:0/151724971 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e752e40 0x55d83eb52690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f16a4ffe640 1 -- 172.21.15.120:0/151724971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e76b3b0 msgr2=0x55d83eb641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f16a4ffe640 1 --2- 172.21.15.120:0/151724971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e76b3b0 0x55d83eb641b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f16a4ffe640 1 -- 172.21.15.120:0/151724971 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d83ebf28b0 con 0x55d83e773590 2024-07-27T03:09:29.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f169ffff640 1 --2- 172.21.15.120:0/151724971 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e752e40 0x55d83eb52690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:29.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f16a4ffe640 1 --2- 172.21.15.120:0/151724971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb60960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1698009cd0 tx=0x7f1698004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bbac154f4f2a26 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f16857fa640 1 -- 172.21.15.120:0/151724971 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698004040 con 0x55d83e773590 2024-07-27T03:09:29.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f16857fa640 1 -- 172.21.15.120:0/151724971 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16980041e0 con 0x55d83e773590 2024-07-27T03:09:29.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.629+0000 7f16857fa640 1 -- 172.21.15.120:0/151724971 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698004610 con 0x55d83e773590 2024-07-27T03:09:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.630+0000 7f16ad97c740 1 -- 172.21.15.120:0/151724971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 msgr2=0x55d83eb60960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.630+0000 7f16ad97c740 1 --2- 172.21.15.120:0/151724971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb60960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1698009cd0 tx=0x7f1698004a40 comp rx=0 tx=0).stop 2024-07-27T03:09:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.630+0000 7f16ad97c740 1 -- 172.21.15.120:0/151724971 shutdown_connections 2024-07-27T03:09:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.630+0000 7f16ad97c740 1 --2- 172.21.15.120:0/151724971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb60960 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.630+0000 7f16ad97c740 1 --2- 172.21.15.120:0/151724971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e76b3b0 0x55d83eb641b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.630+0000 7f16ad97c740 1 --2- 172.21.15.120:0/151724971 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e752e40 0x55d83eb52690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.630+0000 7f16ad97c740 1 -- 172.21.15.120:0/151724971 >> 172.21.15.120:0/151724971 conn(0x55d83e7883c0 msgr2=0x55d83eb3ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.630+0000 7f16ad97c740 1 -- 172.21.15.120:0/151724971 shutdown_connections 2024-07-27T03:09:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.630+0000 7f16ad97c740 1 -- 172.21.15.120:0/151724971 wait complete. 2024-07-27T03:09:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.631+0000 7f16ad97c740 1 -- start start 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.631+0000 7f16ad97c740 1 Processor -- start 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e752e40 0x55d83eb51990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e76b3b0 0x55d83ebe1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16ad97c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb399f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16ad97c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d83eb5d2f0 con 0x55d83e773590 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16ad97c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d83e80e620 con 0x55d83e752e40 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16ad97c740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55d83eb60020 con 0x55d83e76b3b0 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16ad97c740 10 client.0 _ll_register_callbacks cb 0x7f16940092d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16a4ffe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16a4ffe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb399f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51266/0 (socket says 172.21.15.120:51266) 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16a4ffe640 1 -- 172.21.15.120:0/1711628596 learned_addr learned my addr 172.21.15.120:0/1711628596 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f169f7fe640 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e76b3b0 0x55d83ebe1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f169ffff640 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e752e40 0x55d83eb51990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16a4ffe640 1 -- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e76b3b0 msgr2=0x55d83ebe1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16a4ffe640 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e76b3b0 0x55d83ebe1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16a4ffe640 1 -- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e752e40 msgr2=0x55d83eb51990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16a4ffe640 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e752e40 0x55d83eb51990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.632+0000 7f16a4ffe640 1 -- 172.21.15.120:0/1711628596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d83eb38c00 con 0x55d83e773590 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f16a4ffe640 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb399f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1698043000 tx=0x7f16980048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2967e5da22d23e7 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f167effd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f167effd640 1 -- 172.21.15.120:0/1711628596 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698055060 con 0x55d83e773590 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f167effd640 1 -- 172.21.15.120:0/1711628596 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1698042040 con 0x55d83e773590 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f16ad97c740 1 -- 172.21.15.120:0/1711628596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16980041e0 con 0x55d83e773590 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f167effd640 1 -- 172.21.15.120:0/1711628596 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1698003b30 con 0x55d83e773590 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f16ad97c740 10 client.5103 fetch_fsmap learned FSMap version 22 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f16ad97c740 1 -- 172.21.15.120:0/1711628596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55d83ebfcf80 con 0x55d83e773590 2024-07-27T03:09:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f167effd640 1 -- 172.21.15.120:0/1711628596 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16980041e0 con 0x55d83e773590 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f167effd640 1 -- 172.21.15.120:0/1711628596 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 22) ==== 3542+0+0 (secure 0 0 0) 0x7f1698031650 con 0x55d83e773590 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f16ad97c740 10 client.5103 fetch_fsmap finished waiting for FSMap version 22 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f16ad97c740 10 client.5103 resolve_mds: resolved name 'd' to daemon mds.d 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f16ad97c740 20 client.5103 populate_metadata read hostname 'smithi120' 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f16ad97c740 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:6835/3538993507,v1:172.21.15.121:6837/3538993507] conn(0x55d83e728280 0x55d83ebfc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f16ad97c740 4 client.5103 mds_command: new command op to 4640 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.633+0000 7f16ad97c740 1 -- 172.21.15.120:0/1711628596 --> [v2:172.21.15.121:6835/3538993507,v1:172.21.15.121:6837/3538993507] -- command(tid 0: {"prefix": "status"}) -- 0x55d83eb36250 con 0x55d83e728280 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f169ffff640 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:6835/3538993507,v1:172.21.15.121:6837/3538993507] conn(0x55d83e728280 0x55d83ebfc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f167effd640 10 client.5103 ms_handle_connect on v2:172.21.15.121:6835/3538993507 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f169ffff640 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:6835/3538993507,v1:172.21.15.121:6837/3538993507] conn(0x55d83e728280 0x55d83ebfc9f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa3c4ffd92609396 server_cookie=ddfb9005656de647 in_seq=0 out_seq=0 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f167effd640 1 -- 172.21.15.120:0/1711628596 <== mds.2 v2:172.21.15.121:6835/3538993507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55d83eb36250 con 0x55d83e728280 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f167effd640 10 client.5103 handle_command_reply: tid=0 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f16ad97c740 1 client.5103 shutdown 2024-07-27T03:09:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f16ad97c740 1 -- 172.21.15.120:0/1711628596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 msgr2=0x55d83eb399f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f16ad97c740 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb399f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1698043000 tx=0x7f16980048d0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f16ad97c740 1 -- 172.21.15.120:0/1711628596 shutdown_connections 2024-07-27T03:09:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f16ad97c740 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:6835/3538993507,v1:172.21.15.121:6837/3538993507] conn(0x55d83e728280 0x55d83ebfc9f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f16ad97c740 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d83e773590 0x55d83eb399f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f16ad97c740 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55d83e76b3b0 0x55d83ebe1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f167effd640 0 client.5103 ms_handle_reset on v2:172.21.15.121:6835/3538993507 2024-07-27T03:09:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f16ad97c740 1 --2- 172.21.15.120:0/1711628596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d83e752e40 0x55d83eb51990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f16ad97c740 1 -- 172.21.15.120:0/1711628596 >> 172.21.15.120:0/1711628596 conn(0x55d83e7883c0 msgr2=0x55d83eb33cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f16ad97c740 1 -- 172.21.15.120:0/1711628596 shutdown_connections 2024-07-27T03:09:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.634+0000 7f16ad97c740 1 -- 172.21.15.120:0/1711628596 wait complete. 2024-07-27T03:09:29.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16ad97c740 20 client.5103 trim_cache size 0 max 16384 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 2, 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4640, 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 1.708976166, 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 22, 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 33, 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 33, 2024-07-27T03:09:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 21.921159143000001 2024-07-27T03:09:29.644 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:09:29.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 -- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f168c077040 msgr2=0x7f168c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f168c077040 0x7f168c079550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1694006fd0 tx=0x7f1694009060 comp rx=0 tx=0).stop 2024-07-27T03:09:29.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 -- 172.21.15.120:0/1107092464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16a00cf480 msgr2=0x7f16a0151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16a00cf480 0x7f16a0151e10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f169000c340 tx=0x7f169000c800 comp rx=0 tx=0).stop 2024-07-27T03:09:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 -- 172.21.15.120:0/1107092464 shutdown_connections 2024-07-27T03:09:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f168c077040 0x7f168c079550 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16a01530f0 0x7f16a006eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f16a015f760 0x7f16a01455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 --2- 172.21.15.120:0/1107092464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16a00cf480 0x7f16a0151e10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 -- 172.21.15.120:0/1107092464 >> 172.21.15.120:0/1107092464 conn(0x7f16a00b1a10 msgr2=0x7f16a00735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 -- 172.21.15.120:0/1107092464 shutdown_connections 2024-07-27T03:09:29.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.635+0000 7f16a6a61640 1 -- 172.21.15.120:0/1107092464 wait complete. 2024-07-27T03:09:29.649 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-07-27T03:09:29.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.761+0000 7f5d395e3640 1 -- 172.21.15.120:0/2781118576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d20003a00 msgr2=0x7f5d20003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.761+0000 7f5d395e3640 1 --2- 172.21.15.120:0/2781118576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d20003a00 0x7f5d20003e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009b50 tx=0x7f5d20005830 comp rx=0 tx=0).stop 2024-07-27T03:09:29.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.761+0000 7f5d337fe640 1 -- 172.21.15.120:0/2781118576 reap_dead start 2024-07-27T03:09:29.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.761+0000 7f5d395e3640 1 -- 172.21.15.120:0/2781118576 shutdown_connections 2024-07-27T03:09:29.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.761+0000 7f5d395e3640 1 -- 172.21.15.120:0/2781118576 >> 172.21.15.120:0/2781118576 conn(0x7f5d3408d690 msgr2=0x7f5d3409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.761+0000 7f5d395e3640 1 -- 172.21.15.120:0/2781118576 shutdown_connections 2024-07-27T03:09:29.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.761+0000 7f5d395e3640 1 -- 172.21.15.120:0/2781118576 wait complete. 2024-07-27T03:09:29.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.763+0000 7f5d395e3640 1 Processor -- start 2024-07-27T03:09:29.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.763+0000 7f5d395e3640 1 -- start start 2024-07-27T03:09:29.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.764+0000 7f5d395e3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d20003a00 0x7f5d3414e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.764+0000 7f5d395e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3415c120 0x7f5d34160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.764+0000 7f5d395e3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d34160870 0x7f5d34150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.764+0000 7f5d395e3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5d340b2fd0 con 0x7f5d3415c120 2024-07-27T03:09:29.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.764+0000 7f5d395e3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5d340b2e50 con 0x7f5d20003a00 2024-07-27T03:09:29.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.764+0000 7f5d395e3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5d340cebe0 con 0x7f5d34160870 2024-07-27T03:09:29.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.764+0000 7f5d2a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3415c120 0x7f5d34160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.764+0000 7f5d2a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3415c120 0x7f5d34160330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51274/0 (socket says 172.21.15.120:51274) 2024-07-27T03:09:29.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.764+0000 7f5d2a7fc640 1 -- 172.21.15.120:0/841458715 learned_addr learned my addr 172.21.15.120:0/841458715 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.764+0000 7f5d337fe640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d34160870 0x7f5d34150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.764+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d20003a00 0x7f5d3414e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.765+0000 7f5d2a7fc640 1 -- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d34160870 msgr2=0x7f5d34150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.765+0000 7f5d2a7fc640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d34160870 0x7f5d34150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.765+0000 7f5d2a7fc640 1 -- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d20003a00 msgr2=0x7f5d3414e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.765+0000 7f5d2a7fc640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d20003a00 0x7f5d3414e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.765+0000 7f5d2a7fc640 1 -- 172.21.15.120:0/841458715 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3415f290 con 0x7f5d3415c120 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.765+0000 7f5d2a7fc640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3415c120 0x7f5d34160330 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00e590 tx=0x7f5d1c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.765+0000 7f5d2bfff640 1 -- 172.21.15.120:0/841458715 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c015070 con 0x7f5d3415c120 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.765+0000 7f5d2bfff640 1 -- 172.21.15.120:0/841458715 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d1c0109a0 con 0x7f5d3415c120 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.765+0000 7f5d395e3640 1 -- 172.21.15.120:0/841458715 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3415f570 con 0x7f5d3415c120 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.765+0000 7f5d2bfff640 1 -- 172.21.15.120:0/841458715 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c010df0 con 0x7f5d3415c120 2024-07-27T03:09:29.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.765+0000 7f5d395e3640 1 -- 172.21.15.120:0/841458715 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3415fb30 con 0x7f5d3415c120 2024-07-27T03:09:29.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.767+0000 7f5d2bfff640 1 -- 172.21.15.120:0/841458715 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5d1c018070 con 0x7f5d3415c120 2024-07-27T03:09:29.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.767+0000 7f5d2bfff640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d14077010 0x7f5d14079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.767+0000 7f5d2bfff640 1 -- 172.21.15.120:0/841458715 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5d1c098bd0 con 0x7f5d3415c120 2024-07-27T03:09:29.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.767+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d14077010 0x7f5d14079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.768+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d14077010 0x7f5d14079520 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009b50 tx=0x7f5d2402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.768+0000 7f5d405d8740 1 Processor -- start 2024-07-27T03:09:29.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.768+0000 7f5d405d8740 1 -- start start 2024-07-27T03:09:29.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.769+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c1380270 0x5636c176d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.769+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c13573b0 0x5636c174fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.769+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c135f590 0x5636c1750380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.769+0000 7f5d405d8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5636c1698360 con 0x5636c135f590 2024-07-27T03:09:29.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.769+0000 7f5d405d8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5636c1687860 con 0x5636c13573b0 2024-07-27T03:09:29.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.769+0000 7f5d405d8740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5636c168b8a0 con 0x5636c1380270 2024-07-27T03:09:29.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c135f590 0x5636c1750380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c135f590 0x5636c1750380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51286/0 (socket says 172.21.15.120:51286) 2024-07-27T03:09:29.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d337fe640 1 -- 172.21.15.120:0/3958023560 learned_addr learned my addr 172.21.15.120:0/3958023560 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/3958023560 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c1380270 0x5636c176d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d2a7fc640 1 --2- 172.21.15.120:0/3958023560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c13573b0 0x5636c174fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d337fe640 1 -- 172.21.15.120:0/3958023560 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c1380270 msgr2=0x5636c176d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d337fe640 1 --2- 172.21.15.120:0/3958023560 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c1380270 0x5636c176d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d337fe640 1 -- 172.21.15.120:0/3958023560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c13573b0 msgr2=0x5636c174fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d337fe640 1 --2- 172.21.15.120:0/3958023560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c13573b0 0x5636c174fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d337fe640 1 -- 172.21.15.120:0/3958023560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636c1617360 con 0x5636c135f590 2024-07-27T03:09:29.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d337fe640 1 --2- 172.21.15.120:0/3958023560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c135f590 0x5636c1750380 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c005fd0 tx=0x7f5d2c009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8622b08d8661c689 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d28ff9640 1 -- 172.21.15.120:0/3958023560 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c009de0 con 0x5636c135f590 2024-07-27T03:09:29.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d28ff9640 1 -- 172.21.15.120:0/3958023560 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d2c016020 con 0x5636c135f590 2024-07-27T03:09:29.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.770+0000 7f5d28ff9640 1 -- 172.21.15.120:0/3958023560 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0047c0 con 0x5636c135f590 2024-07-27T03:09:29.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.771+0000 7f5d405d8740 1 -- 172.21.15.120:0/3958023560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c135f590 msgr2=0x5636c1750380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.771+0000 7f5d405d8740 1 --2- 172.21.15.120:0/3958023560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c135f590 0x5636c1750380 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c005fd0 tx=0x7f5d2c009cb0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.771+0000 7f5d405d8740 1 -- 172.21.15.120:0/3958023560 shutdown_connections 2024-07-27T03:09:29.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.771+0000 7f5d405d8740 1 --2- 172.21.15.120:0/3958023560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c135f590 0x5636c1750380 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.771+0000 7f5d405d8740 1 --2- 172.21.15.120:0/3958023560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c13573b0 0x5636c174fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.771+0000 7f5d405d8740 1 --2- 172.21.15.120:0/3958023560 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c1380270 0x5636c176d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.771+0000 7f5d405d8740 1 -- 172.21.15.120:0/3958023560 >> 172.21.15.120:0/3958023560 conn(0x5636c13743c0 msgr2=0x5636c1726060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.771+0000 7f5d405d8740 1 -- 172.21.15.120:0/3958023560 shutdown_connections 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.771+0000 7f5d405d8740 1 -- 172.21.15.120:0/3958023560 wait complete. 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.772+0000 7f5d405d8740 1 -- start start 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.772+0000 7f5d405d8740 1 Processor -- start 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.773+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c13573b0 0x5636c1779f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.773+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c135f590 0x5636c174cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.773+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.773+0000 7f5d405d8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5636c13fa620 con 0x5636c1380270 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.773+0000 7f5d405d8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5636c1623140 con 0x5636c135f590 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.773+0000 7f5d405d8740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5636c1765800 con 0x5636c13573b0 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.773+0000 7f5d405d8740 10 client.0 _ll_register_callbacks cb 0x5636c1680c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.773+0000 7f5d337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.773+0000 7f5d337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17679b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51294/0 (socket says 172.21.15.120:51294) 2024-07-27T03:09:29.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d337fe640 1 -- 172.21.15.120:0/519838279 learned_addr learned my addr 172.21.15.120:0/519838279 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c13573b0 0x5636c1779f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d2a7fc640 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c135f590 0x5636c174cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d337fe640 1 -- 172.21.15.120:0/519838279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c13573b0 msgr2=0x5636c1779f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d337fe640 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c13573b0 0x5636c1779f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d337fe640 1 -- 172.21.15.120:0/519838279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c135f590 msgr2=0x5636c174cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d337fe640 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c135f590 0x5636c174cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d337fe640 1 -- 172.21.15.120:0/519838279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636c13eb850 con 0x5636c1380270 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d337fe640 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17679b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c004410 tx=0x7f5d2c012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323a30cb4bcaf425 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d11ffb640 1 -- 172.21.15.120:0/519838279 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c004d20 con 0x5636c1380270 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d11ffb640 1 -- 172.21.15.120:0/519838279 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5d2c025aa0 con 0x5636c1380270 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d405d8740 1 -- 172.21.15.120:0/519838279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d2c016020 con 0x5636c1380270 2024-07-27T03:09:29.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d11ffb640 1 -- 172.21.15.120:0/519838279 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5d2c012850 con 0x5636c1380270 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d405d8740 10 client.5115 fetch_fsmap learned FSMap version 22 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d405d8740 1 -- 172.21.15.120:0/519838279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x5636c14626b0 con 0x5636c1380270 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.774+0000 7f5d11ffb640 1 -- 172.21.15.120:0/519838279 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d2c016020 con 0x5636c1380270 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.775+0000 7f5d11ffb640 1 -- 172.21.15.120:0/519838279 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 22) ==== 3542+0+0 (secure 0 0 0) 0x7f5d2c023070 con 0x5636c1380270 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.775+0000 7f5d405d8740 10 client.5115 fetch_fsmap finished waiting for FSMap version 22 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.775+0000 7f5d405d8740 10 client.5115 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.775+0000 7f5d405d8740 20 client.5115 populate_metadata read hostname 'smithi120' 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.775+0000 7f5d405d8740 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.120:6832/503930696,v1:172.21.15.120:6834/503930696] conn(0x5636c133ee40 0x5636c177d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.775+0000 7f5d405d8740 4 client.5115 mds_command: new command op to 4857 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.775+0000 7f5d405d8740 1 -- 172.21.15.120:0/519838279 --> [v2:172.21.15.120:6832/503930696,v1:172.21.15.120:6834/503930696] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636c169a2b0 con 0x5636c133ee40 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.775+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.120:6832/503930696,v1:172.21.15.120:6834/503930696] conn(0x5636c133ee40 0x5636c177d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.775+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.120:6832/503930696,v1:172.21.15.120:6834/503930696] conn(0x5636c133ee40 0x5636c177d540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee33c20057401c1e server_cookie=8788c1362868d22d in_seq=0 out_seq=0 2024-07-27T03:09:29.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.775+0000 7f5d11ffb640 10 client.5115 ms_handle_connect on v2:172.21.15.120:6832/503930696 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d11ffb640 1 -- 172.21.15.120:0/519838279 <== mds.1 v2:172.21.15.120:6832/503930696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636c169a2b0 con 0x5636c133ee40 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d11ffb640 10 client.5115 handle_command_reply: tid=0 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 1 client.5115 shutdown 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 1 -- 172.21.15.120:0/519838279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 msgr2=0x5636c17679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17679b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c004410 tx=0x7f5d2c012450 comp rx=0 tx=0).stop 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 1 -- 172.21.15.120:0/519838279 shutdown_connections 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17679b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.120:6832/503930696,v1:172.21.15.120:6834/503930696] conn(0x5636c133ee40 0x5636c177d540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c135f590 0x5636c174cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 1 --2- 172.21.15.120:0/519838279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c13573b0 0x5636c1779f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 1 -- 172.21.15.120:0/519838279 >> 172.21.15.120:0/519838279 conn(0x5636c13743c0 msgr2=0x5636c173ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d11ffb640 0 client.5115 ms_handle_reset on v2:172.21.15.120:6832/503930696 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 1 -- 172.21.15.120:0/519838279 shutdown_connections 2024-07-27T03:09:29.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 1 -- 172.21.15.120:0/519838279 wait complete. 2024-07-27T03:09:29.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.776+0000 7f5d405d8740 20 client.5115 trim_cache size 0 max 16384 2024-07-27T03:09:29.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.795+0000 7f5d405d8740 1 Processor -- start 2024-07-27T03:09:29.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.795+0000 7f5d405d8740 1 -- start start 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.796+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c13573b0 0x5636c176b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.796+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c135f590 0x5636c1767380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.796+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17678c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d405d8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5d34200f80 con 0x5636c1380270 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d405d8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5d34201610 con 0x5636c135f590 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d405d8740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5d341f8e40 con 0x5636c13573b0 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17678c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51306/0 (socket says 172.21.15.120:51306) 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d337fe640 1 -- 172.21.15.120:0/1154275161 learned_addr learned my addr 172.21.15.120:0/1154275161 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d2a7fc640 1 --2- 172.21.15.120:0/1154275161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c135f590 0x5636c1767380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d337fe640 1 -- 172.21.15.120:0/1154275161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c13573b0 msgr2=0x5636c176b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/1154275161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c13573b0 0x5636c176b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d337fe640 1 --2- 172.21.15.120:0/1154275161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c13573b0 0x5636c176b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d337fe640 1 -- 172.21.15.120:0/1154275161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c135f590 msgr2=0x5636c1767380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d337fe640 1 --2- 172.21.15.120:0/1154275161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c135f590 0x5636c1767380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d337fe640 1 -- 172.21.15.120:0/1154275161 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636c173f330 con 0x5636c1380270 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d2a7fc640 1 --2- 172.21.15.120:0/1154275161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c135f590 0x5636c1767380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/1154275161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c13573b0 0x5636c176b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d337fe640 1 --2- 172.21.15.120:0/1154275161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17678c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009500 tx=0x7f5d2c012a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ceafffefd14849 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d13fff640 1 -- 172.21.15.120:0/1154275161 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c02f480 con 0x5636c1380270 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d13fff640 1 -- 172.21.15.120:0/1154275161 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d2c034070 con 0x5636c1380270 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.797+0000 7f5d13fff640 1 -- 172.21.15.120:0/1154275161 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c02f970 con 0x5636c1380270 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.798+0000 7f5d405d8740 1 -- 172.21.15.120:0/1154275161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 msgr2=0x5636c17678c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.798+0000 7f5d405d8740 1 --2- 172.21.15.120:0/1154275161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17678c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009500 tx=0x7f5d2c012a70 comp rx=0 tx=0).stop 2024-07-27T03:09:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.798+0000 7f5d405d8740 1 -- 172.21.15.120:0/1154275161 shutdown_connections 2024-07-27T03:09:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.798+0000 7f5d405d8740 1 --2- 172.21.15.120:0/1154275161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c1380270 0x5636c17678c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.798+0000 7f5d405d8740 1 --2- 172.21.15.120:0/1154275161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c135f590 0x5636c1767380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.798+0000 7f5d405d8740 1 --2- 172.21.15.120:0/1154275161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c13573b0 0x5636c176b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.798+0000 7f5d405d8740 1 -- 172.21.15.120:0/1154275161 >> 172.21.15.120:0/1154275161 conn(0x5636c13743c0 msgr2=0x5636c171be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.798+0000 7f5d405d8740 1 -- 172.21.15.120:0/1154275161 shutdown_connections 2024-07-27T03:09:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.798+0000 7f5d405d8740 1 -- 172.21.15.120:0/1154275161 wait complete. 2024-07-27T03:09:29.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.799+0000 7f5d405d8740 1 -- start start 2024-07-27T03:09:29.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.799+0000 7f5d405d8740 1 Processor -- start 2024-07-27T03:09:29.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c13573b0 0x5636c17de4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c135f590 0x5636c174c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d405d8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c1380270 0x5636c1767330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d405d8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5636c173e510 con 0x5636c13573b0 2024-07-27T03:09:29.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d405d8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5636c1767ef0 con 0x5636c1380270 2024-07-27T03:09:29.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d405d8740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5636c1761a70 con 0x5636c135f590 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d405d8740 10 client.0 _ll_register_callbacks cb 0x7f5d1c061540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d32ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c13573b0 0x5636c17de4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d32ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c13573b0 0x5636c17de4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51312/0 (socket says 172.21.15.120:51312) 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d32ffd640 1 -- 172.21.15.120:0/801173824 learned_addr learned my addr 172.21.15.120:0/801173824 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d337fe640 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c1380270 0x5636c1767330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.800+0000 7f5d2a7fc640 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c135f590 0x5636c174c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d32ffd640 1 -- 172.21.15.120:0/801173824 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c135f590 msgr2=0x5636c174c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c135f590 0x5636c174c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d32ffd640 1 -- 172.21.15.120:0/801173824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c1380270 msgr2=0x5636c1767330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c1380270 0x5636c1767330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d32ffd640 1 -- 172.21.15.120:0/801173824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636c1722c00 con 0x5636c13573b0 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d32ffd640 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c13573b0 0x5636c17de4d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009c40 tx=0x7f5d240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f4c4ac85688944 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:09:29.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d11ffb640 1 -- 172.21.15.120:0/801173824 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24038040 con 0x5636c13573b0 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d11ffb640 1 -- 172.21.15.120:0/801173824 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5d24004020 con 0x5636c13573b0 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d405d8740 1 -- 172.21.15.120:0/801173824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d2c034070 con 0x5636c13573b0 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d11ffb640 1 -- 172.21.15.120:0/801173824 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5d24061050 con 0x5636c13573b0 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d405d8740 10 client.5121 fetch_fsmap learned FSMap version 22 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d405d8740 1 -- 172.21.15.120:0/801173824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x5636c171f900 con 0x5636c13573b0 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d11ffb640 1 -- 172.21.15.120:0/801173824 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d2c034070 con 0x5636c13573b0 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d11ffb640 1 -- 172.21.15.120:0/801173824 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 22) ==== 3542+0+0 (secure 0 0 0) 0x7f5d24064020 con 0x5636c13573b0 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d405d8740 10 client.5121 fetch_fsmap finished waiting for FSMap version 22 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d405d8740 10 client.5121 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d405d8740 20 client.5121 populate_metadata read hostname 'smithi120' 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d405d8740 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.120:6832/503930696,v1:172.21.15.120:6834/503930696] conn(0x5636c1765780 0x5636c1767870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d405d8740 4 client.5121 mds_command: new command op to 4857 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:09:29.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d405d8740 1 -- 172.21.15.120:0/801173824 --> [v2:172.21.15.120:6832/503930696,v1:172.21.15.120:6834/503930696] -- command(tid 0: {"prefix": "status"}) -- 0x5636c1695d50 con 0x5636c1765780 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.801+0000 7f5d2a7fc640 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.120:6832/503930696,v1:172.21.15.120:6834/503930696] conn(0x5636c1765780 0x5636c1767870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d11ffb640 10 client.5121 ms_handle_connect on v2:172.21.15.120:6832/503930696 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d2a7fc640 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.120:6832/503930696,v1:172.21.15.120:6834/503930696] conn(0x5636c1765780 0x5636c1767870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a25923648af8a52 server_cookie=1b41f93223973db6 in_seq=0 out_seq=0 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d11ffb640 1 -- 172.21.15.120:0/801173824 <== mds.1 v2:172.21.15.120:6832/503930696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x5636c1695d50 con 0x5636c1765780 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d11ffb640 10 client.5121 handle_command_reply: tid=0 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d405d8740 1 client.5121 shutdown 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d405d8740 1 -- 172.21.15.120:0/801173824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c13573b0 msgr2=0x5636c17de4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d405d8740 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c13573b0 0x5636c17de4d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009c40 tx=0x7f5d240046c0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d405d8740 1 -- 172.21.15.120:0/801173824 shutdown_connections 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d405d8740 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.120:6832/503930696,v1:172.21.15.120:6834/503930696] conn(0x5636c1765780 0x5636c1767870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d405d8740 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5636c1380270 0x5636c1767330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d405d8740 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5636c135f590 0x5636c174c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d11ffb640 0 client.5121 ms_handle_reset on v2:172.21.15.120:6832/503930696 2024-07-27T03:09:29.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d405d8740 1 --2- 172.21.15.120:0/801173824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c13573b0 0x5636c17de4d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d405d8740 1 -- 172.21.15.120:0/801173824 >> 172.21.15.120:0/801173824 conn(0x5636c13743c0 msgr2=0x5636c178e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d405d8740 1 -- 172.21.15.120:0/801173824 shutdown_connections 2024-07-27T03:09:29.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.802+0000 7f5d405d8740 1 -- 172.21.15.120:0/801173824 wait complete. 2024-07-27T03:09:29.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d405d8740 20 client.5121 trim_cache size 0 max 16384 2024-07-27T03:09:29.811 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:09:29.811 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:09:29.811 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 1, 2024-07-27T03:09:29.811 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4857, 2024-07-27T03:09:29.811 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:09:29.812 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:09:29.812 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:09:29.812 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 2.886378927, 2024-07-27T03:09:29.812 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 22, 2024-07-27T03:09:29.812 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 33, 2024-07-27T03:09:29.812 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 33, 2024-07-27T03:09:29.812 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 22.090920553 2024-07-27T03:09:29.812 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:09:29.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 -- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d14077010 msgr2=0x7f5d14079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d14077010 0x7f5d14079520 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009b50 tx=0x7f5d2402d040 comp rx=0 tx=0).stop 2024-07-27T03:09:29.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 -- 172.21.15.120:0/841458715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3415c120 msgr2=0x7f5d34160330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3415c120 0x7f5d34160330 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00e590 tx=0x7f5d1c00ea50 comp rx=0 tx=0).stop 2024-07-27T03:09:29.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 -- 172.21.15.120:0/841458715 shutdown_connections 2024-07-27T03:09:29.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d14077010 0x7f5d14079520 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3415c120 0x7f5d34160330 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d34160870 0x7f5d34150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 --2- 172.21.15.120:0/841458715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d20003a00 0x7f5d3414e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 -- 172.21.15.120:0/841458715 >> 172.21.15.120:0/841458715 conn(0x7f5d3408d690 msgr2=0x7f5d340b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 -- 172.21.15.120:0/841458715 shutdown_connections 2024-07-27T03:09:29.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.803+0000 7f5d395e3640 1 -- 172.21.15.120:0/841458715 wait complete. 2024-07-27T03:09:29.817 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-07-27T03:09:29.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.930+0000 7f611da75640 1 -- 172.21.15.120:0/2307267543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61000039e0 msgr2=0x7f6100003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.930+0000 7f611da75640 1 --2- 172.21.15.120:0/2307267543 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61000039e0 0x7f6100003e10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6108002230 tx=0x7f6100005830 comp rx=0 tx=0).stop 2024-07-27T03:09:29.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.930+0000 7f6117fff640 1 -- 172.21.15.120:0/2307267543 reap_dead start 2024-07-27T03:09:29.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.930+0000 7f611da75640 1 -- 172.21.15.120:0/2307267543 shutdown_connections 2024-07-27T03:09:29.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.930+0000 7f611da75640 1 -- 172.21.15.120:0/2307267543 >> 172.21.15.120:0/2307267543 conn(0x7f611806cba0 msgr2=0x7f611806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.930+0000 7f611da75640 1 -- 172.21.15.120:0/2307267543 shutdown_connections 2024-07-27T03:09:29.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.930+0000 7f611da75640 1 -- 172.21.15.120:0/2307267543 wait complete. 2024-07-27T03:09:29.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.932+0000 7f611da75640 1 Processor -- start 2024-07-27T03:09:29.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.932+0000 7f611da75640 1 -- start start 2024-07-27T03:09:29.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f611da75640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61000039e0 0x7f6118073640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f611da75640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61181f8f20 0x7f61180b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f611da75640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61181f4d20 0x7f61181f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f611da75640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f61180cd920 con 0x7f61000039e0 2024-07-27T03:09:29.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f611da75640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f61180cd7a0 con 0x7f61181f8f20 2024-07-27T03:09:29.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f611da75640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f61180cdaa0 con 0x7f61181f4d20 2024-07-27T03:09:29.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f61177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61000039e0 0x7f6118073640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f61177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61000039e0 0x7f6118073640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51332/0 (socket says 172.21.15.120:51332) 2024-07-27T03:09:29.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f61177fe640 1 -- 172.21.15.120:0/550983415 learned_addr learned my addr 172.21.15.120:0/550983415 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f6117fff640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61181f4d20 0x7f61181f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f6116ffd640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61181f8f20 0x7f61180b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f61177fe640 1 -- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61181f4d20 msgr2=0x7f61181f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f61177fe640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61181f4d20 0x7f61181f5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f61177fe640 1 -- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61181f8f20 msgr2=0x7f61180b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f61177fe640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61181f8f20 0x7f61180b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.933+0000 7f61177fe640 1 -- 172.21.15.120:0/550983415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6118153340 con 0x7f61000039e0 2024-07-27T03:09:29.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.934+0000 7f61177fe640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61000039e0 0x7f6118073640 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f610800c6d0 tx=0x7f6108004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.934+0000 7f60fffff640 1 -- 172.21.15.120:0/550983415 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108039070 con 0x7f61000039e0 2024-07-27T03:09:29.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.934+0000 7f60fffff640 1 -- 172.21.15.120:0/550983415 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f610802b9b0 con 0x7f61000039e0 2024-07-27T03:09:29.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.934+0000 7f611da75640 1 -- 172.21.15.120:0/550983415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61181f8440 con 0x7f61000039e0 2024-07-27T03:09:29.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.934+0000 7f60fffff640 1 -- 172.21.15.120:0/550983415 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610802bde0 con 0x7f61000039e0 2024-07-27T03:09:29.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.934+0000 7f611da75640 1 -- 172.21.15.120:0/550983415 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6118153620 con 0x7f61000039e0 2024-07-27T03:09:29.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.936+0000 7f60fffff640 1 -- 172.21.15.120:0/550983415 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6108006030 con 0x7f61000039e0 2024-07-27T03:09:29.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.936+0000 7f60fffff640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6104077010 0x7f6104079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.936+0000 7f6116ffd640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6104077010 0x7f6104079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.937+0000 7f6116ffd640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6104077010 0x7f6104079520 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f61180cc540 tx=0x7f610c0060d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.937+0000 7f612498c740 1 Processor -- start 2024-07-27T03:09:29.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.937+0000 7f612498c740 1 -- start start 2024-07-27T03:09:29.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f612498c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e50c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f612498c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0f63b0 0x55f41e4eee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f612498c740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e0fe590 0x55f41e4ef380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f612498c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f41e437360 con 0x55f41e11f270 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f612498c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f41e426860 con 0x55f41e0f63b0 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f612498c740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55f41e42a8a0 con 0x55f41e0fe590 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f61177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e50c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f61177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e50c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51342/0 (socket says 172.21.15.120:51342) 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f61177fe640 1 -- 172.21.15.120:0/1952621940 learned_addr learned my addr 172.21.15.120:0/1952621940 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f6117fff640 1 --2- 172.21.15.120:0/1952621940 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e0fe590 0x55f41e4ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f6116ffd640 1 --2- 172.21.15.120:0/1952621940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0f63b0 0x55f41e4eee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f60fffff640 1 -- 172.21.15.120:0/550983415 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6108089fd0 con 0x7f61000039e0 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f61177fe640 1 -- 172.21.15.120:0/1952621940 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e0fe590 msgr2=0x55f41e4ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f61177fe640 1 --2- 172.21.15.120:0/1952621940 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e0fe590 0x55f41e4ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f61177fe640 1 -- 172.21.15.120:0/1952621940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0f63b0 msgr2=0x55f41e4eee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f61177fe640 1 --2- 172.21.15.120:0/1952621940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0f63b0 0x55f41e4eee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f61177fe640 1 -- 172.21.15.120:0/1952621940 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f41e3b6360 con 0x55f41e11f270 2024-07-27T03:09:29.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f61177fe640 1 --2- 172.21.15.120:0/1952621940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e50c170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f61080813d0 tx=0x7f6108081790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a15d20d150d10 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.939+0000 7f60fd7fa640 1 -- 172.21.15.120:0/1952621940 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108086e60 con 0x55f41e11f270 2024-07-27T03:09:29.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.940+0000 7f60fd7fa640 1 -- 172.21.15.120:0/1952621940 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f610802f020 con 0x55f41e11f270 2024-07-27T03:09:29.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.940+0000 7f60fd7fa640 1 -- 172.21.15.120:0/1952621940 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108080930 con 0x55f41e11f270 2024-07-27T03:09:29.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.940+0000 7f612498c740 1 -- 172.21.15.120:0/1952621940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 msgr2=0x55f41e50c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.940+0000 7f612498c740 1 --2- 172.21.15.120:0/1952621940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e50c170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f61080813d0 tx=0x7f6108081790 comp rx=0 tx=0).stop 2024-07-27T03:09:29.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.940+0000 7f612498c740 1 -- 172.21.15.120:0/1952621940 shutdown_connections 2024-07-27T03:09:29.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.940+0000 7f612498c740 1 --2- 172.21.15.120:0/1952621940 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e0fe590 0x55f41e4ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.940+0000 7f612498c740 1 --2- 172.21.15.120:0/1952621940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0f63b0 0x55f41e4eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.940+0000 7f612498c740 1 --2- 172.21.15.120:0/1952621940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e50c170 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.940+0000 7f612498c740 1 -- 172.21.15.120:0/1952621940 >> 172.21.15.120:0/1952621940 conn(0x55f41e1133c0 msgr2=0x55f41e4c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.940+0000 7f612498c740 1 -- 172.21.15.120:0/1952621940 shutdown_connections 2024-07-27T03:09:29.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.941+0000 7f612498c740 1 -- 172.21.15.120:0/1952621940 wait complete. 2024-07-27T03:09:29.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.941+0000 7f612498c740 1 -- start start 2024-07-27T03:09:29.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.941+0000 7f612498c740 1 Processor -- start 2024-07-27T03:09:29.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f612498c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4e7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f612498c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4e7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f612498c740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e11f270 0x55f41e4d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f612498c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f41e199620 con 0x55f41e0f63b0 2024-07-27T03:09:29.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f612498c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f41e3c2140 con 0x55f41e0fe590 2024-07-27T03:09:29.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f612498c740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55f41e426860 con 0x55f41e11f270 2024-07-27T03:09:29.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f612498c740 10 client.0 _ll_register_callbacks cb 0x55f41e41fc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f61177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f61177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4e7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51344/0 (socket says 172.21.15.120:51344) 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f61177fe640 1 -- 172.21.15.120:0/1738503091 learned_addr learned my addr 172.21.15.120:0/1738503091 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f6116ffd640 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4e7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f6117fff640 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e11f270 0x55f41e4d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f61177fe640 1 -- 172.21.15.120:0/1738503091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e11f270 msgr2=0x55f41e4d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f61177fe640 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e11f270 0x55f41e4d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f61177fe640 1 -- 172.21.15.120:0/1738503091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 msgr2=0x55f41e4e7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f61177fe640 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4e7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f61177fe640 1 -- 172.21.15.120:0/1738503091 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f41e18a850 con 0x55f41e0f63b0 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f6116ffd640 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4e7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f6117fff640 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e11f270 0x55f41e4d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f61177fe640 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4e7590 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6108002230 tx=0x7f6108088280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd3dbdafec16d2f server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f60f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f60f67fc640 1 -- 172.21.15.120:0/1738503091 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108086e60 con 0x55f41e0f63b0 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f60f67fc640 1 -- 172.21.15.120:0/1738503091 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6108080b40 con 0x55f41e0f63b0 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.943+0000 7f612498c740 1 -- 172.21.15.120:0/1738503091 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f610802f020 con 0x55f41e0f63b0 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f60f67fc640 1 -- 172.21.15.120:0/1738503091 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f61080811e0 con 0x55f41e0f63b0 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f612498c740 10 client.5133 fetch_fsmap learned FSMap version 22 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f612498c740 1 -- 172.21.15.120:0/1738503091 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55f41e2016b0 con 0x55f41e0f63b0 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f60f67fc640 1 -- 172.21.15.120:0/1738503091 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f610802f020 con 0x55f41e0f63b0 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f60f67fc640 1 -- 172.21.15.120:0/1738503091 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 22) ==== 3542+0+0 (secure 0 0 0) 0x7f6108096ce0 con 0x55f41e0f63b0 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f612498c740 10 client.5133 fetch_fsmap finished waiting for FSMap version 22 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f612498c740 10 client.5133 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f612498c740 20 client.5133 populate_metadata read hostname 'smithi120' 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f612498c740 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x55f41e0dde40 0x55f41e51c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f612498c740 4 client.5133 mds_command: new command op to 4860 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f612498c740 1 -- 172.21.15.120:0/1738503091 --> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f41e4392b0 con 0x55f41e0dde40 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f6116ffd640 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x55f41e0dde40 0x55f41e51c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.944+0000 7f60f67fc640 10 client.5133 ms_handle_connect on v2:172.21.15.120:6833/1949887551 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f6116ffd640 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x55f41e0dde40 0x55f41e51c610 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6412854ce7925c81 server_cookie=3d292ff8c1750b03 in_seq=0 out_seq=0 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f60f67fc640 1 -- 172.21.15.120:0/1738503091 <== mds.0 v2:172.21.15.120:6833/1949887551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f41e4392b0 con 0x55f41e0dde40 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f60f67fc640 10 client.5133 handle_command_reply: tid=0 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f612498c740 1 client.5133 shutdown 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f612498c740 1 -- 172.21.15.120:0/1738503091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 msgr2=0x55f41e4e7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f612498c740 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4e7590 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6108002230 tx=0x7f6108088280 comp rx=0 tx=0).stop 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f612498c740 1 -- 172.21.15.120:0/1738503091 shutdown_connections 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f612498c740 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x55f41e0dde40 0x55f41e51c610 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f612498c740 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e11f270 0x55f41e4d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f612498c740 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4e7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f60f67fc640 0 client.5133 ms_handle_reset on v2:172.21.15.120:6833/1949887551 2024-07-27T03:09:29.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f612498c740 1 --2- 172.21.15.120:0/1738503091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4e7590 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.945+0000 7f612498c740 1 -- 172.21.15.120:0/1738503091 >> 172.21.15.120:0/1738503091 conn(0x55f41e1133c0 msgr2=0x55f41e4be760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.946+0000 7f612498c740 1 -- 172.21.15.120:0/1738503091 shutdown_connections 2024-07-27T03:09:29.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.946+0000 7f612498c740 1 -- 172.21.15.120:0/1738503091 wait complete. 2024-07-27T03:09:29.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.946+0000 7f612498c740 20 client.5133 trim_cache size 0 max 16384 2024-07-27T03:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.964+0000 7f612498c740 1 Processor -- start 2024-07-27T03:09:29.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.964+0000 7f612498c740 1 -- start start 2024-07-27T03:09:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f612498c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f612498c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4e5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f612498c740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e11f270 0x55f41e51adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f612498c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6118200d00 con 0x55f41e0f63b0 2024-07-27T03:09:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f612498c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f61182013b0 con 0x55f41e0fe590 2024-07-27T03:09:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f612498c740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f61180b5100 con 0x55f41e11f270 2024-07-27T03:09:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f61177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f61177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51358/0 (socket says 172.21.15.120:51358) 2024-07-27T03:09:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f61177fe640 1 -- 172.21.15.120:0/2648591843 learned_addr learned my addr 172.21.15.120:0/2648591843 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f61177fe640 1 -- 172.21.15.120:0/2648591843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e11f270 msgr2=0x55f41e51adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f61177fe640 1 --2- 172.21.15.120:0/2648591843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e11f270 0x55f41e51adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f61177fe640 1 -- 172.21.15.120:0/2648591843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 msgr2=0x55f41e4e5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f61177fe640 1 --2- 172.21.15.120:0/2648591843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f61177fe640 1 -- 172.21.15.120:0/2648591843 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f41e4c23d0 con 0x55f41e0f63b0 2024-07-27T03:09:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f61177fe640 1 --2- 172.21.15.120:0/2648591843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4c5f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f610807e940 tx=0x7f61080882f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235220fe3ca02af3 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f60fcff9640 1 -- 172.21.15.120:0/2648591843 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610807dd20 con 0x55f41e0f63b0 2024-07-27T03:09:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f60fcff9640 1 -- 172.21.15.120:0/2648591843 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f610802f070 con 0x55f41e0f63b0 2024-07-27T03:09:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.966+0000 7f60fcff9640 1 -- 172.21.15.120:0/2648591843 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610807d180 con 0x55f41e0f63b0 2024-07-27T03:09:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.967+0000 7f612498c740 1 -- 172.21.15.120:0/2648591843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 msgr2=0x55f41e4c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.967+0000 7f612498c740 1 --2- 172.21.15.120:0/2648591843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4c5f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f610807e940 tx=0x7f61080882f0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.967+0000 7f612498c740 1 -- 172.21.15.120:0/2648591843 shutdown_connections 2024-07-27T03:09:29.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.967+0000 7f612498c740 1 --2- 172.21.15.120:0/2648591843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e11f270 0x55f41e51adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.967+0000 7f612498c740 1 --2- 172.21.15.120:0/2648591843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4e5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.967+0000 7f612498c740 1 --2- 172.21.15.120:0/2648591843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e0f63b0 0x55f41e4c5f30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.967+0000 7f612498c740 1 -- 172.21.15.120:0/2648591843 >> 172.21.15.120:0/2648591843 conn(0x55f41e1133c0 msgr2=0x55f41e4d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.967+0000 7f612498c740 1 -- 172.21.15.120:0/2648591843 shutdown_connections 2024-07-27T03:09:29.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.967+0000 7f612498c740 1 -- 172.21.15.120:0/2648591843 wait complete. 2024-07-27T03:09:29.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.968+0000 7f612498c740 1 -- start start 2024-07-27T03:09:29.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.968+0000 7f612498c740 1 Processor -- start 2024-07-27T03:09:29.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.969+0000 7f612498c740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e0f63b0 0x55f41e56ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.969+0000 7f612498c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4de8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.969+0000 7f612498c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e4dee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.969+0000 7f612498c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f41e2016b0 con 0x55f41e11f270 2024-07-27T03:09:29.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.969+0000 7f612498c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f41e437360 con 0x55f41e0fe590 2024-07-27T03:09:29.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.969+0000 7f612498c740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55f41e4d1630 con 0x55f41e0f63b0 2024-07-27T03:09:29.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f612498c740 10 client.0 _ll_register_callbacks cb 0x7f6108099070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f6117fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e4dee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f6117fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e4dee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51360/0 (socket says 172.21.15.120:51360) 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f6117fff640 1 -- 172.21.15.120:0/2967696179 learned_addr learned my addr 172.21.15.120:0/2967696179 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f61177fe640 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e0f63b0 0x55f41e56ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f6116ffd640 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4de8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f6117fff640 1 -- 172.21.15.120:0/2967696179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e0f63b0 msgr2=0x55f41e56ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f6117fff640 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e0f63b0 0x55f41e56ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f6117fff640 1 -- 172.21.15.120:0/2967696179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 msgr2=0x55f41e4de8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f6117fff640 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4de8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f6117fff640 1 -- 172.21.15.120:0/2967696179 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f41e4bae80 con 0x55f41e11f270 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f6116ffd640 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4de8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f61177fe640 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e0f63b0 0x55f41e56ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f6117fff640 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e4dee00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6118155cc0 tx=0x7f6110011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae1b7bc06471d3a server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:29.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f60f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f60f67fc640 1 -- 172.21.15.120:0/2967696179 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61100035f0 con 0x55f41e11f270 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f60f67fc640 1 -- 172.21.15.120:0/2967696179 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6110003790 con 0x55f41e11f270 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f612498c740 1 -- 172.21.15.120:0/2967696179 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f610802f070 con 0x55f41e11f270 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f60f67fc640 1 -- 172.21.15.120:0/2967696179 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6110025050 con 0x55f41e11f270 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f612498c740 10 client.5139 fetch_fsmap learned FSMap version 22 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.970+0000 7f612498c740 1 -- 172.21.15.120:0/2967696179 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55f41e56f250 con 0x55f41e11f270 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f60f67fc640 1 -- 172.21.15.120:0/2967696179 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f610802f070 con 0x55f41e11f270 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f60f67fc640 1 -- 172.21.15.120:0/2967696179 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 22) ==== 3542+0+0 (secure 0 0 0) 0x7f6110028020 con 0x55f41e11f270 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f612498c740 10 client.5139 fetch_fsmap finished waiting for FSMap version 22 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f612498c740 10 client.5139 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f612498c740 20 client.5139 populate_metadata read hostname 'smithi120' 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f612498c740 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x55f41e4bf220 0x55f41e589180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:29.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f612498c740 4 client.5139 mds_command: new command op to 4860 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f612498c740 1 -- 172.21.15.120:0/2967696179 --> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] -- command(tid 0: {"prefix": "status"}) -- 0x55f41e434d50 con 0x55f41e4bf220 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f61177fe640 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x55f41e4bf220 0x55f41e589180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f60f67fc640 10 client.5139 ms_handle_connect on v2:172.21.15.120:6833/1949887551 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f61177fe640 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x55f41e4bf220 0x55f41e589180 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afc293fe5ffcc48b server_cookie=fe124a57cd585c30 in_seq=0 out_seq=0 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f60f67fc640 1 -- 172.21.15.120:0/2967696179 <== mds.0 v2:172.21.15.120:6833/1949887551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55f41e434d50 con 0x55f41e4bf220 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f60f67fc640 10 client.5139 handle_command_reply: tid=0 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f612498c740 1 client.5139 shutdown 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f612498c740 1 -- 172.21.15.120:0/2967696179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 msgr2=0x55f41e4dee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.971+0000 7f612498c740 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e4dee00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6118155cc0 tx=0x7f6110011b00 comp rx=0 tx=0).stop 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f612498c740 1 -- 172.21.15.120:0/2967696179 shutdown_connections 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f612498c740 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.120:6833/1949887551,v1:172.21.15.120:6835/1949887551] conn(0x55f41e4bf220 0x55f41e589180 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f612498c740 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f41e11f270 0x55f41e4dee00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f612498c740 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f41e0fe590 0x55f41e4de8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f60f67fc640 0 client.5139 ms_handle_reset on v2:172.21.15.120:6833/1949887551 2024-07-27T03:09:29.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f612498c740 1 --2- 172.21.15.120:0/2967696179 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f41e0f63b0 0x55f41e56ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f612498c740 1 -- 172.21.15.120:0/2967696179 >> 172.21.15.120:0/2967696179 conn(0x55f41e1133c0 msgr2=0x55f41e4c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f612498c740 1 -- 172.21.15.120:0/2967696179 shutdown_connections 2024-07-27T03:09:29.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f612498c740 1 -- 172.21.15.120:0/2967696179 wait complete. 2024-07-27T03:09:29.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f612498c740 20 client.5139 trim_cache size 0 max 16384 2024-07-27T03:09:29.980 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:09:29.980 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:09:29.980 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-07-27T03:09:29.980 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4860, 2024-07-27T03:09:29.981 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:09:29.981 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:09:29.981 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:09:29.981 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 15.366219241, 2024-07-27T03:09:29.981 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 22, 2024-07-27T03:09:29.981 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 33, 2024-07-27T03:09:29.981 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 33, 2024-07-27T03:09:29.981 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 22.259638531 2024-07-27T03:09:29.981 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:09:29.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 -- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6104077010 msgr2=0x7f6104079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6104077010 0x7f6104079520 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f61180cc540 tx=0x7f610c0060d0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 -- 172.21.15.120:0/550983415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61000039e0 msgr2=0x7f6118073640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:29.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61000039e0 0x7f6118073640 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f610800c6d0 tx=0x7f6108004c10 comp rx=0 tx=0).stop 2024-07-27T03:09:29.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 -- 172.21.15.120:0/550983415 shutdown_connections 2024-07-27T03:09:29.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6104077010 0x7f6104079520 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61181f4d20 0x7f61181f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61181f8f20 0x7f61180b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 --2- 172.21.15.120:0/550983415 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61000039e0 0x7f6118073640 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:29.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 -- 172.21.15.120:0/550983415 >> 172.21.15.120:0/550983415 conn(0x7f611806cba0 msgr2=0x7f6118159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:29.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 -- 172.21.15.120:0/550983415 shutdown_connections 2024-07-27T03:09:29.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:29.972+0000 7f611da75640 1 -- 172.21.15.120:0/550983415 wait complete. 2024-07-27T03:09:29.986 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:30.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.096+0000 7fe96fb98640 1 -- 172.21.15.120:0/3576934041 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe96815c220 msgr2=0x7fe968152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:30.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.096+0000 7fe96fb98640 1 --2- 172.21.15.120:0/3576934041 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe96815c220 0x7fe968152160 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe964005fd0 tx=0x7fe96402a5c0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.096+0000 7fe96fb98640 1 -- 172.21.15.120:0/3576934041 shutdown_connections 2024-07-27T03:09:30.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.096+0000 7fe96fb98640 1 --2- 172.21.15.120:0/3576934041 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe96815ec20 0x7fe96815f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.096+0000 7fe96fb98640 1 --2- 172.21.15.120:0/3576934041 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe96815c220 0x7fe968152160 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.096+0000 7fe96fb98640 1 -- 172.21.15.120:0/3576934041 >> 172.21.15.120:0/3576934041 conn(0x7fe96806cba0 msgr2=0x7fe96806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:30.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.096+0000 7fe96fb98640 1 -- 172.21.15.120:0/3576934041 shutdown_connections 2024-07-27T03:09:30.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.096+0000 7fe96fb98640 1 -- 172.21.15.120:0/3576934041 wait complete. 2024-07-27T03:09:30.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.098+0000 7fe96fb98640 1 Processor -- start 2024-07-27T03:09:30.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.098+0000 7fe96fb98640 1 -- start start 2024-07-27T03:09:30.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.099+0000 7fe96fb98640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9680b5cd0 0x7fe968143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:30.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.099+0000 7fe96fb98640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96815c220 0x7fe96814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:30.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.099+0000 7fe96fb98640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe96815ec20 0x7fe968150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:30.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.099+0000 7fe96fb98640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe9680cdbc0 con 0x7fe9680b5cd0 2024-07-27T03:09:30.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.099+0000 7fe96fb98640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9680cda40 con 0x7fe96815c220 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.099+0000 7fe96fb98640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe9680cdd40 con 0x7fe96815ec20 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.099+0000 7fe96d934640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9680b5cd0 0x7fe968143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.099+0000 7fe96d934640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9680b5cd0 0x7fe968143e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51380/0 (socket says 172.21.15.120:51380) 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.099+0000 7fe96d934640 1 -- 172.21.15.120:0/544110572 learned_addr learned my addr 172.21.15.120:0/544110572 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.099+0000 7fe96e135640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe96815ec20 0x7fe968150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.099+0000 7fe96d133640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96815c220 0x7fe96814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe96d934640 1 -- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe96815ec20 msgr2=0x7fe968150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe96d934640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe96815ec20 0x7fe968150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe96d934640 1 -- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96815c220 msgr2=0x7fe96814f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe96d934640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96815c220 0x7fe96814f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe96d934640 1 -- 172.21.15.120:0/544110572 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe968159f80 con 0x7fe9680b5cd0 2024-07-27T03:09:30.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe96d133640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96815c220 0x7fe96814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe96d934640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9680b5cd0 0x7fe968143e50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe964034040 tx=0x7fe9640038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe95e7fc640 1 -- 172.21.15.120:0/544110572 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96403e030 con 0x7fe9680b5cd0 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe95e7fc640 1 -- 172.21.15.120:0/544110572 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe964003d90 con 0x7fe9680b5cd0 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe95e7fc640 1 -- 172.21.15.120:0/544110572 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964035040 con 0x7fe9680b5cd0 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe96fb98640 1 -- 172.21.15.120:0/544110572 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe96815a260 con 0x7fe9680b5cd0 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.100+0000 7fe96fb98640 1 -- 172.21.15.120:0/544110572 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe96815a820 con 0x7fe9680b5cd0 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.101+0000 7fe96fb98640 1 -- 172.21.15.120:0/544110572 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9680ce260 con 0x7fe9680b5cd0 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.101+0000 7fe95e7fc640 1 -- 172.21.15.120:0/544110572 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe964041030 con 0x7fe9680b5cd0 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.102+0000 7fe95e7fc640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe94c077040 0x7fe94c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.102+0000 7fe95e7fc640 1 -- 172.21.15.120:0/544110572 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe9640b91e0 con 0x7fe9680b5cd0 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.102+0000 7fe96d133640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe94c077040 0x7fe94c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:30.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.103+0000 7fe96d133640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe94c077040 0x7fe94c079550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe968155830 tx=0x7fe958009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:30.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.106+0000 7fe95e7fc640 1 -- 172.21.15.120:0/544110572 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fe964081e20 con 0x7fe9680b5cd0 2024-07-27T03:09:30.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.326+0000 7fe96fb98640 1 -- 172.21.15.120:0/544110572 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9680ccca0 con 0x7fe9680b5cd0 2024-07-27T03:09:30.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.326+0000 7fe95e7fc640 1 -- 172.21.15.120:0/544110572 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5270 (secure 0 0 0) 0x7fe964086370 con 0x7fe9680b5cd0 2024-07-27T03:09:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:30.329 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"btime":"2024-07-27T03:09:28:925811+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2961373787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2961373787},{"type":"v1","addr":"172.21.15.121:6836","nonce":2961373787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:09:13.964247+0000","modified":"2024-07-27T03:09:28.925805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4860,"mds_1":4857,"mds_2":4640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4640":{"gid":4640,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6837/3538993507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3538993507},{"type":"v1","addr":"172.21.15.121:6837","nonce":3538993507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4857":{"gid":4857,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/503930696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":503930696},{"type":"v1","addr":"172.21.15.120:6834","nonce":503930696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4860":{"gid":4860,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/1949887551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":1949887551},{"type":"v1","addr":"172.21.15.120:6835","nonce":1949887551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4860,"qdb_cluster":[4640,4857,4860]},"id":2}]} 2024-07-27T03:09:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 22 2024-07-27T03:09:30.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 -- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe94c077040 msgr2=0x7fe94c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:30.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe94c077040 0x7fe94c079550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe968155830 tx=0x7fe958009040 comp rx=0 tx=0).stop 2024-07-27T03:09:30.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 -- 172.21.15.120:0/544110572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9680b5cd0 msgr2=0x7fe968143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:30.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9680b5cd0 0x7fe968143e50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe964034040 tx=0x7fe9640038a0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 -- 172.21.15.120:0/544110572 shutdown_connections 2024-07-27T03:09:30.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe94c077040 0x7fe94c079550 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe96815ec20 0x7fe968150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96815c220 0x7fe96814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 --2- 172.21.15.120:0/544110572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9680b5cd0 0x7fe968143e50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 -- 172.21.15.120:0/544110572 >> 172.21.15.120:0/544110572 conn(0x7fe96806cba0 msgr2=0x7fe9680b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 -- 172.21.15.120:0/544110572 shutdown_connections 2024-07-27T03:09:30.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.328+0000 7fe96fb98640 1 -- 172.21.15.120:0/544110572 wait complete. 2024-07-27T03:09:30.343 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs balance_automate true 2024-07-27T03:09:30.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.457+0000 7effb7a05640 1 -- 172.21.15.120:0/1650592608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effb015f3f0 msgr2=0x7effb0072450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:30.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.457+0000 7effb7a05640 1 --2- 172.21.15.120:0/1650592608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effb015f3f0 0x7effb0072450 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7effa8005fd0 tx=0x7effa802a840 comp rx=0 tx=0).stop 2024-07-27T03:09:30.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.457+0000 7effb7a05640 1 -- 172.21.15.120:0/1650592608 shutdown_connections 2024-07-27T03:09:30.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.457+0000 7effb7a05640 1 --2- 172.21.15.120:0/1650592608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effb015f3f0 0x7effb0072450 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.457+0000 7effb7a05640 1 --2- 172.21.15.120:0/1650592608 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7effb0152210 0x7effb006e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.457+0000 7effb7a05640 1 -- 172.21.15.120:0/1650592608 >> 172.21.15.120:0/1650592608 conn(0x7effb00cfdf0 msgr2=0x7effb00d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:30.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.457+0000 7effb7a05640 1 -- 172.21.15.120:0/1650592608 shutdown_connections 2024-07-27T03:09:30.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.457+0000 7effb7a05640 1 -- 172.21.15.120:0/1650592608 wait complete. 2024-07-27T03:09:30.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.459+0000 7effb7a05640 1 Processor -- start 2024-07-27T03:09:30.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.459+0000 7effb7a05640 1 -- start start 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.460+0000 7effb7a05640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effb00701b0 0x7effb0142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.460+0000 7effb7a05640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effb0152210 0x7effb00b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.460+0000 7effb7a05640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7effb01427a0 0x7effb00b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.460+0000 7effb7a05640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7effb0072d20 con 0x7effb0152210 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.460+0000 7effb7a05640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7effb0072ba0 con 0x7effb00701b0 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.460+0000 7effb7a05640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7effb0072ea0 con 0x7effb01427a0 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb4fa0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effb0152210 0x7effb00b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb4fa0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effb0152210 0x7effb00b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51388/0 (socket says 172.21.15.120:51388) 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb4fa0640 1 -- 172.21.15.120:0/196157436 learned_addr learned my addr 172.21.15.120:0/196157436 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb5fa2640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7effb01427a0 0x7effb00b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb57a1640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effb00701b0 0x7effb0142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb4fa0640 1 -- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7effb01427a0 msgr2=0x7effb00b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb4fa0640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7effb01427a0 0x7effb00b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb4fa0640 1 -- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effb00701b0 msgr2=0x7effb0142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb4fa0640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effb00701b0 0x7effb0142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb4fa0640 1 -- 172.21.15.120:0/196157436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb00b1ea0 con 0x7effb0152210 2024-07-27T03:09:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb4fa0640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effb0152210 0x7effb00b2670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7effa000c3c0 tx=0x7effa000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effa5ffb640 1 -- 172.21.15.120:0/196157436 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0017070 con 0x7effb0152210 2024-07-27T03:09:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effa5ffb640 1 -- 172.21.15.120:0/196157436 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effa00035f0 con 0x7effb0152210 2024-07-27T03:09:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effa5ffb640 1 -- 172.21.15.120:0/196157436 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0003a40 con 0x7effb0152210 2024-07-27T03:09:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb7a05640 1 -- 172.21.15.120:0/196157436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb00b2180 con 0x7effb0152210 2024-07-27T03:09:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.461+0000 7effb7a05640 1 -- 172.21.15.120:0/196157436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb0150800 con 0x7effb0152210 2024-07-27T03:09:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.462+0000 7effb7a05640 1 -- 172.21.15.120:0/196157436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb0073370 con 0x7effb0152210 2024-07-27T03:09:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.463+0000 7effa5ffb640 1 -- 172.21.15.120:0/196157436 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7effa001a070 con 0x7effb0152210 2024-07-27T03:09:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.463+0000 7effa5ffb640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7eff94077010 0x7eff94079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.463+0000 7effa5ffb640 1 -- 172.21.15.120:0/196157436 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7effa0097a00 con 0x7effb0152210 2024-07-27T03:09:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.464+0000 7effb57a1640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7eff94077010 0x7eff94079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:30.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.464+0000 7effb57a1640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7eff94077010 0x7eff94079520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7effac004630 tx=0x7effac00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.468+0000 7effa5ffb640 1 -- 172.21.15.120:0/196157436 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7effa0060670 con 0x7effb0152210 2024-07-27T03:09:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.692+0000 7effb7a05640 1 -- 172.21.15.120:0/196157436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7effb015c340 con 0x7effb0152210 2024-07-27T03:09:30.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.942+0000 7effa5ffb640 1 -- 172.21.15.120:0/196157436 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v23) ==== 117+0+0 (secure 0 0 0) 0x7effa0064bc0 con 0x7effb0152210 2024-07-27T03:09:30.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.944+0000 7effb7a05640 1 -- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7eff94077010 msgr2=0x7eff94079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:30.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.944+0000 7effb7a05640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7eff94077010 0x7eff94079520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7effac004630 tx=0x7effac00b2e0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.944+0000 7effb7a05640 1 -- 172.21.15.120:0/196157436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effb0152210 msgr2=0x7effb00b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:30.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.944+0000 7effb7a05640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effb0152210 0x7effb00b2670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7effa000c3c0 tx=0x7effa000c880 comp rx=0 tx=0).stop 2024-07-27T03:09:30.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.944+0000 7effb7a05640 1 -- 172.21.15.120:0/196157436 shutdown_connections 2024-07-27T03:09:30.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.944+0000 7effb7a05640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7eff94077010 0x7eff94079520 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.944+0000 7effb7a05640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7effb0152210 0x7effb00b2670 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.944+0000 7effb7a05640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7effb01427a0 0x7effb00b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.944+0000 7effb7a05640 1 --2- 172.21.15.120:0/196157436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effb00701b0 0x7effb0142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:30.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.944+0000 7effb7a05640 1 -- 172.21.15.120:0/196157436 >> 172.21.15.120:0/196157436 conn(0x7effb00cfdf0 msgr2=0x7effb014edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:30.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.944+0000 7effb7a05640 1 -- 172.21.15.120:0/196157436 shutdown_connections 2024-07-27T03:09:30.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:30.945+0000 7effb7a05640 1 -- 172.21.15.120:0/196157436 wait complete. 2024-07-27T03:09:30.959 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/a') 2024-07-27T03:09:31.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:31.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:31.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:31.021 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.bal.mask -v 1,2 1) 2024-07-27T03:09:31.047 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/0') 2024-07-27T03:09:31.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:31.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:31.146 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:31.146 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:31.163 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:09:31.163 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:09:31.163 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:09:31.163 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:31.163 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:09:31.163 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:09:31.163 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:09:31.163 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:09:31.163 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/0/file" 2024-07-27T03:09:31.163 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:31.164 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:09:31.164 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:09:31.164 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:09:31.164 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:31.164 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:09:31.164 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:09:31.164 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:31.164 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:09:31.165 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:09:31.165 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:09:31.165 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:09:31.165 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:09:31.165 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:09:31.165 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:09:31.165 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:31.165 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:09:31.165 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:31.166 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:31.166 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:09:31.166 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:09:31.166 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:09:31.166 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:31.166 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:31.166 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:09:31.166 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:09:31.166 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:09:31.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:31.778 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/1') 2024-07-27T03:09:31.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:31.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:31.875 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:31.875 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:31.891 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:09:31.891 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:09:31.891 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/1/file" 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:31.892 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:09:31.893 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:31.894 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:31.894 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:09:31.894 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:09:31.894 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:09:32.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:32.470 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/2') 2024-07-27T03:09:32.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:32.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:32.567 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:32.567 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/2/file" 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:09:32.583 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:32.584 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:09:32.585 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:09:32.585 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:09:32.585 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:32.585 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:32.585 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:09:32.585 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:09:32.585 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:09:33.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:33.212 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/3') 2024-07-27T03:09:33.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:33.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:33.308 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:33.309 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:33.324 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/3/file" 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:33.325 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:33.326 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:09:33.327 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:09:33.327 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:09:33.327 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:33.327 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:33.327 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:09:33.327 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:09:33.327 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:09:33.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:33.924 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/4') 2024-07-27T03:09:34.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:34.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:34.021 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:34.021 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:34.037 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:09:34.037 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:09:34.037 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/4/file" 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:34.038 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:34.039 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:09:34.040 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:09:34.040 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:09:34.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:34.604 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/5') 2024-07-27T03:09:34.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:34.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:34.702 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:34.702 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:34.717 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:09:34.717 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:09:34.717 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:09:34.717 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:34.717 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/5/file" 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:09:34.718 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:09:34.719 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:34.720 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:34.720 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:09:34.720 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:09:34.720 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:09:35.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:35.291 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/6') 2024-07-27T03:09:35.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:35.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:35.389 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:35.389 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:35.404 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:09:35.404 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/6/file" 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:09:35.405 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:35.406 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:09:35.406 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:09:35.406 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:09:35.406 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:09:35.406 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:09:35.406 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:09:35.406 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:09:35.406 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:35.406 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:09:35.407 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:35.407 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:35.407 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:09:35.407 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:09:35.407 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:09:35.407 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:35.407 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:35.407 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:09:35.407 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:09:35.407 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:09:35.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:35.966 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/7') 2024-07-27T03:09:36.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:36.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:36.064 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:36.064 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:36.080 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:09:36.080 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:09:36.080 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:09:36.080 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:36.080 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:09:36.080 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:09:36.080 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:09:36.080 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:09:36.080 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/7/file" 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:09:36.081 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:09:36.082 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:09:36.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:36.643 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/8') 2024-07-27T03:09:36.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:36.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:36.741 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:36.741 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:36.757 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:09:36.757 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:09:36.757 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:09:36.757 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:36.757 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:09:36.757 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/8/file" 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:09:36.758 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:36.759 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:09:36.760 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:09:36.760 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:09:37.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:37.331 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/9') 2024-07-27T03:09:37.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:09:37.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:37.429 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:37.429 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:37.446 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:09:37.446 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:09:37.446 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:09:37.446 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:37.446 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:09:37.447 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:09:37.447 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:09:37.447 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:09:37.448 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/9/file" 2024-07-27T03:09:37.448 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:37.448 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:09:37.448 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:09:37.448 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:09:37.448 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:37.448 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:09:37.448 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:09:37.448 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:09:37.448 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:09:37.449 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:09:37.449 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:09:37.449 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:09:37.449 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:09:37.449 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:09:37.449 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:09:37.449 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:37.449 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:09:37.449 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:37.449 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:37.449 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:09:37.450 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:09:37.450 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:09:37.450 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:09:37.450 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:09:37.450 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:09:37.450 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:09:37.450 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:09:38.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:09:40.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:09:40.089 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:09:53.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-07-27T03:09:53.158 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"/1/7","dirfrag":"0x200000003b1","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"1,2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"0","version":"4034","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"34","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"/1/9","dirfrag":"0x2000000047b","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"/1/8","dirfrag":"0x20000000416","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-07-27T03:09:53.159 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x200000003b1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/7", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "1,2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "4034" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "34" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x2000000047b", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/9", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x20000000416", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/8", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:09:53.159 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds2", "dirfrag": "0x102", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "/1/7", "dirfrag": "0x200000003b1", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "1,2", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "0", "version": "4034", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dnwaiter": 0, "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "34", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "/1/9", "dirfrag": "0x2000000047b", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "/1/8", "dirfrag": "0x20000000416", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } } ] 2024-07-27T03:09:53.159 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-07-27T03:09:53.292 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"1,2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"4034","version":"4034","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":2}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"/1/9","dirfrag":"0x2000000047b","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"/1/8","dirfrag":"0x20000000416","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"/1/7","dirfrag":"0x200000003b1","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"15","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-07-27T03:09:53.293 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "1,2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 2 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "4034", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "4034" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x2000000047b", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/9", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x20000000416", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/8", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x200000003b1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/7", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "15" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-07-27T03:09:53.293 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "1,2", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "4034", "version": "4034", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 1, "2": 2 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "/1/9", "dirfrag": "0x2000000047b", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "/1/8", "dirfrag": "0x20000000416", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "/1/7", "dirfrag": "0x200000003b1", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "15", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } } ] 2024-07-27T03:09:53.294 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-07-27T03:09:53.417 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"1,2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"1046","version":"1046","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"34","version":"34","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1,"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:09:53.418 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "1,2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "1046", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "1046" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1, "2": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "34", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "34" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:09:53.418 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "1,2", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "1046", "version": "1046", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 1, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "34", "version": "34", "committing_version": "1", "committed_version": "1", "is_rep": true, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1, "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds0", "dirfrag": "0x100", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } } ] 2024-07-27T03:09:53.419 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-07-27T03:09:53.419 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:09:53.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:09:53.511 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-07-27T03:09:53.511 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:09:53.511 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:53.511 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:53.527 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:53.527 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:53.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-27T03:09:53.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.736+0000 7f76a29e7640 1 -- 172.21.15.120:0/2368050486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7688005350 msgr2=0x7f768800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:53.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.736+0000 7f76a29e7640 1 --2- 172.21.15.120:0/2368050486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7688005350 0x7f768800b9c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7694001dc0 tx=0x7f7688005830 comp rx=0 tx=0).stop 2024-07-27T03:09:53.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.736+0000 7f76a0f84640 1 -- 172.21.15.120:0/2368050486 reap_dead start 2024-07-27T03:09:53.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.736+0000 7f76a29e7640 1 -- 172.21.15.120:0/2368050486 shutdown_connections 2024-07-27T03:09:53.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.736+0000 7f76a29e7640 1 -- 172.21.15.120:0/2368050486 >> 172.21.15.120:0/2368050486 conn(0x7f769c0b1a10 msgr2=0x7f769c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:53.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.736+0000 7f76a29e7640 1 -- 172.21.15.120:0/2368050486 shutdown_connections 2024-07-27T03:09:53.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.736+0000 7f76a29e7640 1 -- 172.21.15.120:0/2368050486 wait complete. 2024-07-27T03:09:53.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.738+0000 7f76a29e7640 1 Processor -- start 2024-07-27T03:09:53.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.738+0000 7f76a29e7640 1 -- start start 2024-07-27T03:09:53.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.739+0000 7f76a29e7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7688005350 0x7f769c1e4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:53.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.739+0000 7f76a29e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f769c152d90 0x7f769c145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:53.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.739+0000 7f76a29e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c09cc00 0x7f769c09d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:53.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.739+0000 7f76a29e7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f769c15d5a0 con 0x7f769c152d90 2024-07-27T03:09:53.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.739+0000 7f76a29e7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f769c15d420 con 0x7f769c09cc00 2024-07-27T03:09:53.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.739+0000 7f76a29e7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f769c15d720 con 0x7f7688005350 2024-07-27T03:09:53.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.739+0000 7f769b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f769c152d90 0x7f769c145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:53.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.739+0000 7f769b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f769c152d90 0x7f769c145880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34684/0 (socket says 172.21.15.120:34684) 2024-07-27T03:09:53.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.739+0000 7f769b7fe640 1 -- 172.21.15.120:0/1915731077 learned_addr learned my addr 172.21.15.120:0/1915731077 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:53.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.739+0000 7f76a0f84640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c09cc00 0x7f769c09d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:53.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.739+0000 7f769bfff640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7688005350 0x7f769c1e4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:53.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.740+0000 7f769b7fe640 1 -- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7688005350 msgr2=0x7f769c1e4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:53.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.740+0000 7f769b7fe640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7688005350 0x7f769c1e4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:53.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.740+0000 7f769b7fe640 1 -- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c09cc00 msgr2=0x7f769c09d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:53.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.740+0000 7f769b7fe640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c09cc00 0x7f769c09d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:53.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.740+0000 7f769b7fe640 1 -- 172.21.15.120:0/1915731077 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c09d550 con 0x7f769c152d90 2024-07-27T03:09:53.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.740+0000 7f769b7fe640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f769c152d90 0x7f769c145880 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f768c010a50 tx=0x7f768c010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:53.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.740+0000 7f7698ff9640 1 -- 172.21.15.120:0/1915731077 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c00ecc0 con 0x7f769c152d90 2024-07-27T03:09:53.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.740+0000 7f7698ff9640 1 -- 172.21.15.120:0/1915731077 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f768c00ee60 con 0x7f769c152d90 2024-07-27T03:09:53.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.740+0000 7f76a29e7640 1 -- 172.21.15.120:0/1915731077 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769c1e43b0 con 0x7f769c152d90 2024-07-27T03:09:53.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.740+0000 7f7698ff9640 1 -- 172.21.15.120:0/1915731077 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c01c6e0 con 0x7f769c152d90 2024-07-27T03:09:53.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.740+0000 7f76a29e7640 1 -- 172.21.15.120:0/1915731077 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769c146e10 con 0x7f769c152d90 2024-07-27T03:09:53.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.741+0000 7f76a29e7640 1 -- 172.21.15.120:0/1915731077 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f769c15a8b0 con 0x7f769c152d90 2024-07-27T03:09:53.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.742+0000 7f7698ff9640 1 -- 172.21.15.120:0/1915731077 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f768c01c880 con 0x7f769c152d90 2024-07-27T03:09:53.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.742+0000 7f7698ff9640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f767c077040 0x7f767c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:53.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.742+0000 7f7698ff9640 1 -- 172.21.15.120:0/1915731077 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f768c0997f0 con 0x7f769c152d90 2024-07-27T03:09:53.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.742+0000 7f769bfff640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f767c077040 0x7f767c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:53.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.743+0000 7f769bfff640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f767c077040 0x7f767c079550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f769c070650 tx=0x7f76840067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:53.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.747+0000 7f7698ff9640 1 -- 172.21.15.120:0/1915731077 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f769c15a8b0 con 0x7f769c152d90 2024-07-27T03:09:53.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.939+0000 7f76a29e7640 1 -- 172.21.15.120:0/1915731077 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f769c155120 con 0x7f769c152d90 2024-07-27T03:09:53.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.939+0000 7f7698ff9640 1 -- 172.21.15.120:0/1915731077 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f769c09d550 con 0x7f769c152d90 2024-07-27T03:09:53.942 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-07-27T03:09:53.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.941+0000 7f76a29e7640 1 -- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f767c077040 msgr2=0x7f767c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:53.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.941+0000 7f76a29e7640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f767c077040 0x7f767c079550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f769c070650 tx=0x7f76840067a0 comp rx=0 tx=0).stop 2024-07-27T03:09:53.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.941+0000 7f76a29e7640 1 -- 172.21.15.120:0/1915731077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f769c152d90 msgr2=0x7f769c145880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:53.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.941+0000 7f76a29e7640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f769c152d90 0x7f769c145880 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f768c010a50 tx=0x7f768c010e50 comp rx=0 tx=0).stop 2024-07-27T03:09:53.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.942+0000 7f76a29e7640 1 -- 172.21.15.120:0/1915731077 shutdown_connections 2024-07-27T03:09:53.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.942+0000 7f76a29e7640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f767c077040 0x7f767c079550 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:53.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.942+0000 7f76a29e7640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f769c152d90 0x7f769c145880 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:53.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.942+0000 7f76a29e7640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c09cc00 0x7f769c09d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:53.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.942+0000 7f76a29e7640 1 --2- 172.21.15.120:0/1915731077 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7688005350 0x7f769c1e4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:53.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.942+0000 7f76a29e7640 1 -- 172.21.15.120:0/1915731077 >> 172.21.15.120:0/1915731077 conn(0x7f769c0b1a10 msgr2=0x7f769c0b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:53.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.942+0000 7f76a29e7640 1 -- 172.21.15.120:0/1915731077 shutdown_connections 2024-07-27T03:09:53.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:53.942+0000 7f76a29e7640 1 -- 172.21.15.120:0/1915731077 wait complete. 2024-07-27T03:09:53.955 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-07-27T03:09:53.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:53.955 DEBUG:teuthology.orchestra.run.smithi120:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-07-27T03:09:54.267 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:09:54.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:09:54.267 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-07-27T03:09:54.283 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:09:54.283 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:09:54.283 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:54.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:09:54.299 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:09:54.299 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:09:54.299 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:54.340 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:09:54.340 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:09:54.340 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:09:54.341 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:09:54.355 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:09:54.356 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:54.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.492+0000 7f07316bc640 1 -- 172.21.15.120:0/3039696482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072c0d09c0 msgr2=0x7f072c0d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:54.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.492+0000 7f07316bc640 1 --2- 172.21.15.120:0/3039696482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072c0d09c0 0x7f072c0d0dd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f072c0b6b50 tx=0x7f072402aa30 comp rx=0 tx=0).stop 2024-07-27T03:09:54.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.492+0000 7f07316bc640 1 -- 172.21.15.120:0/3039696482 shutdown_connections 2024-07-27T03:09:54.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.492+0000 7f07316bc640 1 --2- 172.21.15.120:0/3039696482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072c0d09c0 0x7f072c0d0dd0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.492+0000 7f07316bc640 1 --2- 172.21.15.120:0/3039696482 >> v2:172.21.15.121:3300/0 conn(0x7f072c0d27e0 0x7f072c0d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.492+0000 7f07316bc640 1 --2- 172.21.15.120:0/3039696482 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f072c0b4740 0x7f072c0b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.492+0000 7f07316bc640 1 -- 172.21.15.120:0/3039696482 >> 172.21.15.120:0/3039696482 conn(0x7f072c08d690 msgr2=0x7f072c09d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:54.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.492+0000 7f07316bc640 1 -- 172.21.15.120:0/3039696482 shutdown_connections 2024-07-27T03:09:54.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.492+0000 7f07316bc640 1 -- 172.21.15.120:0/3039696482 wait complete. 2024-07-27T03:09:54.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.494+0000 7f07316bc640 1 Processor -- start 2024-07-27T03:09:54.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.494+0000 7f07316bc640 1 -- start start 2024-07-27T03:09:54.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f07316bc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072c0b4740 0x7f072c159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:54.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f07316bc640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f072c0d09c0 0x7f072c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:54.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f07316bc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f072c0d27e0 0x7f072c0b7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:54.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f07316bc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f072c0ced60 con 0x7f072c0b4740 2024-07-27T03:09:54.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f07316bc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f072c0cebe0 con 0x7f072c0d27e0 2024-07-27T03:09:54.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f07316bc640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f072c0ceee0 con 0x7f072c0d09c0 2024-07-27T03:09:54.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f072affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072c0b4740 0x7f072c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:54.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f072affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072c0b4740 0x7f072c159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34690/0 (socket says 172.21.15.120:34690) 2024-07-27T03:09:54.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f072affd640 1 -- 172.21.15.120:0/2936644739 learned_addr learned my addr 172.21.15.120:0/2936644739 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:54.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f072a7fc640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f072c0d09c0 0x7f072c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:54.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f072b7fe640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f072c0d27e0 0x7f072c0b7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:54.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f072affd640 1 -- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f072c0d09c0 msgr2=0x7f072c0b7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:54.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f072affd640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f072c0d09c0 0x7f072c0b7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f072affd640 1 -- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f072c0d27e0 msgr2=0x7f072c0b7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:54.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f072affd640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f072c0d27e0 0x7f072c0b7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.495+0000 7f072affd640 1 -- 172.21.15.120:0/2936644739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072c0a1c20 con 0x7f072c0b4740 2024-07-27T03:09:54.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.496+0000 7f072affd640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072c0b4740 0x7f072c159270 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f071c00e7f0 tx=0x7f071c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:54.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.496+0000 7f07137fe640 1 -- 172.21.15.120:0/2936644739 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c00eea0 con 0x7f072c0b4740 2024-07-27T03:09:54.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.496+0000 7f07137fe640 1 -- 172.21.15.120:0/2936644739 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f071c00cc60 con 0x7f072c0b4740 2024-07-27T03:09:54.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.496+0000 7f07316bc640 1 -- 172.21.15.120:0/2936644739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072c15cce0 con 0x7f072c0b4740 2024-07-27T03:09:54.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.496+0000 7f07137fe640 1 -- 172.21.15.120:0/2936644739 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c005020 con 0x7f072c0b4740 2024-07-27T03:09:54.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.496+0000 7f07316bc640 1 -- 172.21.15.120:0/2936644739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072c0a18b0 con 0x7f072c0b4740 2024-07-27T03:09:54.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.497+0000 7f07316bc640 1 -- 172.21.15.120:0/2936644739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072c0d0580 con 0x7f072c0b4740 2024-07-27T03:09:54.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.497+0000 7f07137fe640 1 -- 172.21.15.120:0/2936644739 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f071c0051c0 con 0x7f072c0b4740 2024-07-27T03:09:54.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.498+0000 7f07137fe640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0718077010 0x7f0718079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:54.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.498+0000 7f07137fe640 1 -- 172.21.15.120:0/2936644739 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f071c098f90 con 0x7f072c0b4740 2024-07-27T03:09:54.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.498+0000 7f072a7fc640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0718077010 0x7f0718079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:54.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.499+0000 7f072a7fc640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0718077010 0x7f0718079520 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f072c15e9e0 tx=0x7f0720005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:54.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.502+0000 7f07137fe640 1 -- 172.21.15.120:0/2936644739 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f071c061bd0 con 0x7f072c0b4740 2024-07-27T03:09:54.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.727+0000 7f07316bc640 1 -- 172.21.15.120:0/2936644739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f072c0b3000 con 0x7f072c0b4740 2024-07-27T03:09:54.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.728+0000 7f07137fe640 1 -- 172.21.15.120:0/2936644739 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5272 (secure 0 0 0) 0x7f071c066120 con 0x7f072c0b4740 2024-07-27T03:09:54.731 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:54.731 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"btime":"2024-07-27T03:09:52:976689+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2961373787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2961373787},{"type":"v1","addr":"172.21.15.121:6836","nonce":2961373787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:09:13.964247+0000","modified":"2024-07-27T03:09:52.715414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4860,"mds_1":4857,"mds_2":4640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4640":{"gid":4640,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6837/3538993507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3538993507},{"type":"v1","addr":"172.21.15.121:6837","nonce":3538993507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4857":{"gid":4857,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/503930696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":503930696},{"type":"v1","addr":"172.21.15.120:6834","nonce":503930696}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4860":{"gid":4860,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/1949887551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":1949887551},{"type":"v1","addr":"172.21.15.120:6835","nonce":1949887551}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4860,"qdb_cluster":[4860,4857,4640]},"id":2}]} 2024-07-27T03:09:54.731 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2024-07-27T03:09:54.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 -- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0718077010 msgr2=0x7f0718079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:54.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0718077010 0x7f0718079520 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f072c15e9e0 tx=0x7f0720005f90 comp rx=0 tx=0).stop 2024-07-27T03:09:54.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 -- 172.21.15.120:0/2936644739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072c0b4740 msgr2=0x7f072c159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:54.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072c0b4740 0x7f072c159270 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f071c00e7f0 tx=0x7f071c00ecb0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 -- 172.21.15.120:0/2936644739 shutdown_connections 2024-07-27T03:09:54.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0718077010 0x7f0718079520 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f072c0d27e0 0x7f072c0b7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f072c0d09c0 0x7f072c0b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 --2- 172.21.15.120:0/2936644739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f072c0b4740 0x7f072c159270 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 -- 172.21.15.120:0/2936644739 >> 172.21.15.120:0/2936644739 conn(0x7f072c08d690 msgr2=0x7f072c0b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:54.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 -- 172.21.15.120:0/2936644739 shutdown_connections 2024-07-27T03:09:54.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.730+0000 7f07316bc640 1 -- 172.21.15.120:0/2936644739 wait complete. 2024-07-27T03:09:54.744 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:54.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.854+0000 7f1798667640 1 -- 172.21.15.120:0/3424863061 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17900729b0 msgr2=0x7f17900acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:54.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.854+0000 7f1798667640 1 --2- 172.21.15.120:0/3424863061 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17900729b0 0x7f17900acd60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1790076460 tx=0x7f178c02a4a0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.855+0000 7f1798667640 1 -- 172.21.15.120:0/3424863061 shutdown_connections 2024-07-27T03:09:54.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.855+0000 7f1798667640 1 --2- 172.21.15.120:0/3424863061 >> v2:172.21.15.121:3300/0 conn(0x7f17900aeb10 0x7f17900aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.855+0000 7f1798667640 1 --2- 172.21.15.120:0/3424863061 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17900729b0 0x7f17900acd60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.855+0000 7f1798667640 1 -- 172.21.15.120:0/3424863061 >> 172.21.15.120:0/3424863061 conn(0x7f17900b1a10 msgr2=0x7f17900b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:54.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.855+0000 7f1798667640 1 -- 172.21.15.120:0/3424863061 shutdown_connections 2024-07-27T03:09:54.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.855+0000 7f1798667640 1 -- 172.21.15.120:0/3424863061 wait complete. 2024-07-27T03:09:54.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.856+0000 7f1798667640 1 Processor -- start 2024-07-27T03:09:54.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.856+0000 7f1798667640 1 -- start start 2024-07-27T03:09:54.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1798667640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f17900729b0 0x7f1790143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1798667640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790072dc0 0x7f17901f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1798667640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17900aeb10 0x7f17900d0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1798667640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f179006f400 con 0x7f1790072dc0 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1798667640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f179006f280 con 0x7f17900aeb10 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1798667640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f179006f580 con 0x7f17900729b0 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1795c02640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790072dc0 0x7f17901f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1795c02640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790072dc0 0x7f17901f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34706/0 (socket says 172.21.15.120:34706) 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1795c02640 1 -- 172.21.15.120:0/744517346 learned_addr learned my addr 172.21.15.120:0/744517346 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1796c04640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17900aeb10 0x7f17900d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1796403640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f17900729b0 0x7f1790143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1795c02640 1 -- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f17900729b0 msgr2=0x7f1790143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:54.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1795c02640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f17900729b0 0x7f1790143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1795c02640 1 -- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17900aeb10 msgr2=0x7f17900d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:54.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1795c02640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17900aeb10 0x7f17900d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:54.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1795c02640 1 -- 172.21.15.120:0/744517346 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17901411a0 con 0x7f1790072dc0 2024-07-27T03:09:54.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1795c02640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790072dc0 0x7f17901f3070 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f178000c370 tx=0x7f178000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:54.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.858+0000 7f1786ffd640 1 -- 172.21.15.120:0/744517346 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780011790 con 0x7f1790072dc0 2024-07-27T03:09:54.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.859+0000 7f1786ffd640 1 -- 172.21.15.120:0/744517346 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1780017070 con 0x7f1790072dc0 2024-07-27T03:09:54.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.859+0000 7f1798667640 1 -- 172.21.15.120:0/744517346 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17901f3da0 con 0x7f1790072dc0 2024-07-27T03:09:54.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.859+0000 7f1786ffd640 1 -- 172.21.15.120:0/744517346 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780011c80 con 0x7f1790072dc0 2024-07-27T03:09:54.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.859+0000 7f1798667640 1 -- 172.21.15.120:0/744517346 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f179009aeb0 con 0x7f1790072dc0 2024-07-27T03:09:54.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.860+0000 7f1798667640 1 -- 172.21.15.120:0/744517346 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17901f3b10 con 0x7f1790072dc0 2024-07-27T03:09:54.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.860+0000 7f1786ffd640 1 -- 172.21.15.120:0/744517346 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f178001c460 con 0x7f1790072dc0 2024-07-27T03:09:54.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.861+0000 7f1786ffd640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1774077010 0x7f1774079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:54.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.861+0000 7f1786ffd640 1 -- 172.21.15.120:0/744517346 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1780098530 con 0x7f1790072dc0 2024-07-27T03:09:54.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.861+0000 7f1796403640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1774077010 0x7f1774079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:54.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.861+0000 7f1796403640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1774077010 0x7f1774079520 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f178c034000 tx=0x7f178c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:54.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:54.865+0000 7f1786ffd640 1 -- 172.21.15.120:0/744517346 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f1780061170 con 0x7f1790072dc0 2024-07-27T03:09:55.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.086+0000 7f1798667640 1 -- 172.21.15.120:0/744517346 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17900b2310 con 0x7f1790072dc0 2024-07-27T03:09:55.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.086+0000 7f1786ffd640 1 -- 172.21.15.120:0/744517346 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5272 (secure 0 0 0) 0x7f17900b2310 con 0x7f1790072dc0 2024-07-27T03:09:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:55.091 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"btime":"2024-07-27T03:09:52:976689+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2961373787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2961373787},{"type":"v1","addr":"172.21.15.121:6836","nonce":2961373787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:09:13.964247+0000","modified":"2024-07-27T03:09:52.715414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4860,"mds_1":4857,"mds_2":4640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4640":{"gid":4640,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6837/3538993507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3538993507},{"type":"v1","addr":"172.21.15.121:6837","nonce":3538993507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4857":{"gid":4857,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/503930696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":503930696},{"type":"v1","addr":"172.21.15.120:6834","nonce":503930696}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4860":{"gid":4860,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/1949887551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":1949887551},{"type":"v1","addr":"172.21.15.120:6835","nonce":1949887551}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4860,"qdb_cluster":[4860,4857,4640]},"id":2}]} 2024-07-27T03:09:55.091 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2024-07-27T03:09:55.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.088+0000 7f1798667640 1 -- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1774077010 msgr2=0x7f1774079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.088+0000 7f1798667640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1774077010 0x7f1774079520 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f178c034000 tx=0x7f178c004730 comp rx=0 tx=0).stop 2024-07-27T03:09:55.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.088+0000 7f1798667640 1 -- 172.21.15.120:0/744517346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790072dc0 msgr2=0x7f17901f3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.088+0000 7f1798667640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790072dc0 0x7f17901f3070 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f178000c370 tx=0x7f178000c830 comp rx=0 tx=0).stop 2024-07-27T03:09:55.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.088+0000 7f1798667640 1 -- 172.21.15.120:0/744517346 shutdown_connections 2024-07-27T03:09:55.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.088+0000 7f1798667640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1774077010 0x7f1774079520 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.088+0000 7f1798667640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790072dc0 0x7f17901f3070 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.088+0000 7f1798667640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17900aeb10 0x7f17900d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.088+0000 7f1798667640 1 --2- 172.21.15.120:0/744517346 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f17900729b0 0x7f1790143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.089+0000 7f1798667640 1 -- 172.21.15.120:0/744517346 >> 172.21.15.120:0/744517346 conn(0x7f17900b1a10 msgr2=0x7f17900af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:55.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.089+0000 7f1798667640 1 -- 172.21.15.120:0/744517346 shutdown_connections 2024-07-27T03:09:55.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.089+0000 7f1798667640 1 -- 172.21.15.120:0/744517346 wait complete. 2024-07-27T03:09:55.104 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:09:55.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.213+0000 7f4267576640 1 -- 172.21.15.120:0/1819639678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42600d0f00 msgr2=0x7f42600cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.213+0000 7f4267576640 1 --2- 172.21.15.120:0/1819639678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42600d0f00 0x7f42600cebe0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f42600d24d0 tx=0x7f425802a530 comp rx=0 tx=0).stop 2024-07-27T03:09:55.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.213+0000 7f4267576640 1 -- 172.21.15.120:0/1819639678 shutdown_connections 2024-07-27T03:09:55.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.213+0000 7f4267576640 1 --2- 172.21.15.120:0/1819639678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42600d0f00 0x7f42600cebe0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.213+0000 7f4267576640 1 --2- 172.21.15.120:0/1819639678 >> v2:172.21.15.121:3300/0 conn(0x7f42600b2c40 0x7f42600d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.213+0000 7f4267576640 1 -- 172.21.15.120:0/1819639678 >> 172.21.15.120:0/1819639678 conn(0x7f426008d690 msgr2=0x7f426009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:55.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.213+0000 7f4267576640 1 -- 172.21.15.120:0/1819639678 shutdown_connections 2024-07-27T03:09:55.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.213+0000 7f4267576640 1 -- 172.21.15.120:0/1819639678 wait complete. 2024-07-27T03:09:55.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.215+0000 7f4267576640 1 Processor -- start 2024-07-27T03:09:55.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.215+0000 7f4267576640 1 -- start start 2024-07-27T03:09:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.216+0000 7f4267576640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f42600b2c40 0x7f42600a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.216+0000 7f4267576640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42600b4740 0x7f42600ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.216+0000 7f4267576640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42600d0f00 0x7f42600cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.216+0000 7f4267576640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f42600b33c0 con 0x7f42600d0f00 2024-07-27T03:09:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.216+0000 7f4267576640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42600d3100 con 0x7f42600b4740 2024-07-27T03:09:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.216+0000 7f4267576640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f42600cf120 con 0x7f42600b2c40 2024-07-27T03:09:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.216+0000 7f4265b13640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42600d0f00 0x7f42600cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.216+0000 7f4265b13640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42600d0f00 0x7f42600cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34730/0 (socket says 172.21.15.120:34730) 2024-07-27T03:09:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.216+0000 7f4265b13640 1 -- 172.21.15.120:0/3474635615 learned_addr learned my addr 172.21.15.120:0/3474635615 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:55.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f4264b11640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42600b4740 0x7f42600ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f4265312640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f42600b2c40 0x7f42600a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f4265b13640 1 -- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f42600b2c40 msgr2=0x7f42600a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f4265b13640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f42600b2c40 0x7f42600a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f4265b13640 1 -- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42600b4740 msgr2=0x7f42600ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f4265b13640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42600b4740 0x7f42600ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f4265b13640 1 -- 172.21.15.120:0/3474635615 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42600cdd20 con 0x7f42600d0f00 2024-07-27T03:09:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f4265b13640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42600d0f00 0x7f42600cd4e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f425802ab20 tx=0x7f4258033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f425dffb640 1 -- 172.21.15.120:0/3474635615 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258031d60 con 0x7f42600d0f00 2024-07-27T03:09:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f425dffb640 1 -- 172.21.15.120:0/3474635615 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4258033e10 con 0x7f42600d0f00 2024-07-27T03:09:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f4267576640 1 -- 172.21.15.120:0/3474635615 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42600ce000 con 0x7f42600d0f00 2024-07-27T03:09:55.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f425dffb640 1 -- 172.21.15.120:0/3474635615 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258005280 con 0x7f42600d0f00 2024-07-27T03:09:55.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.217+0000 7f4267576640 1 -- 172.21.15.120:0/3474635615 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42600b71d0 con 0x7f42600d0f00 2024-07-27T03:09:55.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.218+0000 7f4267576640 1 -- 172.21.15.120:0/3474635615 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42600b64b0 con 0x7f42600d0f00 2024-07-27T03:09:55.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.219+0000 7f425dffb640 1 -- 172.21.15.120:0/3474635615 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4258005420 con 0x7f42600d0f00 2024-07-27T03:09:55.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.219+0000 7f425dffb640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f424c077010 0x7f424c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.220+0000 7f425dffb640 1 -- 172.21.15.120:0/3474635615 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f42580b9a30 con 0x7f42600d0f00 2024-07-27T03:09:55.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.220+0000 7f4265312640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f424c077010 0x7f424c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.220+0000 7f4265312640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f424c077010 0x7f424c079520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f42500012e0 tx=0x7f4250009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:55.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.224+0000 7f425dffb640 1 -- 172.21.15.120:0/3474635615 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f42600b64b0 con 0x7f42600d0f00 2024-07-27T03:09:55.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.407+0000 7f4267576640 1 -- 172.21.15.120:0/3474635615 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42600cda90 con 0x7f42600d0f00 2024-07-27T03:09:55.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.408+0000 7f425dffb640 1 -- 172.21.15.120:0/3474635615 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16693 (secure 0 0 0) 0x7f425803f030 con 0x7f42600d0f00 2024-07-27T03:09:55.411 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:55.412 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":33,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:09:15.605018+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:09:12.055060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-07-27T03:09:12.922493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 -- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f424c077010 msgr2=0x7f424c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f424c077010 0x7f424c079520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f42500012e0 tx=0x7f4250009040 comp rx=0 tx=0).stop 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 -- 172.21.15.120:0/3474635615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42600d0f00 msgr2=0x7f42600cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42600d0f00 0x7f42600cd4e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f425802ab20 tx=0x7f4258033c20 comp rx=0 tx=0).stop 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 -- 172.21.15.120:0/3474635615 shutdown_connections 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f424c077010 0x7f424c079520 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42600d0f00 0x7f42600cd4e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42600b4740 0x7f42600ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 --2- 172.21.15.120:0/3474635615 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f42600b2c40 0x7f42600a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 -- 172.21.15.120:0/3474635615 >> 172.21.15.120:0/3474635615 conn(0x7f426008d690 msgr2=0x7f426015d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 -- 172.21.15.120:0/3474635615 shutdown_connections 2024-07-27T03:09:55.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.410+0000 7f4267576640 1 -- 172.21.15.120:0/3474635615 wait complete. 2024-07-27T03:09:55.425 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-07-27T03:09:55.425 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:55.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.534+0000 7fe9e742b640 1 -- 172.21.15.120:0/3075869634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e00b5fe0 msgr2=0x7fe9e015e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.534+0000 7fe9e742b640 1 --2- 172.21.15.120:0/3075869634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e00b5fe0 0x7fe9e015e9c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8005fd0 tx=0x7fe9d802a820 comp rx=0 tx=0).stop 2024-07-27T03:09:55.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.534+0000 7fe9e742b640 1 -- 172.21.15.120:0/3075869634 shutdown_connections 2024-07-27T03:09:55.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.534+0000 7fe9e742b640 1 --2- 172.21.15.120:0/3075869634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e00b5fe0 0x7fe9e015e9c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.534+0000 7fe9e742b640 1 --2- 172.21.15.120:0/3075869634 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe9e00b2110 0x7fe9e00b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.534+0000 7fe9e742b640 1 -- 172.21.15.120:0/3075869634 >> 172.21.15.120:0/3075869634 conn(0x7fe9e00b3920 msgr2=0x7fe9e00b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:55.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.534+0000 7fe9e742b640 1 -- 172.21.15.120:0/3075869634 shutdown_connections 2024-07-27T03:09:55.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.534+0000 7fe9e742b640 1 -- 172.21.15.120:0/3075869634 wait complete. 2024-07-27T03:09:55.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.536+0000 7fe9e742b640 1 Processor -- start 2024-07-27T03:09:55.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.536+0000 7fe9e742b640 1 -- start start 2024-07-27T03:09:55.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.537+0000 7fe9e742b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe9e00b2110 0x7fe9e00b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.537+0000 7fe9e742b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e00b5fe0 0x7fe9e0158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.537+0000 7fe9e742b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e00d0500 0x7fe9e009bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.537+0000 7fe9e742b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e015f540 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.537+0000 7fe9e742b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e015f3c0 con 0x7fe9e00d0500 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.537+0000 7fe9e742b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e015f6c0 con 0x7fe9e00b2110 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e49c6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e00b5fe0 0x7fe9e0158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e49c6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e00b5fe0 0x7fe9e0158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34738/0 (socket says 172.21.15.120:34738) 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e49c6640 1 -- 172.21.15.120:0/1472573438 learned_addr learned my addr 172.21.15.120:0/1472573438 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e59c8640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e00d0500 0x7fe9e009bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e51c7640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe9e00b2110 0x7fe9e00b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e49c6640 1 -- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe9e00b2110 msgr2=0x7fe9e00b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e49c6640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe9e00b2110 0x7fe9e00b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e49c6640 1 -- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e00d0500 msgr2=0x7fe9e009bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e49c6640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e00d0500 0x7fe9e009bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e49c6640 1 -- 172.21.15.120:0/1472573438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e00cb9d0 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e59c8640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e00d0500 0x7fe9e009bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:09:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e49c6640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e00b5fe0 0x7fe9e0158e40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c3d0 tx=0x7fe9d000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9d5ffb640 1 -- 172.21.15.120:0/1472573438 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0017070 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9d5ffb640 1 -- 172.21.15.120:0/1472573438 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9d00053c0 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9e742b640 1 -- 172.21.15.120:0/1472573438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e00cb410 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.538+0000 7fe9d5ffb640 1 -- 172.21.15.120:0/1472573438 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0003850 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.539+0000 7fe9e742b640 1 -- 172.21.15.120:0/1472573438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e00afd60 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.540+0000 7fe9e742b640 1 -- 172.21.15.120:0/1472573438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e015fbe0 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.540+0000 7fe9d5ffb640 1 -- 172.21.15.120:0/1472573438 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe9d001a070 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.541+0000 7fe9d5ffb640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe9c4077010 0x7fe9c4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.541+0000 7fe9d5ffb640 1 -- 172.21.15.120:0/1472573438 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe9d0097b50 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.541+0000 7fe9e51c7640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe9c4077010 0x7fe9c4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.541+0000 7fe9e51c7640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe9c4077010 0x7fe9c4079520 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc005fd0 tx=0x7fe9dc009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:55.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.545+0000 7fe9d5ffb640 1 -- 172.21.15.120:0/1472573438 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fe9d0060790 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.761+0000 7fe9e742b640 1 -- 172.21.15.120:0/1472573438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9e0050a60 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.761+0000 7fe9d5ffb640 1 -- 172.21.15.120:0/1472573438 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5272 (secure 0 0 0) 0x7fe9d0064ce0 con 0x7fe9e00b5fe0 2024-07-27T03:09:55.765 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:55.765 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"btime":"2024-07-27T03:09:52:976689+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2961373787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2961373787},{"type":"v1","addr":"172.21.15.121:6836","nonce":2961373787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:09:13.964247+0000","modified":"2024-07-27T03:09:52.715414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4860,"mds_1":4857,"mds_2":4640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4640":{"gid":4640,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6837/3538993507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3538993507},{"type":"v1","addr":"172.21.15.121:6837","nonce":3538993507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4857":{"gid":4857,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/503930696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":503930696},{"type":"v1","addr":"172.21.15.120:6834","nonce":503930696}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4860":{"gid":4860,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/1949887551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":1949887551},{"type":"v1","addr":"172.21.15.120:6835","nonce":1949887551}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4860,"qdb_cluster":[4860,4857,4640]},"id":2}]} 2024-07-27T03:09:55.765 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2024-07-27T03:09:55.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 -- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe9c4077010 msgr2=0x7fe9c4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe9c4077010 0x7fe9c4079520 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc005fd0 tx=0x7fe9dc009260 comp rx=0 tx=0).stop 2024-07-27T03:09:55.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 -- 172.21.15.120:0/1472573438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e00b5fe0 msgr2=0x7fe9e0158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e00b5fe0 0x7fe9e0158e40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c3d0 tx=0x7fe9d000c7d0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 -- 172.21.15.120:0/1472573438 shutdown_connections 2024-07-27T03:09:55.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe9c4077010 0x7fe9c4079520 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9e00b5fe0 0x7fe9e0158e40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e00d0500 0x7fe9e009bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 --2- 172.21.15.120:0/1472573438 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe9e00b2110 0x7fe9e00b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 -- 172.21.15.120:0/1472573438 >> 172.21.15.120:0/1472573438 conn(0x7fe9e00b3920 msgr2=0x7fe9e00ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:55.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 -- 172.21.15.120:0/1472573438 shutdown_connections 2024-07-27T03:09:55.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.764+0000 7fe9e742b640 1 -- 172.21.15.120:0/1472573438 wait complete. 2024-07-27T03:09:55.778 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:09:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.888+0000 7f398828b640 1 -- 172.21.15.120:0/1097033937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39800ce210 msgr2=0x7f39800ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.888+0000 7f398828b640 1 --2- 172.21.15.120:0/1097033937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39800ce210 0x7f39800ce620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f39800b2470 tx=0x7f397802a4d0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.888+0000 7f398828b640 1 -- 172.21.15.120:0/1097033937 shutdown_connections 2024-07-27T03:09:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.888+0000 7f398828b640 1 --2- 172.21.15.120:0/1097033937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39800ce210 0x7f39800ce620 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.888+0000 7f398828b640 1 --2- 172.21.15.120:0/1097033937 >> v2:172.21.15.121:3300/0 conn(0x7f398015b630 0x7f398015ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.888+0000 7f398828b640 1 -- 172.21.15.120:0/1097033937 >> 172.21.15.120:0/1097033937 conn(0x7f398006cba0 msgr2=0x7f398006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:55.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.888+0000 7f398828b640 1 -- 172.21.15.120:0/1097033937 shutdown_connections 2024-07-27T03:09:55.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.888+0000 7f398828b640 1 -- 172.21.15.120:0/1097033937 wait complete. 2024-07-27T03:09:55.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.890+0000 7f398828b640 1 Processor -- start 2024-07-27T03:09:55.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.890+0000 7f398828b640 1 -- start start 2024-07-27T03:09:55.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f398828b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39800b5d90 0x7f39801f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f398828b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39800ce210 0x7f39801e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f398828b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f398015b630 0x7f39801e8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f398828b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f39800ceb60 con 0x7f39800b5d90 2024-07-27T03:09:55.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f398828b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f39801525d0 con 0x7f398015b630 2024-07-27T03:09:55.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f398828b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f39800cece0 con 0x7f39800ce210 2024-07-27T03:09:55.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f3986027640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39800b5d90 0x7f39801f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f3986027640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39800b5d90 0x7f39801f6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34744/0 (socket says 172.21.15.120:34744) 2024-07-27T03:09:55.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f3986027640 1 -- 172.21.15.120:0/2392537829 learned_addr learned my addr 172.21.15.120:0/2392537829 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f3986828640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f398015b630 0x7f39801e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f3985826640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39800ce210 0x7f39801e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f3986027640 1 -- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39800ce210 msgr2=0x7f39801e7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f3986027640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39800ce210 0x7f39801e7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f3986027640 1 -- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f398015b630 msgr2=0x7f39801e8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f3986027640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f398015b630 0x7f39801e8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f3986027640 1 -- 172.21.15.120:0/2392537829 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39801f8cc0 con 0x7f39800b5d90 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.891+0000 7f3985826640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39800ce210 0x7f39801e7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.892+0000 7f3986027640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39800b5d90 0x7f39801f6170 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f397c00ba50 tx=0x7f397c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.892+0000 7f3976ffd640 1 -- 172.21.15.120:0/2392537829 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c019070 con 0x7f39800b5d90 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.892+0000 7f3976ffd640 1 -- 172.21.15.120:0/2392537829 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f397c00cd10 con 0x7f39800b5d90 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.892+0000 7f3976ffd640 1 -- 172.21.15.120:0/2392537829 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c0146a0 con 0x7f39800b5d90 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.892+0000 7f398828b640 1 -- 172.21.15.120:0/2392537829 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398014cfb0 con 0x7f39800b5d90 2024-07-27T03:09:55.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.892+0000 7f398828b640 1 -- 172.21.15.120:0/2392537829 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39801f94a0 con 0x7f39800b5d90 2024-07-27T03:09:55.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.893+0000 7f398828b640 1 -- 172.21.15.120:0/2392537829 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39800cf260 con 0x7f39800b5d90 2024-07-27T03:09:55.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.893+0000 7f3976ffd640 1 -- 172.21.15.120:0/2392537829 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f397c01c070 con 0x7f39800b5d90 2024-07-27T03:09:55.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.894+0000 7f3976ffd640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3964077010 0x7f3964079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:55.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.894+0000 7f3976ffd640 1 -- 172.21.15.120:0/2392537829 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f397c0986d0 con 0x7f39800b5d90 2024-07-27T03:09:55.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.894+0000 7f3985826640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3964077010 0x7f3964079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:55.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.895+0000 7f3985826640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3964077010 0x7f3964079520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3980070d40 tx=0x7f3970005db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:55.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:55.898+0000 7f3976ffd640 1 -- 172.21.15.120:0/2392537829 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f397c061280 con 0x7f39800b5d90 2024-07-27T03:09:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.118+0000 7f398828b640 1 -- 172.21.15.120:0/2392537829 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f398014e750 con 0x7f39800b5d90 2024-07-27T03:09:56.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.118+0000 7f3976ffd640 1 -- 172.21.15.120:0/2392537829 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5272 (secure 0 0 0) 0x7f397c0657d0 con 0x7f39800b5d90 2024-07-27T03:09:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:56.124 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"btime":"2024-07-27T03:09:52:976689+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2961373787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2961373787},{"type":"v1","addr":"172.21.15.121:6836","nonce":2961373787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:09:13.964247+0000","modified":"2024-07-27T03:09:52.715414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4860,"mds_1":4857,"mds_2":4640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4640":{"gid":4640,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6837/3538993507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3538993507},{"type":"v1","addr":"172.21.15.121:6837","nonce":3538993507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4857":{"gid":4857,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/503930696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":503930696},{"type":"v1","addr":"172.21.15.120:6834","nonce":503930696}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4860":{"gid":4860,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/1949887551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":1949887551},{"type":"v1","addr":"172.21.15.120:6835","nonce":1949887551}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4860,"qdb_cluster":[4860,4857,4640]},"id":2}]} 2024-07-27T03:09:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2024-07-27T03:09:56.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 -- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3964077010 msgr2=0x7f3964079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3964077010 0x7f3964079520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3980070d40 tx=0x7f3970005db0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 -- 172.21.15.120:0/2392537829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39800b5d90 msgr2=0x7f39801f6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39800b5d90 0x7f39801f6170 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f397c00ba50 tx=0x7f397c00bf10 comp rx=0 tx=0).stop 2024-07-27T03:09:56.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 -- 172.21.15.120:0/2392537829 shutdown_connections 2024-07-27T03:09:56.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3964077010 0x7f3964079520 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f398015b630 0x7f39801e8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39800ce210 0x7f39801e7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 --2- 172.21.15.120:0/2392537829 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39800b5d90 0x7f39801f6170 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 -- 172.21.15.120:0/2392537829 >> 172.21.15.120:0/2392537829 conn(0x7f398006cba0 msgr2=0x7f398006ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:56.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 -- 172.21.15.120:0/2392537829 shutdown_connections 2024-07-27T03:09:56.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.120+0000 7f398828b640 1 -- 172.21.15.120:0/2392537829 wait complete. 2024-07-27T03:09:56.136 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:09:56.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.247+0000 7f8482284640 1 -- 172.21.15.120:0/1225215179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8464003a00 msgr2=0x7f8464003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.247+0000 7f8482284640 1 --2- 172.21.15.120:0/1225215179 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8464003a00 0x7f8464003e70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f846c00bb10 tx=0x7f8464005830 comp rx=0 tx=0).stop 2024-07-27T03:09:56.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.247+0000 7f8480821640 1 -- 172.21.15.120:0/1225215179 reap_dead start 2024-07-27T03:09:56.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.247+0000 7f8482284640 1 -- 172.21.15.120:0/1225215179 shutdown_connections 2024-07-27T03:09:56.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.247+0000 7f8482284640 1 -- 172.21.15.120:0/1225215179 >> 172.21.15.120:0/1225215179 conn(0x7f847c0d20a0 msgr2=0x7f847c0d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:56.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.248+0000 7f8482284640 1 -- 172.21.15.120:0/1225215179 shutdown_connections 2024-07-27T03:09:56.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.248+0000 7f8482284640 1 -- 172.21.15.120:0/1225215179 wait complete. 2024-07-27T03:09:56.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.249+0000 7f8482284640 1 Processor -- start 2024-07-27T03:09:56.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.249+0000 7f8482284640 1 -- start start 2024-07-27T03:09:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8482284640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8464003a00 0x7f847c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8482284640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f847c15e4d0 0x7f847c157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8482284640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f847c157d60 0x7f847c1f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8482284640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f847c09aa30 con 0x7f847c157d60 2024-07-27T03:09:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8482284640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f847c09abb0 con 0x7f8464003a00 2024-07-27T03:09:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8482284640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f847c09ad30 con 0x7f847c15e4d0 2024-07-27T03:09:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8480821640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f847c157d60 0x7f847c1f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8480821640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f847c157d60 0x7f847c1f32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34762/0 (socket says 172.21.15.120:34762) 2024-07-27T03:09:56.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8480821640 1 -- 172.21.15.120:0/3238546651 learned_addr learned my addr 172.21.15.120:0/3238546651 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f847bfff640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8464003a00 0x7f847c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f847b7fe640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f847c15e4d0 0x7f847c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8480821640 1 -- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f847c15e4d0 msgr2=0x7f847c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8480821640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f847c15e4d0 0x7f847c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8480821640 1 -- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8464003a00 msgr2=0x7f847c15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8480821640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8464003a00 0x7f847c15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8480821640 1 -- 172.21.15.120:0/3238546651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847c154300 con 0x7f847c157d60 2024-07-27T03:09:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8480821640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f847c157d60 0x7f847c1f32c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8474001330 tx=0x7f84740064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8478ff9640 1 -- 172.21.15.120:0/3238546651 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84740119c0 con 0x7f847c157d60 2024-07-27T03:09:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8478ff9640 1 -- 172.21.15.120:0/3238546651 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8474019070 con 0x7f847c157d60 2024-07-27T03:09:56.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8482284640 1 -- 172.21.15.120:0/3238546651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847c1545e0 con 0x7f847c157d60 2024-07-27T03:09:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.251+0000 7f8478ff9640 1 -- 172.21.15.120:0/3238546651 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474011e20 con 0x7f847c157d60 2024-07-27T03:09:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.252+0000 7f8482284640 1 -- 172.21.15.120:0/3238546651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f847c154ba0 con 0x7f847c157d60 2024-07-27T03:09:56.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.252+0000 7f8482284640 1 -- 172.21.15.120:0/3238546651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f847c15fb80 con 0x7f847c157d60 2024-07-27T03:09:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.253+0000 7f8478ff9640 1 -- 172.21.15.120:0/3238546651 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f847401e460 con 0x7f847c157d60 2024-07-27T03:09:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.254+0000 7f8478ff9640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8468077010 0x7f8468079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.254+0000 7f8478ff9640 1 -- 172.21.15.120:0/3238546651 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8474098b40 con 0x7f847c157d60 2024-07-27T03:09:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.254+0000 7f847bfff640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8468077010 0x7f8468079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.254+0000 7f847bfff640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8468077010 0x7f8468079520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f846c036000 tx=0x7f846c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:56.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.258+0000 7f8478ff9640 1 -- 172.21.15.120:0/3238546651 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f847c09b380 con 0x7f847c157d60 2024-07-27T03:09:56.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.442+0000 7f8482284640 1 -- 172.21.15.120:0/3238546651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f847c154090 con 0x7f847c157d60 2024-07-27T03:09:56.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.443+0000 7f8478ff9640 1 -- 172.21.15.120:0/3238546651 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16693 (secure 0 0 0) 0x7f8474061780 con 0x7f847c157d60 2024-07-27T03:09:56.447 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:09:56.447 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":33,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:09:15.605018+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:09:12.055060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-07-27T03:09:12.922493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:09:56.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 -- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8468077010 msgr2=0x7f8468079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8468077010 0x7f8468079520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f846c036000 tx=0x7f846c03c040 comp rx=0 tx=0).stop 2024-07-27T03:09:56.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 -- 172.21.15.120:0/3238546651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f847c157d60 msgr2=0x7f847c1f32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f847c157d60 0x7f847c1f32c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8474001330 tx=0x7f84740064f0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 -- 172.21.15.120:0/3238546651 shutdown_connections 2024-07-27T03:09:56.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8468077010 0x7f8468079520 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f847c157d60 0x7f847c1f32c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f847c15e4d0 0x7f847c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 --2- 172.21.15.120:0/3238546651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8464003a00 0x7f847c15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 -- 172.21.15.120:0/3238546651 >> 172.21.15.120:0/3238546651 conn(0x7f847c0d20a0 msgr2=0x7f847c156530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:56.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 -- 172.21.15.120:0/3238546651 shutdown_connections 2024-07-27T03:09:56.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.445+0000 7f8482284640 1 -- 172.21.15.120:0/3238546651 wait complete. 2024-07-27T03:09:56.460 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-07-27T03:09:56.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.613+0000 7f6800d88640 1 -- 172.21.15.120:0/2510563334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67fc0d0c10 msgr2=0x7f67fc0b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.613+0000 7f6800d88640 1 --2- 172.21.15.120:0/2510563334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67fc0d0c10 0x7f67fc0b2520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009830 tx=0x7f67e402a480 comp rx=0 tx=0).stop 2024-07-27T03:09:56.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.613+0000 7f6800d88640 1 -- 172.21.15.120:0/2510563334 shutdown_connections 2024-07-27T03:09:56.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.613+0000 7f6800d88640 1 --2- 172.21.15.120:0/2510563334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67fc0d0c10 0x7f67fc0b2520 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.613+0000 7f6800d88640 1 -- 172.21.15.120:0/2510563334 >> 172.21.15.120:0/2510563334 conn(0x7f67fc0b3920 msgr2=0x7f67fc0b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:56.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.613+0000 7f6800d88640 1 -- 172.21.15.120:0/2510563334 shutdown_connections 2024-07-27T03:09:56.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.613+0000 7f6800d88640 1 -- 172.21.15.120:0/2510563334 wait complete. 2024-07-27T03:09:56.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.615+0000 7f6800d88640 1 Processor -- start 2024-07-27T03:09:56.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.615+0000 7f6800d88640 1 -- start start 2024-07-27T03:09:56.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.616+0000 7f6800d88640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67fc0b2110 0x7f67fc0ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.616+0000 7f6800d88640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67fc0b5fe0 0x7f67fc1e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.616+0000 7f6800d88640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67fc1e73c0 0x7f67fc0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.616+0000 7f6800d88640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc15f730 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.616+0000 7f6800d88640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc15f5b0 con 0x7f67fc0b2110 2024-07-27T03:09:56.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.616+0000 7f6800d88640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc15f8b0 con 0x7f67fc1e73c0 2024-07-27T03:09:56.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.616+0000 7f67f1d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67fc0b5fe0 0x7f67fc1e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.616+0000 7f67f1d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67fc0b5fe0 0x7f67fc1e6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34780/0 (socket says 172.21.15.120:34780) 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.616+0000 7f67f1d9b640 1 -- 172.21.15.120:0/1312737120 learned_addr learned my addr 172.21.15.120:0/1312737120 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.616+0000 7f67fad9d640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67fc1e73c0 0x7f67fc0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.616+0000 7f67fa59c640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67fc0b2110 0x7f67fc0ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f67f1d9b640 1 -- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67fc1e73c0 msgr2=0x7f67fc0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f67f1d9b640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67fc1e73c0 0x7f67fc0ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f67f1d9b640 1 -- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67fc0b2110 msgr2=0x7f67fc0ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f67f1d9b640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67fc0b2110 0x7f67fc0ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f67f1d9b640 1 -- 172.21.15.120:0/1312737120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc0cf5c0 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f67fa59c640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67fc0b2110 0x7f67fc0ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f67f1d9b640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67fc0b5fe0 0x7f67fc1e6e80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009950 tx=0x7f67e4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f67f37fe640 1 -- 172.21.15.120:0/1312737120 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e4031d60 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f67f37fe640 1 -- 172.21.15.120:0/1312737120 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67e4033e10 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f6800d88640 1 -- 172.21.15.120:0/1312737120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67fc1f6680 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f67f37fe640 1 -- 172.21.15.120:0/1312737120 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e4005260 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.617+0000 7f6800d88640 1 -- 172.21.15.120:0/1312737120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67fc1f3b80 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.618+0000 7f6800d88640 1 -- 172.21.15.120:0/1312737120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67fc0b2520 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.619+0000 7f67f37fe640 1 -- 172.21.15.120:0/1312737120 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f67e4005400 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.619+0000 7f67f37fe640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f67dc077010 0x7f67dc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.619+0000 7f67f37fe640 1 -- 172.21.15.120:0/1312737120 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f67e40b9b40 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.619+0000 7f67fa59c640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f67dc077010 0x7f67dc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.620+0000 7f67fa59c640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f67dc077010 0x7f67dc079520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f67ec000f60 tx=0x7f67ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:56.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.624+0000 7f67f37fe640 1 -- 172.21.15.120:0/1312737120 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f67e403f030 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.844+0000 7f6800d88640 1 -- 172.21.15.120:0/1312737120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f67fc15d600 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.848 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-07-27T03:09:56.844+0000 7fd09694b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-27T03:09:56.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.846+0000 7f67f37fe640 1 -- 172.21.15.120:0/1312737120 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f67e4082dd0 con 0x7f67fc0b5fe0 2024-07-27T03:09:56.849 INFO:teuthology.orchestra.run.smithi120.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-07-27T03:09:56.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.849+0000 7f6800d88640 1 -- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f67dc077010 msgr2=0x7f67dc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.849+0000 7f6800d88640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f67dc077010 0x7f67dc079520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f67ec000f60 tx=0x7f67ec009040 comp rx=0 tx=0).stop 2024-07-27T03:09:56.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.849+0000 7f6800d88640 1 -- 172.21.15.120:0/1312737120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67fc0b5fe0 msgr2=0x7f67fc1e6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.849+0000 7f6800d88640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67fc0b5fe0 0x7f67fc1e6e80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009950 tx=0x7f67e4033c20 comp rx=0 tx=0).stop 2024-07-27T03:09:56.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.849+0000 7f6800d88640 1 -- 172.21.15.120:0/1312737120 shutdown_connections 2024-07-27T03:09:56.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.849+0000 7f6800d88640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f67dc077010 0x7f67dc079520 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.849+0000 7f6800d88640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67fc0b5fe0 0x7f67fc1e6e80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.849+0000 7f6800d88640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67fc1e73c0 0x7f67fc0ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.849+0000 7f6800d88640 1 --2- 172.21.15.120:0/1312737120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67fc0b2110 0x7f67fc0ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.849+0000 7f6800d88640 1 -- 172.21.15.120:0/1312737120 >> 172.21.15.120:0/1312737120 conn(0x7f67fc0b3920 msgr2=0x7f67fc1e8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:56.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.849+0000 7f6800d88640 1 -- 172.21.15.120:0/1312737120 shutdown_connections 2024-07-27T03:09:56.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.850+0000 7f6800d88640 1 -- 172.21.15.120:0/1312737120 wait complete. 2024-07-27T03:09:56.868 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-07-27T03:09:56.915 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-07-27T03:09:56.916 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-07-27T03:09:56.920 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-07-27T03:09:56.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.985+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3616194355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed809b140 msgr2=0x7f9ed80b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.985+0000 7f9ee05c3640 1 --2- 172.21.15.120:0/3616194355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed809b140 0x7f9ed80b7110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80cfbb0 tx=0x7f9ec802a530 comp rx=0 tx=0).stop 2024-07-27T03:09:56.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.985+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3616194355 shutdown_connections 2024-07-27T03:09:56.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.985+0000 7f9ee05c3640 1 --2- 172.21.15.120:0/3616194355 >> v2:172.21.15.121:3300/0 conn(0x7f9ed80cf4e0 0x7f9ed80b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.985+0000 7f9ee05c3640 1 --2- 172.21.15.120:0/3616194355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed809b140 0x7f9ed80b7110 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.985+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3616194355 >> 172.21.15.120:0/3616194355 conn(0x7f9ed80d20a0 msgr2=0x7f9ed80d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:56.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.986+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3616194355 shutdown_connections 2024-07-27T03:09:56.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.986+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3616194355 wait complete. 2024-07-27T03:09:56.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.987+0000 7f9ee05c3640 1 Processor -- start 2024-07-27T03:09:56.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.987+0000 7f9ee05c3640 1 -- start start 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9ee05c3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ed809b640 0x7f9ed81f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9ee05c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ed80cf4e0 0x7f9ed815a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9ee05c3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed8159db0 0x7f9ed815cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9ee05c3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed80b5a50 con 0x7f9ed8159db0 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9ee05c3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed80b58d0 con 0x7f9ed80cf4e0 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9ee05c3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed80b5bd0 con 0x7f9ed809b640 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9edeb60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed8159db0 0x7f9ed815cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9eddb5e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ed80cf4e0 0x7f9ed815a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9ede35f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ed809b640 0x7f9ed81f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9edeb60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed8159db0 0x7f9ed815cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34834/0 (socket says 172.21.15.120:34834) 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9ede35f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ed809b640 0x7f9ed81f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.120:55674/0 (socket says 172.21.15.120:55674) 2024-07-27T03:09:56.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9eddb5e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ed80cf4e0 0x7f9ed815a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.120:55998/0 (socket says 172.21.15.120:55998) 2024-07-27T03:09:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9edeb60640 1 -- 172.21.15.120:0/3521766270 learned_addr learned my addr 172.21.15.120:0/3521766270 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9edeb60640 1 -- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ed809b640 msgr2=0x7f9ed81f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9edeb60640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ed809b640 0x7f9ed81f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9edeb60640 1 -- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ed80cf4e0 msgr2=0x7f9ed815a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9edeb60640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ed80cf4e0 0x7f9ed815a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9edeb60640 1 -- 172.21.15.120:0/3521766270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed8158370 con 0x7f9ed8159db0 2024-07-27T03:09:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.989+0000 7f9edeb60640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed8159db0 0x7f9ed815cab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000cab0 tx=0x7f9ed000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:56.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.990+0000 7f9eceffd640 1 -- 172.21.15.120:0/3521766270 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0007d30 con 0x7f9ed8159db0 2024-07-27T03:09:56.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.991+0000 7f9eceffd640 1 -- 172.21.15.120:0/3521766270 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ed000f450 con 0x7f9ed8159db0 2024-07-27T03:09:56.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.991+0000 7f9eceffd640 1 -- 172.21.15.120:0/3521766270 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000f8a0 con 0x7f9ed8159db0 2024-07-27T03:09:56.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.991+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3521766270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed815ad40 con 0x7f9ed8159db0 2024-07-27T03:09:56.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.991+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3521766270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed81f3be0 con 0x7f9ed8159db0 2024-07-27T03:09:56.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.992+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3521766270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed80b60a0 con 0x7f9ed8159db0 2024-07-27T03:09:56.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.992+0000 7f9eceffd640 1 -- 172.21.15.120:0/3521766270 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9ed000fa40 con 0x7f9ed8159db0 2024-07-27T03:09:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.993+0000 7f9eceffd640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9ebc077010 0x7f9ebc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.993+0000 7f9eceffd640 1 -- 172.21.15.120:0/3521766270 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5967+0+0 (secure 0 0 0) 0x7f9ed0099320 con 0x7f9ed8159db0 2024-07-27T03:09:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.993+0000 7f9ede35f640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9ebc077010 0x7f9ebc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.993+0000 7f9ede35f640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9ebc077010 0x7f9ebc079520 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40016f0 tx=0x7f9ed4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:57.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:56.999+0000 7f9eceffd640 1 -- 172.21.15.120:0/3521766270 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f9ed0014070 con 0x7f9ed8159db0 2024-07-27T03:09:57.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.218+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3521766270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9ed80b7bd0 con 0x7f9ed8159db0 2024-07-27T03:09:57.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.847+0000 7f9eceffd640 1 -- 172.21.15.120:0/3521766270 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f9ed0061dd0 con 0x7f9ed8159db0 2024-07-27T03:09:57.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9ebc077010 msgr2=0x7f9ebc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:57.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9ebc077010 0x7f9ebc079520 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40016f0 tx=0x7f9ed4009040 comp rx=0 tx=0).stop 2024-07-27T03:09:57.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3521766270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed8159db0 msgr2=0x7f9ed815cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:57.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed8159db0 0x7f9ed815cab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000cab0 tx=0x7f9ed000cf70 comp rx=0 tx=0).stop 2024-07-27T03:09:57.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3521766270 shutdown_connections 2024-07-27T03:09:57.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9ebc077010 0x7f9ebc079520 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:57.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed8159db0 0x7f9ed815cab0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:57.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ed80cf4e0 0x7f9ed815a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:57.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 --2- 172.21.15.120:0/3521766270 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ed809b640 0x7f9ed81f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:57.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3521766270 >> 172.21.15.120:0/3521766270 conn(0x7f9ed80d20a0 msgr2=0x7f9ed815dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:57.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3521766270 shutdown_connections 2024-07-27T03:09:57.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.850+0000 7f9ee05c3640 1 -- 172.21.15.120:0/3521766270 wait complete. 2024-07-27T03:09:57.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-07-27T03:09:57.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.980+0000 7fc8b34b5640 1 -- 172.21.15.120:0/3748309375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8ac0cb410 msgr2=0x7fc8ac151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:57.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.980+0000 7fc8b34b5640 1 --2- 172.21.15.120:0/3748309375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8ac0cb410 0x7fc8ac151930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009830 tx=0x7fc8a802a480 comp rx=0 tx=0).stop 2024-07-27T03:09:57.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.980+0000 7fc8b34b5640 1 -- 172.21.15.120:0/3748309375 shutdown_connections 2024-07-27T03:09:57.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.980+0000 7fc8b34b5640 1 --2- 172.21.15.120:0/3748309375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc8ac073310 0x7fc8ac073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:57.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.980+0000 7fc8b34b5640 1 --2- 172.21.15.120:0/3748309375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8ac0cb410 0x7fc8ac151930 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:57.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.980+0000 7fc8b34b5640 1 -- 172.21.15.120:0/3748309375 >> 172.21.15.120:0/3748309375 conn(0x7fc8ac0cfd60 msgr2=0x7fc8ac0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:57.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.980+0000 7fc8b34b5640 1 -- 172.21.15.120:0/3748309375 shutdown_connections 2024-07-27T03:09:57.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.980+0000 7fc8b34b5640 1 -- 172.21.15.120:0/3748309375 wait complete. 2024-07-27T03:09:57.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.982+0000 7fc8b34b5640 1 Processor -- start 2024-07-27T03:09:57.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.982+0000 7fc8b34b5640 1 -- start start 2024-07-27T03:09:57.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.983+0000 7fc8b34b5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8ac06ec50 0x7fc8ac14cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:57.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.983+0000 7fc8b34b5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8ac073310 0x7fc8ac147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:57.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b34b5640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc8ac0cb410 0x7fc8ac15e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:57.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b34b5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac0cdcc0 con 0x7fc8ac06ec50 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b34b5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac0cdb40 con 0x7fc8ac073310 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b34b5640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc8ac0cde40 con 0x7fc8ac0cb410 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b1251640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8ac06ec50 0x7fc8ac14cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b1251640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8ac06ec50 0x7fc8ac14cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34862/0 (socket says 172.21.15.120:34862) 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b1251640 1 -- 172.21.15.120:0/1919535713 learned_addr learned my addr 172.21.15.120:0/1919535713 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b1a52640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc8ac0cb410 0x7fc8ac15e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b0a50640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8ac073310 0x7fc8ac147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b1251640 1 -- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc8ac0cb410 msgr2=0x7fc8ac15e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b1251640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc8ac0cb410 0x7fc8ac15e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b1251640 1 -- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8ac073310 msgr2=0x7fc8ac147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b1251640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8ac073310 0x7fc8ac147a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:57.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b1251640 1 -- 172.21.15.120:0/1919535713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ac14ca70 con 0x7fc8ac06ec50 2024-07-27T03:09:57.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b0a50640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8ac073310 0x7fc8ac147a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:57.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b1a52640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc8ac0cb410 0x7fc8ac15e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:57.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b1251640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8ac06ec50 0x7fc8ac14cc70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009950 tx=0x7fc8a8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:57.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8a1ffb640 1 -- 172.21.15.120:0/1919535713 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8031d60 con 0x7fc8ac06ec50 2024-07-27T03:09:57.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8a1ffb640 1 -- 172.21.15.120:0/1919535713 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8a8033e10 con 0x7fc8ac06ec50 2024-07-27T03:09:57.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8b34b5640 1 -- 172.21.15.120:0/1919535713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8ac1f2fb0 con 0x7fc8ac06ec50 2024-07-27T03:09:57.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.984+0000 7fc8a1ffb640 1 -- 172.21.15.120:0/1919535713 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8005260 con 0x7fc8ac06ec50 2024-07-27T03:09:57.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.985+0000 7fc8b34b5640 1 -- 172.21.15.120:0/1919535713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8ac0c8500 con 0x7fc8ac06ec50 2024-07-27T03:09:57.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.986+0000 7fc8b34b5640 1 -- 172.21.15.120:0/1919535713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8ac0509d0 con 0x7fc8ac06ec50 2024-07-27T03:09:57.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.986+0000 7fc8a1ffb640 1 -- 172.21.15.120:0/1919535713 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc8a8005400 con 0x7fc8ac06ec50 2024-07-27T03:09:57.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.987+0000 7fc8a1ffb640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc890077010 0x7fc890079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:57.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.987+0000 7fc8a1ffb640 1 -- 172.21.15.120:0/1919535713 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5967+0+0 (secure 0 0 0) 0x7fc8a80b9c50 con 0x7fc8ac06ec50 2024-07-27T03:09:57.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.987+0000 7fc8b0a50640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc890077010 0x7fc890079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:57.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.987+0000 7fc8b0a50640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc890077010 0x7fc890079520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac151b40 tx=0x7fc89c005f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:57.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:57.991+0000 7fc8a1ffb640 1 -- 172.21.15.120:0/1919535713 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc8ac0509d0 con 0x7fc8ac06ec50 2024-07-27T03:09:58.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:58.171+0000 7fc8b34b5640 1 -- 172.21.15.120:0/1919535713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc8ac073720 con 0x7fc8ac06ec50 2024-07-27T03:09:59.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.000+0000 7fc8a1ffb640 1 -- 172.21.15.120:0/1919535713 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7fc8a80bf020 con 0x7fc8ac06ec50 2024-07-27T03:09:59.004 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' removed 2024-07-27T03:09:59.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 -- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc890077010 msgr2=0x7fc890079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:59.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc890077010 0x7fc890079520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac151b40 tx=0x7fc89c005f10 comp rx=0 tx=0).stop 2024-07-27T03:09:59.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 -- 172.21.15.120:0/1919535713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8ac06ec50 msgr2=0x7fc8ac14cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:59.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8ac06ec50 0x7fc8ac14cc70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009950 tx=0x7fc8a8033c20 comp rx=0 tx=0).stop 2024-07-27T03:09:59.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 -- 172.21.15.120:0/1919535713 shutdown_connections 2024-07-27T03:09:59.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc890077010 0x7fc890079520 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:59.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc8ac0cb410 0x7fc8ac15e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:59.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8ac073310 0x7fc8ac147a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:59.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 --2- 172.21.15.120:0/1919535713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc8ac06ec50 0x7fc8ac14cc70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:59.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 -- 172.21.15.120:0/1919535713 >> 172.21.15.120:0/1919535713 conn(0x7fc8ac0cfd60 msgr2=0x7fc8ac0b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:59.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 -- 172.21.15.120:0/1919535713 shutdown_connections 2024-07-27T03:09:59.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.002+0000 7fc8b34b5640 1 -- 172.21.15.120:0/1919535713 wait complete. 2024-07-27T03:09:59.020 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-07-27T03:09:59.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.137+0000 7f7a53946640 1 -- 172.21.15.120:0/3690514731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a38003a50 msgr2=0x7f7a38003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:59.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.137+0000 7f7a53946640 1 --2- 172.21.15.120:0/3690514731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a38003a50 0x7f7a38003ec0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009b20 tx=0x7f7a38005830 comp rx=0 tx=0).stop 2024-07-27T03:09:59.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.137+0000 7f7a53946640 1 -- 172.21.15.120:0/3690514731 shutdown_connections 2024-07-27T03:09:59.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.137+0000 7f7a53946640 1 --2- 172.21.15.120:0/3690514731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a38003a50 0x7f7a38003ec0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:59.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.137+0000 7f7a53946640 1 -- 172.21.15.120:0/3690514731 >> 172.21.15.120:0/3690514731 conn(0x7f7a4c0d1e40 msgr2=0x7f7a4c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:09:59.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.138+0000 7f7a53946640 1 -- 172.21.15.120:0/3690514731 shutdown_connections 2024-07-27T03:09:59.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.138+0000 7f7a53946640 1 -- 172.21.15.120:0/3690514731 wait complete. 2024-07-27T03:09:59.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.139+0000 7f7a53946640 1 Processor -- start 2024-07-27T03:09:59.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.140+0000 7f7a53946640 1 -- start start 2024-07-27T03:09:59.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a53946640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a38003a50 0x7f7a4c0c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:59.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a53946640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a4c1e47e0 0x7f7a4c1e4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:59.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a53946640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c09dcb0 0x7f7a4c09e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:59.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a53946640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c0ccd20 con 0x7f7a38003a50 2024-07-27T03:09:59.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a53946640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c0d2c80 con 0x7f7a4c1e47e0 2024-07-27T03:09:59.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a53946640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4c0ccea0 con 0x7f7a4c09dcb0 2024-07-27T03:09:59.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a516e2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a38003a50 0x7f7a4c0c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:59.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a516e2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a38003a50 0x7f7a4c0c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34866/0 (socket says 172.21.15.120:34866) 2024-07-27T03:09:59.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a516e2640 1 -- 172.21.15.120:0/200863016 learned_addr learned my addr 172.21.15.120:0/200863016 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:09:59.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a50ee1640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a4c1e47e0 0x7f7a4c1e4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:59.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a51ee3640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c09dcb0 0x7f7a4c09e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:59.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a516e2640 1 -- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c09dcb0 msgr2=0x7f7a4c09e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:59.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a516e2640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c09dcb0 0x7f7a4c09e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:59.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a516e2640 1 -- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a4c1e47e0 msgr2=0x7f7a4c1e4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:09:59.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a516e2640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a4c1e47e0 0x7f7a4c1e4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:09:59.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a516e2640 1 -- 172.21.15.120:0/200863016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c0c59e0 con 0x7f7a38003a50 2024-07-27T03:09:59.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a51ee3640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c09dcb0 0x7f7a4c09e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:09:59.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.141+0000 7f7a516e2640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a38003a50 0x7f7a4c0c67a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009b20 tx=0x7f7a480336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:59.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.142+0000 7f7a41ffb640 1 -- 172.21.15.120:0/200863016 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48038040 con 0x7f7a38003a50 2024-07-27T03:09:59.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.142+0000 7f7a41ffb640 1 -- 172.21.15.120:0/200863016 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a48043070 con 0x7f7a38003a50 2024-07-27T03:09:59.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.142+0000 7f7a53946640 1 -- 172.21.15.120:0/200863016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4c0c5cc0 con 0x7f7a38003a50 2024-07-27T03:09:59.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.142+0000 7f7a41ffb640 1 -- 172.21.15.120:0/200863016 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48033c50 con 0x7f7a38003a50 2024-07-27T03:09:59.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.142+0000 7f7a53946640 1 -- 172.21.15.120:0/200863016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a4c0c6280 con 0x7f7a38003a50 2024-07-27T03:09:59.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.143+0000 7f7a53946640 1 -- 172.21.15.120:0/200863016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4c0aff90 con 0x7f7a38003a50 2024-07-27T03:09:59.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.144+0000 7f7a41ffb640 1 -- 172.21.15.120:0/200863016 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f7a4803e440 con 0x7f7a38003a50 2024-07-27T03:09:59.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.144+0000 7f7a41ffb640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7a30077010 0x7f7a30079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:09:59.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.144+0000 7f7a41ffb640 1 -- 172.21.15.120:0/200863016 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5529+0+0 (secure 0 0 0) 0x7f7a480b9270 con 0x7f7a38003a50 2024-07-27T03:09:59.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.144+0000 7f7a50ee1640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7a30077010 0x7f7a30079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:09:59.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.145+0000 7f7a50ee1640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7a30077010 0x7f7a30079520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0b7040 tx=0x7f7a3c006ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:09:59.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.148+0000 7f7a41ffb640 1 -- 172.21.15.120:0/200863016 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f7a4c0aff90 con 0x7f7a38003a50 2024-07-27T03:09:59.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:09:59.330+0000 7f7a53946640 1 -- 172.21.15.120:0/200863016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7a4c0cd390 con 0x7f7a38003a50 2024-07-27T03:10:00.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.001+0000 7f7a41ffb640 1 -- 172.21.15.120:0/200863016 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7f7a4804c020 con 0x7f7a38003a50 2024-07-27T03:10:00.005 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' removed 2024-07-27T03:10:00.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 -- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7a30077010 msgr2=0x7f7a30079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:00.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7a30077010 0x7f7a30079520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0b7040 tx=0x7f7a3c006ce0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 -- 172.21.15.120:0/200863016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a38003a50 msgr2=0x7f7a4c0c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:00.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a38003a50 0x7f7a4c0c67a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009b20 tx=0x7f7a480336f0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 -- 172.21.15.120:0/200863016 shutdown_connections 2024-07-27T03:10:00.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7a30077010 0x7f7a30079520 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a4c09dcb0 0x7f7a4c09e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a4c1e47e0 0x7f7a4c1e4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 --2- 172.21.15.120:0/200863016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a38003a50 0x7f7a4c0c67a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 -- 172.21.15.120:0/200863016 >> 172.21.15.120:0/200863016 conn(0x7f7a4c0d1e40 msgr2=0x7f7a4c0af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:00.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 -- 172.21.15.120:0/200863016 shutdown_connections 2024-07-27T03:10:00.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.004+0000 7f7a53946640 1 -- 172.21.15.120:0/200863016 wait complete. 2024-07-27T03:10:00.026 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-07-27T03:10:00.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.147+0000 7f16d2af2640 1 -- 172.21.15.120:0/3398682307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16cc0d0600 msgr2=0x7f16cc0af190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:00.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.147+0000 7f16d2af2640 1 --2- 172.21.15.120:0/3398682307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16cc0d0600 0x7f16cc0af190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0b39e0 tx=0x7f16b802a4d0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.147+0000 7f16d2af2640 1 -- 172.21.15.120:0/3398682307 shutdown_connections 2024-07-27T03:10:00.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.147+0000 7f16d2af2640 1 --2- 172.21.15.120:0/3398682307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16cc0d0600 0x7f16cc0af190 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.147+0000 7f16d2af2640 1 --2- 172.21.15.120:0/3398682307 >> v2:172.21.15.121:3300/0 conn(0x7f16cc15eb50 0x7f16cc15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.147+0000 7f16d2af2640 1 -- 172.21.15.120:0/3398682307 >> 172.21.15.120:0/3398682307 conn(0x7f16cc0d0de0 msgr2=0x7f16cc0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:00.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.147+0000 7f16d2af2640 1 -- 172.21.15.120:0/3398682307 shutdown_connections 2024-07-27T03:10:00.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.147+0000 7f16d2af2640 1 -- 172.21.15.120:0/3398682307 wait complete. 2024-07-27T03:10:00.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.149+0000 7f16d2af2640 1 Processor -- start 2024-07-27T03:10:00.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.149+0000 7f16d2af2640 1 -- start start 2024-07-27T03:10:00.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d2af2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16cc0af6d0 0x7f16cc0b6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d2af2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f16cc0d0600 0x7f16cc0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d2af2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16cc15eb50 0x7f16cc151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d2af2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc073490 con 0x7f16cc15eb50 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d2af2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc0cf920 con 0x7f16cc0af6d0 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d2af2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f16cc073610 con 0x7f16cc0d0600 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d108f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16cc15eb50 0x7f16cc151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d108f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16cc15eb50 0x7f16cc151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34876/0 (socket says 172.21.15.120:34876) 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d108f640 1 -- 172.21.15.120:0/3332958976 learned_addr learned my addr 172.21.15.120:0/3332958976 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d088e640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16cc0af6d0 0x7f16cc0b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16cbfff640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f16cc0d0600 0x7f16cc0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d108f640 1 -- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f16cc0d0600 msgr2=0x7f16cc0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d108f640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f16cc0d0600 0x7f16cc0c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d108f640 1 -- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16cc0af6d0 msgr2=0x7f16cc0b6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:00.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d108f640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16cc0af6d0 0x7f16cc0b6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d108f640 1 -- 172.21.15.120:0/3332958976 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16cc0b4640 con 0x7f16cc15eb50 2024-07-27T03:10:00.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.151+0000 7f16d108f640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16cc15eb50 0x7f16cc151db0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f16c400ba10 tx=0x7f16c400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:00.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.152+0000 7f16c97fa640 1 -- 172.21.15.120:0/3332958976 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4019070 con 0x7f16cc15eb50 2024-07-27T03:10:00.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.152+0000 7f16c97fa640 1 -- 172.21.15.120:0/3332958976 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16c400cc30 con 0x7f16cc15eb50 2024-07-27T03:10:00.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.152+0000 7f16d2af2640 1 -- 172.21.15.120:0/3332958976 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16cc0b6ba0 con 0x7f16cc15eb50 2024-07-27T03:10:00.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.152+0000 7f16c97fa640 1 -- 172.21.15.120:0/3332958976 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c400ce60 con 0x7f16cc15eb50 2024-07-27T03:10:00.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.152+0000 7f16d2af2640 1 -- 172.21.15.120:0/3332958976 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16cc0b5860 con 0x7f16cc15eb50 2024-07-27T03:10:00.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.153+0000 7f16d2af2640 1 -- 172.21.15.120:0/3332958976 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16cc0b48a0 con 0x7f16cc15eb50 2024-07-27T03:10:00.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.153+0000 7f16c97fa640 1 -- 172.21.15.120:0/3332958976 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f16c401c070 con 0x7f16cc15eb50 2024-07-27T03:10:00.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.154+0000 7f16c97fa640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16b0077010 0x7f16b0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:00.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.154+0000 7f16c97fa640 1 -- 172.21.15.120:0/3332958976 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5115+0+0 (secure 0 0 0) 0x7f16c40982f0 con 0x7f16cc15eb50 2024-07-27T03:10:00.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.154+0000 7f16d088e640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16b0077010 0x7f16b0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:00.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.155+0000 7f16d088e640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16b0077010 0x7f16b0079520 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16c0005fd0 tx=0x7f16c000a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:00.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.159+0000 7f16c97fa640 1 -- 172.21.15.120:0/3332958976 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f16c40610f0 con 0x7f16cc15eb50 2024-07-27T03:10:00.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.353+0000 7f16d2af2640 1 -- 172.21.15.120:0/3332958976 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f16cc15a910 con 0x7f16cc15eb50 2024-07-27T03:10:00.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.356+0000 7f16c97fa640 1 -- 172.21.15.120:0/3332958976 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7f16c4065640 con 0x7f16cc15eb50 2024-07-27T03:10:00.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 -- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16b0077010 msgr2=0x7f16b0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:00.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16b0077010 0x7f16b0079520 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16c0005fd0 tx=0x7f16c000a250 comp rx=0 tx=0).stop 2024-07-27T03:10:00.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 -- 172.21.15.120:0/3332958976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16cc15eb50 msgr2=0x7f16cc151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:00.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16cc15eb50 0x7f16cc151db0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f16c400ba10 tx=0x7f16c400bed0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 -- 172.21.15.120:0/3332958976 shutdown_connections 2024-07-27T03:10:00.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16b0077010 0x7f16b0079520 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16cc15eb50 0x7f16cc151db0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f16cc0d0600 0x7f16cc0c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 --2- 172.21.15.120:0/3332958976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16cc0af6d0 0x7f16cc0b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 -- 172.21.15.120:0/3332958976 >> 172.21.15.120:0/3332958976 conn(0x7f16cc0d0de0 msgr2=0x7f16cc0b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:00.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 -- 172.21.15.120:0/3332958976 shutdown_connections 2024-07-27T03:10:00.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.359+0000 7f16d2af2640 1 -- 172.21.15.120:0/3332958976 wait complete. 2024-07-27T03:10:00.373 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_exports.TestBalMask.test_distribute_directory_to_multiple_ranks' 2024-07-27T03:10:00.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.483+0000 7ff0dc09a640 1 -- 172.21.15.120:0/3306022660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d40d10d0 msgr2=0x7ff0d40cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:00.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.483+0000 7ff0dc09a640 1 --2- 172.21.15.120:0/3306022660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d40d10d0 0x7ff0d40cebe0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc005fd0 tx=0x7ff0cc02a940 comp rx=0 tx=0).stop 2024-07-27T03:10:00.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.483+0000 7ff0dc09a640 1 -- 172.21.15.120:0/3306022660 shutdown_connections 2024-07-27T03:10:00.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.483+0000 7ff0dc09a640 1 --2- 172.21.15.120:0/3306022660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d40d10d0 0x7ff0d40cebe0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.483+0000 7ff0dc09a640 1 -- 172.21.15.120:0/3306022660 >> 172.21.15.120:0/3306022660 conn(0x7ff0d408d690 msgr2=0x7ff0d409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:00.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.483+0000 7ff0dc09a640 1 -- 172.21.15.120:0/3306022660 shutdown_connections 2024-07-27T03:10:00.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.483+0000 7ff0dc09a640 1 -- 172.21.15.120:0/3306022660 wait complete. 2024-07-27T03:10:00.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.485+0000 7ff0dc09a640 1 Processor -- start 2024-07-27T03:10:00.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.485+0000 7ff0dc09a640 1 -- start start 2024-07-27T03:10:00.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.486+0000 7ff0dc09a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0d40b2c40 0x7ff0d41e9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:00.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.486+0000 7ff0dc09a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d40b4740 0x7ff0d415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:00.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.486+0000 7ff0dc09a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0d41f9010 0x7ff0d41f8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:00.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.486+0000 7ff0dc09a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40cf2a0 con 0x7ff0d40b4740 2024-07-27T03:10:00.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.486+0000 7ff0dc09a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40cf120 con 0x7ff0d41f9010 2024-07-27T03:10:00.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.486+0000 7ff0dc09a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d40cf420 con 0x7ff0d40b2c40 2024-07-27T03:10:00.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.486+0000 7ff0d9635640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d40b4740 0x7ff0d415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:00.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.486+0000 7ff0d9635640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d40b4740 0x7ff0d415ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34902/0 (socket says 172.21.15.120:34902) 2024-07-27T03:10:00.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.486+0000 7ff0d9635640 1 -- 172.21.15.120:0/4089117110 learned_addr learned my addr 172.21.15.120:0/4089117110 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:00.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0da637640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0d41f9010 0x7ff0d41f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:00.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0d9e36640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0d40b2c40 0x7ff0d41e9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:00.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0d9635640 1 -- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0d40b2c40 msgr2=0x7ff0d41e9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:00.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0d9635640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0d40b2c40 0x7ff0d41e9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0d9635640 1 -- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0d41f9010 msgr2=0x7ff0d41f8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:00.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0d9635640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0d41f9010 0x7ff0d41f8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:00.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0d9635640 1 -- 172.21.15.120:0/4089117110 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d415bfc0 con 0x7ff0d40b4740 2024-07-27T03:10:00.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0da637640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0d41f9010 0x7ff0d41f8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:10:00.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0d9635640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d40b4740 0x7ff0d415ba80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400c400 tx=0x7ff0c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:00.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0ca7fc640 1 -- 172.21.15.120:0/4089117110 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4017070 con 0x7ff0d40b4740 2024-07-27T03:10:00.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0ca7fc640 1 -- 172.21.15.120:0/4089117110 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0c40053c0 con 0x7ff0d40b4740 2024-07-27T03:10:00.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0dc09a640 1 -- 172.21.15.120:0/4089117110 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d40b77a0 con 0x7ff0d40b4740 2024-07-27T03:10:00.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0ca7fc640 1 -- 172.21.15.120:0/4089117110 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4003850 con 0x7ff0d40b4740 2024-07-27T03:10:00.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.487+0000 7ff0dc09a640 1 -- 172.21.15.120:0/4089117110 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d415d9f0 con 0x7ff0d40b4740 2024-07-27T03:10:00.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.488+0000 7ff0dc09a640 1 -- 172.21.15.120:0/4089117110 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d41e9870 con 0x7ff0d40b4740 2024-07-27T03:10:00.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.489+0000 7ff0ca7fc640 1 -- 172.21.15.120:0/4089117110 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff0c401a070 con 0x7ff0d40b4740 2024-07-27T03:10:00.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.489+0000 7ff0ca7fc640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff0b8077040 0x7ff0b8079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:00.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.490+0000 7ff0ca7fc640 1 -- 172.21.15.120:0/4089117110 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5115+0+0 (secure 0 0 0) 0x7ff0c4097b90 con 0x7ff0d40b4740 2024-07-27T03:10:00.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.490+0000 7ff0d9e36640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff0b8077040 0x7ff0b8079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:00.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.490+0000 7ff0d9e36640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff0b8077040 0x7ff0b8079550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000f60 tx=0x7ff0d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:00.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.494+0000 7ff0ca7fc640 1 -- 172.21.15.120:0/4089117110 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff0c4060fe0 con 0x7ff0d40b4740 2024-07-27T03:10:00.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:00.752+0000 7ff0dc09a640 1 -- 172.21.15.120:0/4089117110 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_exports.TestBalMask.test_distribute_directory_to_multiple_ranks"]} v 0) -- 0x7ff0d40cebe0 con 0x7ff0d40b4740 2024-07-27T03:10:01.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.011+0000 7ff0ca7fc640 1 -- 172.21.15.120:0/4089117110 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_exports.TestBalMask.test_distribute_directory_to_multiple_ranks"]}]=0 v89) ==== 160+0+0 (secure 0 0 0) 0x7ff0c40692b0 con 0x7ff0d40b4740 2024-07-27T03:10:01.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 -- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff0b8077040 msgr2=0x7ff0b8079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff0b8077040 0x7ff0b8079550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000f60 tx=0x7ff0d0009040 comp rx=0 tx=0).stop 2024-07-27T03:10:01.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 -- 172.21.15.120:0/4089117110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d40b4740 msgr2=0x7ff0d415ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d40b4740 0x7ff0d415ba80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400c400 tx=0x7ff0c400c8c0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 -- 172.21.15.120:0/4089117110 shutdown_connections 2024-07-27T03:10:01.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff0b8077040 0x7ff0b8079550 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0d40b4740 0x7ff0d415ba80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0d41f9010 0x7ff0d41f8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 --2- 172.21.15.120:0/4089117110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff0d40b2c40 0x7ff0d41e9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 -- 172.21.15.120:0/4089117110 >> 172.21.15.120:0/4089117110 conn(0x7ff0d408d690 msgr2=0x7ff0d40cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:01.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 -- 172.21.15.120:0/4089117110 shutdown_connections 2024-07-27T03:10:01.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.014+0000 7ff0dc09a640 1 -- 172.21.15.120:0/4089117110 wait complete. 2024-07-27T03:10:01.029 INFO:tasks.cephfs_test_runner:That bal.mask distributes a directory to multiple ranks. ... ok 2024-07-27T03:10:01.029 INFO:tasks.cephfs_test_runner:Starting test: test_ephemeral_pin_overried_rank_mask (tasks.cephfs.test_exports.TestBalMask) That ephemeral pin overrides ceph.dir.bal.mask 2024-07-27T03:10:01.029 INFO:tasks.cephfs_test_runner:test_ephemeral_pin_overried_rank_mask (tasks.cephfs.test_exports.TestBalMask) 2024-07-27T03:10:01.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:10:01.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.140+0000 7f1a4db40640 1 -- 172.21.15.120:0/1394694992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481522e0 msgr2=0x7f1a4806e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.140+0000 7f1a4db40640 1 --2- 172.21.15.120:0/1394694992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481522e0 0x7f1a4806e270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1a38005fd0 tx=0x7f1a3802a540 comp rx=0 tx=0).stop 2024-07-27T03:10:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.140+0000 7f1a4db40640 1 -- 172.21.15.120:0/1394694992 shutdown_connections 2024-07-27T03:10:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.140+0000 7f1a4db40640 1 --2- 172.21.15.120:0/1394694992 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a480733e0 0x7f1a480737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.140+0000 7f1a4db40640 1 --2- 172.21.15.120:0/1394694992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481522e0 0x7f1a4806e270 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.140+0000 7f1a4db40640 1 -- 172.21.15.120:0/1394694992 >> 172.21.15.120:0/1394694992 conn(0x7f1a480b1a10 msgr2=0x7f1a480b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.140+0000 7f1a4db40640 1 -- 172.21.15.120:0/1394694992 shutdown_connections 2024-07-27T03:10:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.140+0000 7f1a4db40640 1 -- 172.21.15.120:0/1394694992 wait complete. 2024-07-27T03:10:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.142+0000 7f1a4db40640 1 Processor -- start 2024-07-27T03:10:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.142+0000 7f1a4db40640 1 -- start start 2024-07-27T03:10:01.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.143+0000 7f1a4db40640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a480733e0 0x7f1a481f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.143+0000 7f1a4db40640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a48073d30 0x7f1a48141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.143+0000 7f1a4db40640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481522e0 0x7f1a48142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.143+0000 7f1a4db40640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4815c220 con 0x7f1a481522e0 2024-07-27T03:10:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.143+0000 7f1a4db40640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4815c0a0 con 0x7f1a48073d30 2024-07-27T03:10:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.143+0000 7f1a4db40640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4815c3a0 con 0x7f1a480733e0 2024-07-27T03:10:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.143+0000 7f1a47fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481522e0 0x7f1a48142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.143+0000 7f1a47fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481522e0 0x7f1a48142310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34912/0 (socket says 172.21.15.120:34912) 2024-07-27T03:10:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.143+0000 7f1a47fff640 1 -- 172.21.15.120:0/551025558 learned_addr learned my addr 172.21.15.120:0/551025558 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.143+0000 7f1a46ffd640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a48073d30 0x7f1a48141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.143+0000 7f1a477fe640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a480733e0 0x7f1a481f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.144+0000 7f1a47fff640 1 -- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a480733e0 msgr2=0x7f1a481f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.144+0000 7f1a47fff640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a480733e0 0x7f1a481f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.144+0000 7f1a47fff640 1 -- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a48073d30 msgr2=0x7f1a48141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.144+0000 7f1a47fff640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a48073d30 0x7f1a48141dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.144+0000 7f1a47fff640 1 -- 172.21.15.120:0/551025558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4809cee0 con 0x7f1a481522e0 2024-07-27T03:10:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.144+0000 7f1a47fff640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481522e0 0x7f1a48142310 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1a40002230 tx=0x7f1a4000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.144+0000 7f1a2ffff640 1 -- 172.21.15.120:0/551025558 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40003b70 con 0x7f1a481522e0 2024-07-27T03:10:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.144+0000 7f1a2ffff640 1 -- 172.21.15.120:0/551025558 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a40003d10 con 0x7f1a481522e0 2024-07-27T03:10:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.144+0000 7f1a2ffff640 1 -- 172.21.15.120:0/551025558 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40005330 con 0x7f1a481522e0 2024-07-27T03:10:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.144+0000 7f1a4db40640 1 -- 172.21.15.120:0/551025558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4809d1c0 con 0x7f1a481522e0 2024-07-27T03:10:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.144+0000 7f1a4db40640 1 -- 172.21.15.120:0/551025558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a481e66a0 con 0x7f1a481522e0 2024-07-27T03:10:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.145+0000 7f1a4db40640 1 -- 172.21.15.120:0/551025558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a4809cc50 con 0x7f1a481522e0 2024-07-27T03:10:01.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.146+0000 7f1a2ffff640 1 -- 172.21.15.120:0/551025558 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1a400056e0 con 0x7f1a481522e0 2024-07-27T03:10:01.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.146+0000 7f1a2ffff640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a34077010 0x7f1a34079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.146+0000 7f1a2ffff640 1 -- 172.21.15.120:0/551025558 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5115+0+0 (secure 0 0 0) 0x7f1a40098580 con 0x7f1a481522e0 2024-07-27T03:10:01.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.147+0000 7f1a477fe640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a34077010 0x7f1a34079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.147+0000 7f1a477fe640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a34077010 0x7f1a34079520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1a38033000 tx=0x7f1a38004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:01.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.151+0000 7f1a2ffff640 1 -- 172.21.15.120:0/551025558 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f1a40061410 con 0x7f1a481522e0 2024-07-27T03:10:01.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.333+0000 7f1a4db40640 1 -- 172.21.15.120:0/551025558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a48073b50 con 0x7f1a481522e0 2024-07-27T03:10:01.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.334+0000 7f1a2ffff640 1 -- 172.21.15.120:0/551025558 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+13308 (secure 0 0 0) 0x7f1a48073b50 con 0x7f1a481522e0 2024-07-27T03:10:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:01.338 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":36,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:10:00.001935+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6837/3538993507":"2024-07-28T03:09:56.846219+0000","172.21.15.120:6834/503930696":"2024-07-28T03:09:56.846240+0000","172.21.15.120:6832/503930696":"2024-07-28T03:09:56.846240+0000","172.21.15.120:6835/1949887551":"2024-07-28T03:09:56.846245+0000","172.21.15.121:6835/3538993507":"2024-07-28T03:09:56.846219+0000","172.21.15.120:6833/1949887551":"2024-07-28T03:09:56.846245+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:10:01.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 -- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a34077010 msgr2=0x7f1a34079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a34077010 0x7f1a34079520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1a38033000 tx=0x7f1a38004730 comp rx=0 tx=0).stop 2024-07-27T03:10:01.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 -- 172.21.15.120:0/551025558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481522e0 msgr2=0x7f1a48142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481522e0 0x7f1a48142310 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1a40002230 tx=0x7f1a4000cb90 comp rx=0 tx=0).stop 2024-07-27T03:10:01.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 -- 172.21.15.120:0/551025558 shutdown_connections 2024-07-27T03:10:01.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a34077010 0x7f1a34079520 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481522e0 0x7f1a48142310 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a48073d30 0x7f1a48141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 --2- 172.21.15.120:0/551025558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a480733e0 0x7f1a481f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 -- 172.21.15.120:0/551025558 >> 172.21.15.120:0/551025558 conn(0x7f1a480b1a10 msgr2=0x7f1a480d03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:01.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 -- 172.21.15.120:0/551025558 shutdown_connections 2024-07-27T03:10:01.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.336+0000 7f1a4db40640 1 -- 172.21.15.120:0/551025558 wait complete. 2024-07-27T03:10:01.351 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-27T03:08:28.548271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-07-27T03:10:01.352 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-07-27T03:10:01.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.468+0000 7fd16b8f3640 1 -- 172.21.15.120:0/402701722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1640d27e0 msgr2=0x7fd1640d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.468+0000 7fd16b8f3640 1 --2- 172.21.15.120:0/402701722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1640d27e0 0x7fd1640d2bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd158005fd0 tx=0x7fd15802a5d0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.468+0000 7fd16b8f3640 1 -- 172.21.15.120:0/402701722 shutdown_connections 2024-07-27T03:10:01.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.468+0000 7fd16b8f3640 1 --2- 172.21.15.120:0/402701722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1640d27e0 0x7fd1640d2bf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.468+0000 7fd16b8f3640 1 --2- 172.21.15.120:0/402701722 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1640b4740 0x7fd1640b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.468+0000 7fd16b8f3640 1 -- 172.21.15.120:0/402701722 >> 172.21.15.120:0/402701722 conn(0x7fd16408d690 msgr2=0x7fd16409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:01.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.468+0000 7fd16b8f3640 1 -- 172.21.15.120:0/402701722 shutdown_connections 2024-07-27T03:10:01.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.468+0000 7fd16b8f3640 1 -- 172.21.15.120:0/402701722 wait complete. 2024-07-27T03:10:01.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.470+0000 7fd16b8f3640 1 Processor -- start 2024-07-27T03:10:01.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.470+0000 7fd16b8f3640 1 -- start start 2024-07-27T03:10:01.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.471+0000 7fd16b8f3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1640b4740 0x7fd1640a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.471+0000 7fd16b8f3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1640d09c0 0x7fd1641592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.471+0000 7fd16b8f3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1640d27e0 0x7fd1641f8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.471+0000 7fd16b8f3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd1640cef70 con 0x7fd1640d27e0 2024-07-27T03:10:01.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.471+0000 7fd16b8f3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd1640cedf0 con 0x7fd1640b4740 2024-07-27T03:10:01.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.471+0000 7fd16b8f3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd1640cf0f0 con 0x7fd1640d09c0 2024-07-27T03:10:01.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.471+0000 7fd169e90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1640d27e0 0x7fd1641f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd169e90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1640d27e0 0x7fd1641f8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34930/0 (socket says 172.21.15.120:34930) 2024-07-27T03:10:01.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd169e90640 1 -- 172.21.15.120:0/1288182673 learned_addr learned my addr 172.21.15.120:0/1288182673 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:01.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd168e8e640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1640d09c0 0x7fd1641592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd16968f640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1640b4740 0x7fd1640a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd169e90640 1 -- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1640d09c0 msgr2=0x7fd1641592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd169e90640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1640d09c0 0x7fd1641592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd169e90640 1 -- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1640b4740 msgr2=0x7fd1640a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd169e90640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1640b4740 0x7fd1640a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd169e90640 1 -- 172.21.15.120:0/1288182673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16415cbe0 con 0x7fd1640d27e0 2024-07-27T03:10:01.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd169e90640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1640d27e0 0x7fd1641f8f90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00c3f0 tx=0x7fd15c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:01.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd161ffb640 1 -- 172.21.15.120:0/1288182673 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c017070 con 0x7fd1640d27e0 2024-07-27T03:10:01.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd161ffb640 1 -- 172.21.15.120:0/1288182673 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd15c0053c0 con 0x7fd1640d27e0 2024-07-27T03:10:01.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd16b8f3640 1 -- 172.21.15.120:0/1288182673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16415cec0 con 0x7fd1640d27e0 2024-07-27T03:10:01.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd161ffb640 1 -- 172.21.15.120:0/1288182673 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c003850 con 0x7fd1640d27e0 2024-07-27T03:10:01.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.472+0000 7fd16b8f3640 1 -- 172.21.15.120:0/1288182673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1640b8a60 con 0x7fd1640d27e0 2024-07-27T03:10:01.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.473+0000 7fd16b8f3640 1 -- 172.21.15.120:0/1288182673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1640d2bf0 con 0x7fd1640d27e0 2024-07-27T03:10:01.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.474+0000 7fd161ffb640 1 -- 172.21.15.120:0/1288182673 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd15c01a070 con 0x7fd1640d27e0 2024-07-27T03:10:01.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.475+0000 7fd161ffb640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd150077010 0x7fd150079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.475+0000 7fd161ffb640 1 -- 172.21.15.120:0/1288182673 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5115+0+0 (secure 0 0 0) 0x7fd15c097990 con 0x7fd1640d27e0 2024-07-27T03:10:01.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.475+0000 7fd16968f640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd150077010 0x7fd150079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.475+0000 7fd16968f640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd150077010 0x7fd150079520 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd154005fd0 tx=0x7fd1540095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:01.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.479+0000 7fd161ffb640 1 -- 172.21.15.120:0/1288182673 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd15c060790 con 0x7fd1640d27e0 2024-07-27T03:10:01.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.662+0000 7fd16b8f3640 1 -- 172.21.15.120:0/1288182673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd16408e050 con 0x7fd1640d27e0 2024-07-27T03:10:01.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.662+0000 7fd161ffb640 1 -- 172.21.15.120:0/1288182673 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7fd15c0690b0 con 0x7fd1640d27e0 2024-07-27T03:10:01.666 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-07-27T03:10:01.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.664+0000 7fd16b8f3640 1 -- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd150077010 msgr2=0x7fd150079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.664+0000 7fd16b8f3640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd150077010 0x7fd150079520 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd154005fd0 tx=0x7fd1540095e0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.664+0000 7fd16b8f3640 1 -- 172.21.15.120:0/1288182673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1640d27e0 msgr2=0x7fd1641f8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.664+0000 7fd16b8f3640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1640d27e0 0x7fd1641f8f90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00c3f0 tx=0x7fd15c00c8b0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.664+0000 7fd16b8f3640 1 -- 172.21.15.120:0/1288182673 shutdown_connections 2024-07-27T03:10:01.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.664+0000 7fd16b8f3640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd150077010 0x7fd150079520 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.664+0000 7fd16b8f3640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd1640d27e0 0x7fd1641f8f90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.664+0000 7fd16b8f3640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1640d09c0 0x7fd1641592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.664+0000 7fd16b8f3640 1 --2- 172.21.15.120:0/1288182673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1640b4740 0x7fd1640a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.664+0000 7fd16b8f3640 1 -- 172.21.15.120:0/1288182673 >> 172.21.15.120:0/1288182673 conn(0x7fd16408d690 msgr2=0x7fd16415f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:01.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.665+0000 7fd16b8f3640 1 -- 172.21.15.120:0/1288182673 shutdown_connections 2024-07-27T03:10:01.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.665+0000 7fd16b8f3640 1 -- 172.21.15.120:0/1288182673 wait complete. 2024-07-27T03:10:01.680 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_pin_overried_rank_mask' 2024-07-27T03:10:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.798+0000 7f1a27b4e640 1 -- 172.21.15.120:0/2982540935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a200b2110 msgr2=0x7f1a200b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.798+0000 7f1a27b4e640 1 --2- 172.21.15.120:0/2982540935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a200b2110 0x7f1a200b2520 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1a20074120 tx=0x7f1a1c02a4d0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.798+0000 7f1a27b4e640 1 -- 172.21.15.120:0/2982540935 shutdown_connections 2024-07-27T03:10:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.798+0000 7f1a27b4e640 1 --2- 172.21.15.120:0/2982540935 >> v2:172.21.15.121:3300/0 conn(0x7f1a200b5fe0 0x7f1a2015e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.798+0000 7f1a27b4e640 1 --2- 172.21.15.120:0/2982540935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a200b2110 0x7f1a200b2520 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.798+0000 7f1a27b4e640 1 -- 172.21.15.120:0/2982540935 >> 172.21.15.120:0/2982540935 conn(0x7f1a200b3920 msgr2=0x7f1a200b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.798+0000 7f1a27b4e640 1 -- 172.21.15.120:0/2982540935 shutdown_connections 2024-07-27T03:10:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.798+0000 7f1a27b4e640 1 -- 172.21.15.120:0/2982540935 wait complete. 2024-07-27T03:10:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.800+0000 7f1a27b4e640 1 Processor -- start 2024-07-27T03:10:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.800+0000 7f1a27b4e640 1 -- start start 2024-07-27T03:10:01.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.801+0000 7f1a27b4e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a200b2110 0x7f1a2015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.801+0000 7f1a27b4e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a200b5fe0 0x7f1a200b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.801+0000 7f1a27b4e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a200d0500 0x7f1a200b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.801+0000 7f1a27b4e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2015f4b0 con 0x7f1a200d0500 2024-07-27T03:10:01.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.801+0000 7f1a27b4e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2015f330 con 0x7f1a200b5fe0 2024-07-27T03:10:01.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.801+0000 7f1a27b4e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2015f630 con 0x7f1a200b2110 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.801+0000 7f1a260eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a200d0500 0x7f1a200b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.801+0000 7f1a260eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a200d0500 0x7f1a200b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60760/0 (socket says 172.21.15.120:60760) 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.801+0000 7f1a260eb640 1 -- 172.21.15.120:0/3948990749 learned_addr learned my addr 172.21.15.120:0/3948990749 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a250e9640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a200b5fe0 0x7f1a200b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a258ea640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a200b2110 0x7f1a2015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a260eb640 1 -- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a200b2110 msgr2=0x7f1a2015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a260eb640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a200b2110 0x7f1a2015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a260eb640 1 -- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a200b5fe0 msgr2=0x7f1a200b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a260eb640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a200b5fe0 0x7f1a200b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a260eb640 1 -- 172.21.15.120:0/3948990749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a201f34e0 con 0x7f1a200d0500 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a260eb640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a200d0500 0x7f1a200b0990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800cae0 tx=0x7f1a18007220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a167fc640 1 -- 172.21.15.120:0/3948990749 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18007da0 con 0x7f1a200d0500 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a167fc640 1 -- 172.21.15.120:0/3948990749 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a18004c30 con 0x7f1a200d0500 2024-07-27T03:10:01.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a27b4e640 1 -- 172.21.15.120:0/3948990749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a201f6f60 con 0x7f1a200d0500 2024-07-27T03:10:01.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a167fc640 1 -- 172.21.15.120:0/3948990749 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18005280 con 0x7f1a200d0500 2024-07-27T03:10:01.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.802+0000 7f1a27b4e640 1 -- 172.21.15.120:0/3948990749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a201f7520 con 0x7f1a200d0500 2024-07-27T03:10:01.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.803+0000 7f1a27b4e640 1 -- 172.21.15.120:0/3948990749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a201f6cd0 con 0x7f1a200d0500 2024-07-27T03:10:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.804+0000 7f1a167fc640 1 -- 172.21.15.120:0/3948990749 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1a18005420 con 0x7f1a200d0500 2024-07-27T03:10:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.804+0000 7f1a167fc640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a04077010 0x7f1a04079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.804+0000 7f1a167fc640 1 -- 172.21.15.120:0/3948990749 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5115+0+0 (secure 0 0 0) 0x7f1a18099050 con 0x7f1a200d0500 2024-07-27T03:10:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.804+0000 7f1a258ea640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a04077010 0x7f1a04079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.805+0000 7f1a258ea640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a04077010 0x7f1a04079520 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c033000 tx=0x7f1a1c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:01.809+0000 7f1a167fc640 1 -- 172.21.15.120:0/3948990749 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f1a18014070 con 0x7f1a200d0500 2024-07-27T03:10:02.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:02.061+0000 7f1a27b4e640 1 -- 172.21.15.120:0/3948990749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_pin_overried_rank_mask"]} v 0) -- 0x7f1a201f36b0 con 0x7f1a200d0500 2024-07-27T03:10:03.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.018+0000 7f1a167fc640 1 -- 172.21.15.120:0/3948990749 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_pin_overried_rank_mask"]}]=0 v91) ==== 157+0+0 (secure 0 0 0) 0x7f1a18061e50 con 0x7f1a200d0500 2024-07-27T03:10:03.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 -- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a04077010 msgr2=0x7f1a04079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a04077010 0x7f1a04079520 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c033000 tx=0x7f1a1c004730 comp rx=0 tx=0).stop 2024-07-27T03:10:03.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 -- 172.21.15.120:0/3948990749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a200d0500 msgr2=0x7f1a200b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a200d0500 0x7f1a200b0990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800cae0 tx=0x7f1a18007220 comp rx=0 tx=0).stop 2024-07-27T03:10:03.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 -- 172.21.15.120:0/3948990749 shutdown_connections 2024-07-27T03:10:03.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1a04077010 0x7f1a04079520 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a200d0500 0x7f1a200b0990 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a200b5fe0 0x7f1a200b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 --2- 172.21.15.120:0/3948990749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1a200b2110 0x7f1a2015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 -- 172.21.15.120:0/3948990749 >> 172.21.15.120:0/3948990749 conn(0x7f1a200b3920 msgr2=0x7f1a2015b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:03.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 -- 172.21.15.120:0/3948990749 shutdown_connections 2024-07-27T03:10:03.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.020+0000 7f1a27b4e640 1 -- 172.21.15.120:0/3948990749 wait complete. 2024-07-27T03:10:03.037 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-07-27T03:10:03.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.151+0000 7f1deff58640 1 -- 172.21.15.120:0/1052522028 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1de80b92c0 msgr2=0x7f1de80cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.151+0000 7f1deff58640 1 --2- 172.21.15.120:0/1052522028 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1de80b92c0 0x7f1de80cecc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8005fd0 tx=0x7f1dd802aa90 comp rx=0 tx=0).stop 2024-07-27T03:10:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.151+0000 7f1deff58640 1 -- 172.21.15.120:0/1052522028 shutdown_connections 2024-07-27T03:10:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.151+0000 7f1deff58640 1 --2- 172.21.15.120:0/1052522028 >> v2:172.21.15.121:3300/0 conn(0x7f1de80b3dd0 0x7f1de80b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.151+0000 7f1deff58640 1 --2- 172.21.15.120:0/1052522028 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1de80b92c0 0x7f1de80cecc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.151+0000 7f1deff58640 1 -- 172.21.15.120:0/1052522028 >> 172.21.15.120:0/1052522028 conn(0x7f1de80d3f70 msgr2=0x7f1de80d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.152+0000 7f1deff58640 1 -- 172.21.15.120:0/1052522028 shutdown_connections 2024-07-27T03:10:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.152+0000 7f1deff58640 1 -- 172.21.15.120:0/1052522028 wait complete. 2024-07-27T03:10:03.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.153+0000 7f1deff58640 1 Processor -- start 2024-07-27T03:10:03.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.153+0000 7f1deff58640 1 -- start start 2024-07-27T03:10:03.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1deff58640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1de80b3dd0 0x7f1de8151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1deff58640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1de80b92c0 0x7f1de8160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1deff58640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1de80cf200 0x7f1de8161350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1deff58640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1de80b4930 con 0x7f1de80b92c0 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1deff58640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1de80b3710 con 0x7f1de80cf200 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1deff58640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1de80b4ab0 con 0x7f1de80b3dd0 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1ded4f3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1de80b92c0 0x7f1de8160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1ded4f3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1de80b92c0 0x7f1de8160e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60764/0 (socket says 172.21.15.120:60764) 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1ded4f3640 1 -- 172.21.15.120:0/3522402720 learned_addr learned my addr 172.21.15.120:0/3522402720 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1dedcf4640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1de80b3dd0 0x7f1de8151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1dee4f5640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1de80cf200 0x7f1de8161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1ded4f3640 1 -- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1de80b3dd0 msgr2=0x7f1de8151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1ded4f3640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1de80b3dd0 0x7f1de8151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1ded4f3640 1 -- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1de80cf200 msgr2=0x7f1de8161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1ded4f3640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1de80cf200 0x7f1de8161350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1ded4f3640 1 -- 172.21.15.120:0/3522402720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de80cba40 con 0x7f1de80b92c0 2024-07-27T03:10:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1ded4f3640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1de80b92c0 0x7f1de8160e10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c370 tx=0x7f1ddc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1de67fc640 1 -- 172.21.15.120:0/3522402720 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc017070 con 0x7f1de80b92c0 2024-07-27T03:10:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1de67fc640 1 -- 172.21.15.120:0/3522402720 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ddc0053c0 con 0x7f1de80b92c0 2024-07-27T03:10:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1deff58640 1 -- 172.21.15.120:0/3522402720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de80cbd00 con 0x7f1de80b92c0 2024-07-27T03:10:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1de67fc640 1 -- 172.21.15.120:0/3522402720 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc003850 con 0x7f1de80b92c0 2024-07-27T03:10:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.155+0000 7f1deff58640 1 -- 172.21.15.120:0/3522402720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de80c7e90 con 0x7f1de80b92c0 2024-07-27T03:10:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.156+0000 7f1deff58640 1 -- 172.21.15.120:0/3522402720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1de80b5040 con 0x7f1de80b92c0 2024-07-27T03:10:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.157+0000 7f1de67fc640 1 -- 172.21.15.120:0/3522402720 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1ddc01a070 con 0x7f1de80b92c0 2024-07-27T03:10:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.157+0000 7f1de67fc640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1dd4077010 0x7f1dd4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.158+0000 7f1de67fc640 1 -- 172.21.15.120:0/3522402720 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5115+0+0 (secure 0 0 0) 0x7f1ddc097920 con 0x7f1de80b92c0 2024-07-27T03:10:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.158+0000 7f1dedcf4640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1dd4077010 0x7f1dd4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.158+0000 7f1dedcf4640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1dd4077010 0x7f1dd4079520 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8035000 tx=0x7f1dd8038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:03.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.162+0000 7f1de67fc640 1 -- 172.21.15.120:0/3522402720 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f1ddc060840 con 0x7f1de80b92c0 2024-07-27T03:10:03.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.346+0000 7f1deff58640 1 -- 172.21.15.120:0/3522402720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f1de80b2a20 con 0x7f1de80b92c0 2024-07-27T03:10:03.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.347+0000 7f1de67fc640 1 -- 172.21.15.120:0/3522402720 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v29) ==== 59+0+1998 (secure 0 0 0) 0x7f1ddc0690d0 con 0x7f1de80b92c0 2024-07-27T03:10:03.351 INFO:teuthology.orchestra.run.smithi120.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-07-27T03:10:03.351 INFO:teuthology.orchestra.run.smithi120.stdout:mon advanced mon_op_complaint_time 120 2024-07-27T03:10:03.351 INFO:teuthology.orchestra.run.smithi120.stdout:mon dev mon_warn_on_pool_no_app false 2024-07-27T03:10:03.351 INFO:teuthology.orchestra.run.smithi120.stdout:osd advanced osd_op_complaint_time 180.000000 2024-07-27T03:10:03.351 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5257.409462 2024-07-27T03:10:03.351 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6039.326463 2024-07-27T03:10:03.351 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5855.738461 2024-07-27T03:10:03.351 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4876.658742 2024-07-27T03:10:03.351 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4850.335109 2024-07-27T03:10:03.351 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5729.677637 2024-07-27T03:10:03.351 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5061.056911 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5680.764045 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_mds 20/20 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_mds_balancer 20/20 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_ms 2/2 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_debug_frag true 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_debug_scatterstat true 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced mds_op_complaint_time 180.000000 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_verify_scatter true 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced osd_op_complaint_time 180.000000 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced rados_mon_op_timeout 900 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced rados_osd_op_timeout 900 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced client_mount_timeout 600 2024-07-27T03:10:03.352 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced debug_client 20/20 2024-07-27T03:10:03.353 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced debug_ms 1/1 2024-07-27T03:10:03.353 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced rados_mon_op_timeout 900 2024-07-27T03:10:03.353 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced rados_osd_op_timeout 900 2024-07-27T03:10:03.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 -- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1dd4077010 msgr2=0x7f1dd4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1dd4077010 0x7f1dd4079520 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8035000 tx=0x7f1dd8038040 comp rx=0 tx=0).stop 2024-07-27T03:10:03.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 -- 172.21.15.120:0/3522402720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1de80b92c0 msgr2=0x7f1de8160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1de80b92c0 0x7f1de8160e10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00c370 tx=0x7f1ddc00c830 comp rx=0 tx=0).stop 2024-07-27T03:10:03.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 -- 172.21.15.120:0/3522402720 shutdown_connections 2024-07-27T03:10:03.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1dd4077010 0x7f1dd4079520 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1de80b92c0 0x7f1de8160e10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1de80cf200 0x7f1de8161350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 --2- 172.21.15.120:0/3522402720 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1de80b3dd0 0x7f1de8151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 -- 172.21.15.120:0/3522402720 >> 172.21.15.120:0/3522402720 conn(0x7f1de80d3f70 msgr2=0x7f1de80d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:03.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 -- 172.21.15.120:0/3522402720 shutdown_connections 2024-07-27T03:10:03.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.349+0000 7f1deff58640 1 -- 172.21.15.120:0/3522402720 wait complete. 2024-07-27T03:10:03.364 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-07-27T03:10:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.477+0000 7f8ea8d38640 1 -- 172.21.15.120:0/326112468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea40d0f00 msgr2=0x7f8ea40cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.477+0000 7f8ea8d38640 1 --2- 172.21.15.120:0/326112468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea40d0f00 0x7f8ea40cebe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40d24d0 tx=0x7f8e9c02aaa0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.477+0000 7f8ea8d38640 1 -- 172.21.15.120:0/326112468 shutdown_connections 2024-07-27T03:10:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.477+0000 7f8ea8d38640 1 --2- 172.21.15.120:0/326112468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea40d0f00 0x7f8ea40cebe0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.477+0000 7f8ea8d38640 1 --2- 172.21.15.120:0/326112468 >> v2:172.21.15.121:3300/0 conn(0x7f8ea40b2c40 0x7f8ea40d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.477+0000 7f8ea8d38640 1 -- 172.21.15.120:0/326112468 >> 172.21.15.120:0/326112468 conn(0x7f8ea408d690 msgr2=0x7f8ea409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:03.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.477+0000 7f8ea8d38640 1 -- 172.21.15.120:0/326112468 shutdown_connections 2024-07-27T03:10:03.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.477+0000 7f8ea8d38640 1 -- 172.21.15.120:0/326112468 wait complete. 2024-07-27T03:10:03.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.479+0000 7f8ea8d38640 1 Processor -- start 2024-07-27T03:10:03.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.479+0000 7f8ea8d38640 1 -- start start 2024-07-27T03:10:03.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.480+0000 7f8ea8d38640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea40b2c40 0x7f8ea40caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:03.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea8d38640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ea40b4740 0x7f8ea4152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:03.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea8d38640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea40d0f00 0x7f8ea40b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea8d38640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea40b33c0 con 0x7f8ea40d0f00 2024-07-27T03:10:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea8d38640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea40d3100 con 0x7f8ea40b2c40 2024-07-27T03:10:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea8d38640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea40cf120 con 0x7f8ea40b4740 2024-07-27T03:10:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea2d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea40d0f00 0x7f8ea40b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea2d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea40d0f00 0x7f8ea40b7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60782/0 (socket says 172.21.15.120:60782) 2024-07-27T03:10:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea2d9d640 1 -- 172.21.15.120:0/1862124521 learned_addr learned my addr 172.21.15.120:0/1862124521 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea259c640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea40b2c40 0x7f8ea40caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea1d9b640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ea40b4740 0x7f8ea4152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea2d9d640 1 -- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ea40b4740 msgr2=0x7f8ea4152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea2d9d640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ea40b4740 0x7f8ea4152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea2d9d640 1 -- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea40b2c40 msgr2=0x7f8ea40caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea2d9d640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea40b2c40 0x7f8ea40caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea2d9d640 1 -- 172.21.15.120:0/1862124521 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea41f8b10 con 0x7f8ea40d0f00 2024-07-27T03:10:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea2d9d640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea40d0f00 0x7f8ea40b7e30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c005fd0 tx=0x7f8e9c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8e92ffd640 1 -- 172.21.15.120:0/1862124521 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c044070 con 0x7f8ea40d0f00 2024-07-27T03:10:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8e92ffd640 1 -- 172.21.15.120:0/1862124521 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e9c004250 con 0x7f8ea40d0f00 2024-07-27T03:10:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea8d38640 1 -- 172.21.15.120:0/1862124521 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea41f8db0 con 0x7f8ea40d0f00 2024-07-27T03:10:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8e92ffd640 1 -- 172.21.15.120:0/1862124521 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c004680 con 0x7f8ea40d0f00 2024-07-27T03:10:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.481+0000 7f8ea8d38640 1 -- 172.21.15.120:0/1862124521 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea41f9370 con 0x7f8ea40d0f00 2024-07-27T03:10:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.483+0000 7f8ea8d38640 1 -- 172.21.15.120:0/1862124521 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea40d09c0 con 0x7f8ea40d0f00 2024-07-27T03:10:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.483+0000 7f8e92ffd640 1 -- 172.21.15.120:0/1862124521 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8e9c047070 con 0x7f8ea40d0f00 2024-07-27T03:10:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.484+0000 7f8e92ffd640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8e84077010 0x7f8e84079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.484+0000 7f8e92ffd640 1 -- 172.21.15.120:0/1862124521 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5115+0+0 (secure 0 0 0) 0x7f8e9c0b94c0 con 0x7f8ea40d0f00 2024-07-27T03:10:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.484+0000 7f8ea259c640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8e84077010 0x7f8e84079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:03.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.484+0000 7f8ea259c640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8e84077010 0x7f8e84079520 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8e94001720 tx=0x7f8e94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:03.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.488+0000 7f8e92ffd640 1 -- 172.21.15.120:0/1862124521 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f8ea41f8b10 con 0x7f8ea40d0f00 2024-07-27T03:10:03.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.670+0000 7f8ea8d38640 1 -- 172.21.15.120:0/1862124521 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8ea4075d00 con 0x7f8ea40d0f00 2024-07-27T03:10:03.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.673+0000 7f8e92ffd640 1 -- 172.21.15.120:0/1862124521 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7f8e9c032030 con 0x7f8ea40d0f00 2024-07-27T03:10:03.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 -- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8e84077010 msgr2=0x7f8e84079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8e84077010 0x7f8e84079520 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8e94001720 tx=0x7f8e94009040 comp rx=0 tx=0).stop 2024-07-27T03:10:03.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 -- 172.21.15.120:0/1862124521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea40d0f00 msgr2=0x7f8ea40b7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:03.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea40d0f00 0x7f8ea40b7e30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c005fd0 tx=0x7f8e9c003f10 comp rx=0 tx=0).stop 2024-07-27T03:10:03.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 -- 172.21.15.120:0/1862124521 shutdown_connections 2024-07-27T03:10:03.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8e84077010 0x7f8e84079520 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8ea40d0f00 0x7f8ea40b7e30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8ea40b4740 0x7f8ea4152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 --2- 172.21.15.120:0/1862124521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea40b2c40 0x7f8ea40caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:03.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 -- 172.21.15.120:0/1862124521 >> 172.21.15.120:0/1862124521 conn(0x7f8ea408d690 msgr2=0x7f8ea40b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:03.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 -- 172.21.15.120:0/1862124521 shutdown_connections 2024-07-27T03:10:03.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:03.676+0000 7f8ea8d38640 1 -- 172.21.15.120:0/1862124521 wait complete. 2024-07-27T03:10:03.691 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-07-27T03:10:03.691 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:10:03.732 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:10:03.778 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-07-27T03:10:03.779 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:10:03.779 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:10:03.795 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:10:03.795 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:10:03.795 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:10:03.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:10:03.814 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:10:03.814 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:10:03.852 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:10:03.852 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:10:03.852 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:10:03.872 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:10:03.872 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-07-27T03:10:03.872 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:10:04.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.001+0000 7f3de625a640 1 -- 172.21.15.120:0/2425820445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dc8005f50 msgr2=0x7f3dc800cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:04.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.001+0000 7f3de625a640 1 --2- 172.21.15.120:0/2425820445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dc8005f50 0x7f3dc800cad0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800c610 tx=0x7f3dc8006940 comp rx=0 tx=0).stop 2024-07-27T03:10:04.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.001+0000 7f3ddffff640 1 -- 172.21.15.120:0/2425820445 reap_dead start 2024-07-27T03:10:04.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.001+0000 7f3de625a640 1 -- 172.21.15.120:0/2425820445 shutdown_connections 2024-07-27T03:10:04.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.001+0000 7f3de625a640 1 -- 172.21.15.120:0/2425820445 >> 172.21.15.120:0/2425820445 conn(0x7f3de00b1a10 msgr2=0x7f3de00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:04.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.001+0000 7f3de625a640 1 -- 172.21.15.120:0/2425820445 shutdown_connections 2024-07-27T03:10:04.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.001+0000 7f3de625a640 1 -- 172.21.15.120:0/2425820445 wait complete. 2024-07-27T03:10:04.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.003+0000 7f3de625a640 1 Processor -- start 2024-07-27T03:10:04.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.004+0000 7f3de625a640 1 -- start start 2024-07-27T03:10:04.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3de625a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dc8005f50 0x7f3de014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:04.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3de625a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3de01595e0 0x7f3de01f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:04.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3de625a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3de0149400 0x7f3de01f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:04.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3de625a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3de0070640 con 0x7f3dc8005f50 2024-07-27T03:10:04.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3de625a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3de00704c0 con 0x7f3de01595e0 2024-07-27T03:10:04.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3de625a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3de00723d0 con 0x7f3de0149400 2024-07-27T03:10:04.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3ddf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dc8005f50 0x7f3de014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:04.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3ddf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dc8005f50 0x7f3de014d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60808/0 (socket says 172.21.15.120:60808) 2024-07-27T03:10:04.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3ddf7fe640 1 -- 172.21.15.120:0/4099766606 learned_addr learned my addr 172.21.15.120:0/4099766606 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:04.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3ddeffd640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3de01595e0 0x7f3de01f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:04.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3ddffff640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3de0149400 0x7f3de01f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:04.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3ddf7fe640 1 -- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3de0149400 msgr2=0x7f3de01f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:04.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3ddf7fe640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3de0149400 0x7f3de01f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:04.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3ddf7fe640 1 -- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3de01595e0 msgr2=0x7f3de01f0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:04.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3ddf7fe640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3de01595e0 0x7f3de01f0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:04.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3ddf7fe640 1 -- 172.21.15.120:0/4099766606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de01586c0 con 0x7f3dc8005f50 2024-07-27T03:10:04.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.005+0000 7f3ddf7fe640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dc8005f50 0x7f3de014d0c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000e740 tx=0x7f3dd000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:04.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.006+0000 7f3dc7fff640 1 -- 172.21.15.120:0/4099766606 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd000ccc0 con 0x7f3dc8005f50 2024-07-27T03:10:04.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.006+0000 7f3dc7fff640 1 -- 172.21.15.120:0/4099766606 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dd000ee50 con 0x7f3dc8005f50 2024-07-27T03:10:04.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.006+0000 7f3dc7fff640 1 -- 172.21.15.120:0/4099766606 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd000ce60 con 0x7f3dc8005f50 2024-07-27T03:10:04.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.006+0000 7f3de625a640 1 -- 172.21.15.120:0/4099766606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de01589a0 con 0x7f3dc8005f50 2024-07-27T03:10:04.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.006+0000 7f3de625a640 1 -- 172.21.15.120:0/4099766606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de01f3d50 con 0x7f3dc8005f50 2024-07-27T03:10:04.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.007+0000 7f3de625a640 1 -- 172.21.15.120:0/4099766606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de00728e0 con 0x7f3dc8005f50 2024-07-27T03:10:04.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.008+0000 7f3dc7fff640 1 -- 172.21.15.120:0/4099766606 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f3dd0010690 con 0x7f3dc8005f50 2024-07-27T03:10:04.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.008+0000 7f3dc7fff640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3dcc077010 0x7f3dcc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:04.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.008+0000 7f3dc7fff640 1 -- 172.21.15.120:0/4099766606 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5115+0+0 (secure 0 0 0) 0x7f3dd0098eb0 con 0x7f3dc8005f50 2024-07-27T03:10:04.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.008+0000 7f3ddeffd640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3dcc077010 0x7f3dcc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:04.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.009+0000 7f3ddeffd640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3dcc077010 0x7f3dcc079520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3de01f17a0 tx=0x7f3dd4006b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:04.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.013+0000 7f3dc7fff640 1 -- 172.21.15.120:0/4099766606 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f3dd00551a0 con 0x7f3dc8005f50 2024-07-27T03:10:04.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.230+0000 7f3de625a640 1 -- 172.21.15.120:0/4099766606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3de00af130 con 0x7f3dc8005f50 2024-07-27T03:10:04.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.231+0000 7f3dc7fff640 1 -- 172.21.15.120:0/4099766606 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+3917 (secure 0 0 0) 0x7f3dd0061d40 con 0x7f3dc8005f50 2024-07-27T03:10:04.235 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:04.235 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"btime":"2024-07-27T03:09:57:847803+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2961373787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2961373787},{"type":"v1","addr":"172.21.15.121:6836","nonce":2961373787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/2465352861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":2465352861},{"type":"v1","addr":"172.21.15.121:6837","nonce":2465352861}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/26143567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":26143567},{"type":"v1","addr":"172.21.15.120:6833","nonce":26143567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/4135344055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":4135344055},{"type":"v1","addr":"172.21.15.120:6835","nonce":4135344055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[]} 2024-07-27T03:10:04.235 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 27 2024-07-27T03:10:04.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 -- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3dcc077010 msgr2=0x7f3dcc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:04.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3dcc077010 0x7f3dcc079520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3de01f17a0 tx=0x7f3dd4006b50 comp rx=0 tx=0).stop 2024-07-27T03:10:04.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 -- 172.21.15.120:0/4099766606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dc8005f50 msgr2=0x7f3de014d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:04.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dc8005f50 0x7f3de014d0c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000e740 tx=0x7f3dd000ec00 comp rx=0 tx=0).stop 2024-07-27T03:10:04.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 -- 172.21.15.120:0/4099766606 shutdown_connections 2024-07-27T03:10:04.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3dcc077010 0x7f3dcc079520 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:04.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3de0149400 0x7f3de01f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:04.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3de01595e0 0x7f3de01f0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:04.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 --2- 172.21.15.120:0/4099766606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3dc8005f50 0x7f3de014d0c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:04.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 -- 172.21.15.120:0/4099766606 >> 172.21.15.120:0/4099766606 conn(0x7f3de00b1a10 msgr2=0x7f3de00b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:04.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 -- 172.21.15.120:0/4099766606 shutdown_connections 2024-07-27T03:10:04.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.233+0000 7f3de625a640 1 -- 172.21.15.120:0/4099766606 wait complete. 2024-07-27T03:10:04.248 INFO:tasks.ceph.mds.a:Restarting daemon 2024-07-27T03:10:04.249 INFO:tasks.ceph.mds.a:Stopping old one... 2024-07-27T03:10:04.249 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-07-27T03:10:04.249 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:10:04.249 INFO:tasks.ceph.mds.c:Restarting daemon 2024-07-27T03:10:04.249 INFO:tasks.ceph.mds.c:Stopping old one... 2024-07-27T03:10:04.249 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-07-27T03:10:04.249 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:10:04.250 INFO:tasks.ceph.mds.b:Restarting daemon 2024-07-27T03:10:04.250 INFO:tasks.ceph.mds.b:Stopping old one... 2024-07-27T03:10:04.250 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-07-27T03:10:04.250 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:10:04.250 INFO:tasks.ceph.mds.d:Restarting daemon 2024-07-27T03:10:04.250 INFO:tasks.ceph.mds.d:Stopping old one... 2024-07-27T03:10:04.251 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-07-27T03:10:04.251 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:10:04.261 INFO:tasks.ceph.mds.b:Stopped 2024-07-27T03:10:04.261 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-07-27T03:10:04.262 INFO:tasks.ceph.mds.a:Stopped 2024-07-27T03:10:04.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-07-27T03:10:04.263 INFO:tasks.ceph.mds.c:Stopped 2024-07-27T03:10:04.264 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-07-27T03:10:04.265 INFO:tasks.ceph.mds.d:Stopped 2024-07-27T03:10:04.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-07-27T03:10:04.305 INFO:tasks.ceph.mds.a:Started 2024-07-27T03:10:04.305 DEBUG:teuthology.parallel:result is None 2024-07-27T03:10:04.306 INFO:tasks.ceph.mds.c:Started 2024-07-27T03:10:04.306 DEBUG:teuthology.parallel:result is None 2024-07-27T03:10:04.307 INFO:tasks.ceph.mds.b:Started 2024-07-27T03:10:04.307 DEBUG:teuthology.parallel:result is None 2024-07-27T03:10:04.309 INFO:tasks.ceph.mds.d:Started 2024-07-27T03:10:04.309 DEBUG:teuthology.parallel:result is None 2024-07-27T03:10:04.309 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-07-27T03:10:04.391 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-07-27T03:10:04.393 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-07-27T03:10:04.394 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-07-27T03:10:04.394 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-07-27T03:10:04.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.427+0000 7f270e957640 1 -- 172.21.15.120:0/338900415 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27080b4740 msgr2=0x7f27080b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:04.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.427+0000 7f270e957640 1 --2- 172.21.15.120:0/338900415 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27080b4740 0x7f27080b2c40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f26f8005fd0 tx=0x7f26f802a5d0 comp rx=0 tx=0).stop 2024-07-27T03:10:04.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.427+0000 7f270e957640 1 -- 172.21.15.120:0/338900415 shutdown_connections 2024-07-27T03:10:04.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.427+0000 7f270e957640 1 --2- 172.21.15.120:0/338900415 >> v2:172.21.15.121:3300/0 conn(0x7f27080d10d0 0x7f27080d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:04.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.427+0000 7f270e957640 1 --2- 172.21.15.120:0/338900415 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27080b4740 0x7f27080b2c40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:04.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.427+0000 7f270e957640 1 -- 172.21.15.120:0/338900415 >> 172.21.15.120:0/338900415 conn(0x7f270808d690 msgr2=0x7f270809d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:04.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.427+0000 7f270e957640 1 -- 172.21.15.120:0/338900415 shutdown_connections 2024-07-27T03:10:04.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.427+0000 7f270e957640 1 -- 172.21.15.120:0/338900415 wait complete. 2024-07-27T03:10:04.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.429+0000 7f270e957640 1 Processor -- start 2024-07-27T03:10:04.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.429+0000 7f270e957640 1 -- start start 2024-07-27T03:10:04.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.430+0000 7f270e957640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27080b4740 0x7f27080a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:04.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.430+0000 7f270e957640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27080d27e0 0x7f27081f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:04.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.430+0000 7f270e957640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27080b82c0 0x7f27080b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.430+0000 7f270e957640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f27080cef70 con 0x7f27080d27e0 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.430+0000 7f270e957640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f27080cedf0 con 0x7f27080b4740 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.430+0000 7f270e957640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f27080cf0f0 con 0x7f27080b82c0 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.430+0000 7f27077fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27080d27e0 0x7f27081f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.430+0000 7f2707fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27080b4740 0x7f27080a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f270cef4640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27080b82c0 0x7f27080b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f2707fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27080b4740 0x7f27080a1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.120:58792/0 (socket says 172.21.15.120:58792) 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f2707fff640 1 -- 172.21.15.120:0/1052436348 learned_addr learned my addr 172.21.15.120:0/1052436348 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f270cef4640 1 -- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27080b4740 msgr2=0x7f27080a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f270cef4640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27080b4740 0x7f27080a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f270cef4640 1 -- 172.21.15.120:0/1052436348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27080d27e0 msgr2=0x7f27081f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f270cef4640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27080d27e0 0x7f27081f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:04.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f270cef4640 1 -- 172.21.15.120:0/1052436348 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27081f57b0 con 0x7f27080b82c0 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f2707fff640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27080b4740 0x7f27080a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f270cef4640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27080b82c0 0x7f27080b86d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2700005fd0 tx=0x7f270000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f2704ff9640 1 -- 172.21.15.120:0/1052436348 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270000cd80 con 0x7f27080b82c0 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f2704ff9640 1 -- 172.21.15.120:0/1052436348 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2700004b20 con 0x7f27080b82c0 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f270e957640 1 -- 172.21.15.120:0/1052436348 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27080b8c10 con 0x7f27080b82c0 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f2704ff9640 1 -- 172.21.15.120:0/1052436348 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2700005020 con 0x7f27080b82c0 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.431+0000 7f270e957640 1 -- 172.21.15.120:0/1052436348 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f27081f5f60 con 0x7f27080b82c0 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.432+0000 7f270e957640 1 -- 172.21.15.120:0/1052436348 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27080d2bf0 con 0x7f27080b82c0 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.433+0000 7f2704ff9640 1 -- 172.21.15.120:0/1052436348 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f27000051c0 con 0x7f27080b82c0 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.433+0000 7f2704ff9640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f26f4077010 0x7f26f4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.433+0000 7f2704ff9640 1 -- 172.21.15.120:0/1052436348 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 5115+0+0 (secure 0 0 0) 0x7f2700099280 con 0x7f27080b82c0 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.433+0000 7f2707fff640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f26f4077010 0x7f26f4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:04.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.434+0000 7f2707fff640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f26f4077010 0x7f26f4079520 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009230 tx=0x7f26f8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:04.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.438+0000 7f2704ff9640 1 -- 172.21.15.120:0/1052436348 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f27080b8c10 con 0x7f27080b82c0 2024-07-27T03:10:04.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:04.633+0000 7f270e957640 1 -- 172.21.15.120:0/1052436348 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f27081f5a10 con 0x7f27080b82c0 2024-07-27T03:10:05.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.034+0000 7f2704ff9640 1 -- 172.21.15.120:0/1052436348 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) ==== 97+0+0 (secure 0 0 0) 0x7f27000620c0 con 0x7f27080b82c0 2024-07-27T03:10:05.037 INFO:teuthology.orchestra.run.smithi120.stderr: removed all blocklist entries 2024-07-27T03:10:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 -- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f26f4077010 msgr2=0x7f26f4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f26f4077010 0x7f26f4079520 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009230 tx=0x7f26f8004730 comp rx=0 tx=0).stop 2024-07-27T03:10:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 -- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27080b82c0 msgr2=0x7f27080b86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27080b82c0 0x7f27080b86d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2700005fd0 tx=0x7f270000ee40 comp rx=0 tx=0).stop 2024-07-27T03:10:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 -- 172.21.15.120:0/1052436348 shutdown_connections 2024-07-27T03:10:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f26f4077010 0x7f26f4079520 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27080d27e0 0x7f27081f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27080b82c0 0x7f27080b86d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 --2- 172.21.15.120:0/1052436348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27080b4740 0x7f27080a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 -- 172.21.15.120:0/1052436348 >> 172.21.15.120:0/1052436348 conn(0x7f270808d690 msgr2=0x7f27080b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 -- 172.21.15.120:0/1052436348 shutdown_connections 2024-07-27T03:10:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.036+0000 7f270e957640 1 -- 172.21.15.120:0/1052436348 wait complete. 2024-07-27T03:10:05.052 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-07-27T03:10:05.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.162+0000 7f739b6d2640 1 -- 172.21.15.120:0/4040732679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739415c220 msgr2=0x7f7394152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.162+0000 7f739b6d2640 1 --2- 172.21.15.120:0/4040732679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739415c220 0x7f7394152160 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7390009830 tx=0x7f739002a500 comp rx=0 tx=0).stop 2024-07-27T03:10:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.162+0000 7f739b6d2640 1 -- 172.21.15.120:0/4040732679 shutdown_connections 2024-07-27T03:10:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.162+0000 7f739b6d2640 1 --2- 172.21.15.120:0/4040732679 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f739415ec20 0x7f739415f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.162+0000 7f739b6d2640 1 --2- 172.21.15.120:0/4040732679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739415c220 0x7f7394152160 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.162+0000 7f739b6d2640 1 -- 172.21.15.120:0/4040732679 >> 172.21.15.120:0/4040732679 conn(0x7f739406cba0 msgr2=0x7f739406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.162+0000 7f739b6d2640 1 -- 172.21.15.120:0/4040732679 shutdown_connections 2024-07-27T03:10:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.162+0000 7f739b6d2640 1 -- 172.21.15.120:0/4040732679 wait complete. 2024-07-27T03:10:05.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.164+0000 7f739b6d2640 1 Processor -- start 2024-07-27T03:10:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.164+0000 7f739b6d2640 1 -- start start 2024-07-27T03:10:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f739b6d2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73940b5cd0 0x7f7394159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f739b6d2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739415c220 0x7f73940c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f739b6d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f739415ec20 0x7f73941f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f739b6d2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f73940cdbc0 con 0x7f739415c220 2024-07-27T03:10:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f739b6d2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f73940cda40 con 0x7f739415ec20 2024-07-27T03:10:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f739b6d2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f73940cdd40 con 0x7f73940b5cd0 2024-07-27T03:10:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f7398c6d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739415c220 0x7f73940c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f7398c6d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739415c220 0x7f73940c6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60856/0 (socket says 172.21.15.120:60856) 2024-07-27T03:10:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f7398c6d640 1 -- 172.21.15.120:0/3715382113 learned_addr learned my addr 172.21.15.120:0/3715382113 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f7399c6f640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f739415ec20 0x7f73941f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f739946e640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73940b5cd0 0x7f7394159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f7398c6d640 1 -- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73940b5cd0 msgr2=0x7f7394159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f7398c6d640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73940b5cd0 0x7f7394159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f7398c6d640 1 -- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f739415ec20 msgr2=0x7f73941f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f7398c6d640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f739415ec20 0x7f73941f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.165+0000 7f7398c6d640 1 -- 172.21.15.120:0/3715382113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73940c6bd0 con 0x7f739415c220 2024-07-27T03:10:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.166+0000 7f7398c6d640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739415c220 0x7f73940c6f60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f738400c3c0 tx=0x7f738400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.166+0000 7f7389ffb640 1 -- 172.21.15.120:0/3715382113 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384017070 con 0x7f739415c220 2024-07-27T03:10:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.166+0000 7f7389ffb640 1 -- 172.21.15.120:0/3715382113 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73840035f0 con 0x7f739415c220 2024-07-27T03:10:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.166+0000 7f739b6d2640 1 -- 172.21.15.120:0/3715382113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73940ccd90 con 0x7f739415c220 2024-07-27T03:10:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.166+0000 7f7389ffb640 1 -- 172.21.15.120:0/3715382113 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384003a80 con 0x7f739415c220 2024-07-27T03:10:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.166+0000 7f739b6d2640 1 -- 172.21.15.120:0/3715382113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73940c68f0 con 0x7f739415c220 2024-07-27T03:10:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.167+0000 7f739b6d2640 1 -- 172.21.15.120:0/3715382113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73940ce260 con 0x7f739415c220 2024-07-27T03:10:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.168+0000 7f7389ffb640 1 -- 172.21.15.120:0/3715382113 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f738401a070 con 0x7f739415c220 2024-07-27T03:10:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.168+0000 7f7389ffb640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7378077010 0x7f7378079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.168+0000 7f7389ffb640 1 -- 172.21.15.120:0/3715382113 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f7384097770 con 0x7f739415c220 2024-07-27T03:10:05.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.168+0000 7f739946e640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7378077010 0x7f7378079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.169+0000 7f739946e640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7378077010 0x7f7378079520 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7390034000 tx=0x7f7390004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:05.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.173+0000 7f7389ffb640 1 -- 172.21.15.120:0/3715382113 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f7384060790 con 0x7f739415c220 2024-07-27T03:10:05.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.423+0000 7f739b6d2640 1 -- 172.21.15.120:0/3715382113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f73940c74a0 con 0x7f739415c220 2024-07-27T03:10:05.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.424+0000 7f7389ffb640 1 -- 172.21.15.120:0/3715382113 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f7384064ce0 con 0x7f739415c220 2024-07-27T03:10:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:05.428 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:10:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_dump": [ 2024-07-27T03:10:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.428 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.a", 2024-07-27T03:10:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRm7HVTGBAADA2eiX5COiTN6OTelto+6g==", 2024-07-27T03:10:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:10:05.429 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:10:05.430 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:10:05.430 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.431 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.b", 2024-07-27T03:10:05.431 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmMfl8JRAA+4W3m5lICDf6dIU1dELj5Q==", 2024-07-27T03:10:05.431 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.431 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:10:05.431 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:10:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:10:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.c", 2024-07-27T03:10:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmDnDuHxAAWKoH2jvhBqPNxL7NrtCJuw==", 2024-07-27T03:10:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:10:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:10:05.432 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.d", 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmxkcwLRAAMzpPET/zdPCxfhbsMeLJuQ==", 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.0", 2024-07-27T03:10:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCCZKRmtTNTChAAYbSo/j1WO/4nocsPhy8JRw==", 2024-07-27T03:10:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:10:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:10:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.434 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.1", 2024-07-27T03:10:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCFZKRmLRqlCBAAYgYpmzL3If445MkxGxBKHw==", 2024-07-27T03:10:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:10:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:10:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.2", 2024-07-27T03:10:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCIZKRmDhKBBhAAl6K58lvyVrAqfWffwAr1Mg==", 2024-07-27T03:10:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:10:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:10:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.3", 2024-07-27T03:10:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCLZKRmUDrLBBAAyUyAP/dCtMZVZpzi7TZIzA==", 2024-07-27T03:10:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.437 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:10:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:10:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.4", 2024-07-27T03:10:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCRZKRmXRMoCRAAcfX7u17DIoxM9dK3/TFu8Q==", 2024-07-27T03:10:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:10:05.438 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:10:05.439 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.439 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.5", 2024-07-27T03:10:05.439 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCUZKRmyaL0BxAANbxggtK64zbog9+KDXeOew==", 2024-07-27T03:10:05.439 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.439 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:10:05.439 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:10:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.6", 2024-07-27T03:10:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCXZKRmATKrBhAAeEBqJxkOoQozFzw1yeL6lw==", 2024-07-27T03:10:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.440 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:10:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:10:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.7", 2024-07-27T03:10:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCaZKRmCh6nBBAA8Cc+xOuBxqDAUgpweyq23A==", 2024-07-27T03:10:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:10:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:10:05.441 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.0", 2024-07-27T03:10:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmI8baMRAArCIL9NNNVlevij0JAWwGwg==", 2024-07-27T03:10:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:10:05.442 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow r", 2024-07-27T03:10:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-07-27T03:10:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.1", 2024-07-27T03:10:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmgOpnORAAkcLaNUd6cnsV/sHwOOI+2w==", 2024-07-27T03:10:05.443 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.2", 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmwOSdNRAALgx82wMQ+5fPOrFL/qhj8g==", 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:10:05.444 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.3", 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB/ZKRmHh6PARAAZ9nBBam/kVvT6C1aFbNC3g==", 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:10:05.445 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.admin", 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB9ZKRmpVPmNRAAay22/X8LO2KsI86ehHZ/MA==", 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.x", 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmFsR+FBAA8tKKAi2Y/Yaxxca+ep3BRQ==", 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.y", 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmWLnrDxAAfy1pvcoGJESVPs9k+so+/A==", 2024-07-27T03:10:05.447 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:10:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:10:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2024-07-27T03:10:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:10:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.448 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-07-27T03:10:05.448 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:10:05.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 -- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7378077010 msgr2=0x7f7378079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7378077010 0x7f7378079520 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7390034000 tx=0x7f7390004730 comp rx=0 tx=0).stop 2024-07-27T03:10:05.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 -- 172.21.15.120:0/3715382113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739415c220 msgr2=0x7f73940c6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739415c220 0x7f73940c6f60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f738400c3c0 tx=0x7f738400c880 comp rx=0 tx=0).stop 2024-07-27T03:10:05.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 -- 172.21.15.120:0/3715382113 shutdown_connections 2024-07-27T03:10:05.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7378077010 0x7f7378079520 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739415c220 0x7f73940c6f60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f739415ec20 0x7f73941f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 --2- 172.21.15.120:0/3715382113 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73940b5cd0 0x7f7394159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 -- 172.21.15.120:0/3715382113 >> 172.21.15.120:0/3715382113 conn(0x7f739406cba0 msgr2=0x7f73940b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:05.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 -- 172.21.15.120:0/3715382113 shutdown_connections 2024-07-27T03:10:05.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.426+0000 7f739b6d2640 1 -- 172.21.15.120:0/3715382113 wait complete. 2024-07-27T03:10:05.451 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-07-27T03:10:05.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.561+0000 7f613cbe7640 1 -- 172.21.15.120:0/37459004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f613815ec10 msgr2=0x7f613815f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.561+0000 7f613cbe7640 1 --2- 172.21.15.120:0/37459004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f613815ec10 0x7f613815f020 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6128009830 tx=0x7f612802a480 comp rx=0 tx=0).stop 2024-07-27T03:10:05.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.561+0000 7f613cbe7640 1 -- 172.21.15.120:0/37459004 shutdown_connections 2024-07-27T03:10:05.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.561+0000 7f613cbe7640 1 --2- 172.21.15.120:0/37459004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f613815ec10 0x7f613815f020 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.561+0000 7f613cbe7640 1 --2- 172.21.15.120:0/37459004 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f613806e270 0x7f6138073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.561+0000 7f613cbe7640 1 -- 172.21.15.120:0/37459004 >> 172.21.15.120:0/37459004 conn(0x7f61380b1a10 msgr2=0x7f61380b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:05.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.561+0000 7f613cbe7640 1 -- 172.21.15.120:0/37459004 shutdown_connections 2024-07-27T03:10:05.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.561+0000 7f613cbe7640 1 -- 172.21.15.120:0/37459004 wait complete. 2024-07-27T03:10:05.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.563+0000 7f613cbe7640 1 Processor -- start 2024-07-27T03:10:05.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.563+0000 7f613cbe7640 1 -- start start 2024-07-27T03:10:05.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.564+0000 7f613cbe7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f613806e270 0x7f6138144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.564+0000 7f613cbe7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61381522e0 0x7f613809d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.564+0000 7f613cbe7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613815ec10 0x7f61381f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.564+0000 7f613cbe7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f613815f8f0 con 0x7f61381522e0 2024-07-27T03:10:05.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.564+0000 7f613cbe7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f613815f770 con 0x7f613815ec10 2024-07-27T03:10:05.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.564+0000 7f613cbe7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f613815fa70 con 0x7f613806e270 2024-07-27T03:10:05.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.564+0000 7f6135d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61381522e0 0x7f613809d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.564+0000 7f6135d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61381522e0 0x7f613809d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60870/0 (socket says 172.21.15.120:60870) 2024-07-27T03:10:05.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.564+0000 7f6135d9b640 1 -- 172.21.15.120:0/2594268764 learned_addr learned my addr 172.21.15.120:0/2594268764 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:05.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.564+0000 7f613659c640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f613806e270 0x7f6138144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f6135d9b640 1 -- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f613806e270 msgr2=0x7f6138144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f6135d9b640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f613806e270 0x7f6138144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f6136d9d640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613815ec10 0x7f61381f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f6135d9b640 1 -- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613815ec10 msgr2=0x7f61381f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f6135d9b640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613815ec10 0x7f61381f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f6135d9b640 1 -- 172.21.15.120:0/2594268764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613809dc00 con 0x7f61381522e0 2024-07-27T03:10:05.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f613659c640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f613806e270 0x7f6138144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:05.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f6135d9b640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61381522e0 0x7f613809d6c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f612000c970 tx=0x7f612000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:05.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f612effd640 1 -- 172.21.15.120:0/2594268764 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120007b50 con 0x7f61381522e0 2024-07-27T03:10:05.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f612effd640 1 -- 172.21.15.120:0/2594268764 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6120007de0 con 0x7f61381522e0 2024-07-27T03:10:05.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f612effd640 1 -- 172.21.15.120:0/2594268764 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120005280 con 0x7f61381522e0 2024-07-27T03:10:05.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f613cbe7640 1 -- 172.21.15.120:0/2594268764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613815b100 con 0x7f61381522e0 2024-07-27T03:10:05.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.565+0000 7f613cbe7640 1 -- 172.21.15.120:0/2594268764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613815b6c0 con 0x7f61381522e0 2024-07-27T03:10:05.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.566+0000 7f613cbe7640 1 -- 172.21.15.120:0/2594268764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6138155aa0 con 0x7f61381522e0 2024-07-27T03:10:05.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.567+0000 7f612effd640 1 -- 172.21.15.120:0/2594268764 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6120005420 con 0x7f61381522e0 2024-07-27T03:10:05.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.567+0000 7f612effd640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6118077010 0x7f6118079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.567+0000 7f612effd640 1 -- 172.21.15.120:0/2594268764 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f61200988e0 con 0x7f61381522e0 2024-07-27T03:10:05.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.568+0000 7f613659c640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6118077010 0x7f6118079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.568+0000 7f613659c640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6118077010 0x7f6118079520 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f61300012e0 tx=0x7f6130009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:05.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.572+0000 7f612effd640 1 -- 172.21.15.120:0/2594268764 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6138155aa0 con 0x7f61381522e0 2024-07-27T03:10:05.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.753+0000 7f613cbe7640 1 -- 172.21.15.120:0/2594268764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f61380b45a0 con 0x7f61381522e0 2024-07-27T03:10:05.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.754+0000 7f612effd640 1 -- 172.21.15.120:0/2594268764 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) ==== 84+0+65 (secure 0 0 0) 0x7f61380b45a0 con 0x7f61381522e0 2024-07-27T03:10:05.757 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:05.757 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-07-27T03:10:05.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:10:05.758 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2024-07-27T03:10:05.758 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2024-07-27T03:10:05.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:10:05.758 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-07-27T03:10:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 -- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6118077010 msgr2=0x7f6118079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6118077010 0x7f6118079520 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f61300012e0 tx=0x7f6130009040 comp rx=0 tx=0).stop 2024-07-27T03:10:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 -- 172.21.15.120:0/2594268764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61381522e0 msgr2=0x7f613809d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61381522e0 0x7f613809d6c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f612000c970 tx=0x7f612000ce30 comp rx=0 tx=0).stop 2024-07-27T03:10:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 -- 172.21.15.120:0/2594268764 shutdown_connections 2024-07-27T03:10:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6118077010 0x7f6118079520 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f61381522e0 0x7f613809d6c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f613815ec10 0x7f61381f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 --2- 172.21.15.120:0/2594268764 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f613806e270 0x7f6138144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 -- 172.21.15.120:0/2594268764 >> 172.21.15.120:0/2594268764 conn(0x7f61380b1a10 msgr2=0x7f61380b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 -- 172.21.15.120:0/2594268764 shutdown_connections 2024-07-27T03:10:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.756+0000 7f613cbe7640 1 -- 172.21.15.120:0/2594268764 wait complete. 2024-07-27T03:10:05.771 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-07-27T03:10:05.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-07-27T03:10:05.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.884+0000 7f73d00d2640 1 -- 172.21.15.120:0/1926388887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73c80733c0 msgr2=0x7f73c80737d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.884+0000 7f73d00d2640 1 --2- 172.21.15.120:0/1926388887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73c80733c0 0x7f73c80737d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f73c0005fd0 tx=0x7f73c002aa30 comp rx=0 tx=0).stop 2024-07-27T03:10:05.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.884+0000 7f73d00d2640 1 -- 172.21.15.120:0/1926388887 shutdown_connections 2024-07-27T03:10:05.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.884+0000 7f73d00d2640 1 --2- 172.21.15.120:0/1926388887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73c80733c0 0x7f73c80737d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.884+0000 7f73d00d2640 1 --2- 172.21.15.120:0/1926388887 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73c80cfe50 0x7f73c815b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.884+0000 7f73d00d2640 1 -- 172.21.15.120:0/1926388887 >> 172.21.15.120:0/1926388887 conn(0x7f73c80d0ea0 msgr2=0x7f73c80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:05.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.884+0000 7f73d00d2640 1 -- 172.21.15.120:0/1926388887 shutdown_connections 2024-07-27T03:10:05.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.884+0000 7f73d00d2640 1 -- 172.21.15.120:0/1926388887 wait complete. 2024-07-27T03:10:05.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.886+0000 7f73d00d2640 1 Processor -- start 2024-07-27T03:10:05.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.886+0000 7f73d00d2640 1 -- start start 2024-07-27T03:10:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.887+0000 7f73d00d2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73c8071530 0x7f73c81f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.887+0000 7f73d00d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c80733c0 0x7f73c8155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.887+0000 7f73d00d2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73c80cfe50 0x7f73c814d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.887+0000 7f73d00d2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f73c80cebf0 con 0x7f73c80cfe50 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.887+0000 7f73d00d2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f73c80cea70 con 0x7f73c80733c0 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.887+0000 7f73d00d2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f73c80ced70 con 0x7f73c8071530 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.887+0000 7f73ce66f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73c80cfe50 0x7f73c814d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73ce66f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73c80cfe50 0x7f73c814d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60890/0 (socket says 172.21.15.120:60890) 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73ce66f640 1 -- 172.21.15.120:0/3710061979 learned_addr learned my addr 172.21.15.120:0/3710061979 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73cd66d640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c80733c0 0x7f73c8155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73cde6e640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73c8071530 0x7f73c81f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73ce66f640 1 -- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73c8071530 msgr2=0x7f73c81f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73ce66f640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73c8071530 0x7f73c81f3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73ce66f640 1 -- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c80733c0 msgr2=0x7f73c8155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73ce66f640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c80733c0 0x7f73c8155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73ce66f640 1 -- 172.21.15.120:0/3710061979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c8156170 con 0x7f73c80cfe50 2024-07-27T03:10:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73cd66d640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c80733c0 0x7f73c8155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73cde6e640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73c8071530 0x7f73c81f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73ce66f640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73c80cfe50 0x7f73c814d2e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f73c0006010 tx=0x7f73c0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73be7fc640 1 -- 172.21.15.120:0/3710061979 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0046070 con 0x7f73c80cfe50 2024-07-27T03:10:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73be7fc640 1 -- 172.21.15.120:0/3710061979 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73c00045c0 con 0x7f73c80cfe50 2024-07-27T03:10:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73d00d2640 1 -- 172.21.15.120:0/3710061979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c80c4b60 con 0x7f73c80cfe50 2024-07-27T03:10:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73be7fc640 1 -- 172.21.15.120:0/3710061979 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0033070 con 0x7f73c80cfe50 2024-07-27T03:10:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.888+0000 7f73d00d2640 1 -- 172.21.15.120:0/3710061979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c80c5120 con 0x7f73c80cfe50 2024-07-27T03:10:05.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.889+0000 7f73d00d2640 1 -- 172.21.15.120:0/3710061979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c80cf290 con 0x7f73c80cfe50 2024-07-27T03:10:05.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.890+0000 7f73be7fc640 1 -- 172.21.15.120:0/3710061979 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f73c0049070 con 0x7f73c80cfe50 2024-07-27T03:10:05.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.890+0000 7f73be7fc640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f73ac077040 0x7f73ac079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:05.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.890+0000 7f73be7fc640 1 -- 172.21.15.120:0/3710061979 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f73c00b98a0 con 0x7f73c80cfe50 2024-07-27T03:10:05.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.890+0000 7f73cde6e640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f73ac077040 0x7f73ac079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:05.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.891+0000 7f73cde6e640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f73ac077040 0x7f73ac079550 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f73c40058c0 tx=0x7f73c4005c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:05.895+0000 7f73be7fc640 1 -- 172.21.15.120:0/3710061979 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f73c003e070 con 0x7f73c80cfe50 2024-07-27T03:10:06.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:06.083+0000 7f73d00d2640 1 -- 172.21.15.120:0/3710061979 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f73c8075b20 con 0x7f73c80cfe50 2024-07-27T03:10:07.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.035+0000 7f73be7fc640 1 -- 172.21.15.120:0/3710061979 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) ==== 138+0+0 (secure 0 0 0) 0x7f73c0082e80 con 0x7f73c80cfe50 2024-07-27T03:10:07.038 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2024-07-27T03:10:07.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 -- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f73ac077040 msgr2=0x7f73ac079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:07.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f73ac077040 0x7f73ac079550 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f73c40058c0 tx=0x7f73c4005c90 comp rx=0 tx=0).stop 2024-07-27T03:10:07.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 -- 172.21.15.120:0/3710061979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73c80cfe50 msgr2=0x7f73c814d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:07.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73c80cfe50 0x7f73c814d2e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f73c0006010 tx=0x7f73c0003f10 comp rx=0 tx=0).stop 2024-07-27T03:10:07.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 -- 172.21.15.120:0/3710061979 shutdown_connections 2024-07-27T03:10:07.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f73ac077040 0x7f73ac079550 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:07.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73c80cfe50 0x7f73c814d2e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:07.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c80733c0 0x7f73c8155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:07.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 --2- 172.21.15.120:0/3710061979 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f73c8071530 0x7f73c81f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:07.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 -- 172.21.15.120:0/3710061979 >> 172.21.15.120:0/3710061979 conn(0x7f73c80d0ea0 msgr2=0x7f73c815a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:07.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 -- 172.21.15.120:0/3710061979 shutdown_connections 2024-07-27T03:10:07.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.037+0000 7f73d00d2640 1 -- 172.21.15.120:0/3710061979 wait complete. 2024-07-27T03:10:07.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-07-27T03:10:07.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.176+0000 7fe48a2fa640 1 -- 172.21.15.120:0/2884720326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe484073e20 msgr2=0x7fe4841554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:07.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.176+0000 7fe48a2fa640 1 --2- 172.21.15.120:0/2884720326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe484073e20 0x7fe4841554a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe478009830 tx=0x7fe47802a480 comp rx=0 tx=0).stop 2024-07-27T03:10:07.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.176+0000 7fe48a2fa640 1 -- 172.21.15.120:0/2884720326 shutdown_connections 2024-07-27T03:10:07.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.176+0000 7fe48a2fa640 1 --2- 172.21.15.120:0/2884720326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe484073e20 0x7fe4841554a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:07.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.176+0000 7fe48a2fa640 1 -- 172.21.15.120:0/2884720326 >> 172.21.15.120:0/2884720326 conn(0x7fe4840b1a10 msgr2=0x7fe4840b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:07.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.176+0000 7fe48a2fa640 1 -- 172.21.15.120:0/2884720326 shutdown_connections 2024-07-27T03:10:07.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.176+0000 7fe48a2fa640 1 -- 172.21.15.120:0/2884720326 wait complete. 2024-07-27T03:10:07.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.178+0000 7fe48a2fa640 1 Processor -- start 2024-07-27T03:10:07.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.178+0000 7fe48a2fa640 1 -- start start 2024-07-27T03:10:07.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.179+0000 7fe48a2fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe48406e270 0x7fe4841e8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:07.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.179+0000 7fe48a2fa640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe484073e20 0x7fe4841e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:07.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.179+0000 7fe48a2fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe48415eb40 0x7fe4840b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:07.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.179+0000 7fe48a2fa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe48415f880 con 0x7fe48406e270 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.179+0000 7fe48a2fa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4840b4f90 con 0x7fe48415eb40 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.179+0000 7fe48a2fa640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe4840b3f90 con 0x7fe484073e20 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.179+0000 7fe483fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe48406e270 0x7fe4841e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.179+0000 7fe483fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe48406e270 0x7fe4841e8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60906/0 (socket says 172.21.15.120:60906) 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.179+0000 7fe483fff640 1 -- 172.21.15.120:0/3943122189 learned_addr learned my addr 172.21.15.120:0/3943122189 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe4837fe640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe484073e20 0x7fe4841e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe488897640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe48415eb40 0x7fe4840b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe483fff640 1 -- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe484073e20 msgr2=0x7fe4841e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe483fff640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe484073e20 0x7fe4841e6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe483fff640 1 -- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe48415eb40 msgr2=0x7fe4840b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe483fff640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe48415eb40 0x7fe4840b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe483fff640 1 -- 172.21.15.120:0/3943122189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4841f5bc0 con 0x7fe48406e270 2024-07-27T03:10:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe4837fe640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe484073e20 0x7fe4841e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe488897640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe48415eb40 0x7fe4840b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe483fff640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe48406e270 0x7fe4841e8270 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c3c0 tx=0x7fe47400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe480ff9640 1 -- 172.21.15.120:0/3943122189 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474017070 con 0x7fe48406e270 2024-07-27T03:10:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe480ff9640 1 -- 172.21.15.120:0/3943122189 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4740035f0 con 0x7fe48406e270 2024-07-27T03:10:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe480ff9640 1 -- 172.21.15.120:0/3943122189 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474003a80 con 0x7fe48406e270 2024-07-27T03:10:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe48a2fa640 1 -- 172.21.15.120:0/3943122189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4841f5ea0 con 0x7fe48406e270 2024-07-27T03:10:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.180+0000 7fe48a2fa640 1 -- 172.21.15.120:0/3943122189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4841f6460 con 0x7fe48406e270 2024-07-27T03:10:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.181+0000 7fe48a2fa640 1 -- 172.21.15.120:0/3943122189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4840b4ba0 con 0x7fe48406e270 2024-07-27T03:10:07.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.182+0000 7fe480ff9640 1 -- 172.21.15.120:0/3943122189 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe47401a070 con 0x7fe48406e270 2024-07-27T03:10:07.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.182+0000 7fe480ff9640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe470077010 0x7fe470079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:07.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.183+0000 7fe480ff9640 1 -- 172.21.15.120:0/3943122189 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5227+0+0 (secure 0 0 0) 0x7fe474097af0 con 0x7fe48406e270 2024-07-27T03:10:07.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.183+0000 7fe4837fe640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe470077010 0x7fe470079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:07.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.183+0000 7fe4837fe640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe470077010 0x7fe470079520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe478034000 tx=0x7fe478004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:07.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.187+0000 7fe480ff9640 1 -- 172.21.15.120:0/3943122189 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fe4840b4ba0 con 0x7fe48406e270 2024-07-27T03:10:07.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:07.370+0000 7fe48a2fa640 1 -- 172.21.15.120:0/3943122189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe4841554a0 con 0x7fe48406e270 2024-07-27T03:10:08.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.037+0000 7fe480ff9640 1 -- 172.21.15.120:0/3943122189 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) ==== 170+0+0 (secure 0 0 0) 0x7fe484074230 con 0x7fe48406e270 2024-07-27T03:10:08.040 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2024-07-27T03:10:08.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 -- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe470077010 msgr2=0x7fe470079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:08.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe470077010 0x7fe470079520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe478034000 tx=0x7fe478004730 comp rx=0 tx=0).stop 2024-07-27T03:10:08.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 -- 172.21.15.120:0/3943122189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe48406e270 msgr2=0x7fe4841e8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:08.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe48406e270 0x7fe4841e8270 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c3c0 tx=0x7fe47400c880 comp rx=0 tx=0).stop 2024-07-27T03:10:08.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 -- 172.21.15.120:0/3943122189 shutdown_connections 2024-07-27T03:10:08.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe470077010 0x7fe470079520 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:08.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe48415eb40 0x7fe4840b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:08.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe484073e20 0x7fe4841e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:08.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 --2- 172.21.15.120:0/3943122189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe48406e270 0x7fe4841e8270 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:08.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 -- 172.21.15.120:0/3943122189 >> 172.21.15.120:0/3943122189 conn(0x7fe4840b1a10 msgr2=0x7fe4840cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:08.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 -- 172.21.15.120:0/3943122189 shutdown_connections 2024-07-27T03:10:08.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.039+0000 7fe48a2fa640 1 -- 172.21.15.120:0/3943122189 wait complete. 2024-07-27T03:10:08.065 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-07-27T03:10:08.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.180+0000 7f44d89c7640 1 -- 172.21.15.120:0/1043018143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d40b63e0 msgr2=0x7f44d4152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:08.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.180+0000 7f44d89c7640 1 --2- 172.21.15.120:0/1043018143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d40b63e0 0x7f44d4152160 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009830 tx=0x7f44bc02a500 comp rx=0 tx=0).stop 2024-07-27T03:10:08.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.180+0000 7f44d89c7640 1 -- 172.21.15.120:0/1043018143 shutdown_connections 2024-07-27T03:10:08.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.180+0000 7f44d89c7640 1 --2- 172.21.15.120:0/1043018143 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d415ec20 0x7f44d415f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:08.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.180+0000 7f44d89c7640 1 --2- 172.21.15.120:0/1043018143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d40b63e0 0x7f44d4152160 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:08.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.180+0000 7f44d89c7640 1 -- 172.21.15.120:0/1043018143 >> 172.21.15.120:0/1043018143 conn(0x7f44d406cba0 msgr2=0x7f44d406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:08.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.180+0000 7f44d89c7640 1 -- 172.21.15.120:0/1043018143 shutdown_connections 2024-07-27T03:10:08.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.180+0000 7f44d89c7640 1 -- 172.21.15.120:0/1043018143 wait complete. 2024-07-27T03:10:08.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.182+0000 7f44d89c7640 1 Processor -- start 2024-07-27T03:10:08.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.182+0000 7f44d89c7640 1 -- start start 2024-07-27T03:10:08.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.183+0000 7f44d89c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d415c220 0x7f44d4146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:08.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.183+0000 7f44d89c7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d415ec20 0x7f44d40b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:08.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.183+0000 7f44d89c7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44d4147310 0x7f44d40b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:08.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.183+0000 7f44d89c7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f44d40cdbc0 con 0x7f44d415c220 2024-07-27T03:10:08.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.183+0000 7f44d89c7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44d40cda40 con 0x7f44d4147310 2024-07-27T03:10:08.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.183+0000 7f44d89c7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f44d40cdd40 con 0x7f44d415ec20 2024-07-27T03:10:08.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.183+0000 7f44d259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d415c220 0x7f44d4146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:08.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.183+0000 7f44d259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d415c220 0x7f44d4146750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60928/0 (socket says 172.21.15.120:60928) 2024-07-27T03:10:08.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.183+0000 7f44d259c640 1 -- 172.21.15.120:0/339602090 learned_addr learned my addr 172.21.15.120:0/339602090 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:08.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44d2d9d640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44d4147310 0x7f44d40b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:08.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44c9d9b640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d415ec20 0x7f44d40b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:08.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44d259c640 1 -- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d415ec20 msgr2=0x7f44d40b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:08.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44d259c640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d415ec20 0x7f44d40b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:08.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44d259c640 1 -- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44d4147310 msgr2=0x7f44d40b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:08.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44d259c640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44d4147310 0x7f44d40b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:08.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44d259c640 1 -- 172.21.15.120:0/339602090 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d4146dc0 con 0x7f44d415c220 2024-07-27T03:10:08.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44d259c640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d415c220 0x7f44d4146750 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c390 tx=0x7f44c400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:08.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44cb7fe640 1 -- 172.21.15.120:0/339602090 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4017070 con 0x7f44d415c220 2024-07-27T03:10:08.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44cb7fe640 1 -- 172.21.15.120:0/339602090 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44c40035f0 con 0x7f44d415c220 2024-07-27T03:10:08.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44cb7fe640 1 -- 172.21.15.120:0/339602090 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4003a20 con 0x7f44d415c220 2024-07-27T03:10:08.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44d89c7640 1 -- 172.21.15.120:0/339602090 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d414e7d0 con 0x7f44d415c220 2024-07-27T03:10:08.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.184+0000 7f44d89c7640 1 -- 172.21.15.120:0/339602090 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d414ed90 con 0x7f44d415c220 2024-07-27T03:10:08.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.185+0000 7f44d89c7640 1 -- 172.21.15.120:0/339602090 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d40cea20 con 0x7f44d415c220 2024-07-27T03:10:08.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.187+0000 7f44cb7fe640 1 -- 172.21.15.120:0/339602090 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f44c401a070 con 0x7f44d415c220 2024-07-27T03:10:08.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.187+0000 7f44cb7fe640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f44b4077010 0x7f44b4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:08.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.187+0000 7f44cb7fe640 1 -- 172.21.15.120:0/339602090 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5609+0+0 (secure 0 0 0) 0x7f44c4097ee0 con 0x7f44d415c220 2024-07-27T03:10:08.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.187+0000 7f44c9d9b640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f44b4077010 0x7f44b4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:08.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.188+0000 7f44c9d9b640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f44b4077010 0x7f44b4079520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f44bc034000 tx=0x7f44bc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:08.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.191+0000 7f44cb7fe640 1 -- 172.21.15.120:0/339602090 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f44c4021020 con 0x7f44d415c220 2024-07-27T03:10:08.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:08.409+0000 7f44d89c7640 1 -- 172.21.15.120:0/339602090 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f44d40b3370 con 0x7f44d415c220 2024-07-27T03:10:09.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.067+0000 7f44cb7fe640 1 -- 172.21.15.120:0/339602090 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v30) ==== 172+0+0 (secure 0 0 0) 0x7f44c4061340 con 0x7f44d415c220 2024-07-27T03:10:09.070 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 6 and data pool 7 2024-07-27T03:10:09.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.077+0000 7f44d89c7640 1 -- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f44b4077010 msgr2=0x7f44b4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.077+0000 7f44d89c7640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f44b4077010 0x7f44b4079520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f44bc034000 tx=0x7f44bc004730 comp rx=0 tx=0).stop 2024-07-27T03:10:09.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.077+0000 7f44d89c7640 1 -- 172.21.15.120:0/339602090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d415c220 msgr2=0x7f44d4146750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.077+0000 7f44d89c7640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d415c220 0x7f44d4146750 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c390 tx=0x7f44c400c850 comp rx=0 tx=0).stop 2024-07-27T03:10:09.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.077+0000 7f44d89c7640 1 -- 172.21.15.120:0/339602090 shutdown_connections 2024-07-27T03:10:09.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.077+0000 7f44d89c7640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f44b4077010 0x7f44b4079520 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f44bc034000 tx=0x7f44bc004730 comp rx=0 tx=0).stop 2024-07-27T03:10:09.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.077+0000 7f44d89c7640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44d4147310 0x7f44d40b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.077+0000 7f44d89c7640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d415ec20 0x7f44d40b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.077+0000 7f44d89c7640 1 --2- 172.21.15.120:0/339602090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d415c220 0x7f44d4146750 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.077+0000 7f44d89c7640 1 -- 172.21.15.120:0/339602090 >> 172.21.15.120:0/339602090 conn(0x7f44d406cba0 msgr2=0x7f44d40b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:09.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.079+0000 7f44d89c7640 1 -- 172.21.15.120:0/339602090 shutdown_connections 2024-07-27T03:10:09.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.082+0000 7f44d89c7640 1 -- 172.21.15.120:0/339602090 wait complete. 2024-07-27T03:10:09.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:10:09.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.212+0000 7f182e51f640 1 -- 172.21.15.120:0/2949110441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182815c000 msgr2=0x7f182815c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.212+0000 7f182e51f640 1 --2- 172.21.15.120:0/2949110441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182815c000 0x7f182815c410 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1828071ba0 tx=0x7f181002a530 comp rx=0 tx=0).stop 2024-07-27T03:10:09.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.212+0000 7f182e51f640 1 -- 172.21.15.120:0/2949110441 shutdown_connections 2024-07-27T03:10:09.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.212+0000 7f182e51f640 1 --2- 172.21.15.120:0/2949110441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182815c000 0x7f182815c410 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.212+0000 7f182e51f640 1 --2- 172.21.15.120:0/2949110441 >> v2:172.21.15.121:3300/0 conn(0x7f18281585d0 0x7f182815dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.212+0000 7f182e51f640 1 -- 172.21.15.120:0/2949110441 >> 172.21.15.120:0/2949110441 conn(0x7f18280b1a10 msgr2=0x7f18280b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:09.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.212+0000 7f182e51f640 1 -- 172.21.15.120:0/2949110441 shutdown_connections 2024-07-27T03:10:09.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.212+0000 7f182e51f640 1 -- 172.21.15.120:0/2949110441 wait complete. 2024-07-27T03:10:09.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.214+0000 7f182e51f640 1 Processor -- start 2024-07-27T03:10:09.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.214+0000 7f182e51f640 1 -- start start 2024-07-27T03:10:09.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182e51f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f182806eb00 0x7f18280ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182e51f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18281585d0 0x7f18281f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182e51f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182815c000 0x7f1828156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182e51f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f182806e600 con 0x7f182815c000 2024-07-27T03:10:09.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182e51f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f182806e480 con 0x7f18281585d0 2024-07-27T03:10:09.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182e51f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f182806e780 con 0x7f182806eb00 2024-07-27T03:10:09.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182cabc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182815c000 0x7f1828156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182cabc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182815c000 0x7f1828156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60950/0 (socket says 172.21.15.120:60950) 2024-07-27T03:10:09.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182cabc640 1 -- 172.21.15.120:0/3492799905 learned_addr learned my addr 172.21.15.120:0/3492799905 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:09.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f181ffff640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18281585d0 0x7f18281f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f1827fff640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f182806eb00 0x7f18280ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182cabc640 1 -- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f182806eb00 msgr2=0x7f18280ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182cabc640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f182806eb00 0x7f18280ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182cabc640 1 -- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18281585d0 msgr2=0x7f18281f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182cabc640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18281585d0 0x7f18281f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f182cabc640 1 -- 172.21.15.120:0/3492799905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182809aad0 con 0x7f182815c000 2024-07-27T03:10:09.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.215+0000 7f1827fff640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f182806eb00 0x7f18280ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:10:09.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.216+0000 7f182cabc640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182815c000 0x7f1828156fe0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f182000cb10 tx=0x7f182000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:09.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.216+0000 7f18257fa640 1 -- 172.21.15.120:0/3492799905 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820016020 con 0x7f182815c000 2024-07-27T03:10:09.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.216+0000 7f18257fa640 1 -- 172.21.15.120:0/3492799905 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f182000ad00 con 0x7f182815c000 2024-07-27T03:10:09.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.216+0000 7f182e51f640 1 -- 172.21.15.120:0/3492799905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182809adb0 con 0x7f182815c000 2024-07-27T03:10:09.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.216+0000 7f18257fa640 1 -- 172.21.15.120:0/3492799905 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820012680 con 0x7f182815c000 2024-07-27T03:10:09.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.216+0000 7f182e51f640 1 -- 172.21.15.120:0/3492799905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1828157520 con 0x7f182815c000 2024-07-27T03:10:09.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.217+0000 7f182e51f640 1 -- 172.21.15.120:0/3492799905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18280cd560 con 0x7f182815c000 2024-07-27T03:10:09.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.217+0000 7f18257fa640 1 -- 172.21.15.120:0/3492799905 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1820019020 con 0x7f182815c000 2024-07-27T03:10:09.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.218+0000 7f18257fa640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1808077010 0x7f1808079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.218+0000 7f18257fa640 1 -- 172.21.15.120:0/3492799905 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f1820098c00 con 0x7f182815c000 2024-07-27T03:10:09.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.218+0000 7f1827fff640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1808077010 0x7f1808079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.219+0000 7f1827fff640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1808077010 0x7f1808079520 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1818005fd0 tx=0x7f181800e7c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:09.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.222+0000 7f18257fa640 1 -- 172.21.15.120:0/3492799905 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f182009f080 con 0x7f182815c000 2024-07-27T03:10:09.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.407+0000 7f182e51f640 1 -- 172.21.15.120:0/3492799905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f182815dc10 con 0x7f182815c000 2024-07-27T03:10:09.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.409+0000 7f18257fa640 1 -- 172.21.15.120:0/3492799905 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16650 (secure 0 0 0) 0x7f1820020030 con 0x7f182815c000 2024-07-27T03:10:09.411 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:09.412 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:10:08.410697+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:10:06.088796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-07-27T03:10:07.376160+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:10:09.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 -- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1808077010 msgr2=0x7f1808079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1808077010 0x7f1808079520 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1818005fd0 tx=0x7f181800e7c0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 -- 172.21.15.120:0/3492799905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182815c000 msgr2=0x7f1828156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182815c000 0x7f1828156fe0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f182000cb10 tx=0x7f182000a060 comp rx=0 tx=0).stop 2024-07-27T03:10:09.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 -- 172.21.15.120:0/3492799905 shutdown_connections 2024-07-27T03:10:09.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1808077010 0x7f1808079520 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f182815c000 0x7f1828156fe0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18281585d0 0x7f18281f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 --2- 172.21.15.120:0/3492799905 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f182806eb00 0x7f18280ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 -- 172.21.15.120:0/3492799905 >> 172.21.15.120:0/3492799905 conn(0x7f18280b1a10 msgr2=0x7f18280b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:09.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 -- 172.21.15.120:0/3492799905 shutdown_connections 2024-07-27T03:10:09.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.411+0000 7f182e51f640 1 -- 172.21.15.120:0/3492799905 wait complete. 2024-07-27T03:10:09.425 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:10:09.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.537+0000 7f4c6722b640 1 -- 172.21.15.120:0/2808525736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c50004d40 msgr2=0x7f4c50005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.537+0000 7f4c6722b640 1 --2- 172.21.15.120:0/2808525736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c50004d40 0x7f4c50005150 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800c750 tx=0x7f4c50005830 comp rx=0 tx=0).stop 2024-07-27T03:10:09.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.537+0000 7f4c657c8640 1 -- 172.21.15.120:0/2808525736 reap_dead start 2024-07-27T03:10:09.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.537+0000 7f4c6722b640 1 -- 172.21.15.120:0/2808525736 shutdown_connections 2024-07-27T03:10:09.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.537+0000 7f4c6722b640 1 -- 172.21.15.120:0/2808525736 >> 172.21.15.120:0/2808525736 conn(0x7f4c600b3920 msgr2=0x7f4c600b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:09.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.537+0000 7f4c6722b640 1 -- 172.21.15.120:0/2808525736 shutdown_connections 2024-07-27T03:10:09.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.537+0000 7f4c6722b640 1 -- 172.21.15.120:0/2808525736 wait complete. 2024-07-27T03:10:09.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.539+0000 7f4c6722b640 1 Processor -- start 2024-07-27T03:10:09.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.539+0000 7f4c6722b640 1 -- start start 2024-07-27T03:10:09.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.540+0000 7f4c6722b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50004d40 0x7f4c601f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.540+0000 7f4c6722b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c600cf530 0x7f4c601f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.540+0000 7f4c6722b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c601f0290 0x7f4c601532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.540+0000 7f4c6722b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4c600b2520 con 0x7f4c601f0290 2024-07-27T03:10:09.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.540+0000 7f4c6722b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6015fcc0 con 0x7f4c50004d40 2024-07-27T03:10:09.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.540+0000 7f4c6722b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4c600b26a0 con 0x7f4c600cf530 2024-07-27T03:10:09.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.540+0000 7f4c657c8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c601f0290 0x7f4c601532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.540+0000 7f4c657c8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c601f0290 0x7f4c601532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60970/0 (socket says 172.21.15.120:60970) 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.540+0000 7f4c657c8640 1 -- 172.21.15.120:0/235559413 learned_addr learned my addr 172.21.15.120:0/235559413 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.540+0000 7f4c5ffff640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c600cf530 0x7f4c601f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.540+0000 7f4c64fc7640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50004d40 0x7f4c601f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.541+0000 7f4c657c8640 1 -- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c600cf530 msgr2=0x7f4c601f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.541+0000 7f4c657c8640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c600cf530 0x7f4c601f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.541+0000 7f4c657c8640 1 -- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50004d40 msgr2=0x7f4c601f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.541+0000 7f4c657c8640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50004d40 0x7f4c601f6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.541+0000 7f4c657c8640 1 -- 172.21.15.120:0/235559413 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c601f6de0 con 0x7f4c601f0290 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.541+0000 7f4c657c8640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c601f0290 0x7f4c601532e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4c5802b660 tx=0x7f4c5802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.541+0000 7f4c5d7fa640 1 -- 172.21.15.120:0/235559413 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5800c3a0 con 0x7f4c601f0290 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.541+0000 7f4c5d7fa640 1 -- 172.21.15.120:0/235559413 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c58001a40 con 0x7f4c601f0290 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.541+0000 7f4c6722b640 1 -- 172.21.15.120:0/235559413 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c601f70c0 con 0x7f4c601f0290 2024-07-27T03:10:09.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.541+0000 7f4c5d7fa640 1 -- 172.21.15.120:0/235559413 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5802bc10 con 0x7f4c601f0290 2024-07-27T03:10:09.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.541+0000 7f4c6722b640 1 -- 172.21.15.120:0/235559413 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c601f3300 con 0x7f4c601f0290 2024-07-27T03:10:09.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.542+0000 7f4c6722b640 1 -- 172.21.15.120:0/235559413 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c601f6b50 con 0x7f4c601f0290 2024-07-27T03:10:09.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.543+0000 7f4c5d7fa640 1 -- 172.21.15.120:0/235559413 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4c5803f030 con 0x7f4c601f0290 2024-07-27T03:10:09.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.543+0000 7f4c5d7fa640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c44077010 0x7f4c44079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.544+0000 7f4c5d7fa640 1 -- 172.21.15.120:0/235559413 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f4c580b81b0 con 0x7f4c601f0290 2024-07-27T03:10:09.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.544+0000 7f4c64fc7640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c44077010 0x7f4c44079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.544+0000 7f4c64fc7640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c44077010 0x7f4c44079520 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009c50 tx=0x7f4c54005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:09.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.548+0000 7f4c5d7fa640 1 -- 172.21.15.120:0/235559413 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f4c600d0e50 con 0x7f4c601f0290 2024-07-27T03:10:09.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.728+0000 7f4c6722b640 1 -- 172.21.15.120:0/235559413 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c600d0910 con 0x7f4c601f0290 2024-07-27T03:10:09.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.729+0000 7f4c5d7fa640 1 -- 172.21.15.120:0/235559413 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16650 (secure 0 0 0) 0x7f4c580813d0 con 0x7f4c601f0290 2024-07-27T03:10:09.732 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:09.732 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":43,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:10:08.410697+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:10:06.088796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-07-27T03:10:07.376160+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:10:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.731+0000 7f4c6722b640 1 -- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c44077010 msgr2=0x7f4c44079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.731+0000 7f4c6722b640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c44077010 0x7f4c44079520 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009c50 tx=0x7f4c54005f90 comp rx=0 tx=0).stop 2024-07-27T03:10:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.731+0000 7f4c6722b640 1 -- 172.21.15.120:0/235559413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c601f0290 msgr2=0x7f4c601532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.731+0000 7f4c6722b640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c601f0290 0x7f4c601532e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4c5802b660 tx=0x7f4c5802b7f0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.732+0000 7f4c6722b640 1 -- 172.21.15.120:0/235559413 shutdown_connections 2024-07-27T03:10:09.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.732+0000 7f4c6722b640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c44077010 0x7f4c44079520 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.732+0000 7f4c6722b640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c601f0290 0x7f4c601532e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.732+0000 7f4c6722b640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c600cf530 0x7f4c601f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.732+0000 7f4c6722b640 1 --2- 172.21.15.120:0/235559413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c50004d40 0x7f4c601f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.732+0000 7f4c6722b640 1 -- 172.21.15.120:0/235559413 >> 172.21.15.120:0/235559413 conn(0x7f4c600b3920 msgr2=0x7f4c600b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:09.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.732+0000 7f4c6722b640 1 -- 172.21.15.120:0/235559413 shutdown_connections 2024-07-27T03:10:09.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.732+0000 7f4c6722b640 1 -- 172.21.15.120:0/235559413 wait complete. 2024-07-27T03:10:09.746 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-07-27T03:10:09.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.859+0000 7fd0d5540640 1 -- 172.21.15.120:0/1023461248 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00d10d0 msgr2=0x7fd0d00d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.859+0000 7fd0d5540640 1 --2- 172.21.15.120:0/1023461248 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00d10d0 0x7fd0d00d2bf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd0d00b3b30 tx=0x7fd0c002aac0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.859+0000 7fd0d5540640 1 -- 172.21.15.120:0/1023461248 shutdown_connections 2024-07-27T03:10:09.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.859+0000 7fd0d5540640 1 --2- 172.21.15.120:0/1023461248 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00d10d0 0x7fd0d00d2bf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.859+0000 7fd0d5540640 1 --2- 172.21.15.120:0/1023461248 >> v2:172.21.15.121:3300/0 conn(0x7fd0d00b4740 0x7fd0d00b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.859+0000 7fd0d5540640 1 -- 172.21.15.120:0/1023461248 >> 172.21.15.120:0/1023461248 conn(0x7fd0d008d690 msgr2=0x7fd0d009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:09.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.859+0000 7fd0d5540640 1 -- 172.21.15.120:0/1023461248 shutdown_connections 2024-07-27T03:10:09.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.859+0000 7fd0d5540640 1 -- 172.21.15.120:0/1023461248 wait complete. 2024-07-27T03:10:09.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.861+0000 7fd0d5540640 1 Processor -- start 2024-07-27T03:10:09.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.861+0000 7fd0d5540640 1 -- start start 2024-07-27T03:10:09.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.862+0000 7fd0d5540640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00b4740 0x7fd0d00ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.862+0000 7fd0d5540640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0d00d27e0 0x7fd0d01f8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.862+0000 7fd0d5540640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0d01f8e70 0x7fd0d015b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.862+0000 7fd0d5540640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d00cef70 con 0x7fd0d00b4740 2024-07-27T03:10:09.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.862+0000 7fd0d5540640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d00cedf0 con 0x7fd0d00d27e0 2024-07-27T03:10:09.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.862+0000 7fd0d5540640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d00cf0f0 con 0x7fd0d01f8e70 2024-07-27T03:10:09.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0ceffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00b4740 0x7fd0d00ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0ceffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00b4740 0x7fd0d00ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60992/0 (socket says 172.21.15.120:60992) 2024-07-27T03:10:09.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0ceffd640 1 -- 172.21.15.120:0/3683129830 learned_addr learned my addr 172.21.15.120:0/3683129830 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:09.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0ce7fc640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0d00d27e0 0x7fd0d01f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0cf7fe640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0d01f8e70 0x7fd0d015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0ceffd640 1 -- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0d01f8e70 msgr2=0x7fd0d015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0ceffd640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0d01f8e70 0x7fd0d015b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0ceffd640 1 -- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0d00d27e0 msgr2=0x7fd0d01f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:09.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0ceffd640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0d00d27e0 0x7fd0d01f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:09.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0ceffd640 1 -- 172.21.15.120:0/3683129830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d01f9280 con 0x7fd0d00b4740 2024-07-27T03:10:09.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0ceffd640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00b4740 0x7fd0d00ca4c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800d750 tx=0x7fd0c800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:09.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0c77fe640 1 -- 172.21.15.120:0/3683129830 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8017070 con 0x7fd0d00b4740 2024-07-27T03:10:09.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0c77fe640 1 -- 172.21.15.120:0/3683129830 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0c8004310 con 0x7fd0d00b4740 2024-07-27T03:10:09.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0d5540640 1 -- 172.21.15.120:0/3683129830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d01f5d80 con 0x7fd0d00b4740 2024-07-27T03:10:09.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0c77fe640 1 -- 172.21.15.120:0/3683129830 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800de60 con 0x7fd0d00b4740 2024-07-27T03:10:09.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.863+0000 7fd0d5540640 1 -- 172.21.15.120:0/3683129830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d00b6e80 con 0x7fd0d00b4740 2024-07-27T03:10:09.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.865+0000 7fd0d5540640 1 -- 172.21.15.120:0/3683129830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d00d2bf0 con 0x7fd0d00b4740 2024-07-27T03:10:09.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.865+0000 7fd0c77fe640 1 -- 172.21.15.120:0/3683129830 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd0c8009c30 con 0x7fd0d00b4740 2024-07-27T03:10:09.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.865+0000 7fd0c77fe640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd0b0077010 0x7fd0b0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:09.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.866+0000 7fd0c77fe640 1 -- 172.21.15.120:0/3683129830 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fd0c8098b20 con 0x7fd0d00b4740 2024-07-27T03:10:09.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.866+0000 7fd0ce7fc640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd0b0077010 0x7fd0b0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:09.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.866+0000 7fd0ce7fc640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd0b0077010 0x7fd0b0079520 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8001720 tx=0x7fd0b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:09.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:09.870+0000 7fd0c77fe640 1 -- 172.21.15.120:0/3683129830 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd0c8020020 con 0x7fd0d00b4740 2024-07-27T03:10:10.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:10.091+0000 7fd0d5540640 1 -- 172.21.15.120:0/3683129830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd0d0160380 con 0x7fd0d00b4740 2024-07-27T03:10:10.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:10:10.361 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:10:11.037 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-07-27T03:10:11.035+0000 7fb01c72c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-27T03:10:11.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.081+0000 7fd0c77fe640 1 -- 172.21.15.120:0/3683129830 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) ==== 118+0+0 (secure 0 0 0) 0x7fd0c80616e0 con 0x7fd0d00b4740 2024-07-27T03:10:11.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.083+0000 7fd0d5540640 1 -- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd0b0077010 msgr2=0x7fd0b0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:11.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.083+0000 7fd0d5540640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd0b0077010 0x7fd0b0079520 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8001720 tx=0x7fd0b8009040 comp rx=0 tx=0).stop 2024-07-27T03:10:11.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.083+0000 7fd0d5540640 1 -- 172.21.15.120:0/3683129830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00b4740 msgr2=0x7fd0d00ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:11.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.083+0000 7fd0d5540640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00b4740 0x7fd0d00ca4c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800d750 tx=0x7fd0c800dc10 comp rx=0 tx=0).stop 2024-07-27T03:10:11.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.083+0000 7fd0d5540640 1 -- 172.21.15.120:0/3683129830 shutdown_connections 2024-07-27T03:10:11.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.083+0000 7fd0d5540640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd0b0077010 0x7fd0b0079520 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:11.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.083+0000 7fd0d5540640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0d01f8e70 0x7fd0d015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:11.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.083+0000 7fd0d5540640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0d00d27e0 0x7fd0d01f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:11.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.083+0000 7fd0d5540640 1 --2- 172.21.15.120:0/3683129830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0d00b4740 0x7fd0d00ca4c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:11.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.083+0000 7fd0d5540640 1 -- 172.21.15.120:0/3683129830 >> 172.21.15.120:0/3683129830 conn(0x7fd0d008d690 msgr2=0x7fd0d00cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:11.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.083+0000 7fd0d5540640 1 -- 172.21.15.120:0/3683129830 shutdown_connections 2024-07-27T03:10:11.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.084+0000 7fd0d5540640 1 -- 172.21.15.120:0/3683129830 wait complete. 2024-07-27T03:10:11.100 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-07-27T03:10:11.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-07-27T03:10:11.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.218+0000 7feb5b7fa640 1 -- 172.21.15.120:0/2359706998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb540b2c40 msgr2=0x7feb540d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:11.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.218+0000 7feb5b7fa640 1 --2- 172.21.15.120:0/2359706998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb540b2c40 0x7feb540d09c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7feb44009830 tx=0x7feb4402a510 comp rx=0 tx=0).stop 2024-07-27T03:10:11.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.218+0000 7feb5b7fa640 1 -- 172.21.15.120:0/2359706998 shutdown_connections 2024-07-27T03:10:11.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.218+0000 7feb5b7fa640 1 --2- 172.21.15.120:0/2359706998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb540b2c40 0x7feb540d09c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:11.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.218+0000 7feb5b7fa640 1 -- 172.21.15.120:0/2359706998 >> 172.21.15.120:0/2359706998 conn(0x7feb5408d690 msgr2=0x7feb5409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:11.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.218+0000 7feb5b7fa640 1 -- 172.21.15.120:0/2359706998 shutdown_connections 2024-07-27T03:10:11.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.218+0000 7feb5b7fa640 1 -- 172.21.15.120:0/2359706998 wait complete. 2024-07-27T03:10:11.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.220+0000 7feb5b7fa640 1 Processor -- start 2024-07-27T03:10:11.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.220+0000 7feb5b7fa640 1 -- start start 2024-07-27T03:10:11.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.221+0000 7feb5b7fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb540b2c40 0x7feb5414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb5b7fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb540b4740 0x7feb540b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb5b7fa640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feb540d0f00 0x7feb5415f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb5b7fa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7feb540b33c0 con 0x7feb540b2c40 2024-07-27T03:10:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb5b7fa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feb540d3100 con 0x7feb540b4740 2024-07-27T03:10:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb5b7fa640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7feb540cf2f0 con 0x7feb540d0f00 2024-07-27T03:10:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb59596640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb540b2c40 0x7feb5414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb59596640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb540b2c40 0x7feb5414f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32788/0 (socket says 172.21.15.120:32788) 2024-07-27T03:10:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb59596640 1 -- 172.21.15.120:0/3644821906 learned_addr learned my addr 172.21.15.120:0/3644821906 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb58d95640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb540b4740 0x7feb540b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb59d97640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feb540d0f00 0x7feb5415f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:11.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb59596640 1 -- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feb540d0f00 msgr2=0x7feb5415f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:11.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb59596640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feb540d0f00 0x7feb5415f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:11.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb59596640 1 -- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb540b4740 msgr2=0x7feb540b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:11.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb59596640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb540b4740 0x7feb540b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:11.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb59596640 1 -- 172.21.15.120:0/3644821906 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5414f610 con 0x7feb540b2c40 2024-07-27T03:10:11.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb59596640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb540b2c40 0x7feb5414f0d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7feb5000b3f0 tx=0x7feb5000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:11.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb49ffb640 1 -- 172.21.15.120:0/3644821906 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50015020 con 0x7feb540b2c40 2024-07-27T03:10:11.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb49ffb640 1 -- 172.21.15.120:0/3644821906 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb50011920 con 0x7feb540b2c40 2024-07-27T03:10:11.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb5b7fa640 1 -- 172.21.15.120:0/3644821906 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb54156450 con 0x7feb540b2c40 2024-07-27T03:10:11.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.222+0000 7feb49ffb640 1 -- 172.21.15.120:0/3644821906 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50011d70 con 0x7feb540b2c40 2024-07-27T03:10:11.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.223+0000 7feb5b7fa640 1 -- 172.21.15.120:0/3644821906 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb540b7d30 con 0x7feb540b2c40 2024-07-27T03:10:11.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.224+0000 7feb5b7fa640 1 -- 172.21.15.120:0/3644821906 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb540d09c0 con 0x7feb540b2c40 2024-07-27T03:10:11.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.224+0000 7feb49ffb640 1 -- 172.21.15.120:0/3644821906 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7feb50018020 con 0x7feb540b2c40 2024-07-27T03:10:11.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.225+0000 7feb49ffb640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feb38077010 0x7feb38079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:11.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.225+0000 7feb49ffb640 1 -- 172.21.15.120:0/3644821906 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7feb50098870 con 0x7feb540b2c40 2024-07-27T03:10:11.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.225+0000 7feb58d95640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feb38077010 0x7feb38079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:11.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.226+0000 7feb58d95640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feb38077010 0x7feb38079520 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feb44034000 tx=0x7feb44004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:11.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.230+0000 7feb49ffb640 1 -- 172.21.15.120:0/3644821906 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7feb5001f020 con 0x7feb540b2c40 2024-07-27T03:10:11.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:11.448+0000 7feb5b7fa640 1 -- 172.21.15.120:0/3644821906 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7feb540b55a0 con 0x7feb540b2c40 2024-07-27T03:10:12.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.082+0000 7feb49ffb640 1 -- 172.21.15.120:0/3644821906 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7feb50061b90 con 0x7feb540b2c40 2024-07-27T03:10:12.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 -- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feb38077010 msgr2=0x7feb38079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feb38077010 0x7feb38079520 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feb44034000 tx=0x7feb44004730 comp rx=0 tx=0).stop 2024-07-27T03:10:12.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 -- 172.21.15.120:0/3644821906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb540b2c40 msgr2=0x7feb5414f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb540b2c40 0x7feb5414f0d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7feb5000b3f0 tx=0x7feb5000b8b0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 -- 172.21.15.120:0/3644821906 shutdown_connections 2024-07-27T03:10:12.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feb38077010 0x7feb38079520 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feb540d0f00 0x7feb5415f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb540b4740 0x7feb540b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 --2- 172.21.15.120:0/3644821906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb540b2c40 0x7feb5414f0d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 -- 172.21.15.120:0/3644821906 >> 172.21.15.120:0/3644821906 conn(0x7feb5408d690 msgr2=0x7feb540b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:12.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 -- 172.21.15.120:0/3644821906 shutdown_connections 2024-07-27T03:10:12.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.085+0000 7feb5b7fa640 1 -- 172.21.15.120:0/3644821906 wait complete. 2024-07-27T03:10:12.101 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-07-27T03:10:12.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:10:12.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.214+0000 7f2f2a05a640 1 -- 172.21.15.120:0/872817399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f240b63e0 msgr2=0x7f2f24152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.214+0000 7f2f2a05a640 1 --2- 172.21.15.120:0/872817399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f240b63e0 0x7f2f24152160 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2f18005fd0 tx=0x7f2f1802a540 comp rx=0 tx=0).stop 2024-07-27T03:10:12.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.214+0000 7f2f2a05a640 1 -- 172.21.15.120:0/872817399 shutdown_connections 2024-07-27T03:10:12.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.214+0000 7f2f2a05a640 1 --2- 172.21.15.120:0/872817399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f240b63e0 0x7f2f24152160 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.214+0000 7f2f2a05a640 1 -- 172.21.15.120:0/872817399 >> 172.21.15.120:0/872817399 conn(0x7f2f2406cba0 msgr2=0x7f2f2406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:12.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.214+0000 7f2f2a05a640 1 -- 172.21.15.120:0/872817399 shutdown_connections 2024-07-27T03:10:12.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.214+0000 7f2f2a05a640 1 -- 172.21.15.120:0/872817399 wait complete. 2024-07-27T03:10:12.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.216+0000 7f2f2a05a640 1 Processor -- start 2024-07-27T03:10:12.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.216+0000 7f2f2a05a640 1 -- start start 2024-07-27T03:10:12.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.217+0000 7f2f2a05a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f2415c220 0x7f2f24157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.217+0000 7f2f2a05a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f2415ec20 0x7f2f24155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.217+0000 7f2f2a05a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f24156200 0x7f2f241f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.217+0000 7f2f2a05a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2f240cddb0 con 0x7f2f2415c220 2024-07-27T03:10:12.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.217+0000 7f2f2a05a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2f240cdc30 con 0x7f2f24156200 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.217+0000 7f2f2a05a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2f240cdf30 con 0x7f2f2415ec20 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.217+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f2415c220 0x7f2f24157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.217+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f2415c220 0x7f2f24157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58206/0 (socket says 172.21.15.120:58206) 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.217+0000 7f2f237fe640 1 -- 172.21.15.120:0/3553540074 learned_addr learned my addr 172.21.15.120:0/3553540074 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.217+0000 7f2f23fff640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f24156200 0x7f2f241f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f22ffd640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f2415ec20 0x7f2f24155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f237fe640 1 -- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f2415ec20 msgr2=0x7f2f24155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f237fe640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f2415ec20 0x7f2f24155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f237fe640 1 -- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f24156200 msgr2=0x7f2f241f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f237fe640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f24156200 0x7f2f241f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f237fe640 1 -- 172.21.15.120:0/3553540074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f24159ff0 con 0x7f2f2415c220 2024-07-27T03:10:12.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f22ffd640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f2415ec20 0x7f2f24155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:12.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f237fe640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f2415c220 0x7f2f24157630 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400c3c0 tx=0x7f2f1400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:12.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f0bfff640 1 -- 172.21.15.120:0/3553540074 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f14017070 con 0x7f2f2415c220 2024-07-27T03:10:12.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f0bfff640 1 -- 172.21.15.120:0/3553540074 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f140035f0 con 0x7f2f2415c220 2024-07-27T03:10:12.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f0bfff640 1 -- 172.21.15.120:0/3553540074 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f14003a20 con 0x7f2f2415c220 2024-07-27T03:10:12.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f2a05a640 1 -- 172.21.15.120:0/3553540074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2415a2d0 con 0x7f2f2415c220 2024-07-27T03:10:12.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.218+0000 7f2f2a05a640 1 -- 172.21.15.120:0/3553540074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f2415a890 con 0x7f2f2415c220 2024-07-27T03:10:12.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.219+0000 7f2f2a05a640 1 -- 172.21.15.120:0/3553540074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f24152160 con 0x7f2f2415c220 2024-07-27T03:10:12.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.220+0000 7f2f0bfff640 1 -- 172.21.15.120:0/3553540074 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2f1401a070 con 0x7f2f2415c220 2024-07-27T03:10:12.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.220+0000 7f2f0bfff640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f10077010 0x7f2f10079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.220+0000 7f2f0bfff640 1 -- 172.21.15.120:0/3553540074 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f2f14097c50 con 0x7f2f2415c220 2024-07-27T03:10:12.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.220+0000 7f2f22ffd640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f10077010 0x7f2f10079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.221+0000 7f2f22ffd640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f10077010 0x7f2f10079520 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2f18033000 tx=0x7f2f18004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:12.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.225+0000 7f2f0bfff640 1 -- 172.21.15.120:0/3553540074 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f2f1409d020 con 0x7f2f2415c220 2024-07-27T03:10:12.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.442+0000 7f2f2a05a640 1 -- 172.21.15.120:0/3553540074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f240b2f40 con 0x7f2f2415c220 2024-07-27T03:10:12.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.443+0000 7f2f0bfff640 1 -- 172.21.15.120:0/3553540074 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5229 (secure 0 0 0) 0x7f2f14060e50 con 0x7f2f2415c220 2024-07-27T03:10:12.446 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:12.447 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":34,"btime":"2024-07-27T03:10:12:081716+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/296895260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":296895260},{"type":"v1","addr":"172.21.15.121:6837","nonce":296895260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/1978820402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1978820402},{"type":"v1","addr":"172.21.15.121:6836","nonce":1978820402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5325,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/1425775647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1425775647},{"type":"v1","addr":"172.21.15.120:6834","nonce":1425775647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:10:08.410648+0000","modified":"2024-07-27T03:10:11.449906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/890762307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":890762307},{"type":"v1","addr":"172.21.15.120:6835","nonce":890762307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-07-27T03:10:12.449 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 34 2024-07-27T03:10:12.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 -- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f10077010 msgr2=0x7f2f10079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f10077010 0x7f2f10079520 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2f18033000 tx=0x7f2f18004730 comp rx=0 tx=0).stop 2024-07-27T03:10:12.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 -- 172.21.15.120:0/3553540074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f2415c220 msgr2=0x7f2f24157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f2415c220 0x7f2f24157630 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400c3c0 tx=0x7f2f1400c880 comp rx=0 tx=0).stop 2024-07-27T03:10:12.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 -- 172.21.15.120:0/3553540074 shutdown_connections 2024-07-27T03:10:12.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f10077010 0x7f2f10079520 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f24156200 0x7f2f241f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f2415ec20 0x7f2f24155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 --2- 172.21.15.120:0/3553540074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f2415c220 0x7f2f24157630 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 -- 172.21.15.120:0/3553540074 >> 172.21.15.120:0/3553540074 conn(0x7f2f2406cba0 msgr2=0x7f2f240cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 -- 172.21.15.120:0/3553540074 shutdown_connections 2024-07-27T03:10:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.445+0000 7f2f2a05a640 1 -- 172.21.15.120:0/3553540074 wait complete. 2024-07-27T03:10:12.460 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:10:12.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.572+0000 7f1461684640 1 -- 172.21.15.120:0/4186384938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1448003a30 msgr2=0x7f1448003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.572+0000 7f1461684640 1 --2- 172.21.15.120:0/4186384938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1448003a30 0x7f1448003ea0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f144c006fd0 tx=0x7f1448005830 comp rx=0 tx=0).stop 2024-07-27T03:10:12.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.572+0000 7f145b7fe640 1 -- 172.21.15.120:0/4186384938 reap_dead start 2024-07-27T03:10:12.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.572+0000 7f1461684640 1 -- 172.21.15.120:0/4186384938 shutdown_connections 2024-07-27T03:10:12.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.572+0000 7f1461684640 1 -- 172.21.15.120:0/4186384938 >> 172.21.15.120:0/4186384938 conn(0x7f145c0d0480 msgr2=0x7f145c0d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:12.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.572+0000 7f1461684640 1 -- 172.21.15.120:0/4186384938 shutdown_connections 2024-07-27T03:10:12.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.572+0000 7f1461684640 1 -- 172.21.15.120:0/4186384938 wait complete. 2024-07-27T03:10:12.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.574+0000 7f1461684640 1 Processor -- start 2024-07-27T03:10:12.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.574+0000 7f1461684640 1 -- start start 2024-07-27T03:10:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f1461684640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1448003a30 0x7f145c0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f1461684640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145c146ef0 0x7f145c1f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f1461684640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f145c1f6c90 0x7f145c0aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f1461684640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f145c0cfc40 con 0x7f1448003a30 2024-07-27T03:10:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f1461684640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f145c0cfac0 con 0x7f145c146ef0 2024-07-27T03:10:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f1461684640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f145c072c00 con 0x7f145c1f6c90 2024-07-27T03:10:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f145affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1448003a30 0x7f145c0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f145affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1448003a30 0x7f145c0af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58218/0 (socket says 172.21.15.120:58218) 2024-07-27T03:10:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f145affd640 1 -- 172.21.15.120:0/3957082951 learned_addr learned my addr 172.21.15.120:0/3957082951 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:12.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f145b7fe640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f145c1f6c90 0x7f145c0aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f14527fc640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145c146ef0 0x7f145c1f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f145affd640 1 -- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f145c1f6c90 msgr2=0x7f145c0aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f145affd640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f145c1f6c90 0x7f145c0aaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f145affd640 1 -- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145c146ef0 msgr2=0x7f145c1f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f145affd640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145c146ef0 0x7f145c1f6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f145affd640 1 -- 172.21.15.120:0/3957082951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c1f70a0 con 0x7f1448003a30 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.575+0000 7f14527fc640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145c146ef0 0x7f145c1f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.576+0000 7f145affd640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1448003a30 0x7f145c0af710 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f144c02b0f0 tx=0x7f144c001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.576+0000 7f1453fff640 1 -- 172.21.15.120:0/3957082951 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c031040 con 0x7f1448003a30 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.576+0000 7f1453fff640 1 -- 172.21.15.120:0/3957082951 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f144c003800 con 0x7f1448003a30 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.576+0000 7f1461684640 1 -- 172.21.15.120:0/3957082951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f145c0ad7f0 con 0x7f1448003a30 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.576+0000 7f1453fff640 1 -- 172.21.15.120:0/3957082951 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c006580 con 0x7f1448003a30 2024-07-27T03:10:12.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.576+0000 7f1461684640 1 -- 172.21.15.120:0/3957082951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f145c0addb0 con 0x7f1448003a30 2024-07-27T03:10:12.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.577+0000 7f1461684640 1 -- 172.21.15.120:0/3957082951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f145c073130 con 0x7f1448003a30 2024-07-27T03:10:12.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.578+0000 7f1453fff640 1 -- 172.21.15.120:0/3957082951 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f144c03e030 con 0x7f1448003a30 2024-07-27T03:10:12.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.578+0000 7f1453fff640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f143c077010 0x7f143c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.579+0000 7f1453fff640 1 -- 172.21.15.120:0/3957082951 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f144c0b84f0 con 0x7f1448003a30 2024-07-27T03:10:12.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.579+0000 7f14527fc640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f143c077010 0x7f143c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.579+0000 7f14527fc640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f143c077010 0x7f143c079520 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f145c0ad6e0 tx=0x7f1444005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:12.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.583+0000 7f1453fff640 1 -- 172.21.15.120:0/3957082951 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f144c0810a0 con 0x7f1448003a30 2024-07-27T03:10:12.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.767+0000 7f1461684640 1 -- 172.21.15.120:0/3957082951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f145c15dc30 con 0x7f1448003a30 2024-07-27T03:10:12.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.768+0000 7f1453fff640 1 -- 172.21.15.120:0/3957082951 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16637 (secure 0 0 0) 0x7f144c0855f0 con 0x7f1448003a30 2024-07-27T03:10:12.771 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:12.771 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":44,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:10:10.056003+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:10:06.088796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-07-27T03:10:07.376160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:10:12.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.770+0000 7f1461684640 1 -- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f143c077010 msgr2=0x7f143c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.770+0000 7f1461684640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f143c077010 0x7f143c079520 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f145c0ad6e0 tx=0x7f1444005f90 comp rx=0 tx=0).stop 2024-07-27T03:10:12.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.770+0000 7f1461684640 1 -- 172.21.15.120:0/3957082951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1448003a30 msgr2=0x7f145c0af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.770+0000 7f1461684640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1448003a30 0x7f145c0af710 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f144c02b0f0 tx=0x7f144c001c70 comp rx=0 tx=0).stop 2024-07-27T03:10:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.770+0000 7f1461684640 1 -- 172.21.15.120:0/3957082951 shutdown_connections 2024-07-27T03:10:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.770+0000 7f1461684640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f143c077010 0x7f143c079520 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.770+0000 7f1461684640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f145c1f6c90 0x7f145c0aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.770+0000 7f1461684640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f145c146ef0 0x7f145c1f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.770+0000 7f1461684640 1 --2- 172.21.15.120:0/3957082951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1448003a30 0x7f145c0af710 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.770+0000 7f1461684640 1 -- 172.21.15.120:0/3957082951 >> 172.21.15.120:0/3957082951 conn(0x7f145c0d0480 msgr2=0x7f145c15d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.771+0000 7f1461684640 1 -- 172.21.15.120:0/3957082951 shutdown_connections 2024-07-27T03:10:12.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.771+0000 7f1461684640 1 -- 172.21.15.120:0/3957082951 wait complete. 2024-07-27T03:10:12.785 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-27T03:10:12.785 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:10:12.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.896+0000 7fb931df0640 1 -- 172.21.15.120:0/1958185242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb92c0718c0 msgr2=0x7fb92c0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.896+0000 7fb931df0640 1 --2- 172.21.15.120:0/1958185242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb92c0718c0 0x7fb92c0cc910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb9140098e0 tx=0x7fb91402a4a0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.896+0000 7fb931df0640 1 -- 172.21.15.120:0/1958185242 shutdown_connections 2024-07-27T03:10:12.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.896+0000 7fb931df0640 1 --2- 172.21.15.120:0/1958185242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb92c0718c0 0x7fb92c0cc910 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.896+0000 7fb931df0640 1 --2- 172.21.15.120:0/1958185242 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb92c0d0450 0x7fb92c15f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.896+0000 7fb931df0640 1 -- 172.21.15.120:0/1958185242 >> 172.21.15.120:0/1958185242 conn(0x7fb92c0d0df0 msgr2=0x7fb92c0d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:12.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.896+0000 7fb931df0640 1 -- 172.21.15.120:0/1958185242 shutdown_connections 2024-07-27T03:10:12.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.896+0000 7fb931df0640 1 -- 172.21.15.120:0/1958185242 wait complete. 2024-07-27T03:10:12.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.898+0000 7fb931df0640 1 Processor -- start 2024-07-27T03:10:12.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.898+0000 7fb931df0640 1 -- start start 2024-07-27T03:10:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.899+0000 7fb931df0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb92c0718c0 0x7fb92c150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.899+0000 7fb931df0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb92c0733c0 0x7fb92c1f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.899+0000 7fb931df0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb92c0d0450 0x7fb92c0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.899+0000 7fb931df0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c15bb50 con 0x7fb92c0d0450 2024-07-27T03:10:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.899+0000 7fb931df0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c15b9d0 con 0x7fb92c0718c0 2024-07-27T03:10:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.899+0000 7fb931df0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb92c15bcd0 con 0x7fb92c0733c0 2024-07-27T03:10:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.899+0000 7fb92bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb92c0d0450 0x7fb92c0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.899+0000 7fb92bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb92c0d0450 0x7fb92c0b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58222/0 (socket says 172.21.15.120:58222) 2024-07-27T03:10:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.899+0000 7fb92bfff640 1 -- 172.21.15.120:0/3027376123 learned_addr learned my addr 172.21.15.120:0/3027376123 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.899+0000 7fb923fff640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb92c0733c0 0x7fb92c1f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.899+0000 7fb92b7fe640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb92c0718c0 0x7fb92c150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.900+0000 7fb92bfff640 1 -- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb92c0733c0 msgr2=0x7fb92c1f7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.900+0000 7fb92bfff640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb92c0733c0 0x7fb92c1f7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.900+0000 7fb92bfff640 1 -- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb92c0718c0 msgr2=0x7fb92c150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.900+0000 7fb92bfff640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb92c0718c0 0x7fb92c150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.900+0000 7fb92bfff640 1 -- 172.21.15.120:0/3027376123 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c1f3b60 con 0x7fb92c0d0450 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.900+0000 7fb92bfff640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb92c0d0450 0x7fb92c0b5f30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb924002230 tx=0x7fb92400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.900+0000 7fb928ff9640 1 -- 172.21.15.120:0/3027376123 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924003b70 con 0x7fb92c0d0450 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.900+0000 7fb928ff9640 1 -- 172.21.15.120:0/3027376123 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb924003d10 con 0x7fb92c0d0450 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.900+0000 7fb931df0640 1 -- 172.21.15.120:0/3027376123 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92c1f3e40 con 0x7fb92c0d0450 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.900+0000 7fb928ff9640 1 -- 172.21.15.120:0/3027376123 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924005330 con 0x7fb92c0d0450 2024-07-27T03:10:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.900+0000 7fb931df0640 1 -- 172.21.15.120:0/3027376123 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92c1f4400 con 0x7fb92c0d0450 2024-07-27T03:10:12.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.901+0000 7fb931df0640 1 -- 172.21.15.120:0/3027376123 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92c0cb9d0 con 0x7fb92c0d0450 2024-07-27T03:10:12.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.902+0000 7fb928ff9640 1 -- 172.21.15.120:0/3027376123 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb9240056e0 con 0x7fb92c0d0450 2024-07-27T03:10:12.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.902+0000 7fb928ff9640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb90c077040 0x7fb90c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:12.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.902+0000 7fb928ff9640 1 -- 172.21.15.120:0/3027376123 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fb9240987c0 con 0x7fb92c0d0450 2024-07-27T03:10:12.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.902+0000 7fb92b7fe640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb90c077040 0x7fb90c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:12.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.903+0000 7fb92b7fe640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb90c077040 0x7fb90c079550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0095f0 tx=0x7fb91c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:12.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:12.907+0000 7fb928ff9640 1 -- 172.21.15.120:0/3027376123 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb92c0cb9d0 con 0x7fb92c0d0450 2024-07-27T03:10:13.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.087+0000 7fb931df0640 1 -- 172.21.15.120:0/3027376123 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb92c0aeda0 con 0x7fb90c077040 2024-07-27T03:10:13.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.092+0000 7fb928ff9640 1 -- 172.21.15.120:0/3027376123 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244313 (secure 0 0 0) 0x7fb92c0aeda0 con 0x7fb90c077040 2024-07-27T03:10:13.097 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:13.098 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:10:13.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 -- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb90c077040 msgr2=0x7fb90c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb90c077040 0x7fb90c079550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0095f0 tx=0x7fb91c005f90 comp rx=0 tx=0).stop 2024-07-27T03:10:13.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 -- 172.21.15.120:0/3027376123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb92c0d0450 msgr2=0x7fb92c0b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb92c0d0450 0x7fb92c0b5f30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb924002230 tx=0x7fb92400cb90 comp rx=0 tx=0).stop 2024-07-27T03:10:13.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 -- 172.21.15.120:0/3027376123 shutdown_connections 2024-07-27T03:10:13.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb90c077040 0x7fb90c079550 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb92c0d0450 0x7fb92c0b5f30 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb92c0733c0 0x7fb92c1f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 --2- 172.21.15.120:0/3027376123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb92c0718c0 0x7fb92c150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 -- 172.21.15.120:0/3027376123 >> 172.21.15.120:0/3027376123 conn(0x7fb92c0d0df0 msgr2=0x7fb92c0737d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:13.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 -- 172.21.15.120:0/3027376123 shutdown_connections 2024-07-27T03:10:13.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.095+0000 7fb931df0640 1 -- 172.21.15.120:0/3027376123 wait complete. 2024-07-27T03:10:13.109 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-07-27T03:10:12.555347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":254348,"kb_used_data":4888,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720372,"statfs":{"total":773094113280,"available":772833660928,"internally_reserved":0,"allocated":5005312,"data_stored":2688428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.516835"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.043292+0000","last_change":"2024-07-27T03:10:08.043292+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.043292+0000","last_undegraded":"2024-07-27T03:10:08.043292+0000","last_fullsized":"2024-07-27T03:10:08.043292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046072+0000","last_change":"2024-07-27T03:10:08.046072+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046072+0000","last_undegraded":"2024-07-27T03:10:08.046072+0000","last_fullsized":"2024-07-27T03:10:08.046072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049915+0000","last_change":"2024-07-27T03:10:08.049915+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049915+0000","last_undegraded":"2024-07-27T03:10:08.049915+0000","last_fullsized":"2024-07-27T03:10:08.049915+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047191+0000","last_change":"2024-07-27T03:10:08.047191+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047191+0000","last_undegraded":"2024-07-27T03:10:08.047191+0000","last_fullsized":"2024-07-27T03:10:08.047191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049882+0000","last_change":"2024-07-27T03:10:08.049882+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049882+0000","last_undegraded":"2024-07-27T03:10:08.049882+0000","last_fullsized":"2024-07-27T03:10:08.049882+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.044705+0000","last_change":"2024-07-27T03:10:08.044705+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.044705+0000","last_undegraded":"2024-07-27T03:10:08.044705+0000","last_fullsized":"2024-07-27T03:10:08.044705+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.053019+0000","last_change":"2024-07-27T03:10:08.053019+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.053019+0000","last_undegraded":"2024-07-27T03:10:08.053019+0000","last_fullsized":"2024-07-27T03:10:08.053019+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.053508+0000","last_change":"2024-07-27T03:10:08.053508+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.053508+0000","last_undegraded":"2024-07-27T03:10:08.053508+0000","last_fullsized":"2024-07-27T03:10:08.053508+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049486+0000","last_change":"2024-07-27T03:10:08.049486+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049486+0000","last_undegraded":"2024-07-27T03:10:08.049486+0000","last_fullsized":"2024-07-27T03:10:08.049486+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047569+0000","last_change":"2024-07-27T03:10:08.047569+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047569+0000","last_undegraded":"2024-07-27T03:10:08.047569+0000","last_fullsized":"2024-07-27T03:10:08.047569+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047683+0000","last_change":"2024-07-27T03:10:08.047683+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047683+0000","last_undegraded":"2024-07-27T03:10:08.047683+0000","last_fullsized":"2024-07-27T03:10:08.047683+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.050410+0000","last_change":"2024-07-27T03:10:08.050410+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.050410+0000","last_undegraded":"2024-07-27T03:10:08.050410+0000","last_fullsized":"2024-07-27T03:10:08.050410+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051620+0000","last_change":"2024-07-27T03:10:08.051620+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051620+0000","last_undegraded":"2024-07-27T03:10:08.051620+0000","last_fullsized":"2024-07-27T03:10:08.051620+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049263+0000","last_change":"2024-07-27T03:10:08.049263+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049263+0000","last_undegraded":"2024-07-27T03:10:08.049263+0000","last_fullsized":"2024-07-27T03:10:08.049263+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.050380+0000","last_change":"2024-07-27T03:10:08.050380+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.050380+0000","last_undegraded":"2024-07-27T03:10:08.050380+0000","last_fullsized":"2024-07-27T03:10:08.050380+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047854+0000","last_change":"2024-07-27T03:10:08.047854+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047854+0000","last_undegraded":"2024-07-27T03:10:08.047854+0000","last_fullsized":"2024-07-27T03:10:08.047854+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051127+0000","last_change":"2024-07-27T03:10:08.051127+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051127+0000","last_undegraded":"2024-07-27T03:10:08.051127+0000","last_fullsized":"2024-07-27T03:10:08.051127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048334+0000","last_change":"2024-07-27T03:10:08.048334+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048334+0000","last_undegraded":"2024-07-27T03:10:08.048334+0000","last_fullsized":"2024-07-27T03:10:08.048334+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047168+0000","last_change":"2024-07-27T03:10:08.047168+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047168+0000","last_undegraded":"2024-07-27T03:10:08.047168+0000","last_fullsized":"2024-07-27T03:10:08.047168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047630+0000","last_change":"2024-07-27T03:10:08.047630+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047630+0000","last_undegraded":"2024-07-27T03:10:08.047630+0000","last_fullsized":"2024-07-27T03:10:08.047630+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048126+0000","last_change":"2024-07-27T03:10:08.048126+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048126+0000","last_undegraded":"2024-07-27T03:10:08.048126+0000","last_fullsized":"2024-07-27T03:10:08.048126+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.062524+0000","last_change":"2024-07-27T03:10:08.057878+0000","last_active":"2024-07-27T03:10:08.062524+0000","last_peered":"2024-07-27T03:10:08.062524+0000","last_clean":"2024-07-27T03:10:08.062524+0000","last_became_active":"2024-07-27T03:10:08.057580+0000","last_became_peered":"2024-07-27T03:10:08.057580+0000","last_unstale":"2024-07-27T03:10:08.062524+0000","last_undegraded":"2024-07-27T03:10:08.062524+0000","last_fullsized":"2024-07-27T03:10:08.062524+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:36:51.886898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.041376+0000","last_change":"2024-07-27T03:10:07.041376+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.041376+0000","last_undegraded":"2024-07-27T03:10:07.041376+0000","last_fullsized":"2024-07-27T03:10:07.041376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046658+0000","last_change":"2024-07-27T03:10:08.046658+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046658+0000","last_undegraded":"2024-07-27T03:10:08.046658+0000","last_fullsized":"2024-07-27T03:10:08.046658+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.046429+0000","last_change":"2024-07-27T03:10:07.046429+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.046429+0000","last_undegraded":"2024-07-27T03:10:07.046429+0000","last_fullsized":"2024-07-27T03:10:07.046429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.055973+0000","last_change":"2024-07-27T03:10:08.051365+0000","last_active":"2024-07-27T03:10:08.055973+0000","last_peered":"2024-07-27T03:10:08.055973+0000","last_clean":"2024-07-27T03:10:08.055973+0000","last_became_active":"2024-07-27T03:10:08.051023+0000","last_became_peered":"2024-07-27T03:10:08.051023+0000","last_unstale":"2024-07-27T03:10:08.055973+0000","last_undegraded":"2024-07-27T03:10:08.055973+0000","last_fullsized":"2024-07-27T03:10:08.055973+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:53:58.440417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060590+0000","last_change":"2024-07-27T03:10:08.053873+0000","last_active":"2024-07-27T03:10:08.060590+0000","last_peered":"2024-07-27T03:10:08.060590+0000","last_clean":"2024-07-27T03:10:08.060590+0000","last_became_active":"2024-07-27T03:10:08.053435+0000","last_became_peered":"2024-07-27T03:10:08.053435+0000","last_unstale":"2024-07-27T03:10:08.060590+0000","last_undegraded":"2024-07-27T03:10:08.060590+0000","last_fullsized":"2024-07-27T03:10:08.060590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:23:52.157366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051375+0000","last_change":"2024-07-27T03:10:08.051375+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051375+0000","last_undegraded":"2024-07-27T03:10:08.051375+0000","last_fullsized":"2024-07-27T03:10:08.051375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040990+0000","last_change":"2024-07-27T03:10:07.040990+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040990+0000","last_undegraded":"2024-07-27T03:10:07.040990+0000","last_fullsized":"2024-07-27T03:10:07.040990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051833+0000","last_change":"2024-07-27T03:10:08.051833+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051833+0000","last_undegraded":"2024-07-27T03:10:08.051833+0000","last_fullsized":"2024-07-27T03:10:08.051833+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060523+0000","last_change":"2024-07-27T03:10:08.056579+0000","last_active":"2024-07-27T03:10:08.060523+0000","last_peered":"2024-07-27T03:10:08.060523+0000","last_clean":"2024-07-27T03:10:08.060523+0000","last_became_active":"2024-07-27T03:10:08.056287+0000","last_became_peered":"2024-07-27T03:10:08.056287+0000","last_unstale":"2024-07-27T03:10:08.060523+0000","last_undegraded":"2024-07-27T03:10:08.060523+0000","last_fullsized":"2024-07-27T03:10:08.060523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:09:35.700169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063260+0000","last_change":"2024-07-27T03:10:08.059489+0000","last_active":"2024-07-27T03:10:08.063260+0000","last_peered":"2024-07-27T03:10:08.063260+0000","last_clean":"2024-07-27T03:10:08.063260+0000","last_became_active":"2024-07-27T03:10:08.059189+0000","last_became_peered":"2024-07-27T03:10:08.059189+0000","last_unstale":"2024-07-27T03:10:08.063260+0000","last_undegraded":"2024-07-27T03:10:08.063260+0000","last_fullsized":"2024-07-27T03:10:08.063260+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:39:03.015556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040192+0000","last_change":"2024-07-27T03:10:07.040192+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040192+0000","last_undegraded":"2024-07-27T03:10:07.040192+0000","last_fullsized":"2024-07-27T03:10:07.040192+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.042675+0000","last_change":"2024-07-27T03:10:08.042675+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.042675+0000","last_undegraded":"2024-07-27T03:10:08.042675+0000","last_fullsized":"2024-07-27T03:10:08.042675+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063101+0000","last_change":"2024-07-27T03:10:08.058799+0000","last_active":"2024-07-27T03:10:08.063101+0000","last_peered":"2024-07-27T03:10:08.063101+0000","last_clean":"2024-07-27T03:10:08.063101+0000","last_became_active":"2024-07-27T03:10:08.058488+0000","last_became_peered":"2024-07-27T03:10:08.058488+0000","last_unstale":"2024-07-27T03:10:08.063101+0000","last_undegraded":"2024-07-27T03:10:08.063101+0000","last_fullsized":"2024-07-27T03:10:08.063101+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:40:50.750102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047269+0000","last_change":"2024-07-27T03:10:08.047269+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047269+0000","last_undegraded":"2024-07-27T03:10:08.047269+0000","last_fullsized":"2024-07-27T03:10:08.047269+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061124+0000","last_change":"2024-07-27T03:10:08.055592+0000","last_active":"2024-07-27T03:10:08.061124+0000","last_peered":"2024-07-27T03:10:08.061124+0000","last_clean":"2024-07-27T03:10:08.061124+0000","last_became_active":"2024-07-27T03:10:08.054236+0000","last_became_peered":"2024-07-27T03:10:08.054236+0000","last_unstale":"2024-07-27T03:10:08.061124+0000","last_undegraded":"2024-07-27T03:10:08.061124+0000","last_fullsized":"2024-07-27T03:10:08.061124+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:48:04.798715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.043965+0000","last_change":"2024-07-27T03:10:08.043965+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.043965+0000","last_undegraded":"2024-07-27T03:10:08.043965+0000","last_fullsized":"2024-07-27T03:10:08.043965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.067662+0000","last_change":"2024-07-27T03:10:08.061069+0000","last_active":"2024-07-27T03:10:08.067662+0000","last_peered":"2024-07-27T03:10:08.067662+0000","last_clean":"2024-07-27T03:10:08.067662+0000","last_became_active":"2024-07-27T03:10:08.060741+0000","last_became_peered":"2024-07-27T03:10:08.060741+0000","last_unstale":"2024-07-27T03:10:08.067662+0000","last_undegraded":"2024-07-27T03:10:08.067662+0000","last_fullsized":"2024-07-27T03:10:08.067662+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:30:31.323266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.062947+0000","last_change":"2024-07-27T03:10:08.059186+0000","last_active":"2024-07-27T03:10:08.062947+0000","last_peered":"2024-07-27T03:10:08.062947+0000","last_clean":"2024-07-27T03:10:08.062947+0000","last_became_active":"2024-07-27T03:10:08.058906+0000","last_became_peered":"2024-07-27T03:10:08.058906+0000","last_unstale":"2024-07-27T03:10:08.062947+0000","last_undegraded":"2024-07-27T03:10:08.062947+0000","last_fullsized":"2024-07-27T03:10:08.062947+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:11:20.575169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.050984+0000","last_change":"2024-07-27T03:10:08.050984+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.050984+0000","last_undegraded":"2024-07-27T03:10:08.050984+0000","last_fullsized":"2024-07-27T03:10:08.050984+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061689+0000","last_change":"2024-07-27T03:10:08.056502+0000","last_active":"2024-07-27T03:10:08.061689+0000","last_peered":"2024-07-27T03:10:08.061689+0000","last_clean":"2024-07-27T03:10:08.061689+0000","last_became_active":"2024-07-27T03:10:08.056132+0000","last_became_peered":"2024-07-27T03:10:08.056132+0000","last_unstale":"2024-07-27T03:10:08.061689+0000","last_undegraded":"2024-07-27T03:10:08.061689+0000","last_fullsized":"2024-07-27T03:10:08.061689+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:29:41.752116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047253+0000","last_change":"2024-07-27T03:10:08.047253+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047253+0000","last_undegraded":"2024-07-27T03:10:08.047253+0000","last_fullsized":"2024-07-27T03:10:08.047253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.065127+0000","last_change":"2024-07-27T03:10:08.060288+0000","last_active":"2024-07-27T03:10:08.065127+0000","last_peered":"2024-07-27T03:10:08.065127+0000","last_clean":"2024-07-27T03:10:08.065127+0000","last_became_active":"2024-07-27T03:10:08.059433+0000","last_became_peered":"2024-07-27T03:10:08.059433+0000","last_unstale":"2024-07-27T03:10:08.065127+0000","last_undegraded":"2024-07-27T03:10:08.065127+0000","last_fullsized":"2024-07-27T03:10:08.065127+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:39:15.226163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.042383+0000","last_change":"2024-07-27T03:10:08.042383+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.042383+0000","last_undegraded":"2024-07-27T03:10:08.042383+0000","last_fullsized":"2024-07-27T03:10:08.042383+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.065120+0000","last_change":"2024-07-27T03:10:08.061580+0000","last_active":"2024-07-27T03:10:08.065120+0000","last_peered":"2024-07-27T03:10:08.065120+0000","last_clean":"2024-07-27T03:10:08.065120+0000","last_became_active":"2024-07-27T03:10:08.061085+0000","last_became_peered":"2024-07-27T03:10:08.061085+0000","last_unstale":"2024-07-27T03:10:08.065120+0000","last_undegraded":"2024-07-27T03:10:08.065120+0000","last_fullsized":"2024-07-27T03:10:08.065120+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:41:37.614315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047849+0000","last_change":"2024-07-27T03:10:08.047849+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047849+0000","last_undegraded":"2024-07-27T03:10:08.047849+0000","last_fullsized":"2024-07-27T03:10:08.047849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.064903+0000","last_change":"2024-07-27T03:10:08.057979+0000","last_active":"2024-07-27T03:10:08.064903+0000","last_peered":"2024-07-27T03:10:08.064903+0000","last_clean":"2024-07-27T03:10:08.064903+0000","last_became_active":"2024-07-27T03:10:08.057612+0000","last_became_peered":"2024-07-27T03:10:08.057612+0000","last_unstale":"2024-07-27T03:10:08.064903+0000","last_undegraded":"2024-07-27T03:10:08.064903+0000","last_fullsized":"2024-07-27T03:10:08.064903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:43:33.553794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.053050+0000","last_change":"2024-07-27T03:10:08.053050+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.053050+0000","last_undegraded":"2024-07-27T03:10:08.053050+0000","last_fullsized":"2024-07-27T03:10:08.053050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040297+0000","last_change":"2024-07-27T03:10:07.040297+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040297+0000","last_undegraded":"2024-07-27T03:10:07.040297+0000","last_fullsized":"2024-07-27T03:10:07.040297+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.069118+0000","last_change":"2024-07-27T03:10:08.063876+0000","last_active":"2024-07-27T03:10:08.069118+0000","last_peered":"2024-07-27T03:10:08.069118+0000","last_clean":"2024-07-27T03:10:08.069118+0000","last_became_active":"2024-07-27T03:10:08.063533+0000","last_became_peered":"2024-07-27T03:10:08.063533+0000","last_unstale":"2024-07-27T03:10:08.069118+0000","last_undegraded":"2024-07-27T03:10:08.069118+0000","last_fullsized":"2024-07-27T03:10:08.069118+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:29:41.752116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.062467+0000","last_change":"2024-07-27T03:10:08.057169+0000","last_active":"2024-07-27T03:10:08.062467+0000","last_peered":"2024-07-27T03:10:08.062467+0000","last_clean":"2024-07-27T03:10:08.062467+0000","last_became_active":"2024-07-27T03:10:08.056850+0000","last_became_peered":"2024-07-27T03:10:08.056850+0000","last_unstale":"2024-07-27T03:10:08.062467+0000","last_undegraded":"2024-07-27T03:10:08.062467+0000","last_fullsized":"2024-07-27T03:10:08.062467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:25.827206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048125+0000","last_change":"2024-07-27T03:10:08.048125+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048125+0000","last_undegraded":"2024-07-27T03:10:08.048125+0000","last_fullsized":"2024-07-27T03:10:08.048125+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060614+0000","last_change":"2024-07-27T03:10:08.054887+0000","last_active":"2024-07-27T03:10:08.060614+0000","last_peered":"2024-07-27T03:10:08.060614+0000","last_clean":"2024-07-27T03:10:08.060614+0000","last_became_active":"2024-07-27T03:10:08.054547+0000","last_became_peered":"2024-07-27T03:10:08.054547+0000","last_unstale":"2024-07-27T03:10:08.060614+0000","last_undegraded":"2024-07-27T03:10:08.060614+0000","last_fullsized":"2024-07-27T03:10:08.060614+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:04.286247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063414+0000","last_change":"2024-07-27T03:10:08.061634+0000","last_active":"2024-07-27T03:10:08.063414+0000","last_peered":"2024-07-27T03:10:08.063414+0000","last_clean":"2024-07-27T03:10:08.063414+0000","last_became_active":"2024-07-27T03:10:08.061239+0000","last_became_peered":"2024-07-27T03:10:08.061239+0000","last_unstale":"2024-07-27T03:10:08.063414+0000","last_undegraded":"2024-07-27T03:10:08.063414+0000","last_fullsized":"2024-07-27T03:10:08.063414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:48:04.798715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047632+0000","last_change":"2024-07-27T03:10:08.047632+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047632+0000","last_undegraded":"2024-07-27T03:10:08.047632+0000","last_fullsized":"2024-07-27T03:10:08.047632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063096+0000","last_change":"2024-07-27T03:10:08.058770+0000","last_active":"2024-07-27T03:10:08.063096+0000","last_peered":"2024-07-27T03:10:08.063096+0000","last_clean":"2024-07-27T03:10:08.063096+0000","last_became_active":"2024-07-27T03:10:08.058426+0000","last_became_peered":"2024-07-27T03:10:08.058426+0000","last_unstale":"2024-07-27T03:10:08.063096+0000","last_undegraded":"2024-07-27T03:10:08.063096+0000","last_fullsized":"2024-07-27T03:10:08.063096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:25.809218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049398+0000","last_change":"2024-07-27T03:10:08.049398+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049398+0000","last_undegraded":"2024-07-27T03:10:08.049398+0000","last_fullsized":"2024-07-27T03:10:08.049398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.066244+0000","last_change":"2024-07-27T03:10:08.061434+0000","last_active":"2024-07-27T03:10:08.066244+0000","last_peered":"2024-07-27T03:10:08.066244+0000","last_clean":"2024-07-27T03:10:08.066244+0000","last_became_active":"2024-07-27T03:10:08.061012+0000","last_became_peered":"2024-07-27T03:10:08.061012+0000","last_unstale":"2024-07-27T03:10:08.066244+0000","last_undegraded":"2024-07-27T03:10:08.066244+0000","last_fullsized":"2024-07-27T03:10:08.066244+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:03:41.401965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060447+0000","last_change":"2024-07-27T03:10:08.052094+0000","last_active":"2024-07-27T03:10:08.060447+0000","last_peered":"2024-07-27T03:10:08.060447+0000","last_clean":"2024-07-27T03:10:08.060447+0000","last_became_active":"2024-07-27T03:10:08.051179+0000","last_became_peered":"2024-07-27T03:10:08.051179+0000","last_unstale":"2024-07-27T03:10:08.060447+0000","last_undegraded":"2024-07-27T03:10:08.060447+0000","last_fullsized":"2024-07-27T03:10:08.060447+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:57:08.805918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048115+0000","last_change":"2024-07-27T03:10:08.048115+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048115+0000","last_undegraded":"2024-07-27T03:10:08.048115+0000","last_fullsized":"2024-07-27T03:10:08.048115+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061081+0000","last_change":"2024-07-27T03:10:08.055310+0000","last_active":"2024-07-27T03:10:08.061081+0000","last_peered":"2024-07-27T03:10:08.061081+0000","last_clean":"2024-07-27T03:10:08.061081+0000","last_became_active":"2024-07-27T03:10:08.055017+0000","last_became_peered":"2024-07-27T03:10:08.055017+0000","last_unstale":"2024-07-27T03:10:08.061081+0000","last_undegraded":"2024-07-27T03:10:08.061081+0000","last_fullsized":"2024-07-27T03:10:08.061081+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:14:41.840850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.042109+0000","last_change":"2024-07-27T03:10:08.042109+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.042109+0000","last_undegraded":"2024-07-27T03:10:08.042109+0000","last_fullsized":"2024-07-27T03:10:08.042109+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.045762+0000","last_change":"2024-07-27T03:10:07.045762+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.045762+0000","last_undegraded":"2024-07-27T03:10:07.045762+0000","last_fullsized":"2024-07-27T03:10:07.045762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046654+0000","last_change":"2024-07-27T03:10:08.046654+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046654+0000","last_undegraded":"2024-07-27T03:10:08.046654+0000","last_fullsized":"2024-07-27T03:10:08.046654+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061100+0000","last_change":"2024-07-27T03:10:08.055344+0000","last_active":"2024-07-27T03:10:08.061100+0000","last_peered":"2024-07-27T03:10:08.061100+0000","last_clean":"2024-07-27T03:10:08.061100+0000","last_became_active":"2024-07-27T03:10:08.054304+0000","last_became_peered":"2024-07-27T03:10:08.054304+0000","last_unstale":"2024-07-27T03:10:08.061100+0000","last_undegraded":"2024-07-27T03:10:08.061100+0000","last_fullsized":"2024-07-27T03:10:08.061100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:09:35.700169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046651+0000","last_change":"2024-07-27T03:10:08.046651+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046651+0000","last_undegraded":"2024-07-27T03:10:08.046651+0000","last_fullsized":"2024-07-27T03:10:08.046651+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040192+0000","last_change":"2024-07-27T03:10:07.040192+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040192+0000","last_undegraded":"2024-07-27T03:10:07.040192+0000","last_fullsized":"2024-07-27T03:10:07.040192+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.044979+0000","last_change":"2024-07-27T03:10:08.044979+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.044979+0000","last_undegraded":"2024-07-27T03:10:08.044979+0000","last_fullsized":"2024-07-27T03:10:08.044979+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.045196+0000","last_change":"2024-07-27T03:10:07.045196+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.045196+0000","last_undegraded":"2024-07-27T03:10:07.045196+0000","last_fullsized":"2024-07-27T03:10:07.045196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.065144+0000","last_change":"2024-07-27T03:10:08.061822+0000","last_active":"2024-07-27T03:10:08.065144+0000","last_peered":"2024-07-27T03:10:08.065144+0000","last_clean":"2024-07-27T03:10:08.065144+0000","last_became_active":"2024-07-27T03:10:08.061513+0000","last_became_peered":"2024-07-27T03:10:08.061513+0000","last_unstale":"2024-07-27T03:10:08.065144+0000","last_undegraded":"2024-07-27T03:10:08.065144+0000","last_fullsized":"2024-07-27T03:10:08.065144+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:00:29.051706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049060+0000","last_change":"2024-07-27T03:10:08.049060+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049060+0000","last_undegraded":"2024-07-27T03:10:08.049060+0000","last_fullsized":"2024-07-27T03:10:08.049060+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060567+0000","last_change":"2024-07-27T03:10:08.053861+0000","last_active":"2024-07-27T03:10:08.060567+0000","last_peered":"2024-07-27T03:10:08.060567+0000","last_clean":"2024-07-27T03:10:08.060567+0000","last_became_active":"2024-07-27T03:10:08.053505+0000","last_became_peered":"2024-07-27T03:10:08.053505+0000","last_unstale":"2024-07-27T03:10:08.060567+0000","last_undegraded":"2024-07-27T03:10:08.060567+0000","last_fullsized":"2024-07-27T03:10:08.060567+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:14:41.840850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":146,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.047604+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:10:08.047604+0000","last_peered":"2024-07-27T03:10:08.047604+0000","last_clean":"2024-07-27T03:10:08.047604+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:10:08.047604+0000","last_undegraded":"2024-07-27T03:10:08.047604+0000","last_fullsized":"2024-07-27T03:10:08.047604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":781963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":483328,"data_stored":191595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":483328,"data_stored":191595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":781963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:10:13.114 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:10:13.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.262+0000 7f1bab4b6640 1 -- 172.21.15.120:0/3928266095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ba40b63e0 msgr2=0x7f1ba4152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.262+0000 7f1bab4b6640 1 --2- 172.21.15.120:0/3928266095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ba40b63e0 0x7f1ba4152160 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1b94005fd0 tx=0x7f1b9402a520 comp rx=0 tx=0).stop 2024-07-27T03:10:13.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.262+0000 7f1bab4b6640 1 -- 172.21.15.120:0/3928266095 shutdown_connections 2024-07-27T03:10:13.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.262+0000 7f1bab4b6640 1 --2- 172.21.15.120:0/3928266095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ba415ec20 0x7f1ba415f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.262+0000 7f1bab4b6640 1 --2- 172.21.15.120:0/3928266095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ba40b63e0 0x7f1ba4152160 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.262+0000 7f1bab4b6640 1 -- 172.21.15.120:0/3928266095 >> 172.21.15.120:0/3928266095 conn(0x7f1ba406cba0 msgr2=0x7f1ba406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:13.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.262+0000 7f1bab4b6640 1 -- 172.21.15.120:0/3928266095 shutdown_connections 2024-07-27T03:10:13.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.262+0000 7f1bab4b6640 1 -- 172.21.15.120:0/3928266095 wait complete. 2024-07-27T03:10:13.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.264+0000 7f1bab4b6640 1 Processor -- start 2024-07-27T03:10:13.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.264+0000 7f1bab4b6640 1 -- start start 2024-07-27T03:10:13.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1bab4b6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ba415c220 0x7f1ba40cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1bab4b6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ba415ec20 0x7f1ba4139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1bab4b6640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ba413a0b0 0x7f1ba4152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1bab4b6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba40cdb80 con 0x7f1ba415c220 2024-07-27T03:10:13.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1bab4b6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba40cda00 con 0x7f1ba415ec20 2024-07-27T03:10:13.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1bab4b6640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba40cdd00 con 0x7f1ba413a0b0 2024-07-27T03:10:13.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba9252640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ba415c220 0x7f1ba40cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba9252640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ba415c220 0x7f1ba40cf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58242/0 (socket says 172.21.15.120:58242) 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba9252640 1 -- 172.21.15.120:0/2409414260 learned_addr learned my addr 172.21.15.120:0/2409414260 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba8a51640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ba415ec20 0x7f1ba4139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba9a53640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ba413a0b0 0x7f1ba4152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba9252640 1 -- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ba413a0b0 msgr2=0x7f1ba4152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba9252640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ba413a0b0 0x7f1ba4152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba9252640 1 -- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ba415ec20 msgr2=0x7f1ba4139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba9252640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ba415ec20 0x7f1ba4139b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba9252640 1 -- 172.21.15.120:0/2409414260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba413a8e0 con 0x7f1ba415c220 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba9a53640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ba413a0b0 0x7f1ba4152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.265+0000 7f1ba9252640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ba415c220 0x7f1ba40cf860 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000b3f0 tx=0x7f1ba000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.266+0000 7f1b99ffb640 1 -- 172.21.15.120:0/2409414260 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0015020 con 0x7f1ba415c220 2024-07-27T03:10:13.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.266+0000 7f1b99ffb640 1 -- 172.21.15.120:0/2409414260 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ba0011920 con 0x7f1ba415c220 2024-07-27T03:10:13.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.266+0000 7f1b99ffb640 1 -- 172.21.15.120:0/2409414260 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0011d70 con 0x7f1ba415c220 2024-07-27T03:10:13.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.266+0000 7f1bab4b6640 1 -- 172.21.15.120:0/2409414260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba41f50f0 con 0x7f1ba415c220 2024-07-27T03:10:13.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.266+0000 7f1bab4b6640 1 -- 172.21.15.120:0/2409414260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba41f56b0 con 0x7f1ba415c220 2024-07-27T03:10:13.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.267+0000 7f1bab4b6640 1 -- 172.21.15.120:0/2409414260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba40ce240 con 0x7f1ba415c220 2024-07-27T03:10:13.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.267+0000 7f1b99ffb640 1 -- 172.21.15.120:0/2409414260 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1ba0018020 con 0x7f1ba415c220 2024-07-27T03:10:13.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.268+0000 7f1b99ffb640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1b88077040 0x7f1b88079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.268+0000 7f1b99ffb640 1 -- 172.21.15.120:0/2409414260 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f1ba0098600 con 0x7f1ba415c220 2024-07-27T03:10:13.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.268+0000 7f1ba8a51640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1b88077040 0x7f1b88079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:13.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.269+0000 7f1ba8a51640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1b88077040 0x7f1b88079550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1b94033000 tx=0x7f1b94004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:13.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.272+0000 7f1b99ffb640 1 -- 172.21.15.120:0/2409414260 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f1ba001f030 con 0x7f1ba415c220 2024-07-27T03:10:13.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.451+0000 7f1bab4b6640 1 -- 172.21.15.120:0/2409414260 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ba4069c10 con 0x7f1b88077040 2024-07-27T03:10:13.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.456+0000 7f1b99ffb640 1 -- 172.21.15.120:0/2409414260 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244313 (secure 0 0 0) 0x7f1b940047a0 con 0x7f1b88077040 2024-07-27T03:10:13.460 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:13.461 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:10:13.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.458+0000 7f1bab4b6640 1 -- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1b88077040 msgr2=0x7f1b88079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.459+0000 7f1bab4b6640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1b88077040 0x7f1b88079550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1b94033000 tx=0x7f1b94004730 comp rx=0 tx=0).stop 2024-07-27T03:10:13.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.459+0000 7f1bab4b6640 1 -- 172.21.15.120:0/2409414260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ba415c220 msgr2=0x7f1ba40cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.459+0000 7f1bab4b6640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ba415c220 0x7f1ba40cf860 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000b3f0 tx=0x7f1ba000b8b0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.459+0000 7f1bab4b6640 1 -- 172.21.15.120:0/2409414260 shutdown_connections 2024-07-27T03:10:13.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.459+0000 7f1bab4b6640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1b88077040 0x7f1b88079550 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.459+0000 7f1bab4b6640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ba413a0b0 0x7f1ba4152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.459+0000 7f1bab4b6640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ba415ec20 0x7f1ba4139b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.459+0000 7f1bab4b6640 1 --2- 172.21.15.120:0/2409414260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1ba415c220 0x7f1ba40cf860 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.459+0000 7f1bab4b6640 1 -- 172.21.15.120:0/2409414260 >> 172.21.15.120:0/2409414260 conn(0x7f1ba406cba0 msgr2=0x7f1ba40cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:13.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.459+0000 7f1bab4b6640 1 -- 172.21.15.120:0/2409414260 shutdown_connections 2024-07-27T03:10:13.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.459+0000 7f1bab4b6640 1 -- 172.21.15.120:0/2409414260 wait complete. 2024-07-27T03:10:13.472 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-07-27T03:10:12.555347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":254348,"kb_used_data":4888,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720372,"statfs":{"total":773094113280,"available":772833660928,"internally_reserved":0,"allocated":5005312,"data_stored":2688428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.516835"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.043292+0000","last_change":"2024-07-27T03:10:08.043292+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.043292+0000","last_undegraded":"2024-07-27T03:10:08.043292+0000","last_fullsized":"2024-07-27T03:10:08.043292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046072+0000","last_change":"2024-07-27T03:10:08.046072+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046072+0000","last_undegraded":"2024-07-27T03:10:08.046072+0000","last_fullsized":"2024-07-27T03:10:08.046072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049915+0000","last_change":"2024-07-27T03:10:08.049915+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049915+0000","last_undegraded":"2024-07-27T03:10:08.049915+0000","last_fullsized":"2024-07-27T03:10:08.049915+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047191+0000","last_change":"2024-07-27T03:10:08.047191+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047191+0000","last_undegraded":"2024-07-27T03:10:08.047191+0000","last_fullsized":"2024-07-27T03:10:08.047191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049882+0000","last_change":"2024-07-27T03:10:08.049882+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049882+0000","last_undegraded":"2024-07-27T03:10:08.049882+0000","last_fullsized":"2024-07-27T03:10:08.049882+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.044705+0000","last_change":"2024-07-27T03:10:08.044705+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.044705+0000","last_undegraded":"2024-07-27T03:10:08.044705+0000","last_fullsized":"2024-07-27T03:10:08.044705+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.053019+0000","last_change":"2024-07-27T03:10:08.053019+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.053019+0000","last_undegraded":"2024-07-27T03:10:08.053019+0000","last_fullsized":"2024-07-27T03:10:08.053019+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.053508+0000","last_change":"2024-07-27T03:10:08.053508+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.053508+0000","last_undegraded":"2024-07-27T03:10:08.053508+0000","last_fullsized":"2024-07-27T03:10:08.053508+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049486+0000","last_change":"2024-07-27T03:10:08.049486+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049486+0000","last_undegraded":"2024-07-27T03:10:08.049486+0000","last_fullsized":"2024-07-27T03:10:08.049486+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047569+0000","last_change":"2024-07-27T03:10:08.047569+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047569+0000","last_undegraded":"2024-07-27T03:10:08.047569+0000","last_fullsized":"2024-07-27T03:10:08.047569+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047683+0000","last_change":"2024-07-27T03:10:08.047683+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047683+0000","last_undegraded":"2024-07-27T03:10:08.047683+0000","last_fullsized":"2024-07-27T03:10:08.047683+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.050410+0000","last_change":"2024-07-27T03:10:08.050410+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.050410+0000","last_undegraded":"2024-07-27T03:10:08.050410+0000","last_fullsized":"2024-07-27T03:10:08.050410+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051620+0000","last_change":"2024-07-27T03:10:08.051620+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051620+0000","last_undegraded":"2024-07-27T03:10:08.051620+0000","last_fullsized":"2024-07-27T03:10:08.051620+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049263+0000","last_change":"2024-07-27T03:10:08.049263+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049263+0000","last_undegraded":"2024-07-27T03:10:08.049263+0000","last_fullsized":"2024-07-27T03:10:08.049263+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.050380+0000","last_change":"2024-07-27T03:10:08.050380+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.050380+0000","last_undegraded":"2024-07-27T03:10:08.050380+0000","last_fullsized":"2024-07-27T03:10:08.050380+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047854+0000","last_change":"2024-07-27T03:10:08.047854+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047854+0000","last_undegraded":"2024-07-27T03:10:08.047854+0000","last_fullsized":"2024-07-27T03:10:08.047854+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051127+0000","last_change":"2024-07-27T03:10:08.051127+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051127+0000","last_undegraded":"2024-07-27T03:10:08.051127+0000","last_fullsized":"2024-07-27T03:10:08.051127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048334+0000","last_change":"2024-07-27T03:10:08.048334+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048334+0000","last_undegraded":"2024-07-27T03:10:08.048334+0000","last_fullsized":"2024-07-27T03:10:08.048334+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047168+0000","last_change":"2024-07-27T03:10:08.047168+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047168+0000","last_undegraded":"2024-07-27T03:10:08.047168+0000","last_fullsized":"2024-07-27T03:10:08.047168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047630+0000","last_change":"2024-07-27T03:10:08.047630+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047630+0000","last_undegraded":"2024-07-27T03:10:08.047630+0000","last_fullsized":"2024-07-27T03:10:08.047630+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048126+0000","last_change":"2024-07-27T03:10:08.048126+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048126+0000","last_undegraded":"2024-07-27T03:10:08.048126+0000","last_fullsized":"2024-07-27T03:10:08.048126+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.062524+0000","last_change":"2024-07-27T03:10:08.057878+0000","last_active":"2024-07-27T03:10:08.062524+0000","last_peered":"2024-07-27T03:10:08.062524+0000","last_clean":"2024-07-27T03:10:08.062524+0000","last_became_active":"2024-07-27T03:10:08.057580+0000","last_became_peered":"2024-07-27T03:10:08.057580+0000","last_unstale":"2024-07-27T03:10:08.062524+0000","last_undegraded":"2024-07-27T03:10:08.062524+0000","last_fullsized":"2024-07-27T03:10:08.062524+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:36:51.886898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.041376+0000","last_change":"2024-07-27T03:10:07.041376+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.041376+0000","last_undegraded":"2024-07-27T03:10:07.041376+0000","last_fullsized":"2024-07-27T03:10:07.041376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046658+0000","last_change":"2024-07-27T03:10:08.046658+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046658+0000","last_undegraded":"2024-07-27T03:10:08.046658+0000","last_fullsized":"2024-07-27T03:10:08.046658+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.046429+0000","last_change":"2024-07-27T03:10:07.046429+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.046429+0000","last_undegraded":"2024-07-27T03:10:07.046429+0000","last_fullsized":"2024-07-27T03:10:07.046429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.055973+0000","last_change":"2024-07-27T03:10:08.051365+0000","last_active":"2024-07-27T03:10:08.055973+0000","last_peered":"2024-07-27T03:10:08.055973+0000","last_clean":"2024-07-27T03:10:08.055973+0000","last_became_active":"2024-07-27T03:10:08.051023+0000","last_became_peered":"2024-07-27T03:10:08.051023+0000","last_unstale":"2024-07-27T03:10:08.055973+0000","last_undegraded":"2024-07-27T03:10:08.055973+0000","last_fullsized":"2024-07-27T03:10:08.055973+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:53:58.440417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060590+0000","last_change":"2024-07-27T03:10:08.053873+0000","last_active":"2024-07-27T03:10:08.060590+0000","last_peered":"2024-07-27T03:10:08.060590+0000","last_clean":"2024-07-27T03:10:08.060590+0000","last_became_active":"2024-07-27T03:10:08.053435+0000","last_became_peered":"2024-07-27T03:10:08.053435+0000","last_unstale":"2024-07-27T03:10:08.060590+0000","last_undegraded":"2024-07-27T03:10:08.060590+0000","last_fullsized":"2024-07-27T03:10:08.060590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:23:52.157366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051375+0000","last_change":"2024-07-27T03:10:08.051375+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051375+0000","last_undegraded":"2024-07-27T03:10:08.051375+0000","last_fullsized":"2024-07-27T03:10:08.051375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040990+0000","last_change":"2024-07-27T03:10:07.040990+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040990+0000","last_undegraded":"2024-07-27T03:10:07.040990+0000","last_fullsized":"2024-07-27T03:10:07.040990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051833+0000","last_change":"2024-07-27T03:10:08.051833+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051833+0000","last_undegraded":"2024-07-27T03:10:08.051833+0000","last_fullsized":"2024-07-27T03:10:08.051833+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060523+0000","last_change":"2024-07-27T03:10:08.056579+0000","last_active":"2024-07-27T03:10:08.060523+0000","last_peered":"2024-07-27T03:10:08.060523+0000","last_clean":"2024-07-27T03:10:08.060523+0000","last_became_active":"2024-07-27T03:10:08.056287+0000","last_became_peered":"2024-07-27T03:10:08.056287+0000","last_unstale":"2024-07-27T03:10:08.060523+0000","last_undegraded":"2024-07-27T03:10:08.060523+0000","last_fullsized":"2024-07-27T03:10:08.060523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:09:35.700169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063260+0000","last_change":"2024-07-27T03:10:08.059489+0000","last_active":"2024-07-27T03:10:08.063260+0000","last_peered":"2024-07-27T03:10:08.063260+0000","last_clean":"2024-07-27T03:10:08.063260+0000","last_became_active":"2024-07-27T03:10:08.059189+0000","last_became_peered":"2024-07-27T03:10:08.059189+0000","last_unstale":"2024-07-27T03:10:08.063260+0000","last_undegraded":"2024-07-27T03:10:08.063260+0000","last_fullsized":"2024-07-27T03:10:08.063260+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:39:03.015556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040192+0000","last_change":"2024-07-27T03:10:07.040192+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040192+0000","last_undegraded":"2024-07-27T03:10:07.040192+0000","last_fullsized":"2024-07-27T03:10:07.040192+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.042675+0000","last_change":"2024-07-27T03:10:08.042675+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.042675+0000","last_undegraded":"2024-07-27T03:10:08.042675+0000","last_fullsized":"2024-07-27T03:10:08.042675+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063101+0000","last_change":"2024-07-27T03:10:08.058799+0000","last_active":"2024-07-27T03:10:08.063101+0000","last_peered":"2024-07-27T03:10:08.063101+0000","last_clean":"2024-07-27T03:10:08.063101+0000","last_became_active":"2024-07-27T03:10:08.058488+0000","last_became_peered":"2024-07-27T03:10:08.058488+0000","last_unstale":"2024-07-27T03:10:08.063101+0000","last_undegraded":"2024-07-27T03:10:08.063101+0000","last_fullsized":"2024-07-27T03:10:08.063101+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:40:50.750102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047269+0000","last_change":"2024-07-27T03:10:08.047269+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047269+0000","last_undegraded":"2024-07-27T03:10:08.047269+0000","last_fullsized":"2024-07-27T03:10:08.047269+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061124+0000","last_change":"2024-07-27T03:10:08.055592+0000","last_active":"2024-07-27T03:10:08.061124+0000","last_peered":"2024-07-27T03:10:08.061124+0000","last_clean":"2024-07-27T03:10:08.061124+0000","last_became_active":"2024-07-27T03:10:08.054236+0000","last_became_peered":"2024-07-27T03:10:08.054236+0000","last_unstale":"2024-07-27T03:10:08.061124+0000","last_undegraded":"2024-07-27T03:10:08.061124+0000","last_fullsized":"2024-07-27T03:10:08.061124+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:48:04.798715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.043965+0000","last_change":"2024-07-27T03:10:08.043965+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.043965+0000","last_undegraded":"2024-07-27T03:10:08.043965+0000","last_fullsized":"2024-07-27T03:10:08.043965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.067662+0000","last_change":"2024-07-27T03:10:08.061069+0000","last_active":"2024-07-27T03:10:08.067662+0000","last_peered":"2024-07-27T03:10:08.067662+0000","last_clean":"2024-07-27T03:10:08.067662+0000","last_became_active":"2024-07-27T03:10:08.060741+0000","last_became_peered":"2024-07-27T03:10:08.060741+0000","last_unstale":"2024-07-27T03:10:08.067662+0000","last_undegraded":"2024-07-27T03:10:08.067662+0000","last_fullsized":"2024-07-27T03:10:08.067662+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:30:31.323266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.062947+0000","last_change":"2024-07-27T03:10:08.059186+0000","last_active":"2024-07-27T03:10:08.062947+0000","last_peered":"2024-07-27T03:10:08.062947+0000","last_clean":"2024-07-27T03:10:08.062947+0000","last_became_active":"2024-07-27T03:10:08.058906+0000","last_became_peered":"2024-07-27T03:10:08.058906+0000","last_unstale":"2024-07-27T03:10:08.062947+0000","last_undegraded":"2024-07-27T03:10:08.062947+0000","last_fullsized":"2024-07-27T03:10:08.062947+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:11:20.575169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.050984+0000","last_change":"2024-07-27T03:10:08.050984+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.050984+0000","last_undegraded":"2024-07-27T03:10:08.050984+0000","last_fullsized":"2024-07-27T03:10:08.050984+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061689+0000","last_change":"2024-07-27T03:10:08.056502+0000","last_active":"2024-07-27T03:10:08.061689+0000","last_peered":"2024-07-27T03:10:08.061689+0000","last_clean":"2024-07-27T03:10:08.061689+0000","last_became_active":"2024-07-27T03:10:08.056132+0000","last_became_peered":"2024-07-27T03:10:08.056132+0000","last_unstale":"2024-07-27T03:10:08.061689+0000","last_undegraded":"2024-07-27T03:10:08.061689+0000","last_fullsized":"2024-07-27T03:10:08.061689+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:29:41.752116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047253+0000","last_change":"2024-07-27T03:10:08.047253+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047253+0000","last_undegraded":"2024-07-27T03:10:08.047253+0000","last_fullsized":"2024-07-27T03:10:08.047253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.065127+0000","last_change":"2024-07-27T03:10:08.060288+0000","last_active":"2024-07-27T03:10:08.065127+0000","last_peered":"2024-07-27T03:10:08.065127+0000","last_clean":"2024-07-27T03:10:08.065127+0000","last_became_active":"2024-07-27T03:10:08.059433+0000","last_became_peered":"2024-07-27T03:10:08.059433+0000","last_unstale":"2024-07-27T03:10:08.065127+0000","last_undegraded":"2024-07-27T03:10:08.065127+0000","last_fullsized":"2024-07-27T03:10:08.065127+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:39:15.226163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.042383+0000","last_change":"2024-07-27T03:10:08.042383+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.042383+0000","last_undegraded":"2024-07-27T03:10:08.042383+0000","last_fullsized":"2024-07-27T03:10:08.042383+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.065120+0000","last_change":"2024-07-27T03:10:08.061580+0000","last_active":"2024-07-27T03:10:08.065120+0000","last_peered":"2024-07-27T03:10:08.065120+0000","last_clean":"2024-07-27T03:10:08.065120+0000","last_became_active":"2024-07-27T03:10:08.061085+0000","last_became_peered":"2024-07-27T03:10:08.061085+0000","last_unstale":"2024-07-27T03:10:08.065120+0000","last_undegraded":"2024-07-27T03:10:08.065120+0000","last_fullsized":"2024-07-27T03:10:08.065120+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:41:37.614315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047849+0000","last_change":"2024-07-27T03:10:08.047849+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047849+0000","last_undegraded":"2024-07-27T03:10:08.047849+0000","last_fullsized":"2024-07-27T03:10:08.047849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.064903+0000","last_change":"2024-07-27T03:10:08.057979+0000","last_active":"2024-07-27T03:10:08.064903+0000","last_peered":"2024-07-27T03:10:08.064903+0000","last_clean":"2024-07-27T03:10:08.064903+0000","last_became_active":"2024-07-27T03:10:08.057612+0000","last_became_peered":"2024-07-27T03:10:08.057612+0000","last_unstale":"2024-07-27T03:10:08.064903+0000","last_undegraded":"2024-07-27T03:10:08.064903+0000","last_fullsized":"2024-07-27T03:10:08.064903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:43:33.553794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.053050+0000","last_change":"2024-07-27T03:10:08.053050+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.053050+0000","last_undegraded":"2024-07-27T03:10:08.053050+0000","last_fullsized":"2024-07-27T03:10:08.053050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040297+0000","last_change":"2024-07-27T03:10:07.040297+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040297+0000","last_undegraded":"2024-07-27T03:10:07.040297+0000","last_fullsized":"2024-07-27T03:10:07.040297+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.069118+0000","last_change":"2024-07-27T03:10:08.063876+0000","last_active":"2024-07-27T03:10:08.069118+0000","last_peered":"2024-07-27T03:10:08.069118+0000","last_clean":"2024-07-27T03:10:08.069118+0000","last_became_active":"2024-07-27T03:10:08.063533+0000","last_became_peered":"2024-07-27T03:10:08.063533+0000","last_unstale":"2024-07-27T03:10:08.069118+0000","last_undegraded":"2024-07-27T03:10:08.069118+0000","last_fullsized":"2024-07-27T03:10:08.069118+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:29:41.752116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.062467+0000","last_change":"2024-07-27T03:10:08.057169+0000","last_active":"2024-07-27T03:10:08.062467+0000","last_peered":"2024-07-27T03:10:08.062467+0000","last_clean":"2024-07-27T03:10:08.062467+0000","last_became_active":"2024-07-27T03:10:08.056850+0000","last_became_peered":"2024-07-27T03:10:08.056850+0000","last_unstale":"2024-07-27T03:10:08.062467+0000","last_undegraded":"2024-07-27T03:10:08.062467+0000","last_fullsized":"2024-07-27T03:10:08.062467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:25.827206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048125+0000","last_change":"2024-07-27T03:10:08.048125+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048125+0000","last_undegraded":"2024-07-27T03:10:08.048125+0000","last_fullsized":"2024-07-27T03:10:08.048125+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060614+0000","last_change":"2024-07-27T03:10:08.054887+0000","last_active":"2024-07-27T03:10:08.060614+0000","last_peered":"2024-07-27T03:10:08.060614+0000","last_clean":"2024-07-27T03:10:08.060614+0000","last_became_active":"2024-07-27T03:10:08.054547+0000","last_became_peered":"2024-07-27T03:10:08.054547+0000","last_unstale":"2024-07-27T03:10:08.060614+0000","last_undegraded":"2024-07-27T03:10:08.060614+0000","last_fullsized":"2024-07-27T03:10:08.060614+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:04.286247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063414+0000","last_change":"2024-07-27T03:10:08.061634+0000","last_active":"2024-07-27T03:10:08.063414+0000","last_peered":"2024-07-27T03:10:08.063414+0000","last_clean":"2024-07-27T03:10:08.063414+0000","last_became_active":"2024-07-27T03:10:08.061239+0000","last_became_peered":"2024-07-27T03:10:08.061239+0000","last_unstale":"2024-07-27T03:10:08.063414+0000","last_undegraded":"2024-07-27T03:10:08.063414+0000","last_fullsized":"2024-07-27T03:10:08.063414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:48:04.798715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047632+0000","last_change":"2024-07-27T03:10:08.047632+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047632+0000","last_undegraded":"2024-07-27T03:10:08.047632+0000","last_fullsized":"2024-07-27T03:10:08.047632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063096+0000","last_change":"2024-07-27T03:10:08.058770+0000","last_active":"2024-07-27T03:10:08.063096+0000","last_peered":"2024-07-27T03:10:08.063096+0000","last_clean":"2024-07-27T03:10:08.063096+0000","last_became_active":"2024-07-27T03:10:08.058426+0000","last_became_peered":"2024-07-27T03:10:08.058426+0000","last_unstale":"2024-07-27T03:10:08.063096+0000","last_undegraded":"2024-07-27T03:10:08.063096+0000","last_fullsized":"2024-07-27T03:10:08.063096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:25.809218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049398+0000","last_change":"2024-07-27T03:10:08.049398+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049398+0000","last_undegraded":"2024-07-27T03:10:08.049398+0000","last_fullsized":"2024-07-27T03:10:08.049398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.066244+0000","last_change":"2024-07-27T03:10:08.061434+0000","last_active":"2024-07-27T03:10:08.066244+0000","last_peered":"2024-07-27T03:10:08.066244+0000","last_clean":"2024-07-27T03:10:08.066244+0000","last_became_active":"2024-07-27T03:10:08.061012+0000","last_became_peered":"2024-07-27T03:10:08.061012+0000","last_unstale":"2024-07-27T03:10:08.066244+0000","last_undegraded":"2024-07-27T03:10:08.066244+0000","last_fullsized":"2024-07-27T03:10:08.066244+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:03:41.401965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060447+0000","last_change":"2024-07-27T03:10:08.052094+0000","last_active":"2024-07-27T03:10:08.060447+0000","last_peered":"2024-07-27T03:10:08.060447+0000","last_clean":"2024-07-27T03:10:08.060447+0000","last_became_active":"2024-07-27T03:10:08.051179+0000","last_became_peered":"2024-07-27T03:10:08.051179+0000","last_unstale":"2024-07-27T03:10:08.060447+0000","last_undegraded":"2024-07-27T03:10:08.060447+0000","last_fullsized":"2024-07-27T03:10:08.060447+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:57:08.805918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048115+0000","last_change":"2024-07-27T03:10:08.048115+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048115+0000","last_undegraded":"2024-07-27T03:10:08.048115+0000","last_fullsized":"2024-07-27T03:10:08.048115+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061081+0000","last_change":"2024-07-27T03:10:08.055310+0000","last_active":"2024-07-27T03:10:08.061081+0000","last_peered":"2024-07-27T03:10:08.061081+0000","last_clean":"2024-07-27T03:10:08.061081+0000","last_became_active":"2024-07-27T03:10:08.055017+0000","last_became_peered":"2024-07-27T03:10:08.055017+0000","last_unstale":"2024-07-27T03:10:08.061081+0000","last_undegraded":"2024-07-27T03:10:08.061081+0000","last_fullsized":"2024-07-27T03:10:08.061081+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:14:41.840850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.042109+0000","last_change":"2024-07-27T03:10:08.042109+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.042109+0000","last_undegraded":"2024-07-27T03:10:08.042109+0000","last_fullsized":"2024-07-27T03:10:08.042109+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.045762+0000","last_change":"2024-07-27T03:10:07.045762+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.045762+0000","last_undegraded":"2024-07-27T03:10:07.045762+0000","last_fullsized":"2024-07-27T03:10:07.045762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046654+0000","last_change":"2024-07-27T03:10:08.046654+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046654+0000","last_undegraded":"2024-07-27T03:10:08.046654+0000","last_fullsized":"2024-07-27T03:10:08.046654+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061100+0000","last_change":"2024-07-27T03:10:08.055344+0000","last_active":"2024-07-27T03:10:08.061100+0000","last_peered":"2024-07-27T03:10:08.061100+0000","last_clean":"2024-07-27T03:10:08.061100+0000","last_became_active":"2024-07-27T03:10:08.054304+0000","last_became_peered":"2024-07-27T03:10:08.054304+0000","last_unstale":"2024-07-27T03:10:08.061100+0000","last_undegraded":"2024-07-27T03:10:08.061100+0000","last_fullsized":"2024-07-27T03:10:08.061100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:09:35.700169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046651+0000","last_change":"2024-07-27T03:10:08.046651+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046651+0000","last_undegraded":"2024-07-27T03:10:08.046651+0000","last_fullsized":"2024-07-27T03:10:08.046651+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040192+0000","last_change":"2024-07-27T03:10:07.040192+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040192+0000","last_undegraded":"2024-07-27T03:10:07.040192+0000","last_fullsized":"2024-07-27T03:10:07.040192+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.044979+0000","last_change":"2024-07-27T03:10:08.044979+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.044979+0000","last_undegraded":"2024-07-27T03:10:08.044979+0000","last_fullsized":"2024-07-27T03:10:08.044979+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.045196+0000","last_change":"2024-07-27T03:10:07.045196+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.045196+0000","last_undegraded":"2024-07-27T03:10:07.045196+0000","last_fullsized":"2024-07-27T03:10:07.045196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.065144+0000","last_change":"2024-07-27T03:10:08.061822+0000","last_active":"2024-07-27T03:10:08.065144+0000","last_peered":"2024-07-27T03:10:08.065144+0000","last_clean":"2024-07-27T03:10:08.065144+0000","last_became_active":"2024-07-27T03:10:08.061513+0000","last_became_peered":"2024-07-27T03:10:08.061513+0000","last_unstale":"2024-07-27T03:10:08.065144+0000","last_undegraded":"2024-07-27T03:10:08.065144+0000","last_fullsized":"2024-07-27T03:10:08.065144+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:00:29.051706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049060+0000","last_change":"2024-07-27T03:10:08.049060+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049060+0000","last_undegraded":"2024-07-27T03:10:08.049060+0000","last_fullsized":"2024-07-27T03:10:08.049060+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060567+0000","last_change":"2024-07-27T03:10:08.053861+0000","last_active":"2024-07-27T03:10:08.060567+0000","last_peered":"2024-07-27T03:10:08.060567+0000","last_clean":"2024-07-27T03:10:08.060567+0000","last_became_active":"2024-07-27T03:10:08.053505+0000","last_became_peered":"2024-07-27T03:10:08.053505+0000","last_unstale":"2024-07-27T03:10:08.060567+0000","last_undegraded":"2024-07-27T03:10:08.060567+0000","last_fullsized":"2024-07-27T03:10:08.060567+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:14:41.840850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":146,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.047604+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:10:08.047604+0000","last_peered":"2024-07-27T03:10:08.047604+0000","last_clean":"2024-07-27T03:10:08.047604+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:10:08.047604+0000","last_undegraded":"2024-07-27T03:10:08.047604+0000","last_fullsized":"2024-07-27T03:10:08.047604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":781963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":483328,"data_stored":191595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":483328,"data_stored":191595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":781963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:10:13.476 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:10:13.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.625+0000 7f558296b640 1 -- 172.21.15.120:0/3593829810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5564003a50 msgr2=0x7f5564003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.625+0000 7f558296b640 1 --2- 172.21.15.120:0/3593829810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5564003a50 0x7f5564003ec0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f556c00c310 tx=0x7f5564005830 comp rx=0 tx=0).stop 2024-07-27T03:10:13.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.625+0000 7f558296b640 1 -- 172.21.15.120:0/3593829810 shutdown_connections 2024-07-27T03:10:13.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.625+0000 7f558296b640 1 --2- 172.21.15.120:0/3593829810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5564003a50 0x7f5564003ec0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.625+0000 7f558296b640 1 -- 172.21.15.120:0/3593829810 >> 172.21.15.120:0/3593829810 conn(0x7f557c0b3920 msgr2=0x7f557c0b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:13.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.625+0000 7f558296b640 1 -- 172.21.15.120:0/3593829810 shutdown_connections 2024-07-27T03:10:13.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.625+0000 7f558296b640 1 -- 172.21.15.120:0/3593829810 wait complete. 2024-07-27T03:10:13.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.626+0000 7f558296b640 1 Processor -- start 2024-07-27T03:10:13.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.627+0000 7f558296b640 1 -- start start 2024-07-27T03:10:13.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f558296b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5564003a50 0x7f557c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f558296b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f557c0708b0 0x7f557c070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f558296b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c159d00 0x7f557c15a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f558296b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f557c0d0500 con 0x7f557c0708b0 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f558296b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f557c0b2890 con 0x7f5564003a50 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f558296b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f557c0d0680 con 0x7f557c159d00 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f557b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f557c0708b0 0x7f557c070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f557b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f557c0708b0 0x7f557c070cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58262/0 (socket says 172.21.15.120:58262) 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f557b7fe640 1 -- 172.21.15.120:0/975650072 learned_addr learned my addr 172.21.15.120:0/975650072 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f557bfff640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5564003a50 0x7f557c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f5580f08640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c159d00 0x7f557c15a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f557b7fe640 1 -- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c159d00 msgr2=0x7f557c15a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f557b7fe640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c159d00 0x7f557c15a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f557b7fe640 1 -- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5564003a50 msgr2=0x7f557c0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f557b7fe640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5564003a50 0x7f557c0b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f557b7fe640 1 -- 172.21.15.120:0/975650072 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557c1f3a50 con 0x7f557c0708b0 2024-07-27T03:10:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.628+0000 7f5580f08640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c159d00 0x7f557c15a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:10:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.629+0000 7f557b7fe640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f557c0708b0 0x7f557c070cc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5570011ae0 tx=0x7f5570009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.629+0000 7f5578ff9640 1 -- 172.21.15.120:0/975650072 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557001e070 con 0x7f557c0708b0 2024-07-27T03:10:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.629+0000 7f5578ff9640 1 -- 172.21.15.120:0/975650072 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f557000fc10 con 0x7f557c0708b0 2024-07-27T03:10:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.629+0000 7f558296b640 1 -- 172.21.15.120:0/975650072 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557c1f2ed0 con 0x7f557c0708b0 2024-07-27T03:10:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.629+0000 7f5578ff9640 1 -- 172.21.15.120:0/975650072 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5570019410 con 0x7f557c0708b0 2024-07-27T03:10:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.629+0000 7f558296b640 1 -- 172.21.15.120:0/975650072 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f557c1f3490 con 0x7f557c0708b0 2024-07-27T03:10:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.630+0000 7f558296b640 1 -- 172.21.15.120:0/975650072 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f557c0d0b90 con 0x7f557c0708b0 2024-07-27T03:10:13.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.630+0000 7f5578ff9640 1 -- 172.21.15.120:0/975650072 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5570021070 con 0x7f557c0708b0 2024-07-27T03:10:13.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.631+0000 7f5578ff9640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5568077010 0x7f5568079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.631+0000 7f5578ff9640 1 -- 172.21.15.120:0/975650072 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f5570098ef0 con 0x7f557c0708b0 2024-07-27T03:10:13.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.631+0000 7f557bfff640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5568077010 0x7f5568079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:13.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.632+0000 7f557bfff640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5568077010 0x7f5568079520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f556c033000 tx=0x7f556c038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:13.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.635+0000 7f5578ff9640 1 -- 172.21.15.120:0/975650072 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5570061b30 con 0x7f557c0708b0 2024-07-27T03:10:13.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.814+0000 7f558296b640 1 -- 172.21.15.120:0/975650072 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f557c15cb60 con 0x7f5568077010 2024-07-27T03:10:13.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.819+0000 7f5578ff9640 1 -- 172.21.15.120:0/975650072 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244313 (secure 0 0 0) 0x7f556c07fa70 con 0x7f5568077010 2024-07-27T03:10:13.824 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:13.826 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:10:13.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.821+0000 7f558296b640 1 -- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5568077010 msgr2=0x7f5568079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.821+0000 7f558296b640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5568077010 0x7f5568079520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f556c033000 tx=0x7f556c038040 comp rx=0 tx=0).stop 2024-07-27T03:10:13.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.821+0000 7f558296b640 1 -- 172.21.15.120:0/975650072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f557c0708b0 msgr2=0x7f557c070cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.821+0000 7f558296b640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f557c0708b0 0x7f557c070cc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5570011ae0 tx=0x7f5570009eb0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.821+0000 7f558296b640 1 -- 172.21.15.120:0/975650072 shutdown_connections 2024-07-27T03:10:13.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.821+0000 7f558296b640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5568077010 0x7f5568079520 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.821+0000 7f558296b640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f557c0708b0 0x7f557c070cc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.821+0000 7f558296b640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f557c159d00 0x7f557c15a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.821+0000 7f558296b640 1 --2- 172.21.15.120:0/975650072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5564003a50 0x7f557c0b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.822+0000 7f558296b640 1 -- 172.21.15.120:0/975650072 >> 172.21.15.120:0/975650072 conn(0x7f557c0b3920 msgr2=0x7f557c15d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:13.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.822+0000 7f558296b640 1 -- 172.21.15.120:0/975650072 shutdown_connections 2024-07-27T03:10:13.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.822+0000 7f558296b640 1 -- 172.21.15.120:0/975650072 wait complete. 2024-07-27T03:10:13.835 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-07-27T03:10:12.555347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":254348,"kb_used_data":4888,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720372,"statfs":{"total":773094113280,"available":772833660928,"internally_reserved":0,"allocated":5005312,"data_stored":2688428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.516835"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.043292+0000","last_change":"2024-07-27T03:10:08.043292+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.043292+0000","last_undegraded":"2024-07-27T03:10:08.043292+0000","last_fullsized":"2024-07-27T03:10:08.043292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046072+0000","last_change":"2024-07-27T03:10:08.046072+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046072+0000","last_undegraded":"2024-07-27T03:10:08.046072+0000","last_fullsized":"2024-07-27T03:10:08.046072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049915+0000","last_change":"2024-07-27T03:10:08.049915+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049915+0000","last_undegraded":"2024-07-27T03:10:08.049915+0000","last_fullsized":"2024-07-27T03:10:08.049915+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047191+0000","last_change":"2024-07-27T03:10:08.047191+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047191+0000","last_undegraded":"2024-07-27T03:10:08.047191+0000","last_fullsized":"2024-07-27T03:10:08.047191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049882+0000","last_change":"2024-07-27T03:10:08.049882+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049882+0000","last_undegraded":"2024-07-27T03:10:08.049882+0000","last_fullsized":"2024-07-27T03:10:08.049882+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.044705+0000","last_change":"2024-07-27T03:10:08.044705+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.044705+0000","last_undegraded":"2024-07-27T03:10:08.044705+0000","last_fullsized":"2024-07-27T03:10:08.044705+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.053019+0000","last_change":"2024-07-27T03:10:08.053019+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.053019+0000","last_undegraded":"2024-07-27T03:10:08.053019+0000","last_fullsized":"2024-07-27T03:10:08.053019+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.053508+0000","last_change":"2024-07-27T03:10:08.053508+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.053508+0000","last_undegraded":"2024-07-27T03:10:08.053508+0000","last_fullsized":"2024-07-27T03:10:08.053508+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049486+0000","last_change":"2024-07-27T03:10:08.049486+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049486+0000","last_undegraded":"2024-07-27T03:10:08.049486+0000","last_fullsized":"2024-07-27T03:10:08.049486+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047569+0000","last_change":"2024-07-27T03:10:08.047569+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047569+0000","last_undegraded":"2024-07-27T03:10:08.047569+0000","last_fullsized":"2024-07-27T03:10:08.047569+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047683+0000","last_change":"2024-07-27T03:10:08.047683+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047683+0000","last_undegraded":"2024-07-27T03:10:08.047683+0000","last_fullsized":"2024-07-27T03:10:08.047683+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.050410+0000","last_change":"2024-07-27T03:10:08.050410+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.050410+0000","last_undegraded":"2024-07-27T03:10:08.050410+0000","last_fullsized":"2024-07-27T03:10:08.050410+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051620+0000","last_change":"2024-07-27T03:10:08.051620+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051620+0000","last_undegraded":"2024-07-27T03:10:08.051620+0000","last_fullsized":"2024-07-27T03:10:08.051620+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049263+0000","last_change":"2024-07-27T03:10:08.049263+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049263+0000","last_undegraded":"2024-07-27T03:10:08.049263+0000","last_fullsized":"2024-07-27T03:10:08.049263+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.050380+0000","last_change":"2024-07-27T03:10:08.050380+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.050380+0000","last_undegraded":"2024-07-27T03:10:08.050380+0000","last_fullsized":"2024-07-27T03:10:08.050380+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047854+0000","last_change":"2024-07-27T03:10:08.047854+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047854+0000","last_undegraded":"2024-07-27T03:10:08.047854+0000","last_fullsized":"2024-07-27T03:10:08.047854+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051127+0000","last_change":"2024-07-27T03:10:08.051127+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051127+0000","last_undegraded":"2024-07-27T03:10:08.051127+0000","last_fullsized":"2024-07-27T03:10:08.051127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048334+0000","last_change":"2024-07-27T03:10:08.048334+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048334+0000","last_undegraded":"2024-07-27T03:10:08.048334+0000","last_fullsized":"2024-07-27T03:10:08.048334+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047168+0000","last_change":"2024-07-27T03:10:08.047168+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047168+0000","last_undegraded":"2024-07-27T03:10:08.047168+0000","last_fullsized":"2024-07-27T03:10:08.047168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047630+0000","last_change":"2024-07-27T03:10:08.047630+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047630+0000","last_undegraded":"2024-07-27T03:10:08.047630+0000","last_fullsized":"2024-07-27T03:10:08.047630+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048126+0000","last_change":"2024-07-27T03:10:08.048126+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048126+0000","last_undegraded":"2024-07-27T03:10:08.048126+0000","last_fullsized":"2024-07-27T03:10:08.048126+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.062524+0000","last_change":"2024-07-27T03:10:08.057878+0000","last_active":"2024-07-27T03:10:08.062524+0000","last_peered":"2024-07-27T03:10:08.062524+0000","last_clean":"2024-07-27T03:10:08.062524+0000","last_became_active":"2024-07-27T03:10:08.057580+0000","last_became_peered":"2024-07-27T03:10:08.057580+0000","last_unstale":"2024-07-27T03:10:08.062524+0000","last_undegraded":"2024-07-27T03:10:08.062524+0000","last_fullsized":"2024-07-27T03:10:08.062524+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:36:51.886898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.041376+0000","last_change":"2024-07-27T03:10:07.041376+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.041376+0000","last_undegraded":"2024-07-27T03:10:07.041376+0000","last_fullsized":"2024-07-27T03:10:07.041376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046658+0000","last_change":"2024-07-27T03:10:08.046658+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046658+0000","last_undegraded":"2024-07-27T03:10:08.046658+0000","last_fullsized":"2024-07-27T03:10:08.046658+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.046429+0000","last_change":"2024-07-27T03:10:07.046429+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.046429+0000","last_undegraded":"2024-07-27T03:10:07.046429+0000","last_fullsized":"2024-07-27T03:10:07.046429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.055973+0000","last_change":"2024-07-27T03:10:08.051365+0000","last_active":"2024-07-27T03:10:08.055973+0000","last_peered":"2024-07-27T03:10:08.055973+0000","last_clean":"2024-07-27T03:10:08.055973+0000","last_became_active":"2024-07-27T03:10:08.051023+0000","last_became_peered":"2024-07-27T03:10:08.051023+0000","last_unstale":"2024-07-27T03:10:08.055973+0000","last_undegraded":"2024-07-27T03:10:08.055973+0000","last_fullsized":"2024-07-27T03:10:08.055973+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:53:58.440417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060590+0000","last_change":"2024-07-27T03:10:08.053873+0000","last_active":"2024-07-27T03:10:08.060590+0000","last_peered":"2024-07-27T03:10:08.060590+0000","last_clean":"2024-07-27T03:10:08.060590+0000","last_became_active":"2024-07-27T03:10:08.053435+0000","last_became_peered":"2024-07-27T03:10:08.053435+0000","last_unstale":"2024-07-27T03:10:08.060590+0000","last_undegraded":"2024-07-27T03:10:08.060590+0000","last_fullsized":"2024-07-27T03:10:08.060590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:23:52.157366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051375+0000","last_change":"2024-07-27T03:10:08.051375+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051375+0000","last_undegraded":"2024-07-27T03:10:08.051375+0000","last_fullsized":"2024-07-27T03:10:08.051375+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040990+0000","last_change":"2024-07-27T03:10:07.040990+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040990+0000","last_undegraded":"2024-07-27T03:10:07.040990+0000","last_fullsized":"2024-07-27T03:10:07.040990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.051833+0000","last_change":"2024-07-27T03:10:08.051833+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.051833+0000","last_undegraded":"2024-07-27T03:10:08.051833+0000","last_fullsized":"2024-07-27T03:10:08.051833+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060523+0000","last_change":"2024-07-27T03:10:08.056579+0000","last_active":"2024-07-27T03:10:08.060523+0000","last_peered":"2024-07-27T03:10:08.060523+0000","last_clean":"2024-07-27T03:10:08.060523+0000","last_became_active":"2024-07-27T03:10:08.056287+0000","last_became_peered":"2024-07-27T03:10:08.056287+0000","last_unstale":"2024-07-27T03:10:08.060523+0000","last_undegraded":"2024-07-27T03:10:08.060523+0000","last_fullsized":"2024-07-27T03:10:08.060523+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:09:35.700169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063260+0000","last_change":"2024-07-27T03:10:08.059489+0000","last_active":"2024-07-27T03:10:08.063260+0000","last_peered":"2024-07-27T03:10:08.063260+0000","last_clean":"2024-07-27T03:10:08.063260+0000","last_became_active":"2024-07-27T03:10:08.059189+0000","last_became_peered":"2024-07-27T03:10:08.059189+0000","last_unstale":"2024-07-27T03:10:08.063260+0000","last_undegraded":"2024-07-27T03:10:08.063260+0000","last_fullsized":"2024-07-27T03:10:08.063260+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:39:03.015556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040192+0000","last_change":"2024-07-27T03:10:07.040192+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040192+0000","last_undegraded":"2024-07-27T03:10:07.040192+0000","last_fullsized":"2024-07-27T03:10:07.040192+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.042675+0000","last_change":"2024-07-27T03:10:08.042675+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.042675+0000","last_undegraded":"2024-07-27T03:10:08.042675+0000","last_fullsized":"2024-07-27T03:10:08.042675+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063101+0000","last_change":"2024-07-27T03:10:08.058799+0000","last_active":"2024-07-27T03:10:08.063101+0000","last_peered":"2024-07-27T03:10:08.063101+0000","last_clean":"2024-07-27T03:10:08.063101+0000","last_became_active":"2024-07-27T03:10:08.058488+0000","last_became_peered":"2024-07-27T03:10:08.058488+0000","last_unstale":"2024-07-27T03:10:08.063101+0000","last_undegraded":"2024-07-27T03:10:08.063101+0000","last_fullsized":"2024-07-27T03:10:08.063101+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:40:50.750102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047269+0000","last_change":"2024-07-27T03:10:08.047269+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047269+0000","last_undegraded":"2024-07-27T03:10:08.047269+0000","last_fullsized":"2024-07-27T03:10:08.047269+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061124+0000","last_change":"2024-07-27T03:10:08.055592+0000","last_active":"2024-07-27T03:10:08.061124+0000","last_peered":"2024-07-27T03:10:08.061124+0000","last_clean":"2024-07-27T03:10:08.061124+0000","last_became_active":"2024-07-27T03:10:08.054236+0000","last_became_peered":"2024-07-27T03:10:08.054236+0000","last_unstale":"2024-07-27T03:10:08.061124+0000","last_undegraded":"2024-07-27T03:10:08.061124+0000","last_fullsized":"2024-07-27T03:10:08.061124+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:48:04.798715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.043965+0000","last_change":"2024-07-27T03:10:08.043965+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.043965+0000","last_undegraded":"2024-07-27T03:10:08.043965+0000","last_fullsized":"2024-07-27T03:10:08.043965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.067662+0000","last_change":"2024-07-27T03:10:08.061069+0000","last_active":"2024-07-27T03:10:08.067662+0000","last_peered":"2024-07-27T03:10:08.067662+0000","last_clean":"2024-07-27T03:10:08.067662+0000","last_became_active":"2024-07-27T03:10:08.060741+0000","last_became_peered":"2024-07-27T03:10:08.060741+0000","last_unstale":"2024-07-27T03:10:08.067662+0000","last_undegraded":"2024-07-27T03:10:08.067662+0000","last_fullsized":"2024-07-27T03:10:08.067662+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:30:31.323266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.062947+0000","last_change":"2024-07-27T03:10:08.059186+0000","last_active":"2024-07-27T03:10:08.062947+0000","last_peered":"2024-07-27T03:10:08.062947+0000","last_clean":"2024-07-27T03:10:08.062947+0000","last_became_active":"2024-07-27T03:10:08.058906+0000","last_became_peered":"2024-07-27T03:10:08.058906+0000","last_unstale":"2024-07-27T03:10:08.062947+0000","last_undegraded":"2024-07-27T03:10:08.062947+0000","last_fullsized":"2024-07-27T03:10:08.062947+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:11:20.575169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.050984+0000","last_change":"2024-07-27T03:10:08.050984+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.050984+0000","last_undegraded":"2024-07-27T03:10:08.050984+0000","last_fullsized":"2024-07-27T03:10:08.050984+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061689+0000","last_change":"2024-07-27T03:10:08.056502+0000","last_active":"2024-07-27T03:10:08.061689+0000","last_peered":"2024-07-27T03:10:08.061689+0000","last_clean":"2024-07-27T03:10:08.061689+0000","last_became_active":"2024-07-27T03:10:08.056132+0000","last_became_peered":"2024-07-27T03:10:08.056132+0000","last_unstale":"2024-07-27T03:10:08.061689+0000","last_undegraded":"2024-07-27T03:10:08.061689+0000","last_fullsized":"2024-07-27T03:10:08.061689+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:29:41.752116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047253+0000","last_change":"2024-07-27T03:10:08.047253+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047253+0000","last_undegraded":"2024-07-27T03:10:08.047253+0000","last_fullsized":"2024-07-27T03:10:08.047253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.065127+0000","last_change":"2024-07-27T03:10:08.060288+0000","last_active":"2024-07-27T03:10:08.065127+0000","last_peered":"2024-07-27T03:10:08.065127+0000","last_clean":"2024-07-27T03:10:08.065127+0000","last_became_active":"2024-07-27T03:10:08.059433+0000","last_became_peered":"2024-07-27T03:10:08.059433+0000","last_unstale":"2024-07-27T03:10:08.065127+0000","last_undegraded":"2024-07-27T03:10:08.065127+0000","last_fullsized":"2024-07-27T03:10:08.065127+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:39:15.226163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.042383+0000","last_change":"2024-07-27T03:10:08.042383+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.042383+0000","last_undegraded":"2024-07-27T03:10:08.042383+0000","last_fullsized":"2024-07-27T03:10:08.042383+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.065120+0000","last_change":"2024-07-27T03:10:08.061580+0000","last_active":"2024-07-27T03:10:08.065120+0000","last_peered":"2024-07-27T03:10:08.065120+0000","last_clean":"2024-07-27T03:10:08.065120+0000","last_became_active":"2024-07-27T03:10:08.061085+0000","last_became_peered":"2024-07-27T03:10:08.061085+0000","last_unstale":"2024-07-27T03:10:08.065120+0000","last_undegraded":"2024-07-27T03:10:08.065120+0000","last_fullsized":"2024-07-27T03:10:08.065120+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:41:37.614315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047849+0000","last_change":"2024-07-27T03:10:08.047849+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047849+0000","last_undegraded":"2024-07-27T03:10:08.047849+0000","last_fullsized":"2024-07-27T03:10:08.047849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.064903+0000","last_change":"2024-07-27T03:10:08.057979+0000","last_active":"2024-07-27T03:10:08.064903+0000","last_peered":"2024-07-27T03:10:08.064903+0000","last_clean":"2024-07-27T03:10:08.064903+0000","last_became_active":"2024-07-27T03:10:08.057612+0000","last_became_peered":"2024-07-27T03:10:08.057612+0000","last_unstale":"2024-07-27T03:10:08.064903+0000","last_undegraded":"2024-07-27T03:10:08.064903+0000","last_fullsized":"2024-07-27T03:10:08.064903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:43:33.553794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.053050+0000","last_change":"2024-07-27T03:10:08.053050+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.053050+0000","last_undegraded":"2024-07-27T03:10:08.053050+0000","last_fullsized":"2024-07-27T03:10:08.053050+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040297+0000","last_change":"2024-07-27T03:10:07.040297+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040297+0000","last_undegraded":"2024-07-27T03:10:07.040297+0000","last_fullsized":"2024-07-27T03:10:07.040297+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.069118+0000","last_change":"2024-07-27T03:10:08.063876+0000","last_active":"2024-07-27T03:10:08.069118+0000","last_peered":"2024-07-27T03:10:08.069118+0000","last_clean":"2024-07-27T03:10:08.069118+0000","last_became_active":"2024-07-27T03:10:08.063533+0000","last_became_peered":"2024-07-27T03:10:08.063533+0000","last_unstale":"2024-07-27T03:10:08.069118+0000","last_undegraded":"2024-07-27T03:10:08.069118+0000","last_fullsized":"2024-07-27T03:10:08.069118+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:29:41.752116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.062467+0000","last_change":"2024-07-27T03:10:08.057169+0000","last_active":"2024-07-27T03:10:08.062467+0000","last_peered":"2024-07-27T03:10:08.062467+0000","last_clean":"2024-07-27T03:10:08.062467+0000","last_became_active":"2024-07-27T03:10:08.056850+0000","last_became_peered":"2024-07-27T03:10:08.056850+0000","last_unstale":"2024-07-27T03:10:08.062467+0000","last_undegraded":"2024-07-27T03:10:08.062467+0000","last_fullsized":"2024-07-27T03:10:08.062467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:25.827206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048125+0000","last_change":"2024-07-27T03:10:08.048125+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048125+0000","last_undegraded":"2024-07-27T03:10:08.048125+0000","last_fullsized":"2024-07-27T03:10:08.048125+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060614+0000","last_change":"2024-07-27T03:10:08.054887+0000","last_active":"2024-07-27T03:10:08.060614+0000","last_peered":"2024-07-27T03:10:08.060614+0000","last_clean":"2024-07-27T03:10:08.060614+0000","last_became_active":"2024-07-27T03:10:08.054547+0000","last_became_peered":"2024-07-27T03:10:08.054547+0000","last_unstale":"2024-07-27T03:10:08.060614+0000","last_undegraded":"2024-07-27T03:10:08.060614+0000","last_fullsized":"2024-07-27T03:10:08.060614+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:04.286247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063414+0000","last_change":"2024-07-27T03:10:08.061634+0000","last_active":"2024-07-27T03:10:08.063414+0000","last_peered":"2024-07-27T03:10:08.063414+0000","last_clean":"2024-07-27T03:10:08.063414+0000","last_became_active":"2024-07-27T03:10:08.061239+0000","last_became_peered":"2024-07-27T03:10:08.061239+0000","last_unstale":"2024-07-27T03:10:08.063414+0000","last_undegraded":"2024-07-27T03:10:08.063414+0000","last_fullsized":"2024-07-27T03:10:08.063414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:48:04.798715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.047632+0000","last_change":"2024-07-27T03:10:08.047632+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.047632+0000","last_undegraded":"2024-07-27T03:10:08.047632+0000","last_fullsized":"2024-07-27T03:10:08.047632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.063096+0000","last_change":"2024-07-27T03:10:08.058770+0000","last_active":"2024-07-27T03:10:08.063096+0000","last_peered":"2024-07-27T03:10:08.063096+0000","last_clean":"2024-07-27T03:10:08.063096+0000","last_became_active":"2024-07-27T03:10:08.058426+0000","last_became_peered":"2024-07-27T03:10:08.058426+0000","last_unstale":"2024-07-27T03:10:08.063096+0000","last_undegraded":"2024-07-27T03:10:08.063096+0000","last_fullsized":"2024-07-27T03:10:08.063096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:25.809218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049398+0000","last_change":"2024-07-27T03:10:08.049398+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049398+0000","last_undegraded":"2024-07-27T03:10:08.049398+0000","last_fullsized":"2024-07-27T03:10:08.049398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.066244+0000","last_change":"2024-07-27T03:10:08.061434+0000","last_active":"2024-07-27T03:10:08.066244+0000","last_peered":"2024-07-27T03:10:08.066244+0000","last_clean":"2024-07-27T03:10:08.066244+0000","last_became_active":"2024-07-27T03:10:08.061012+0000","last_became_peered":"2024-07-27T03:10:08.061012+0000","last_unstale":"2024-07-27T03:10:08.066244+0000","last_undegraded":"2024-07-27T03:10:08.066244+0000","last_fullsized":"2024-07-27T03:10:08.066244+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:03:41.401965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060447+0000","last_change":"2024-07-27T03:10:08.052094+0000","last_active":"2024-07-27T03:10:08.060447+0000","last_peered":"2024-07-27T03:10:08.060447+0000","last_clean":"2024-07-27T03:10:08.060447+0000","last_became_active":"2024-07-27T03:10:08.051179+0000","last_became_peered":"2024-07-27T03:10:08.051179+0000","last_unstale":"2024-07-27T03:10:08.060447+0000","last_undegraded":"2024-07-27T03:10:08.060447+0000","last_fullsized":"2024-07-27T03:10:08.060447+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:57:08.805918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.048115+0000","last_change":"2024-07-27T03:10:08.048115+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.048115+0000","last_undegraded":"2024-07-27T03:10:08.048115+0000","last_fullsized":"2024-07-27T03:10:08.048115+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061081+0000","last_change":"2024-07-27T03:10:08.055310+0000","last_active":"2024-07-27T03:10:08.061081+0000","last_peered":"2024-07-27T03:10:08.061081+0000","last_clean":"2024-07-27T03:10:08.061081+0000","last_became_active":"2024-07-27T03:10:08.055017+0000","last_became_peered":"2024-07-27T03:10:08.055017+0000","last_unstale":"2024-07-27T03:10:08.061081+0000","last_undegraded":"2024-07-27T03:10:08.061081+0000","last_fullsized":"2024-07-27T03:10:08.061081+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:14:41.840850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.042109+0000","last_change":"2024-07-27T03:10:08.042109+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.042109+0000","last_undegraded":"2024-07-27T03:10:08.042109+0000","last_fullsized":"2024-07-27T03:10:08.042109+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.045762+0000","last_change":"2024-07-27T03:10:07.045762+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.045762+0000","last_undegraded":"2024-07-27T03:10:07.045762+0000","last_fullsized":"2024-07-27T03:10:07.045762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046654+0000","last_change":"2024-07-27T03:10:08.046654+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046654+0000","last_undegraded":"2024-07-27T03:10:08.046654+0000","last_fullsized":"2024-07-27T03:10:08.046654+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.061100+0000","last_change":"2024-07-27T03:10:08.055344+0000","last_active":"2024-07-27T03:10:08.061100+0000","last_peered":"2024-07-27T03:10:08.061100+0000","last_clean":"2024-07-27T03:10:08.061100+0000","last_became_active":"2024-07-27T03:10:08.054304+0000","last_became_peered":"2024-07-27T03:10:08.054304+0000","last_unstale":"2024-07-27T03:10:08.061100+0000","last_undegraded":"2024-07-27T03:10:08.061100+0000","last_fullsized":"2024-07-27T03:10:08.061100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:09:35.700169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.046651+0000","last_change":"2024-07-27T03:10:08.046651+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.046651+0000","last_undegraded":"2024-07-27T03:10:08.046651+0000","last_fullsized":"2024-07-27T03:10:08.046651+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.040192+0000","last_change":"2024-07-27T03:10:07.040192+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.040192+0000","last_undegraded":"2024-07-27T03:10:07.040192+0000","last_fullsized":"2024-07-27T03:10:07.040192+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.044979+0000","last_change":"2024-07-27T03:10:08.044979+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.044979+0000","last_undegraded":"2024-07-27T03:10:08.044979+0000","last_fullsized":"2024-07-27T03:10:08.044979+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-07-27T03:10:07.045196+0000","last_change":"2024-07-27T03:10:07.045196+0000","last_active":"2024-07-27T03:10:07.029584+0000","last_peered":"2024-07-27T03:10:07.029584+0000","last_clean":"2024-07-27T03:10:07.029584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:07.045196+0000","last_undegraded":"2024-07-27T03:10:07.045196+0000","last_fullsized":"2024-07-27T03:10:07.045196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:10:08.036352+0000","last_change":"2024-07-27T03:10:08.036352+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.036352+0000","last_undegraded":"2024-07-27T03:10:08.036352+0000","last_fullsized":"2024-07-27T03:10:08.036352+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.065144+0000","last_change":"2024-07-27T03:10:08.061822+0000","last_active":"2024-07-27T03:10:08.065144+0000","last_peered":"2024-07-27T03:10:08.065144+0000","last_clean":"2024-07-27T03:10:08.065144+0000","last_became_active":"2024-07-27T03:10:08.061513+0000","last_became_peered":"2024-07-27T03:10:08.061513+0000","last_unstale":"2024-07-27T03:10:08.065144+0000","last_undegraded":"2024-07-27T03:10:08.065144+0000","last_fullsized":"2024-07-27T03:10:08.065144+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:00:29.051706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-07-27T03:10:08.049060+0000","last_change":"2024-07-27T03:10:08.049060+0000","last_active":"2024-07-27T03:10:08.036352+0000","last_peered":"2024-07-27T03:10:08.036352+0000","last_clean":"2024-07-27T03:10:08.036352+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:10:08.049060+0000","last_undegraded":"2024-07-27T03:10:08.049060+0000","last_fullsized":"2024-07-27T03:10:08.049060+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.060567+0000","last_change":"2024-07-27T03:10:08.053861+0000","last_active":"2024-07-27T03:10:08.060567+0000","last_peered":"2024-07-27T03:10:08.060567+0000","last_clean":"2024-07-27T03:10:08.060567+0000","last_became_active":"2024-07-27T03:10:08.053505+0000","last_became_peered":"2024-07-27T03:10:08.053505+0000","last_unstale":"2024-07-27T03:10:08.060567+0000","last_undegraded":"2024-07-27T03:10:08.060567+0000","last_fullsized":"2024-07-27T03:10:08.060567+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:14:41.840850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":146,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-07-27T03:10:08.047604+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:10:08.047604+0000","last_peered":"2024-07-27T03:10:08.047604+0000","last_clean":"2024-07-27T03:10:08.047604+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:10:08.047604+0000","last_undegraded":"2024-07-27T03:10:08.047604+0000","last_fullsized":"2024-07-27T03:10:08.047604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":5},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":781963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":483328,"data_stored":191595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":483328,"data_stored":191595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":781963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":471040,"data_stored":185328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:10:13.842 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3f is not active+clean 2024-07-27T03:10:13.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.043292+0000', 'last_change': '2024-07-27T03:10:08.043292+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.043292+0000', 'last_undegraded': '2024-07-27T03:10:08.043292+0000', 'last_fullsized': '2024-07-27T03:10:08.043292+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:10:13.842 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3e is not active+clean 2024-07-27T03:10:13.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.046072+0000', 'last_change': '2024-07-27T03:10:08.046072+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.046072+0000', 'last_undegraded': '2024-07-27T03:10:08.046072+0000', 'last_fullsized': '2024-07-27T03:10:08.046072+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:10:13.842 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-07-27T03:10:13.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.843 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-07-27T03:10:13.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.049915+0000', 'last_change': '2024-07-27T03:10:08.049915+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.049915+0000', 'last_undegraded': '2024-07-27T03:10:08.049915+0000', 'last_fullsized': '2024-07-27T03:10:08.049915+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.843 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3b is not active+clean 2024-07-27T03:10:13.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.047191+0000', 'last_change': '2024-07-27T03:10:08.047191+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.047191+0000', 'last_undegraded': '2024-07-27T03:10:08.047191+0000', 'last_fullsized': '2024-07-27T03:10:08.047191+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:10:13.843 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3a is not active+clean 2024-07-27T03:10:13.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.049882+0000', 'last_change': '2024-07-27T03:10:08.049882+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.049882+0000', 'last_undegraded': '2024-07-27T03:10:08.049882+0000', 'last_fullsized': '2024-07-27T03:10:08.049882+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:10:13.843 INFO:tasks.ceph.ceph_manager.ceph:PG 7.39 is not active+clean 2024-07-27T03:10:13.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.044705+0000', 'last_change': '2024-07-27T03:10:08.044705+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.044705+0000', 'last_undegraded': '2024-07-27T03:10:08.044705+0000', 'last_fullsized': '2024-07-27T03:10:08.044705+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:10:13.844 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-07-27T03:10:13.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.053019+0000', 'last_change': '2024-07-27T03:10:08.053019+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.053019+0000', 'last_undegraded': '2024-07-27T03:10:08.053019+0000', 'last_fullsized': '2024-07-27T03:10:08.053019+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.844 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-07-27T03:10:13.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.053508+0000', 'last_change': '2024-07-27T03:10:08.053508+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.053508+0000', 'last_undegraded': '2024-07-27T03:10:08.053508+0000', 'last_fullsized': '2024-07-27T03:10:08.053508+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.844 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-07-27T03:10:13.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.049486+0000', 'last_change': '2024-07-27T03:10:08.049486+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.049486+0000', 'last_undegraded': '2024-07-27T03:10:08.049486+0000', 'last_fullsized': '2024-07-27T03:10:08.049486+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.844 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-07-27T03:10:13.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.047569+0000', 'last_change': '2024-07-27T03:10:08.047569+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.047569+0000', 'last_undegraded': '2024-07-27T03:10:08.047569+0000', 'last_fullsized': '2024-07-27T03:10:08.047569+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.844 INFO:tasks.ceph.ceph_manager.ceph:PG 7.34 is not active+clean 2024-07-27T03:10:13.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.047683+0000', 'last_change': '2024-07-27T03:10:08.047683+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.047683+0000', 'last_undegraded': '2024-07-27T03:10:08.047683+0000', 'last_fullsized': '2024-07-27T03:10:08.047683+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:10:13.845 INFO:tasks.ceph.ceph_manager.ceph:PG 7.33 is not active+clean 2024-07-27T03:10:13.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.050410+0000', 'last_change': '2024-07-27T03:10:08.050410+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.050410+0000', 'last_undegraded': '2024-07-27T03:10:08.050410+0000', 'last_fullsized': '2024-07-27T03:10:08.050410+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-27T03:10:13.845 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-07-27T03:10:13.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.051620+0000', 'last_change': '2024-07-27T03:10:08.051620+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.051620+0000', 'last_undegraded': '2024-07-27T03:10:08.051620+0000', 'last_fullsized': '2024-07-27T03:10:08.051620+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.845 INFO:tasks.ceph.ceph_manager.ceph:PG 7.31 is not active+clean 2024-07-27T03:10:13.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.049263+0000', 'last_change': '2024-07-27T03:10:08.049263+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.049263+0000', 'last_undegraded': '2024-07-27T03:10:08.049263+0000', 'last_fullsized': '2024-07-27T03:10:08.049263+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:10:13.845 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-07-27T03:10:13.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.845 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-07-27T03:10:13.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.846 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-07-27T03:10:13.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.846 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-07-27T03:10:13.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.846 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2c is not active+clean 2024-07-27T03:10:13.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.050380+0000', 'last_change': '2024-07-27T03:10:08.050380+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.050380+0000', 'last_undegraded': '2024-07-27T03:10:08.050380+0000', 'last_fullsized': '2024-07-27T03:10:08.050380+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-27T03:10:13.846 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2b is not active+clean 2024-07-27T03:10:13.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.047854+0000', 'last_change': '2024-07-27T03:10:08.047854+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.047854+0000', 'last_undegraded': '2024-07-27T03:10:08.047854+0000', 'last_fullsized': '2024-07-27T03:10:08.047854+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:10:13.846 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-07-27T03:10:13.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.051127+0000', 'last_change': '2024-07-27T03:10:08.051127+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.051127+0000', 'last_undegraded': '2024-07-27T03:10:08.051127+0000', 'last_fullsized': '2024-07-27T03:10:08.051127+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.846 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-07-27T03:10:13.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.847 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-07-27T03:10:13.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.847 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-07-27T03:10:13.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.847 INFO:tasks.ceph.ceph_manager.ceph:PG 7.26 is not active+clean 2024-07-27T03:10:13.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.048334+0000', 'last_change': '2024-07-27T03:10:08.048334+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.048334+0000', 'last_undegraded': '2024-07-27T03:10:08.048334+0000', 'last_fullsized': '2024-07-27T03:10:08.048334+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-27T03:10:13.847 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-07-27T03:10:13.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.847 INFO:tasks.ceph.ceph_manager.ceph:PG 7.24 is not active+clean 2024-07-27T03:10:13.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.047168+0000', 'last_change': '2024-07-27T03:10:08.047168+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.047168+0000', 'last_undegraded': '2024-07-27T03:10:08.047168+0000', 'last_fullsized': '2024-07-27T03:10:08.047168+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:10:13.848 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-07-27T03:10:13.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.848 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-07-27T03:10:13.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.848 INFO:tasks.ceph.ceph_manager.ceph:PG 7.21 is not active+clean 2024-07-27T03:10:13.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.047630+0000', 'last_change': '2024-07-27T03:10:08.047630+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.047630+0000', 'last_undegraded': '2024-07-27T03:10:08.047630+0000', 'last_fullsized': '2024-07-27T03:10:08.047630+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:10:13.849 INFO:tasks.ceph.ceph_manager.ceph:PG 7.20 is not active+clean 2024-07-27T03:10:13.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.048126+0000', 'last_change': '2024-07-27T03:10:08.048126+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.048126+0000', 'last_undegraded': '2024-07-27T03:10:08.048126+0000', 'last_fullsized': '2024-07-27T03:10:08.048126+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-27T03:10:13.849 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-07-27T03:10:13.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.849 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-07-27T03:10:13.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.849 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-07-27T03:10:13.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:07.041376+0000', 'last_change': '2024-07-27T03:10:07.041376+0000', 'last_active': '2024-07-27T03:10:07.029584+0000', 'last_peered': '2024-07-27T03:10:07.029584+0000', 'last_clean': '2024-07-27T03:10:07.029584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:07.041376+0000', 'last_undegraded': '2024-07-27T03:10:07.041376+0000', 'last_fullsized': '2024-07-27T03:10:07.041376+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-27T03:10:13.850 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-07-27T03:10:13.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.046658+0000', 'last_change': '2024-07-27T03:10:08.046658+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.046658+0000', 'last_undegraded': '2024-07-27T03:10:08.046658+0000', 'last_fullsized': '2024-07-27T03:10:08.046658+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:10:13.850 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-07-27T03:10:13.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:07.046429+0000', 'last_change': '2024-07-27T03:10:07.046429+0000', 'last_active': '2024-07-27T03:10:07.029584+0000', 'last_peered': '2024-07-27T03:10:07.029584+0000', 'last_clean': '2024-07-27T03:10:07.029584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:07.046429+0000', 'last_undegraded': '2024-07-27T03:10:07.046429+0000', 'last_fullsized': '2024-07-27T03:10:07.046429+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-07-27T03:10:13.850 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-07-27T03:10:13.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.850 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-07-27T03:10:13.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.850 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-07-27T03:10:13.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.051375+0000', 'last_change': '2024-07-27T03:10:08.051375+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.051375+0000', 'last_undegraded': '2024-07-27T03:10:08.051375+0000', 'last_fullsized': '2024-07-27T03:10:08.051375+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.851 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-07-27T03:10:13.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:07.040990+0000', 'last_change': '2024-07-27T03:10:07.040990+0000', 'last_active': '2024-07-27T03:10:07.029584+0000', 'last_peered': '2024-07-27T03:10:07.029584+0000', 'last_clean': '2024-07-27T03:10:07.029584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:07.040990+0000', 'last_undegraded': '2024-07-27T03:10:07.040990+0000', 'last_fullsized': '2024-07-27T03:10:07.040990+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-27T03:10:13.851 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-07-27T03:10:13.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.051833+0000', 'last_change': '2024-07-27T03:10:08.051833+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.051833+0000', 'last_undegraded': '2024-07-27T03:10:08.051833+0000', 'last_fullsized': '2024-07-27T03:10:08.051833+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.851 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-07-27T03:10:13.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.851 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-07-27T03:10:13.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.851 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-07-27T03:10:13.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:07.040192+0000', 'last_change': '2024-07-27T03:10:07.040192+0000', 'last_active': '2024-07-27T03:10:07.029584+0000', 'last_peered': '2024-07-27T03:10:07.029584+0000', 'last_clean': '2024-07-27T03:10:07.029584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:07.040192+0000', 'last_undegraded': '2024-07-27T03:10:07.040192+0000', 'last_fullsized': '2024-07-27T03:10:07.040192+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-27T03:10:13.852 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-07-27T03:10:13.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.042675+0000', 'last_change': '2024-07-27T03:10:08.042675+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.042675+0000', 'last_undegraded': '2024-07-27T03:10:08.042675+0000', 'last_fullsized': '2024-07-27T03:10:08.042675+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:10:13.852 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-07-27T03:10:13.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.047269+0000', 'last_change': '2024-07-27T03:10:08.047269+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.047269+0000', 'last_undegraded': '2024-07-27T03:10:08.047269+0000', 'last_fullsized': '2024-07-27T03:10:08.047269+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:10:13.852 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-07-27T03:10:13.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.043965+0000', 'last_change': '2024-07-27T03:10:08.043965+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.043965+0000', 'last_undegraded': '2024-07-27T03:10:08.043965+0000', 'last_fullsized': '2024-07-27T03:10:08.043965+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:10:13.852 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-07-27T03:10:13.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.852 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-07-27T03:10:13.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.050984+0000', 'last_change': '2024-07-27T03:10:08.050984+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.050984+0000', 'last_undegraded': '2024-07-27T03:10:08.050984+0000', 'last_fullsized': '2024-07-27T03:10:08.050984+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.853 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-07-27T03:10:13.853 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.047253+0000', 'last_change': '2024-07-27T03:10:08.047253+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.047253+0000', 'last_undegraded': '2024-07-27T03:10:08.047253+0000', 'last_fullsized': '2024-07-27T03:10:08.047253+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:10:13.853 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-07-27T03:10:13.853 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.042383+0000', 'last_change': '2024-07-27T03:10:08.042383+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.042383+0000', 'last_undegraded': '2024-07-27T03:10:08.042383+0000', 'last_fullsized': '2024-07-27T03:10:08.042383+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:10:13.853 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-07-27T03:10:13.853 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.047849+0000', 'last_change': '2024-07-27T03:10:08.047849+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.047849+0000', 'last_undegraded': '2024-07-27T03:10:08.047849+0000', 'last_fullsized': '2024-07-27T03:10:08.047849+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-27T03:10:13.853 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-07-27T03:10:13.853 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.053050+0000', 'last_change': '2024-07-27T03:10:08.053050+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.053050+0000', 'last_undegraded': '2024-07-27T03:10:08.053050+0000', 'last_fullsized': '2024-07-27T03:10:08.053050+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.853 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-07-27T03:10:13.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:07.040297+0000', 'last_change': '2024-07-27T03:10:07.040297+0000', 'last_active': '2024-07-27T03:10:07.029584+0000', 'last_peered': '2024-07-27T03:10:07.029584+0000', 'last_clean': '2024-07-27T03:10:07.029584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:07.040297+0000', 'last_undegraded': '2024-07-27T03:10:07.040297+0000', 'last_fullsized': '2024-07-27T03:10:07.040297+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-27T03:10:13.854 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-07-27T03:10:13.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.854 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-07-27T03:10:13.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.854 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-07-27T03:10:13.854 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.048125+0000', 'last_change': '2024-07-27T03:10:08.048125+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.048125+0000', 'last_undegraded': '2024-07-27T03:10:08.048125+0000', 'last_fullsized': '2024-07-27T03:10:08.048125+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:10:13.854 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-07-27T03:10:13.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.855 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-07-27T03:10:13.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.047632+0000', 'last_change': '2024-07-27T03:10:08.047632+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.047632+0000', 'last_undegraded': '2024-07-27T03:10:08.047632+0000', 'last_fullsized': '2024-07-27T03:10:08.047632+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-27T03:10:13.855 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-07-27T03:10:13.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.049398+0000', 'last_change': '2024-07-27T03:10:08.049398+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.049398+0000', 'last_undegraded': '2024-07-27T03:10:08.049398+0000', 'last_fullsized': '2024-07-27T03:10:08.049398+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.855 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-07-27T03:10:13.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.855 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-07-27T03:10:13.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.048115+0000', 'last_change': '2024-07-27T03:10:08.048115+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.048115+0000', 'last_undegraded': '2024-07-27T03:10:08.048115+0000', 'last_fullsized': '2024-07-27T03:10:08.048115+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.855 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-07-27T03:10:13.855 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.042109+0000', 'last_change': '2024-07-27T03:10:08.042109+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.042109+0000', 'last_undegraded': '2024-07-27T03:10:08.042109+0000', 'last_fullsized': '2024-07-27T03:10:08.042109+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:07.045762+0000', 'last_change': '2024-07-27T03:10:07.045762+0000', 'last_active': '2024-07-27T03:10:07.029584+0000', 'last_peered': '2024-07-27T03:10:07.029584+0000', 'last_clean': '2024-07-27T03:10:07.029584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:07.045762+0000', 'last_undegraded': '2024-07-27T03:10:07.045762+0000', 'last_fullsized': '2024-07-27T03:10:07.045762+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.046654+0000', 'last_change': '2024-07-27T03:10:08.046654+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.046654+0000', 'last_undegraded': '2024-07-27T03:10:08.046654+0000', 'last_fullsized': '2024-07-27T03:10:08.046654+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.046651+0000', 'last_change': '2024-07-27T03:10:08.046651+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.046651+0000', 'last_undegraded': '2024-07-27T03:10:08.046651+0000', 'last_fullsized': '2024-07-27T03:10:08.046651+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:07.040192+0000', 'last_change': '2024-07-27T03:10:07.040192+0000', 'last_active': '2024-07-27T03:10:07.029584+0000', 'last_peered': '2024-07-27T03:10:07.029584+0000', 'last_clean': '2024-07-27T03:10:07.029584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:07.040192+0000', 'last_undegraded': '2024-07-27T03:10:07.040192+0000', 'last_fullsized': '2024-07-27T03:10:07.040192+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.044979+0000', 'last_change': '2024-07-27T03:10:08.044979+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.044979+0000', 'last_undegraded': '2024-07-27T03:10:08.044979+0000', 'last_fullsized': '2024-07-27T03:10:08.044979+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-07-27T03:10:13.856 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:07.045196+0000', 'last_change': '2024-07-27T03:10:07.045196+0000', 'last_active': '2024-07-27T03:10:07.029584+0000', 'last_peered': '2024-07-27T03:10:07.029584+0000', 'last_clean': '2024-07-27T03:10:07.029584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:07.045196+0000', 'last_undegraded': '2024-07-27T03:10:07.045196+0000', 'last_fullsized': '2024-07-27T03:10:07.045196+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:07.029584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-07-27T03:10:13.857 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-07-27T03:10:13.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-07-27T03:10:08.036352+0000', 'last_change': '2024-07-27T03:10:08.036352+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.036352+0000', 'last_undegraded': '2024-07-27T03:10:08.036352+0000', 'last_fullsized': '2024-07-27T03:10:08.036352+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-07-27T03:10:13.857 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-07-27T03:10:13.857 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-07-27T03:10:08.049060+0000', 'last_change': '2024-07-27T03:10:08.049060+0000', 'last_active': '2024-07-27T03:10:08.036352+0000', 'last_peered': '2024-07-27T03:10:08.036352+0000', 'last_clean': '2024-07-27T03:10:08.036352+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-27T03:10:08.049060+0000', 'last_undegraded': '2024-07-27T03:10:08.049060+0000', 'last_fullsized': '2024-07-27T03:10:08.049060+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'last_clean_scrub_stamp': '2024-07-27T03:10:08.036352+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-27T03:10:13.857 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-07-27T03:10:13.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.988+0000 7f2b499d9640 1 -- 172.21.15.120:0/2622568976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b2c003a00 msgr2=0x7f2b2c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.988+0000 7f2b499d9640 1 --2- 172.21.15.120:0/2622568976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b2c003a00 0x7f2b2c003e70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2b440ce520 tx=0x7f2b2c005830 comp rx=0 tx=0).stop 2024-07-27T03:10:13.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.988+0000 7f2b437fe640 1 -- 172.21.15.120:0/2622568976 reap_dead start 2024-07-27T03:10:13.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.988+0000 7f2b499d9640 1 -- 172.21.15.120:0/2622568976 shutdown_connections 2024-07-27T03:10:13.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.988+0000 7f2b499d9640 1 -- 172.21.15.120:0/2622568976 >> 172.21.15.120:0/2622568976 conn(0x7f2b4408d690 msgr2=0x7f2b4409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:13.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.988+0000 7f2b499d9640 1 -- 172.21.15.120:0/2622568976 shutdown_connections 2024-07-27T03:10:13.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.988+0000 7f2b499d9640 1 -- 172.21.15.120:0/2622568976 wait complete. 2024-07-27T03:10:13.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.990+0000 7f2b499d9640 1 Processor -- start 2024-07-27T03:10:13.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.990+0000 7f2b499d9640 1 -- start start 2024-07-27T03:10:13.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.991+0000 7f2b499d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b2c003a00 0x7f2b441524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.991+0000 7f2b499d9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b4409dc30 0x7f2b4409e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.991+0000 7f2b499d9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b440b8260 0x7f2b440b8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.991+0000 7f2b499d9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440b2fd0 con 0x7f2b2c003a00 2024-07-27T03:10:13.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.991+0000 7f2b499d9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440b2e50 con 0x7f2b4409dc30 2024-07-27T03:10:13.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.991+0000 7f2b499d9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2b440cebe0 con 0x7f2b440b8260 2024-07-27T03:10:13.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.991+0000 7f2b42ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b2c003a00 0x7f2b441524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:13.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.991+0000 7f2b42ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b2c003a00 0x7f2b441524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58276/0 (socket says 172.21.15.120:58276) 2024-07-27T03:10:13.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.991+0000 7f2b42ffd640 1 -- 172.21.15.120:0/4293878977 learned_addr learned my addr 172.21.15.120:0/4293878977 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:13.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.992+0000 7f2b42ffd640 1 -- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b440b8260 msgr2=0x7f2b440b8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.992+0000 7f2b42ffd640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b440b8260 0x7f2b440b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.992+0000 7f2b42ffd640 1 -- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b4409dc30 msgr2=0x7f2b4409e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:13.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.992+0000 7f2b42ffd640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b4409dc30 0x7f2b4409e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:13.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.992+0000 7f2b42ffd640 1 -- 172.21.15.120:0/4293878977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b441529e0 con 0x7f2b2c003a00 2024-07-27T03:10:13.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.992+0000 7f2b42ffd640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b2c003a00 0x7f2b441524a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2b34001eb0 tx=0x7f2b34033cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:13.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.992+0000 7f2b2bfff640 1 -- 172.21.15.120:0/4293878977 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b34038040 con 0x7f2b2c003a00 2024-07-27T03:10:13.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.992+0000 7f2b2bfff640 1 -- 172.21.15.120:0/4293878977 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b34033e40 con 0x7f2b2c003a00 2024-07-27T03:10:13.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.992+0000 7f2b2bfff640 1 -- 172.21.15.120:0/4293878977 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b34005020 con 0x7f2b2c003a00 2024-07-27T03:10:13.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.992+0000 7f2b499d9640 1 -- 172.21.15.120:0/4293878977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b440b8bb0 con 0x7f2b2c003a00 2024-07-27T03:10:13.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.992+0000 7f2b499d9640 1 -- 172.21.15.120:0/4293878977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b441f8a20 con 0x7f2b2c003a00 2024-07-27T03:10:13.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.993+0000 7f2b499d9640 1 -- 172.21.15.120:0/4293878977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b440b3790 con 0x7f2b2c003a00 2024-07-27T03:10:13.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.994+0000 7f2b2bfff640 1 -- 172.21.15.120:0/4293878977 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2b34045020 con 0x7f2b2c003a00 2024-07-27T03:10:13.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.994+0000 7f2b2bfff640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2b30077010 0x7f2b30079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:13.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.994+0000 7f2b2bfff640 1 -- 172.21.15.120:0/4293878977 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f2b340b98e0 con 0x7f2b2c003a00 2024-07-27T03:10:13.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.995+0000 7f2b427fc640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2b30077010 0x7f2b30079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:13.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.995+0000 7f2b427fc640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2b30077010 0x7f2b30079520 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b440cc440 tx=0x7f2b380013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:14.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:13.999+0000 7f2b2bfff640 1 -- 172.21.15.120:0/4293878977 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f2b440b3790 con 0x7f2b2c003a00 2024-07-27T03:10:14.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.254+0000 7f2b499d9640 1 -- 172.21.15.120:0/4293878977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2b4406ec10 con 0x7f2b2c003a00 2024-07-27T03:10:14.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.254+0000 7f2b2bfff640 1 -- 172.21.15.120:0/4293878977 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1700 (secure 0 0 0) 0x7f2b4406ec10 con 0x7f2b2c003a00 2024-07-27T03:10:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:14.257 INFO:teuthology.orchestra.run.smithi120.stdout:{"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":118,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1722049707,"num_in_osds":8,"osd_in_since":1722049699,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":49},{"state_name":"active+clean","count":25},{"state_name":"unknown","count":23}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":260452352,"bytes_avail":772833660928,"bytes_total":773094113280,"unknown_pgs_ratio":0.23711340129375458,"inactive_pgs_ratio":0.50515460968017578},"fsmap":{"epoch":34,"btime":"2024-07-27T03:10:12:081716+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5328}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-07-27T03:09:30.545057+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-07-27T03:10:14.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.256+0000 7f2b499d9640 1 -- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2b30077010 msgr2=0x7f2b30079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:14.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.256+0000 7f2b499d9640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2b30077010 0x7f2b30079520 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b440cc440 tx=0x7f2b380013f0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.256+0000 7f2b499d9640 1 -- 172.21.15.120:0/4293878977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b2c003a00 msgr2=0x7f2b441524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:14.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.256+0000 7f2b499d9640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b2c003a00 0x7f2b441524a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2b34001eb0 tx=0x7f2b34033cd0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.256+0000 7f2b499d9640 1 -- 172.21.15.120:0/4293878977 shutdown_connections 2024-07-27T03:10:14.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.256+0000 7f2b499d9640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2b30077010 0x7f2b30079520 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.256+0000 7f2b499d9640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b440b8260 0x7f2b440b8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.256+0000 7f2b499d9640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b4409dc30 0x7f2b4409e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.256+0000 7f2b499d9640 1 --2- 172.21.15.120:0/4293878977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b2c003a00 0x7f2b441524a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.256+0000 7f2b499d9640 1 -- 172.21.15.120:0/4293878977 >> 172.21.15.120:0/4293878977 conn(0x7f2b4408d690 msgr2=0x7f2b4406e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:14.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.257+0000 7f2b499d9640 1 -- 172.21.15.120:0/4293878977 shutdown_connections 2024-07-27T03:10:14.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.257+0000 7f2b499d9640 1 -- 172.21.15.120:0/4293878977 wait complete. 2024-07-27T03:10:14.270 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-07-27T03:10:14.270 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:10:14.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.381+0000 7f8754ce2640 1 -- 172.21.15.120:0/3183797472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87500d27e0 msgr2=0x7f87500d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:14.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.381+0000 7f8754ce2640 1 --2- 172.21.15.120:0/3183797472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87500d27e0 0x7f87500d2bf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8744009830 tx=0x7f874402a510 comp rx=0 tx=0).stop 2024-07-27T03:10:14.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.381+0000 7f8754ce2640 1 -- 172.21.15.120:0/3183797472 shutdown_connections 2024-07-27T03:10:14.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.381+0000 7f8754ce2640 1 --2- 172.21.15.120:0/3183797472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87500d27e0 0x7f87500d2bf0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.381+0000 7f8754ce2640 1 --2- 172.21.15.120:0/3183797472 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87500b4740 0x7f87500b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.381+0000 7f8754ce2640 1 -- 172.21.15.120:0/3183797472 >> 172.21.15.120:0/3183797472 conn(0x7f875008d690 msgr2=0x7f875009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:14.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.382+0000 7f8754ce2640 1 -- 172.21.15.120:0/3183797472 shutdown_connections 2024-07-27T03:10:14.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.382+0000 7f8754ce2640 1 -- 172.21.15.120:0/3183797472 wait complete. 2024-07-27T03:10:14.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.383+0000 7f8754ce2640 1 Processor -- start 2024-07-27T03:10:14.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.383+0000 7f8754ce2640 1 -- start start 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f8754ce2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87500b4740 0x7f875014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f8754ce2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87500d09c0 0x7f875014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f8754ce2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87500d27e0 0x7f875014eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f8754ce2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f87500cef70 con 0x7f87500d09c0 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f8754ce2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87500cedf0 con 0x7f87500b4740 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f8754ce2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f87500cf0f0 con 0x7f87500d27e0 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f874dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87500d09c0 0x7f875014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f874dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87500d09c0 0x7f875014e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58282/0 (socket says 172.21.15.120:58282) 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f874dd9b640 1 -- 172.21.15.120:0/2888483672 learned_addr learned my addr 172.21.15.120:0/2888483672 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f874e59c640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87500b4740 0x7f875014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f874ed9d640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87500d27e0 0x7f875014eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:14.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f874dd9b640 1 -- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87500d27e0 msgr2=0x7f875014eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:14.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f874dd9b640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87500d27e0 0x7f875014eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f874dd9b640 1 -- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87500b4740 msgr2=0x7f875014db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:14.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f874dd9b640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87500b4740 0x7f875014db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f874dd9b640 1 -- 172.21.15.120:0/2888483672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87500b1780 con 0x7f87500d09c0 2024-07-27T03:10:14.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f874dd9b640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87500d09c0 0x7f875014e5c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8744000c00 tx=0x7f8744033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:14.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.385+0000 7f873effd640 1 -- 172.21.15.120:0/2888483672 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744005c90 con 0x7f87500d09c0 2024-07-27T03:10:14.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.386+0000 7f873effd640 1 -- 172.21.15.120:0/2888483672 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8744031e50 con 0x7f87500d09c0 2024-07-27T03:10:14.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.386+0000 7f873effd640 1 -- 172.21.15.120:0/2888483672 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87440332f0 con 0x7f87500d09c0 2024-07-27T03:10:14.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.386+0000 7f8754ce2640 1 -- 172.21.15.120:0/2888483672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87500b1a60 con 0x7f87500d09c0 2024-07-27T03:10:14.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.386+0000 7f8754ce2640 1 -- 172.21.15.120:0/2888483672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87500b2020 con 0x7f87500d09c0 2024-07-27T03:10:14.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.386+0000 7f8754ce2640 1 -- 172.21.15.120:0/2888483672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87500ce100 con 0x7f87500d09c0 2024-07-27T03:10:14.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.387+0000 7f873effd640 1 -- 172.21.15.120:0/2888483672 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8744033490 con 0x7f87500d09c0 2024-07-27T03:10:14.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.388+0000 7f873effd640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8730077010 0x7f8730079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:14.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.388+0000 7f873effd640 1 -- 172.21.15.120:0/2888483672 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f87440b9b80 con 0x7f87500d09c0 2024-07-27T03:10:14.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.388+0000 7f874e59c640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8730077010 0x7f8730079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:14.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.389+0000 7f874e59c640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8730077010 0x7f8730079520 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f874000bb50 tx=0x7f874000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:14.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.392+0000 7f873effd640 1 -- 172.21.15.120:0/2888483672 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f874403f030 con 0x7f87500d09c0 2024-07-27T03:10:14.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.571+0000 7f8754ce2640 1 -- 172.21.15.120:0/2888483672 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87500d2bf0 con 0x7f8730077010 2024-07-27T03:10:14.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.575+0000 7f873effd640 1 -- 172.21.15.120:0/2888483672 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f87500d2bf0 con 0x7f8730077010 2024-07-27T03:10:14.580 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:14.581 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:10:14.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 -- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8730077010 msgr2=0x7f8730079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:14.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8730077010 0x7f8730079520 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f874000bb50 tx=0x7f874000b2e0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 -- 172.21.15.120:0/2888483672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87500d09c0 msgr2=0x7f875014e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:14.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87500d09c0 0x7f875014e5c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8744000c00 tx=0x7f8744033c90 comp rx=0 tx=0).stop 2024-07-27T03:10:14.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 -- 172.21.15.120:0/2888483672 shutdown_connections 2024-07-27T03:10:14.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8730077010 0x7f8730079520 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87500d09c0 0x7f875014e5c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87500d27e0 0x7f875014eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 --2- 172.21.15.120:0/2888483672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87500b4740 0x7f875014db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:14.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 -- 172.21.15.120:0/2888483672 >> 172.21.15.120:0/2888483672 conn(0x7f875008d690 msgr2=0x7f8750075950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:14.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 -- 172.21.15.120:0/2888483672 shutdown_connections 2024-07-27T03:10:14.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:14.578+0000 7f8754ce2640 1 -- 172.21.15.120:0/2888483672 wait complete. 2024-07-27T03:10:14.592 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-07-27T03:10:14.555824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258832,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754715888,"statfs":{"total":773094113280,"available":772829069312,"internally_reserved":0,"allocated":5316608,"data_stored":2822916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.515963"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269858+0000","last_change":"2024-07-27T03:10:09.075578+0000","last_active":"2024-07-27T03:10:10.269858+0000","last_peered":"2024-07-27T03:10:10.269858+0000","last_clean":"2024-07-27T03:10:10.269858+0000","last_became_active":"2024-07-27T03:10:09.075274+0000","last_became_peered":"2024-07-27T03:10:09.075274+0000","last_unstale":"2024-07-27T03:10:10.269858+0000","last_undegraded":"2024-07-27T03:10:10.269858+0000","last_fullsized":"2024-07-27T03:10:10.269858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:24:52.967003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063176+0000","last_change":"2024-07-27T03:10:09.069818+0000","last_active":"2024-07-27T03:10:10.063176+0000","last_peered":"2024-07-27T03:10:10.063176+0000","last_clean":"2024-07-27T03:10:10.063176+0000","last_became_active":"2024-07-27T03:10:09.069499+0000","last_became_peered":"2024-07-27T03:10:09.069499+0000","last_unstale":"2024-07-27T03:10:10.063176+0000","last_undegraded":"2024-07-27T03:10:10.063176+0000","last_fullsized":"2024-07-27T03:10:10.063176+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:42:33.014370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.064057+0000","last_change":"2024-07-27T03:10:09.068177+0000","last_active":"2024-07-27T03:10:10.064057+0000","last_peered":"2024-07-27T03:10:10.064057+0000","last_clean":"2024-07-27T03:10:10.064057+0000","last_became_active":"2024-07-27T03:10:09.067881+0000","last_became_peered":"2024-07-27T03:10:09.067881+0000","last_unstale":"2024-07-27T03:10:10.064057+0000","last_undegraded":"2024-07-27T03:10:10.064057+0000","last_fullsized":"2024-07-27T03:10:10.064057+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:44:51.119668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268794+0000","last_change":"2024-07-27T03:10:09.079136+0000","last_active":"2024-07-27T03:10:10.268794+0000","last_peered":"2024-07-27T03:10:10.268794+0000","last_clean":"2024-07-27T03:10:10.268794+0000","last_became_active":"2024-07-27T03:10:09.078837+0000","last_became_peered":"2024-07-27T03:10:09.078837+0000","last_unstale":"2024-07-27T03:10:10.268794+0000","last_undegraded":"2024-07-27T03:10:10.268794+0000","last_fullsized":"2024-07-27T03:10:10.268794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:40:33.821457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063223+0000","last_change":"2024-07-27T03:10:09.069226+0000","last_active":"2024-07-27T03:10:10.063223+0000","last_peered":"2024-07-27T03:10:10.063223+0000","last_clean":"2024-07-27T03:10:10.063223+0000","last_became_active":"2024-07-27T03:10:09.068905+0000","last_became_peered":"2024-07-27T03:10:09.068905+0000","last_unstale":"2024-07-27T03:10:10.063223+0000","last_undegraded":"2024-07-27T03:10:10.063223+0000","last_fullsized":"2024-07-27T03:10:10.063223+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:26:33.849063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074185+0000","last_change":"2024-07-27T03:10:09.071124+0000","last_active":"2024-07-27T03:10:10.074185+0000","last_peered":"2024-07-27T03:10:10.074185+0000","last_clean":"2024-07-27T03:10:10.074185+0000","last_became_active":"2024-07-27T03:10:09.070792+0000","last_became_peered":"2024-07-27T03:10:09.070792+0000","last_unstale":"2024-07-27T03:10:10.074185+0000","last_undegraded":"2024-07-27T03:10:10.074185+0000","last_fullsized":"2024-07-27T03:10:10.074185+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:58:16.371104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269829+0000","last_change":"2024-07-27T03:10:09.080302+0000","last_active":"2024-07-27T03:10:10.269829+0000","last_peered":"2024-07-27T03:10:10.269829+0000","last_clean":"2024-07-27T03:10:10.269829+0000","last_became_active":"2024-07-27T03:10:09.079967+0000","last_became_peered":"2024-07-27T03:10:09.079967+0000","last_unstale":"2024-07-27T03:10:10.269829+0000","last_undegraded":"2024-07-27T03:10:10.269829+0000","last_fullsized":"2024-07-27T03:10:10.269829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:31:58.970960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268010+0000","last_change":"2024-07-27T03:10:09.082073+0000","last_active":"2024-07-27T03:10:10.268010+0000","last_peered":"2024-07-27T03:10:10.268010+0000","last_clean":"2024-07-27T03:10:10.268010+0000","last_became_active":"2024-07-27T03:10:09.081785+0000","last_became_peered":"2024-07-27T03:10:09.081785+0000","last_unstale":"2024-07-27T03:10:10.268010+0000","last_undegraded":"2024-07-27T03:10:10.268010+0000","last_fullsized":"2024-07-27T03:10:10.268010+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:24:52.686001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269128+0000","last_change":"2024-07-27T03:10:09.066158+0000","last_active":"2024-07-27T03:10:10.269128+0000","last_peered":"2024-07-27T03:10:10.269128+0000","last_clean":"2024-07-27T03:10:10.269128+0000","last_became_active":"2024-07-27T03:10:09.065856+0000","last_became_peered":"2024-07-27T03:10:09.065856+0000","last_unstale":"2024-07-27T03:10:10.269128+0000","last_undegraded":"2024-07-27T03:10:10.269128+0000","last_fullsized":"2024-07-27T03:10:10.269128+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:24:52.967003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268965+0000","last_change":"2024-07-27T03:10:09.071639+0000","last_active":"2024-07-27T03:10:10.268965+0000","last_peered":"2024-07-27T03:10:10.268965+0000","last_clean":"2024-07-27T03:10:10.268965+0000","last_became_active":"2024-07-27T03:10:09.071368+0000","last_became_peered":"2024-07-27T03:10:09.071368+0000","last_unstale":"2024-07-27T03:10:10.268965+0000","last_undegraded":"2024-07-27T03:10:10.268965+0000","last_fullsized":"2024-07-27T03:10:10.268965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:32:55.036511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268662+0000","last_change":"2024-07-27T03:10:09.078070+0000","last_active":"2024-07-27T03:10:10.268662+0000","last_peered":"2024-07-27T03:10:10.268662+0000","last_clean":"2024-07-27T03:10:10.268662+0000","last_became_active":"2024-07-27T03:10:09.077740+0000","last_became_peered":"2024-07-27T03:10:09.077740+0000","last_unstale":"2024-07-27T03:10:10.268662+0000","last_undegraded":"2024-07-27T03:10:10.268662+0000","last_fullsized":"2024-07-27T03:10:10.268662+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:42:33.014370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063521+0000","last_change":"2024-07-27T03:10:09.073045+0000","last_active":"2024-07-27T03:10:10.063521+0000","last_peered":"2024-07-27T03:10:10.063521+0000","last_clean":"2024-07-27T03:10:10.063521+0000","last_became_active":"2024-07-27T03:10:09.072727+0000","last_became_peered":"2024-07-27T03:10:09.072727+0000","last_unstale":"2024-07-27T03:10:10.063521+0000","last_undegraded":"2024-07-27T03:10:10.063521+0000","last_fullsized":"2024-07-27T03:10:10.063521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:40:33.821457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062329+0000","last_change":"2024-07-27T03:10:09.086963+0000","last_active":"2024-07-27T03:10:10.062329+0000","last_peered":"2024-07-27T03:10:10.062329+0000","last_clean":"2024-07-27T03:10:10.062329+0000","last_became_active":"2024-07-27T03:10:09.086609+0000","last_became_peered":"2024-07-27T03:10:09.086609+0000","last_unstale":"2024-07-27T03:10:10.062329+0000","last_undegraded":"2024-07-27T03:10:10.062329+0000","last_fullsized":"2024-07-27T03:10:10.062329+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:59.873828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268491+0000","last_change":"2024-07-27T03:10:09.078483+0000","last_active":"2024-07-27T03:10:10.268491+0000","last_peered":"2024-07-27T03:10:10.268491+0000","last_clean":"2024-07-27T03:10:10.268491+0000","last_became_active":"2024-07-27T03:10:09.077420+0000","last_became_peered":"2024-07-27T03:10:09.077420+0000","last_unstale":"2024-07-27T03:10:10.268491+0000","last_undegraded":"2024-07-27T03:10:10.268491+0000","last_fullsized":"2024-07-27T03:10:10.268491+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:41:44.457113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074152+0000","last_change":"2024-07-27T03:10:09.072939+0000","last_active":"2024-07-27T03:10:10.074152+0000","last_peered":"2024-07-27T03:10:10.074152+0000","last_clean":"2024-07-27T03:10:10.074152+0000","last_became_active":"2024-07-27T03:10:09.072423+0000","last_became_peered":"2024-07-27T03:10:09.072423+0000","last_unstale":"2024-07-27T03:10:10.074152+0000","last_undegraded":"2024-07-27T03:10:10.074152+0000","last_fullsized":"2024-07-27T03:10:10.074152+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:26:16.175547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269062+0000","last_change":"2024-07-27T03:10:09.077121+0000","last_active":"2024-07-27T03:10:10.269062+0000","last_peered":"2024-07-27T03:10:10.269062+0000","last_clean":"2024-07-27T03:10:10.269062+0000","last_became_active":"2024-07-27T03:10:09.076828+0000","last_became_peered":"2024-07-27T03:10:09.076828+0000","last_unstale":"2024-07-27T03:10:10.269062+0000","last_undegraded":"2024-07-27T03:10:10.269062+0000","last_fullsized":"2024-07-27T03:10:10.269062+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:27:19.939253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063830+0000","last_change":"2024-07-27T03:10:09.069546+0000","last_active":"2024-07-27T03:10:10.063830+0000","last_peered":"2024-07-27T03:10:10.063830+0000","last_clean":"2024-07-27T03:10:10.063830+0000","last_became_active":"2024-07-27T03:10:09.069231+0000","last_became_peered":"2024-07-27T03:10:09.069231+0000","last_unstale":"2024-07-27T03:10:10.063830+0000","last_undegraded":"2024-07-27T03:10:10.063830+0000","last_fullsized":"2024-07-27T03:10:10.063830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:39:16.232930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063577+0000","last_change":"2024-07-27T03:10:09.076614+0000","last_active":"2024-07-27T03:10:10.063577+0000","last_peered":"2024-07-27T03:10:10.063577+0000","last_clean":"2024-07-27T03:10:10.063577+0000","last_became_active":"2024-07-27T03:10:09.076281+0000","last_became_peered":"2024-07-27T03:10:09.076281+0000","last_unstale":"2024-07-27T03:10:10.063577+0000","last_undegraded":"2024-07-27T03:10:10.063577+0000","last_fullsized":"2024-07-27T03:10:10.063577+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:36:52.893665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269872+0000","last_change":"2024-07-27T03:10:09.075707+0000","last_active":"2024-07-27T03:10:10.269872+0000","last_peered":"2024-07-27T03:10:10.269872+0000","last_clean":"2024-07-27T03:10:10.269872+0000","last_became_active":"2024-07-27T03:10:09.075246+0000","last_became_peered":"2024-07-27T03:10:09.075246+0000","last_unstale":"2024-07-27T03:10:10.269872+0000","last_undegraded":"2024-07-27T03:10:10.269872+0000","last_fullsized":"2024-07-27T03:10:10.269872+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:33:02.588360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062183+0000","last_change":"2024-07-27T03:10:09.074790+0000","last_active":"2024-07-27T03:10:10.062183+0000","last_peered":"2024-07-27T03:10:10.062183+0000","last_clean":"2024-07-27T03:10:10.062183+0000","last_became_active":"2024-07-27T03:10:09.074489+0000","last_became_peered":"2024-07-27T03:10:09.074489+0000","last_unstale":"2024-07-27T03:10:10.062183+0000","last_undegraded":"2024-07-27T03:10:10.062183+0000","last_fullsized":"2024-07-27T03:10:10.062183+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:27.181877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074363+0000","last_change":"2024-07-27T03:10:09.074392+0000","last_active":"2024-07-27T03:10:10.074363+0000","last_peered":"2024-07-27T03:10:10.074363+0000","last_clean":"2024-07-27T03:10:10.074363+0000","last_became_active":"2024-07-27T03:10:09.074107+0000","last_became_peered":"2024-07-27T03:10:09.074107+0000","last_unstale":"2024-07-27T03:10:10.074363+0000","last_undegraded":"2024-07-27T03:10:10.074363+0000","last_fullsized":"2024-07-27T03:10:10.074363+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:52:26.648777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268665+0000","last_change":"2024-07-27T03:10:09.077898+0000","last_active":"2024-07-27T03:10:10.268665+0000","last_peered":"2024-07-27T03:10:10.268665+0000","last_clean":"2024-07-27T03:10:10.268665+0000","last_became_active":"2024-07-27T03:10:09.077021+0000","last_became_peered":"2024-07-27T03:10:09.077021+0000","last_unstale":"2024-07-27T03:10:10.268665+0000","last_undegraded":"2024-07-27T03:10:10.268665+0000","last_fullsized":"2024-07-27T03:10:10.268665+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:09:03.236747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269741+0000","last_change":"2024-07-27T03:10:09.078175+0000","last_active":"2024-07-27T03:10:10.269741+0000","last_peered":"2024-07-27T03:10:10.269741+0000","last_clean":"2024-07-27T03:10:10.269741+0000","last_became_active":"2024-07-27T03:10:09.077829+0000","last_became_peered":"2024-07-27T03:10:09.077829+0000","last_unstale":"2024-07-27T03:10:10.269741+0000","last_undegraded":"2024-07-27T03:10:10.269741+0000","last_fullsized":"2024-07-27T03:10:10.269741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:04:18.314025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268922+0000","last_change":"2024-07-27T03:10:09.071459+0000","last_active":"2024-07-27T03:10:10.268922+0000","last_peered":"2024-07-27T03:10:10.268922+0000","last_clean":"2024-07-27T03:10:10.268922+0000","last_became_active":"2024-07-27T03:10:09.071133+0000","last_became_peered":"2024-07-27T03:10:09.071133+0000","last_unstale":"2024-07-27T03:10:10.268922+0000","last_undegraded":"2024-07-27T03:10:10.268922+0000","last_fullsized":"2024-07-27T03:10:10.268922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:38:24.313977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269935+0000","last_change":"2024-07-27T03:10:09.081144+0000","last_active":"2024-07-27T03:10:10.269935+0000","last_peered":"2024-07-27T03:10:10.269935+0000","last_clean":"2024-07-27T03:10:10.269935+0000","last_became_active":"2024-07-27T03:10:09.080638+0000","last_became_peered":"2024-07-27T03:10:09.080638+0000","last_unstale":"2024-07-27T03:10:10.269935+0000","last_undegraded":"2024-07-27T03:10:10.269935+0000","last_fullsized":"2024-07-27T03:10:10.269935+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:57:09.812686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062100+0000","last_change":"2024-07-27T03:10:09.085552+0000","last_active":"2024-07-27T03:10:10.062100+0000","last_peered":"2024-07-27T03:10:10.062100+0000","last_clean":"2024-07-27T03:10:10.062100+0000","last_became_active":"2024-07-27T03:10:09.085158+0000","last_became_peered":"2024-07-27T03:10:09.085158+0000","last_unstale":"2024-07-27T03:10:10.062100+0000","last_undegraded":"2024-07-27T03:10:10.062100+0000","last_fullsized":"2024-07-27T03:10:10.062100+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:00:30.058473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.064021+0000","last_change":"2024-07-27T03:10:09.067477+0000","last_active":"2024-07-27T03:10:10.064021+0000","last_peered":"2024-07-27T03:10:10.064021+0000","last_clean":"2024-07-27T03:10:10.064021+0000","last_became_active":"2024-07-27T03:10:09.067121+0000","last_became_peered":"2024-07-27T03:10:09.067121+0000","last_unstale":"2024-07-27T03:10:10.064021+0000","last_undegraded":"2024-07-27T03:10:10.064021+0000","last_fullsized":"2024-07-27T03:10:10.064021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:36:41.934134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063684+0000","last_change":"2024-07-27T03:10:09.072273+0000","last_active":"2024-07-27T03:10:10.063684+0000","last_peered":"2024-07-27T03:10:10.063684+0000","last_clean":"2024-07-27T03:10:10.063684+0000","last_became_active":"2024-07-27T03:10:09.071903+0000","last_became_peered":"2024-07-27T03:10:09.071903+0000","last_unstale":"2024-07-27T03:10:10.063684+0000","last_undegraded":"2024-07-27T03:10:10.063684+0000","last_fullsized":"2024-07-27T03:10:10.063684+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:32:55.036511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269218+0000","last_change":"2024-07-27T03:10:09.079947+0000","last_active":"2024-07-27T03:10:10.269218+0000","last_peered":"2024-07-27T03:10:10.269218+0000","last_clean":"2024-07-27T03:10:10.269218+0000","last_became_active":"2024-07-27T03:10:09.079268+0000","last_became_peered":"2024-07-27T03:10:09.079268+0000","last_unstale":"2024-07-27T03:10:10.269218+0000","last_undegraded":"2024-07-27T03:10:10.269218+0000","last_fullsized":"2024-07-27T03:10:10.269218+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:06:19.621019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062831+0000","last_change":"2024-07-27T03:10:09.069811+0000","last_active":"2024-07-27T03:10:10.062831+0000","last_peered":"2024-07-27T03:10:10.062831+0000","last_clean":"2024-07-27T03:10:10.062831+0000","last_became_active":"2024-07-27T03:10:09.068689+0000","last_became_peered":"2024-07-27T03:10:09.068689+0000","last_unstale":"2024-07-27T03:10:10.062831+0000","last_undegraded":"2024-07-27T03:10:10.062831+0000","last_fullsized":"2024-07-27T03:10:10.062831+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:05.293014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074202+0000","last_change":"2024-07-27T03:10:09.072900+0000","last_active":"2024-07-27T03:10:10.074202+0000","last_peered":"2024-07-27T03:10:10.074202+0000","last_clean":"2024-07-27T03:10:10.074202+0000","last_became_active":"2024-07-27T03:10:09.072070+0000","last_became_peered":"2024-07-27T03:10:09.072070+0000","last_unstale":"2024-07-27T03:10:10.074202+0000","last_undegraded":"2024-07-27T03:10:10.074202+0000","last_fullsized":"2024-07-27T03:10:10.074202+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:40:22.610145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.061997+0000","last_change":"2024-07-27T03:10:09.076752+0000","last_active":"2024-07-27T03:10:10.061997+0000","last_peered":"2024-07-27T03:10:10.061997+0000","last_clean":"2024-07-27T03:10:10.061997+0000","last_became_active":"2024-07-27T03:10:09.076441+0000","last_became_peered":"2024-07-27T03:10:09.076441+0000","last_unstale":"2024-07-27T03:10:10.061997+0000","last_undegraded":"2024-07-27T03:10:10.061997+0000","last_fullsized":"2024-07-27T03:10:10.061997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:39:04.022323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268253+0000","last_change":"2024-07-27T03:10:09.066742+0000","last_active":"2024-07-27T03:10:10.268253+0000","last_peered":"2024-07-27T03:10:10.268253+0000","last_clean":"2024-07-27T03:10:10.268253+0000","last_became_active":"2024-07-27T03:10:09.065821+0000","last_became_peered":"2024-07-27T03:10:09.065821+0000","last_unstale":"2024-07-27T03:10:10.268253+0000","last_undegraded":"2024-07-27T03:10:10.268253+0000","last_fullsized":"2024-07-27T03:10:10.268253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:06:49.863301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074658+0000","last_change":"2024-07-27T03:10:08.057878+0000","last_active":"2024-07-27T03:10:10.074658+0000","last_peered":"2024-07-27T03:10:10.074658+0000","last_clean":"2024-07-27T03:10:10.074658+0000","last_became_active":"2024-07-27T03:10:08.057580+0000","last_became_peered":"2024-07-27T03:10:08.057580+0000","last_unstale":"2024-07-27T03:10:10.074658+0000","last_undegraded":"2024-07-27T03:10:10.074658+0000","last_fullsized":"2024-07-27T03:10:10.074658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:36:40.927367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.270069+0000","last_change":"2024-07-27T03:10:09.078809+0000","last_active":"2024-07-27T03:10:10.270069+0000","last_peered":"2024-07-27T03:10:10.270069+0000","last_clean":"2024-07-27T03:10:10.270069+0000","last_became_active":"2024-07-27T03:10:09.078447+0000","last_became_peered":"2024-07-27T03:10:09.078447+0000","last_unstale":"2024-07-27T03:10:10.270069+0000","last_undegraded":"2024-07-27T03:10:10.270069+0000","last_fullsized":"2024-07-27T03:10:10.270069+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:23:53.164134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063663+0000","last_change":"2024-07-27T03:10:08.055214+0000","last_active":"2024-07-27T03:10:10.063663+0000","last_peered":"2024-07-27T03:10:10.063663+0000","last_clean":"2024-07-27T03:10:10.063663+0000","last_became_active":"2024-07-27T03:10:08.054923+0000","last_became_peered":"2024-07-27T03:10:08.054923+0000","last_unstale":"2024-07-27T03:10:10.063663+0000","last_undegraded":"2024-07-27T03:10:10.063663+0000","last_fullsized":"2024-07-27T03:10:10.063663+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:53:20.853027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063902+0000","last_change":"2024-07-27T03:10:09.072898+0000","last_active":"2024-07-27T03:10:10.063902+0000","last_peered":"2024-07-27T03:10:10.063902+0000","last_clean":"2024-07-27T03:10:10.063902+0000","last_became_active":"2024-07-27T03:10:09.072389+0000","last_became_peered":"2024-07-27T03:10:09.072389+0000","last_unstale":"2024-07-27T03:10:10.063902+0000","last_undegraded":"2024-07-27T03:10:10.063902+0000","last_fullsized":"2024-07-27T03:10:10.063902+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:31:58.970960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268788+0000","last_change":"2024-07-27T03:10:08.062648+0000","last_active":"2024-07-27T03:10:10.268788+0000","last_peered":"2024-07-27T03:10:10.268788+0000","last_clean":"2024-07-27T03:10:10.268788+0000","last_became_active":"2024-07-27T03:10:08.062108+0000","last_became_peered":"2024-07-27T03:10:08.062108+0000","last_unstale":"2024-07-27T03:10:10.268788+0000","last_undegraded":"2024-07-27T03:10:10.268788+0000","last_fullsized":"2024-07-27T03:10:10.268788+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:06:18.614252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268883+0000","last_change":"2024-07-27T03:10:09.073412+0000","last_active":"2024-07-27T03:10:10.268883+0000","last_peered":"2024-07-27T03:10:10.268883+0000","last_clean":"2024-07-27T03:10:10.268883+0000","last_became_active":"2024-07-27T03:10:09.073115+0000","last_became_peered":"2024-07-27T03:10:09.073115+0000","last_unstale":"2024-07-27T03:10:10.268883+0000","last_undegraded":"2024-07-27T03:10:10.268883+0000","last_fullsized":"2024-07-27T03:10:10.268883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:57:09.812686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269442+0000","last_change":"2024-07-27T03:10:08.051365+0000","last_active":"2024-07-27T03:10:10.269442+0000","last_peered":"2024-07-27T03:10:10.269442+0000","last_clean":"2024-07-27T03:10:10.269442+0000","last_became_active":"2024-07-27T03:10:08.051023+0000","last_became_peered":"2024-07-27T03:10:08.051023+0000","last_unstale":"2024-07-27T03:10:10.269442+0000","last_undegraded":"2024-07-27T03:10:10.269442+0000","last_fullsized":"2024-07-27T03:10:10.269442+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:24:51.679234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.064167+0000","last_change":"2024-07-27T03:10:09.077457+0000","last_active":"2024-07-27T03:10:10.064167+0000","last_peered":"2024-07-27T03:10:10.064167+0000","last_clean":"2024-07-27T03:10:10.064167+0000","last_became_active":"2024-07-27T03:10:09.077158+0000","last_became_peered":"2024-07-27T03:10:09.077158+0000","last_unstale":"2024-07-27T03:10:10.064167+0000","last_undegraded":"2024-07-27T03:10:10.064167+0000","last_fullsized":"2024-07-27T03:10:10.064167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:12:11.298424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074505+0000","last_change":"2024-07-27T03:10:08.053873+0000","last_active":"2024-07-27T03:10:10.074505+0000","last_peered":"2024-07-27T03:10:10.074505+0000","last_clean":"2024-07-27T03:10:10.074505+0000","last_became_active":"2024-07-27T03:10:08.053435+0000","last_became_peered":"2024-07-27T03:10:08.053435+0000","last_unstale":"2024-07-27T03:10:10.074505+0000","last_undegraded":"2024-07-27T03:10:10.074505+0000","last_fullsized":"2024-07-27T03:10:10.074505+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:44:50.112900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268511+0000","last_change":"2024-07-27T03:10:09.074407+0000","last_active":"2024-07-27T03:10:10.268511+0000","last_peered":"2024-07-27T03:10:10.268511+0000","last_clean":"2024-07-27T03:10:10.268511+0000","last_became_active":"2024-07-27T03:10:09.074180+0000","last_became_peered":"2024-07-27T03:10:09.074180+0000","last_unstale":"2024-07-27T03:10:10.268511+0000","last_undegraded":"2024-07-27T03:10:10.268511+0000","last_fullsized":"2024-07-27T03:10:10.268511+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:11:49.293852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063664+0000","last_change":"2024-07-27T03:10:08.053558+0000","last_active":"2024-07-27T03:10:10.063664+0000","last_peered":"2024-07-27T03:10:10.063664+0000","last_clean":"2024-07-27T03:10:10.063664+0000","last_became_active":"2024-07-27T03:10:08.053048+0000","last_became_peered":"2024-07-27T03:10:08.053048+0000","last_unstale":"2024-07-27T03:10:10.063664+0000","last_undegraded":"2024-07-27T03:10:10.063664+0000","last_fullsized":"2024-07-27T03:10:10.063664+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:07:19.938603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268065+0000","last_change":"2024-07-27T03:10:09.081832+0000","last_active":"2024-07-27T03:10:10.268065+0000","last_peered":"2024-07-27T03:10:10.268065+0000","last_clean":"2024-07-27T03:10:10.268065+0000","last_became_active":"2024-07-27T03:10:09.081491+0000","last_became_peered":"2024-07-27T03:10:09.081491+0000","last_unstale":"2024-07-27T03:10:10.268065+0000","last_undegraded":"2024-07-27T03:10:10.268065+0000","last_fullsized":"2024-07-27T03:10:10.268065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:04:52.875974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062992+0000","last_change":"2024-07-27T03:10:08.056579+0000","last_active":"2024-07-27T03:10:10.062992+0000","last_peered":"2024-07-27T03:10:10.062992+0000","last_clean":"2024-07-27T03:10:10.062992+0000","last_became_active":"2024-07-27T03:10:08.056287+0000","last_became_peered":"2024-07-27T03:10:08.056287+0000","last_unstale":"2024-07-27T03:10:10.062992+0000","last_undegraded":"2024-07-27T03:10:10.062992+0000","last_fullsized":"2024-07-27T03:10:10.062992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:03:41.401965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268862+0000","last_change":"2024-07-27T03:10:09.078165+0000","last_active":"2024-07-27T03:10:10.268862+0000","last_peered":"2024-07-27T03:10:10.268862+0000","last_clean":"2024-07-27T03:10:10.268862+0000","last_became_active":"2024-07-27T03:10:09.077042+0000","last_became_peered":"2024-07-27T03:10:09.077042+0000","last_unstale":"2024-07-27T03:10:10.268862+0000","last_undegraded":"2024-07-27T03:10:10.268862+0000","last_fullsized":"2024-07-27T03:10:10.268862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:15:36.952540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268144+0000","last_change":"2024-07-27T03:10:08.059489+0000","last_active":"2024-07-27T03:10:10.268144+0000","last_peered":"2024-07-27T03:10:10.268144+0000","last_clean":"2024-07-27T03:10:10.268144+0000","last_became_active":"2024-07-27T03:10:08.059189+0000","last_became_peered":"2024-07-27T03:10:08.059189+0000","last_unstale":"2024-07-27T03:10:10.268144+0000","last_undegraded":"2024-07-27T03:10:10.268144+0000","last_fullsized":"2024-07-27T03:10:10.268144+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:26.175110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063630+0000","last_change":"2024-07-27T03:10:09.069482+0000","last_active":"2024-07-27T03:10:10.063630+0000","last_peered":"2024-07-27T03:10:10.063630+0000","last_clean":"2024-07-27T03:10:10.063630+0000","last_became_active":"2024-07-27T03:10:09.069171+0000","last_became_peered":"2024-07-27T03:10:09.069171+0000","last_unstale":"2024-07-27T03:10:10.063630+0000","last_undegraded":"2024-07-27T03:10:10.063630+0000","last_fullsized":"2024-07-27T03:10:10.063630+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:11:21.581936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063398+0000","last_change":"2024-07-27T03:10:08.057942+0000","last_active":"2024-07-27T03:10:10.063398+0000","last_peered":"2024-07-27T03:10:10.063398+0000","last_clean":"2024-07-27T03:10:10.063398+0000","last_became_active":"2024-07-27T03:10:08.057613+0000","last_became_peered":"2024-07-27T03:10:08.057613+0000","last_unstale":"2024-07-27T03:10:10.063398+0000","last_undegraded":"2024-07-27T03:10:10.063398+0000","last_fullsized":"2024-07-27T03:10:10.063398+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:16:56.016010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.270093+0000","last_change":"2024-07-27T03:10:09.073368+0000","last_active":"2024-07-27T03:10:10.270093+0000","last_peered":"2024-07-27T03:10:10.270093+0000","last_clean":"2024-07-27T03:10:10.270093+0000","last_became_active":"2024-07-27T03:10:09.073025+0000","last_became_peered":"2024-07-27T03:10:09.073025+0000","last_unstale":"2024-07-27T03:10:10.270093+0000","last_undegraded":"2024-07-27T03:10:10.270093+0000","last_fullsized":"2024-07-27T03:10:10.270093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:55:49.958867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269077+0000","last_change":"2024-07-27T03:10:08.058799+0000","last_active":"2024-07-27T03:10:10.269077+0000","last_peered":"2024-07-27T03:10:10.269077+0000","last_clean":"2024-07-27T03:10:10.269077+0000","last_became_active":"2024-07-27T03:10:08.058488+0000","last_became_peered":"2024-07-27T03:10:08.058488+0000","last_unstale":"2024-07-27T03:10:10.269077+0000","last_undegraded":"2024-07-27T03:10:10.269077+0000","last_fullsized":"2024-07-27T03:10:10.269077+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:15:32.151502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074576+0000","last_change":"2024-07-27T03:10:09.080279+0000","last_active":"2024-07-27T03:10:10.074576+0000","last_peered":"2024-07-27T03:10:10.074576+0000","last_clean":"2024-07-27T03:10:10.074576+0000","last_became_active":"2024-07-27T03:10:09.079881+0000","last_became_peered":"2024-07-27T03:10:09.079881+0000","last_unstale":"2024-07-27T03:10:10.074576+0000","last_undegraded":"2024-07-27T03:10:10.074576+0000","last_fullsized":"2024-07-27T03:10:10.074576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:39:28.425091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269871+0000","last_change":"2024-07-27T03:10:08.055592+0000","last_active":"2024-07-27T03:10:10.269871+0000","last_peered":"2024-07-27T03:10:10.269871+0000","last_clean":"2024-07-27T03:10:10.269871+0000","last_became_active":"2024-07-27T03:10:08.054236+0000","last_became_peered":"2024-07-27T03:10:08.054236+0000","last_unstale":"2024-07-27T03:10:10.269871+0000","last_undegraded":"2024-07-27T03:10:10.269871+0000","last_fullsized":"2024-07-27T03:10:10.269871+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:53:35.599348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269709+0000","last_change":"2024-07-27T03:10:09.080262+0000","last_active":"2024-07-27T03:10:10.269709+0000","last_peered":"2024-07-27T03:10:10.269709+0000","last_clean":"2024-07-27T03:10:10.269709+0000","last_became_active":"2024-07-27T03:10:09.079953+0000","last_became_peered":"2024-07-27T03:10:09.079953+0000","last_unstale":"2024-07-27T03:10:10.269709+0000","last_undegraded":"2024-07-27T03:10:10.269709+0000","last_fullsized":"2024-07-27T03:10:10.269709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:32:55.036511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062307+0000","last_change":"2024-07-27T03:10:08.061069+0000","last_active":"2024-07-27T03:10:10.062307+0000","last_peered":"2024-07-27T03:10:10.062307+0000","last_clean":"2024-07-27T03:10:10.062307+0000","last_became_active":"2024-07-27T03:10:08.060741+0000","last_became_peered":"2024-07-27T03:10:08.060741+0000","last_unstale":"2024-07-27T03:10:10.062307+0000","last_undegraded":"2024-07-27T03:10:10.062307+0000","last_fullsized":"2024-07-27T03:10:10.062307+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:00:34.352608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269773+0000","last_change":"2024-07-27T03:10:09.074670+0000","last_active":"2024-07-27T03:10:10.269773+0000","last_peered":"2024-07-27T03:10:10.269773+0000","last_clean":"2024-07-27T03:10:10.269773+0000","last_became_active":"2024-07-27T03:10:09.074337+0000","last_became_peered":"2024-07-27T03:10:09.074337+0000","last_unstale":"2024-07-27T03:10:10.269773+0000","last_undegraded":"2024-07-27T03:10:10.269773+0000","last_fullsized":"2024-07-27T03:10:10.269773+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:06:49.863301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074511+0000","last_change":"2024-07-27T03:10:08.059186+0000","last_active":"2024-07-27T03:10:10.074511+0000","last_peered":"2024-07-27T03:10:10.074511+0000","last_clean":"2024-07-27T03:10:10.074511+0000","last_became_active":"2024-07-27T03:10:08.058906+0000","last_became_peered":"2024-07-27T03:10:08.058906+0000","last_unstale":"2024-07-27T03:10:10.074511+0000","last_undegraded":"2024-07-27T03:10:10.074511+0000","last_fullsized":"2024-07-27T03:10:10.074511+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:27:55.300365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268718+0000","last_change":"2024-07-27T03:10:09.069088+0000","last_active":"2024-07-27T03:10:10.268718+0000","last_peered":"2024-07-27T03:10:10.268718+0000","last_clean":"2024-07-27T03:10:10.268718+0000","last_became_active":"2024-07-27T03:10:09.068808+0000","last_became_peered":"2024-07-27T03:10:09.068808+0000","last_unstale":"2024-07-27T03:10:10.268718+0000","last_undegraded":"2024-07-27T03:10:10.268718+0000","last_fullsized":"2024-07-27T03:10:10.268718+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:26:33.849063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269327+0000","last_change":"2024-07-27T03:10:08.056502+0000","last_active":"2024-07-27T03:10:10.269327+0000","last_peered":"2024-07-27T03:10:10.269327+0000","last_clean":"2024-07-27T03:10:10.269327+0000","last_became_active":"2024-07-27T03:10:08.056132+0000","last_became_peered":"2024-07-27T03:10:08.056132+0000","last_unstale":"2024-07-27T03:10:10.269327+0000","last_undegraded":"2024-07-27T03:10:10.269327+0000","last_fullsized":"2024-07-27T03:10:10.269327+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:04:51.869207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074131+0000","last_change":"2024-07-27T03:10:09.071518+0000","last_active":"2024-07-27T03:10:10.074131+0000","last_peered":"2024-07-27T03:10:10.074131+0000","last_clean":"2024-07-27T03:10:10.074131+0000","last_became_active":"2024-07-27T03:10:09.071233+0000","last_became_peered":"2024-07-27T03:10:09.071233+0000","last_unstale":"2024-07-27T03:10:10.074131+0000","last_undegraded":"2024-07-27T03:10:10.074131+0000","last_fullsized":"2024-07-27T03:10:10.074131+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:57:39.756834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074290+0000","last_change":"2024-07-27T03:10:08.060288+0000","last_active":"2024-07-27T03:10:10.074290+0000","last_peered":"2024-07-27T03:10:10.074290+0000","last_clean":"2024-07-27T03:10:10.074290+0000","last_became_active":"2024-07-27T03:10:08.059433+0000","last_became_peered":"2024-07-27T03:10:08.059433+0000","last_unstale":"2024-07-27T03:10:10.074290+0000","last_undegraded":"2024-07-27T03:10:10.074290+0000","last_fullsized":"2024-07-27T03:10:10.074290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:02:45.555740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.270060+0000","last_change":"2024-07-27T03:10:09.079168+0000","last_active":"2024-07-27T03:10:10.270060+0000","last_peered":"2024-07-27T03:10:10.270060+0000","last_clean":"2024-07-27T03:10:10.270060+0000","last_became_active":"2024-07-27T03:10:09.078259+0000","last_became_peered":"2024-07-27T03:10:09.078259+0000","last_unstale":"2024-07-27T03:10:10.270060+0000","last_undegraded":"2024-07-27T03:10:10.270060+0000","last_fullsized":"2024-07-27T03:10:10.270060+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:16:39.564178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268194+0000","last_change":"2024-07-27T03:10:08.061580+0000","last_active":"2024-07-27T03:10:10.268194+0000","last_peered":"2024-07-27T03:10:10.268194+0000","last_clean":"2024-07-27T03:10:10.268194+0000","last_became_active":"2024-07-27T03:10:08.061085+0000","last_became_peered":"2024-07-27T03:10:08.061085+0000","last_unstale":"2024-07-27T03:10:10.268194+0000","last_undegraded":"2024-07-27T03:10:10.268194+0000","last_fullsized":"2024-07-27T03:10:10.268194+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:58.867061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062090+0000","last_change":"2024-07-27T03:10:09.082734+0000","last_active":"2024-07-27T03:10:10.062090+0000","last_peered":"2024-07-27T03:10:10.062090+0000","last_clean":"2024-07-27T03:10:10.062090+0000","last_became_active":"2024-07-27T03:10:09.082398+0000","last_became_peered":"2024-07-27T03:10:09.082398+0000","last_unstale":"2024-07-27T03:10:10.062090+0000","last_undegraded":"2024-07-27T03:10:10.062090+0000","last_fullsized":"2024-07-27T03:10:10.062090+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:15:33.158269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.061941+0000","last_change":"2024-07-27T03:10:08.057979+0000","last_active":"2024-07-27T03:10:10.061941+0000","last_peered":"2024-07-27T03:10:10.061941+0000","last_clean":"2024-07-27T03:10:10.061941+0000","last_became_active":"2024-07-27T03:10:08.057612+0000","last_became_peered":"2024-07-27T03:10:08.057612+0000","last_unstale":"2024-07-27T03:10:10.061941+0000","last_undegraded":"2024-07-27T03:10:10.061941+0000","last_fullsized":"2024-07-27T03:10:10.061941+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:45:28.711632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269166+0000","last_change":"2024-07-27T03:10:09.070486+0000","last_active":"2024-07-27T03:10:10.269166+0000","last_peered":"2024-07-27T03:10:10.269166+0000","last_clean":"2024-07-27T03:10:10.269166+0000","last_became_active":"2024-07-27T03:10:09.070206+0000","last_became_peered":"2024-07-27T03:10:09.070206+0000","last_unstale":"2024-07-27T03:10:10.269166+0000","last_undegraded":"2024-07-27T03:10:10.269166+0000","last_fullsized":"2024-07-27T03:10:10.269166+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:48:46.873968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063715+0000","last_change":"2024-07-27T03:10:08.061075+0000","last_active":"2024-07-27T03:10:10.063715+0000","last_peered":"2024-07-27T03:10:10.063715+0000","last_clean":"2024-07-27T03:10:10.063715+0000","last_became_active":"2024-07-27T03:10:08.060656+0000","last_became_peered":"2024-07-27T03:10:08.060656+0000","last_unstale":"2024-07-27T03:10:10.063715+0000","last_undegraded":"2024-07-27T03:10:10.063715+0000","last_fullsized":"2024-07-27T03:10:10.063715+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:15:35.945773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269328+0000","last_change":"2024-07-27T03:10:09.072384+0000","last_active":"2024-07-27T03:10:10.269328+0000","last_peered":"2024-07-27T03:10:10.269328+0000","last_clean":"2024-07-27T03:10:10.269328+0000","last_became_active":"2024-07-27T03:10:09.071935+0000","last_became_peered":"2024-07-27T03:10:09.071935+0000","last_unstale":"2024-07-27T03:10:10.269328+0000","last_undegraded":"2024-07-27T03:10:10.269328+0000","last_fullsized":"2024-07-27T03:10:10.269328+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:52:50.889663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063143+0000","last_change":"2024-07-27T03:10:08.063876+0000","last_active":"2024-07-27T03:10:10.063143+0000","last_peered":"2024-07-27T03:10:10.063143+0000","last_clean":"2024-07-27T03:10:10.063143+0000","last_became_active":"2024-07-27T03:10:08.063533+0000","last_became_peered":"2024-07-27T03:10:08.063533+0000","last_unstale":"2024-07-27T03:10:10.063143+0000","last_undegraded":"2024-07-27T03:10:10.063143+0000","last_fullsized":"2024-07-27T03:10:10.063143+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:03:08.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269492+0000","last_change":"2024-07-27T03:10:09.081301+0000","last_active":"2024-07-27T03:10:10.269492+0000","last_peered":"2024-07-27T03:10:10.269492+0000","last_clean":"2024-07-27T03:10:10.269492+0000","last_became_active":"2024-07-27T03:10:09.080771+0000","last_became_peered":"2024-07-27T03:10:09.080771+0000","last_unstale":"2024-07-27T03:10:10.269492+0000","last_undegraded":"2024-07-27T03:10:10.269492+0000","last_fullsized":"2024-07-27T03:10:10.269492+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:43:11.921367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074588+0000","last_change":"2024-07-27T03:10:08.057169+0000","last_active":"2024-07-27T03:10:10.074588+0000","last_peered":"2024-07-27T03:10:10.074588+0000","last_clean":"2024-07-27T03:10:10.074588+0000","last_became_active":"2024-07-27T03:10:08.056850+0000","last_became_peered":"2024-07-27T03:10:08.056850+0000","last_unstale":"2024-07-27T03:10:10.074588+0000","last_undegraded":"2024-07-27T03:10:10.074588+0000","last_fullsized":"2024-07-27T03:10:10.074588+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:09:41.137312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074233+0000","last_change":"2024-07-27T03:10:09.080183+0000","last_active":"2024-07-27T03:10:10.074233+0000","last_peered":"2024-07-27T03:10:10.074233+0000","last_clean":"2024-07-27T03:10:10.074233+0000","last_became_active":"2024-07-27T03:10:09.079863+0000","last_became_peered":"2024-07-27T03:10:09.079863+0000","last_unstale":"2024-07-27T03:10:10.074233+0000","last_undegraded":"2024-07-27T03:10:10.074233+0000","last_fullsized":"2024-07-27T03:10:10.074233+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:20.060583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074639+0000","last_change":"2024-07-27T03:10:08.054887+0000","last_active":"2024-07-27T03:10:10.074639+0000","last_peered":"2024-07-27T03:10:10.074639+0000","last_clean":"2024-07-27T03:10:10.074639+0000","last_became_active":"2024-07-27T03:10:08.054547+0000","last_became_peered":"2024-07-27T03:10:08.054547+0000","last_unstale":"2024-07-27T03:10:10.074639+0000","last_undegraded":"2024-07-27T03:10:10.074639+0000","last_fullsized":"2024-07-27T03:10:10.074639+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:43:12.149689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268398+0000","last_change":"2024-07-27T03:10:09.065007+0000","last_active":"2024-07-27T03:10:10.268398+0000","last_peered":"2024-07-27T03:10:10.268398+0000","last_clean":"2024-07-27T03:10:10.268398+0000","last_became_active":"2024-07-27T03:10:09.064722+0000","last_became_peered":"2024-07-27T03:10:09.064722+0000","last_unstale":"2024-07-27T03:10:10.268398+0000","last_undegraded":"2024-07-27T03:10:10.268398+0000","last_fullsized":"2024-07-27T03:10:10.268398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:33:02.588360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062845+0000","last_change":"2024-07-27T03:10:08.061634+0000","last_active":"2024-07-27T03:10:10.062845+0000","last_peered":"2024-07-27T03:10:10.062845+0000","last_clean":"2024-07-27T03:10:10.062845+0000","last_became_active":"2024-07-27T03:10:08.061239+0000","last_became_peered":"2024-07-27T03:10:08.061239+0000","last_unstale":"2024-07-27T03:10:10.062845+0000","last_undegraded":"2024-07-27T03:10:10.062845+0000","last_fullsized":"2024-07-27T03:10:10.062845+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:49:29.997187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.061991+0000","last_change":"2024-07-27T03:10:09.077563+0000","last_active":"2024-07-27T03:10:10.061991+0000","last_peered":"2024-07-27T03:10:10.061991+0000","last_clean":"2024-07-27T03:10:10.061991+0000","last_became_active":"2024-07-27T03:10:09.077284+0000","last_became_peered":"2024-07-27T03:10:09.077284+0000","last_unstale":"2024-07-27T03:10:10.061991+0000","last_undegraded":"2024-07-27T03:10:10.061991+0000","last_fullsized":"2024-07-27T03:10:10.061991+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:41:38.621082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268315+0000","last_change":"2024-07-27T03:10:08.058770+0000","last_active":"2024-07-27T03:10:10.268315+0000","last_peered":"2024-07-27T03:10:10.268315+0000","last_clean":"2024-07-27T03:10:10.268315+0000","last_became_active":"2024-07-27T03:10:08.058426+0000","last_became_peered":"2024-07-27T03:10:08.058426+0000","last_unstale":"2024-07-27T03:10:10.268315+0000","last_undegraded":"2024-07-27T03:10:10.268315+0000","last_fullsized":"2024-07-27T03:10:10.268315+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:41:04.021449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268059+0000","last_change":"2024-07-27T03:10:09.077519+0000","last_active":"2024-07-27T03:10:10.268059+0000","last_peered":"2024-07-27T03:10:10.268059+0000","last_clean":"2024-07-27T03:10:10.268059+0000","last_became_active":"2024-07-27T03:10:09.077215+0000","last_became_peered":"2024-07-27T03:10:09.077215+0000","last_unstale":"2024-07-27T03:10:10.268059+0000","last_undegraded":"2024-07-27T03:10:10.268059+0000","last_fullsized":"2024-07-27T03:10:10.268059+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:53:36.606115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268991+0000","last_change":"2024-07-27T03:10:08.061434+0000","last_active":"2024-07-27T03:10:10.268991+0000","last_peered":"2024-07-27T03:10:10.268991+0000","last_clean":"2024-07-27T03:10:10.268991+0000","last_became_active":"2024-07-27T03:10:08.061012+0000","last_became_peered":"2024-07-27T03:10:08.061012+0000","last_unstale":"2024-07-27T03:10:10.268991+0000","last_undegraded":"2024-07-27T03:10:10.268991+0000","last_fullsized":"2024-07-27T03:10:10.268991+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:03:08.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.270135+0000","last_change":"2024-07-27T03:10:09.076099+0000","last_active":"2024-07-27T03:10:10.270135+0000","last_peered":"2024-07-27T03:10:10.270135+0000","last_clean":"2024-07-27T03:10:10.270135+0000","last_became_active":"2024-07-27T03:10:09.075402+0000","last_became_peered":"2024-07-27T03:10:09.075402+0000","last_unstale":"2024-07-27T03:10:10.270135+0000","last_undegraded":"2024-07-27T03:10:10.270135+0000","last_fullsized":"2024-07-27T03:10:10.270135+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:05.293014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074717+0000","last_change":"2024-07-27T03:10:08.052094+0000","last_active":"2024-07-27T03:10:10.074717+0000","last_peered":"2024-07-27T03:10:10.074717+0000","last_clean":"2024-07-27T03:10:10.074717+0000","last_became_active":"2024-07-27T03:10:08.051179+0000","last_became_peered":"2024-07-27T03:10:08.051179+0000","last_unstale":"2024-07-27T03:10:10.074717+0000","last_undegraded":"2024-07-27T03:10:10.074717+0000","last_fullsized":"2024-07-27T03:10:10.074717+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:12:10.291656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268608+0000","last_change":"2024-07-27T03:10:09.071969+0000","last_active":"2024-07-27T03:10:10.268608+0000","last_peered":"2024-07-27T03:10:10.268608+0000","last_clean":"2024-07-27T03:10:10.268608+0000","last_became_active":"2024-07-27T03:10:09.071688+0000","last_became_peered":"2024-07-27T03:10:09.071688+0000","last_unstale":"2024-07-27T03:10:10.268608+0000","last_undegraded":"2024-07-27T03:10:10.268608+0000","last_fullsized":"2024-07-27T03:10:10.268608+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:57:37.863112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.270010+0000","last_change":"2024-07-27T03:10:08.055310+0000","last_active":"2024-07-27T03:10:10.270010+0000","last_peered":"2024-07-27T03:10:10.270010+0000","last_clean":"2024-07-27T03:10:10.270010+0000","last_became_active":"2024-07-27T03:10:08.055017+0000","last_became_peered":"2024-07-27T03:10:08.055017+0000","last_unstale":"2024-07-27T03:10:10.270010+0000","last_undegraded":"2024-07-27T03:10:10.270010+0000","last_fullsized":"2024-07-27T03:10:10.270010+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:41:43.450346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269862+0000","last_change":"2024-07-27T03:10:09.077646+0000","last_active":"2024-07-27T03:10:10.269862+0000","last_peered":"2024-07-27T03:10:10.269862+0000","last_clean":"2024-07-27T03:10:10.269862+0000","last_became_active":"2024-07-27T03:10:09.077343+0000","last_became_peered":"2024-07-27T03:10:09.077343+0000","last_unstale":"2024-07-27T03:10:10.269862+0000","last_undegraded":"2024-07-27T03:10:10.269862+0000","last_fullsized":"2024-07-27T03:10:10.269862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:48:46.873968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268482+0000","last_change":"2024-07-27T03:10:08.061409+0000","last_active":"2024-07-27T03:10:10.268482+0000","last_peered":"2024-07-27T03:10:10.268482+0000","last_clean":"2024-07-27T03:10:10.268482+0000","last_became_active":"2024-07-27T03:10:08.061106+0000","last_became_peered":"2024-07-27T03:10:08.061106+0000","last_unstale":"2024-07-27T03:10:10.268482+0000","last_undegraded":"2024-07-27T03:10:10.268482+0000","last_fullsized":"2024-07-27T03:10:10.268482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:38:23.307210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074387+0000","last_change":"2024-07-27T03:10:09.074528+0000","last_active":"2024-07-27T03:10:10.074387+0000","last_peered":"2024-07-27T03:10:10.074387+0000","last_clean":"2024-07-27T03:10:10.074387+0000","last_became_active":"2024-07-27T03:10:09.074224+0000","last_became_peered":"2024-07-27T03:10:09.074224+0000","last_unstale":"2024-07-27T03:10:10.074387+0000","last_undegraded":"2024-07-27T03:10:10.074387+0000","last_fullsized":"2024-07-27T03:10:10.074387+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:22:14.612591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269495+0000","last_change":"2024-07-27T03:10:08.055344+0000","last_active":"2024-07-27T03:10:10.269495+0000","last_peered":"2024-07-27T03:10:10.269495+0000","last_clean":"2024-07-27T03:10:10.269495+0000","last_became_active":"2024-07-27T03:10:08.054304+0000","last_became_peered":"2024-07-27T03:10:08.054304+0000","last_unstale":"2024-07-27T03:10:10.269495+0000","last_undegraded":"2024-07-27T03:10:10.269495+0000","last_fullsized":"2024-07-27T03:10:10.269495+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:24:05.695647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074393+0000","last_change":"2024-07-27T03:10:09.080739+0000","last_active":"2024-07-27T03:10:10.074393+0000","last_peered":"2024-07-27T03:10:10.074393+0000","last_clean":"2024-07-27T03:10:10.074393+0000","last_became_active":"2024-07-27T03:10:09.080362+0000","last_became_peered":"2024-07-27T03:10:09.080362+0000","last_unstale":"2024-07-27T03:10:10.074393+0000","last_undegraded":"2024-07-27T03:10:10.074393+0000","last_fullsized":"2024-07-27T03:10:10.074393+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:37:04.437095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063895+0000","last_change":"2024-07-27T03:10:08.051755+0000","last_active":"2024-07-27T03:10:10.063895+0000","last_peered":"2024-07-27T03:10:10.063895+0000","last_clean":"2024-07-27T03:10:10.063895+0000","last_became_active":"2024-07-27T03:10:08.050784+0000","last_became_peered":"2024-07-27T03:10:08.050784+0000","last_unstale":"2024-07-27T03:10:10.063895+0000","last_undegraded":"2024-07-27T03:10:10.063895+0000","last_fullsized":"2024-07-27T03:10:10.063895+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:38:23.307210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062862+0000","last_change":"2024-07-27T03:10:09.075221+0000","last_active":"2024-07-27T03:10:10.062862+0000","last_peered":"2024-07-27T03:10:10.062862+0000","last_clean":"2024-07-27T03:10:10.062862+0000","last_became_active":"2024-07-27T03:10:09.074616+0000","last_became_peered":"2024-07-27T03:10:09.074616+0000","last_unstale":"2024-07-27T03:10:10.062862+0000","last_undegraded":"2024-07-27T03:10:10.062862+0000","last_fullsized":"2024-07-27T03:10:10.062862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:09:03.236747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268193+0000","last_change":"2024-07-27T03:10:08.064636+0000","last_active":"2024-07-27T03:10:10.268193+0000","last_peered":"2024-07-27T03:10:10.268193+0000","last_clean":"2024-07-27T03:10:10.268193+0000","last_became_active":"2024-07-27T03:10:08.064310+0000","last_became_peered":"2024-07-27T03:10:08.064310+0000","last_unstale":"2024-07-27T03:10:10.268193+0000","last_undegraded":"2024-07-27T03:10:10.268193+0000","last_fullsized":"2024-07-27T03:10:10.268193+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:27:18.932485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063277+0000","last_change":"2024-07-27T03:10:09.071133+0000","last_active":"2024-07-27T03:10:10.063277+0000","last_peered":"2024-07-27T03:10:10.063277+0000","last_clean":"2024-07-27T03:10:10.063277+0000","last_became_active":"2024-07-27T03:10:09.070652+0000","last_became_peered":"2024-07-27T03:10:09.070652+0000","last_unstale":"2024-07-27T03:10:10.063277+0000","last_undegraded":"2024-07-27T03:10:10.063277+0000","last_fullsized":"2024-07-27T03:10:10.063277+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:26.833973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268251+0000","last_change":"2024-07-27T03:10:08.061822+0000","last_active":"2024-07-27T03:10:10.268251+0000","last_peered":"2024-07-27T03:10:10.268251+0000","last_clean":"2024-07-27T03:10:10.268251+0000","last_became_active":"2024-07-27T03:10:08.061513+0000","last_became_peered":"2024-07-27T03:10:08.061513+0000","last_unstale":"2024-07-27T03:10:10.268251+0000","last_undegraded":"2024-07-27T03:10:10.268251+0000","last_fullsized":"2024-07-27T03:10:10.268251+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:54:47.622823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269037+0000","last_change":"2024-07-27T03:10:09.069158+0000","last_active":"2024-07-27T03:10:10.269037+0000","last_peered":"2024-07-27T03:10:10.269037+0000","last_clean":"2024-07-27T03:10:10.269037+0000","last_became_active":"2024-07-27T03:10:09.068838+0000","last_became_peered":"2024-07-27T03:10:09.068838+0000","last_unstale":"2024-07-27T03:10:10.269037+0000","last_undegraded":"2024-07-27T03:10:10.269037+0000","last_fullsized":"2024-07-27T03:10:10.269037+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:31:58.970960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063220+0000","last_change":"2024-07-27T03:10:08.053861+0000","last_active":"2024-07-27T03:10:10.063220+0000","last_peered":"2024-07-27T03:10:10.063220+0000","last_clean":"2024-07-27T03:10:10.063220+0000","last_became_active":"2024-07-27T03:10:08.053505+0000","last_became_peered":"2024-07-27T03:10:08.053505+0000","last_unstale":"2024-07-27T03:10:10.063220+0000","last_undegraded":"2024-07-27T03:10:10.063220+0000","last_fullsized":"2024-07-27T03:10:10.063220+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:24:05.695647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":150,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269170+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:10:10.269170+0000","last_peered":"2024-07-27T03:10:10.269170+0000","last_clean":"2024-07-27T03:10:10.269170+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:10:10.269170+0000","last_undegraded":"2024-07-27T03:10:10.269170+0000","last_fullsized":"2024-07-27T03:10:10.269170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":795128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":512000,"data_stored":204740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":520192,"data_stored":205308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":206304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":795072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31692,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340148,"statfs":{"total":96636764160,"available":96604311552,"internally_reserved":0,"allocated":516096,"data_stored":205342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31692,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340148,"statfs":{"total":96636764160,"available":96604311552,"internally_reserved":0,"allocated":520192,"data_stored":206282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":512000,"data_stored":204740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:10:17.599 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:10:17.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.727+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/766804225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f94003a00 msgr2=0x7f9f94003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:17.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.727+0000 7f9fb1ed2640 1 --2- 172.21.15.120:0/766804225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f94003a00 0x7f9f94003e70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009d00 tx=0x7f9f94005830 comp rx=0 tx=0).stop 2024-07-27T03:10:17.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.727+0000 7f9fb16d1640 1 -- 172.21.15.120:0/766804225 reap_dead start 2024-07-27T03:10:17.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.727+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/766804225 shutdown_connections 2024-07-27T03:10:17.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.727+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/766804225 >> 172.21.15.120:0/766804225 conn(0x7f9fac074720 msgr2=0x7f9fac09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:17.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.727+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/766804225 shutdown_connections 2024-07-27T03:10:17.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.727+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/766804225 wait complete. 2024-07-27T03:10:17.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.729+0000 7f9fb1ed2640 1 Processor -- start 2024-07-27T03:10:17.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.729+0000 7f9fb1ed2640 1 -- start start 2024-07-27T03:10:17.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fb1ed2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9f94003a00 0x7f9fac0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:17.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fb1ed2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac1519b0 0x7f9fac0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:17.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fb1ed2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fac0c67c0 0x7f9fac0c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:17.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fb1ed2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9fac160950 con 0x7f9fac1519b0 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fb1ed2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9fac1607d0 con 0x7f9fac0c67c0 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fb1ed2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9fac160ad0 con 0x7f9f94003a00 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fabfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac1519b0 0x7f9fac0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fabfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac1519b0 0x7f9fac0cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58292/0 (socket says 172.21.15.120:58292) 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fabfff640 1 -- 172.21.15.120:0/4108486780 learned_addr learned my addr 172.21.15.120:0/4108486780 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fb0ed0640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9f94003a00 0x7f9fac0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fb16d1640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fac0c67c0 0x7f9fac0c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fabfff640 1 -- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9f94003a00 msgr2=0x7f9fac0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fabfff640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9f94003a00 0x7f9fac0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fabfff640 1 -- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fac0c67c0 msgr2=0x7f9fac0c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fabfff640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fac0c67c0 0x7f9fac0c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.730+0000 7f9fabfff640 1 -- 172.21.15.120:0/4108486780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fac0cbfa0 con 0x7f9fac1519b0 2024-07-27T03:10:17.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.731+0000 7f9fabfff640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac1519b0 0x7f9fac0cf0e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00066b0 tx=0x7f9fa00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:17.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.731+0000 7f9fa97fa640 1 -- 172.21.15.120:0/4108486780 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0015070 con 0x7f9fac1519b0 2024-07-27T03:10:17.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.731+0000 7f9fa97fa640 1 -- 172.21.15.120:0/4108486780 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fa0011860 con 0x7f9fac1519b0 2024-07-27T03:10:17.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.731+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/4108486780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fac0c90d0 con 0x7f9fac1519b0 2024-07-27T03:10:17.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.731+0000 7f9fa97fa640 1 -- 172.21.15.120:0/4108486780 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0011cb0 con 0x7f9fac1519b0 2024-07-27T03:10:17.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.731+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/4108486780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fac0cb7a0 con 0x7f9fac1519b0 2024-07-27T03:10:17.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.732+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/4108486780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fac0c8e40 con 0x7f9fac1519b0 2024-07-27T03:10:17.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.732+0000 7f9fa97fa640 1 -- 172.21.15.120:0/4108486780 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9fa0018070 con 0x7f9fac1519b0 2024-07-27T03:10:17.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.733+0000 7f9fa97fa640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9f98077010 0x7f9f98079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:17.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.733+0000 7f9fa97fa640 1 -- 172.21.15.120:0/4108486780 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f9fa00994c0 con 0x7f9fac1519b0 2024-07-27T03:10:17.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.733+0000 7f9fb0ed0640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9f98077010 0x7f9f98079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:17.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.734+0000 7f9fb0ed0640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9f98077010 0x7f9f98079520 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c035000 tx=0x7f9f9c0046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:17.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.737+0000 7f9fa97fa640 1 -- 172.21.15.120:0/4108486780 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f9fa0062110 con 0x7f9fac1519b0 2024-07-27T03:10:17.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.915+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/4108486780 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9fac0d0540 con 0x7f9f98077010 2024-07-27T03:10:17.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.920+0000 7f9fa97fa640 1 -- 172.21.15.120:0/4108486780 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f9fac0d0540 con 0x7f9f98077010 2024-07-27T03:10:17.925 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:17.926 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:10:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9f98077010 msgr2=0x7f9f98079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9f98077010 0x7f9f98079520 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c035000 tx=0x7f9f9c0046c0 comp rx=0 tx=0).stop 2024-07-27T03:10:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/4108486780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac1519b0 msgr2=0x7f9fac0cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac1519b0 0x7f9fac0cf0e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00066b0 tx=0x7f9fa00039c0 comp rx=0 tx=0).stop 2024-07-27T03:10:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/4108486780 shutdown_connections 2024-07-27T03:10:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9f98077010 0x7f9f98079520 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fac1519b0 0x7f9fac0cf0e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fac0c67c0 0x7f9fac0c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 --2- 172.21.15.120:0/4108486780 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9f94003a00 0x7f9fac0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:17.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/4108486780 >> 172.21.15.120:0/4108486780 conn(0x7f9fac074720 msgr2=0x7f9fac070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:17.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/4108486780 shutdown_connections 2024-07-27T03:10:17.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:17.923+0000 7f9fb1ed2640 1 -- 172.21.15.120:0/4108486780 wait complete. 2024-07-27T03:10:17.938 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-07-27T03:10:16.556592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258832,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754715888,"statfs":{"total":773094113280,"available":772829069312,"internally_reserved":0,"allocated":5316608,"data_stored":2822916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002235"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269858+0000","last_change":"2024-07-27T03:10:09.075578+0000","last_active":"2024-07-27T03:10:10.269858+0000","last_peered":"2024-07-27T03:10:10.269858+0000","last_clean":"2024-07-27T03:10:10.269858+0000","last_became_active":"2024-07-27T03:10:09.075274+0000","last_became_peered":"2024-07-27T03:10:09.075274+0000","last_unstale":"2024-07-27T03:10:10.269858+0000","last_undegraded":"2024-07-27T03:10:10.269858+0000","last_fullsized":"2024-07-27T03:10:10.269858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:24:52.967003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063176+0000","last_change":"2024-07-27T03:10:09.069818+0000","last_active":"2024-07-27T03:10:10.063176+0000","last_peered":"2024-07-27T03:10:10.063176+0000","last_clean":"2024-07-27T03:10:10.063176+0000","last_became_active":"2024-07-27T03:10:09.069499+0000","last_became_peered":"2024-07-27T03:10:09.069499+0000","last_unstale":"2024-07-27T03:10:10.063176+0000","last_undegraded":"2024-07-27T03:10:10.063176+0000","last_fullsized":"2024-07-27T03:10:10.063176+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:42:33.014370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.064057+0000","last_change":"2024-07-27T03:10:09.068177+0000","last_active":"2024-07-27T03:10:10.064057+0000","last_peered":"2024-07-27T03:10:10.064057+0000","last_clean":"2024-07-27T03:10:10.064057+0000","last_became_active":"2024-07-27T03:10:09.067881+0000","last_became_peered":"2024-07-27T03:10:09.067881+0000","last_unstale":"2024-07-27T03:10:10.064057+0000","last_undegraded":"2024-07-27T03:10:10.064057+0000","last_fullsized":"2024-07-27T03:10:10.064057+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:44:51.119668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268794+0000","last_change":"2024-07-27T03:10:09.079136+0000","last_active":"2024-07-27T03:10:10.268794+0000","last_peered":"2024-07-27T03:10:10.268794+0000","last_clean":"2024-07-27T03:10:10.268794+0000","last_became_active":"2024-07-27T03:10:09.078837+0000","last_became_peered":"2024-07-27T03:10:09.078837+0000","last_unstale":"2024-07-27T03:10:10.268794+0000","last_undegraded":"2024-07-27T03:10:10.268794+0000","last_fullsized":"2024-07-27T03:10:10.268794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:40:33.821457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063223+0000","last_change":"2024-07-27T03:10:09.069226+0000","last_active":"2024-07-27T03:10:10.063223+0000","last_peered":"2024-07-27T03:10:10.063223+0000","last_clean":"2024-07-27T03:10:10.063223+0000","last_became_active":"2024-07-27T03:10:09.068905+0000","last_became_peered":"2024-07-27T03:10:09.068905+0000","last_unstale":"2024-07-27T03:10:10.063223+0000","last_undegraded":"2024-07-27T03:10:10.063223+0000","last_fullsized":"2024-07-27T03:10:10.063223+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:26:33.849063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074185+0000","last_change":"2024-07-27T03:10:09.071124+0000","last_active":"2024-07-27T03:10:10.074185+0000","last_peered":"2024-07-27T03:10:10.074185+0000","last_clean":"2024-07-27T03:10:10.074185+0000","last_became_active":"2024-07-27T03:10:09.070792+0000","last_became_peered":"2024-07-27T03:10:09.070792+0000","last_unstale":"2024-07-27T03:10:10.074185+0000","last_undegraded":"2024-07-27T03:10:10.074185+0000","last_fullsized":"2024-07-27T03:10:10.074185+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:58:16.371104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269829+0000","last_change":"2024-07-27T03:10:09.080302+0000","last_active":"2024-07-27T03:10:10.269829+0000","last_peered":"2024-07-27T03:10:10.269829+0000","last_clean":"2024-07-27T03:10:10.269829+0000","last_became_active":"2024-07-27T03:10:09.079967+0000","last_became_peered":"2024-07-27T03:10:09.079967+0000","last_unstale":"2024-07-27T03:10:10.269829+0000","last_undegraded":"2024-07-27T03:10:10.269829+0000","last_fullsized":"2024-07-27T03:10:10.269829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:31:58.970960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268010+0000","last_change":"2024-07-27T03:10:09.082073+0000","last_active":"2024-07-27T03:10:10.268010+0000","last_peered":"2024-07-27T03:10:10.268010+0000","last_clean":"2024-07-27T03:10:10.268010+0000","last_became_active":"2024-07-27T03:10:09.081785+0000","last_became_peered":"2024-07-27T03:10:09.081785+0000","last_unstale":"2024-07-27T03:10:10.268010+0000","last_undegraded":"2024-07-27T03:10:10.268010+0000","last_fullsized":"2024-07-27T03:10:10.268010+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:24:52.686001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269128+0000","last_change":"2024-07-27T03:10:09.066158+0000","last_active":"2024-07-27T03:10:10.269128+0000","last_peered":"2024-07-27T03:10:10.269128+0000","last_clean":"2024-07-27T03:10:10.269128+0000","last_became_active":"2024-07-27T03:10:09.065856+0000","last_became_peered":"2024-07-27T03:10:09.065856+0000","last_unstale":"2024-07-27T03:10:10.269128+0000","last_undegraded":"2024-07-27T03:10:10.269128+0000","last_fullsized":"2024-07-27T03:10:10.269128+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:24:52.967003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268965+0000","last_change":"2024-07-27T03:10:09.071639+0000","last_active":"2024-07-27T03:10:10.268965+0000","last_peered":"2024-07-27T03:10:10.268965+0000","last_clean":"2024-07-27T03:10:10.268965+0000","last_became_active":"2024-07-27T03:10:09.071368+0000","last_became_peered":"2024-07-27T03:10:09.071368+0000","last_unstale":"2024-07-27T03:10:10.268965+0000","last_undegraded":"2024-07-27T03:10:10.268965+0000","last_fullsized":"2024-07-27T03:10:10.268965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:32:55.036511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268662+0000","last_change":"2024-07-27T03:10:09.078070+0000","last_active":"2024-07-27T03:10:10.268662+0000","last_peered":"2024-07-27T03:10:10.268662+0000","last_clean":"2024-07-27T03:10:10.268662+0000","last_became_active":"2024-07-27T03:10:09.077740+0000","last_became_peered":"2024-07-27T03:10:09.077740+0000","last_unstale":"2024-07-27T03:10:10.268662+0000","last_undegraded":"2024-07-27T03:10:10.268662+0000","last_fullsized":"2024-07-27T03:10:10.268662+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:42:33.014370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063521+0000","last_change":"2024-07-27T03:10:09.073045+0000","last_active":"2024-07-27T03:10:10.063521+0000","last_peered":"2024-07-27T03:10:10.063521+0000","last_clean":"2024-07-27T03:10:10.063521+0000","last_became_active":"2024-07-27T03:10:09.072727+0000","last_became_peered":"2024-07-27T03:10:09.072727+0000","last_unstale":"2024-07-27T03:10:10.063521+0000","last_undegraded":"2024-07-27T03:10:10.063521+0000","last_fullsized":"2024-07-27T03:10:10.063521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:40:33.821457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062329+0000","last_change":"2024-07-27T03:10:09.086963+0000","last_active":"2024-07-27T03:10:10.062329+0000","last_peered":"2024-07-27T03:10:10.062329+0000","last_clean":"2024-07-27T03:10:10.062329+0000","last_became_active":"2024-07-27T03:10:09.086609+0000","last_became_peered":"2024-07-27T03:10:09.086609+0000","last_unstale":"2024-07-27T03:10:10.062329+0000","last_undegraded":"2024-07-27T03:10:10.062329+0000","last_fullsized":"2024-07-27T03:10:10.062329+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:59.873828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268491+0000","last_change":"2024-07-27T03:10:09.078483+0000","last_active":"2024-07-27T03:10:10.268491+0000","last_peered":"2024-07-27T03:10:10.268491+0000","last_clean":"2024-07-27T03:10:10.268491+0000","last_became_active":"2024-07-27T03:10:09.077420+0000","last_became_peered":"2024-07-27T03:10:09.077420+0000","last_unstale":"2024-07-27T03:10:10.268491+0000","last_undegraded":"2024-07-27T03:10:10.268491+0000","last_fullsized":"2024-07-27T03:10:10.268491+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:41:44.457113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074152+0000","last_change":"2024-07-27T03:10:09.072939+0000","last_active":"2024-07-27T03:10:10.074152+0000","last_peered":"2024-07-27T03:10:10.074152+0000","last_clean":"2024-07-27T03:10:10.074152+0000","last_became_active":"2024-07-27T03:10:09.072423+0000","last_became_peered":"2024-07-27T03:10:09.072423+0000","last_unstale":"2024-07-27T03:10:10.074152+0000","last_undegraded":"2024-07-27T03:10:10.074152+0000","last_fullsized":"2024-07-27T03:10:10.074152+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:26:16.175547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269062+0000","last_change":"2024-07-27T03:10:09.077121+0000","last_active":"2024-07-27T03:10:10.269062+0000","last_peered":"2024-07-27T03:10:10.269062+0000","last_clean":"2024-07-27T03:10:10.269062+0000","last_became_active":"2024-07-27T03:10:09.076828+0000","last_became_peered":"2024-07-27T03:10:09.076828+0000","last_unstale":"2024-07-27T03:10:10.269062+0000","last_undegraded":"2024-07-27T03:10:10.269062+0000","last_fullsized":"2024-07-27T03:10:10.269062+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:27:19.939253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063830+0000","last_change":"2024-07-27T03:10:09.069546+0000","last_active":"2024-07-27T03:10:10.063830+0000","last_peered":"2024-07-27T03:10:10.063830+0000","last_clean":"2024-07-27T03:10:10.063830+0000","last_became_active":"2024-07-27T03:10:09.069231+0000","last_became_peered":"2024-07-27T03:10:09.069231+0000","last_unstale":"2024-07-27T03:10:10.063830+0000","last_undegraded":"2024-07-27T03:10:10.063830+0000","last_fullsized":"2024-07-27T03:10:10.063830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:39:16.232930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063577+0000","last_change":"2024-07-27T03:10:09.076614+0000","last_active":"2024-07-27T03:10:10.063577+0000","last_peered":"2024-07-27T03:10:10.063577+0000","last_clean":"2024-07-27T03:10:10.063577+0000","last_became_active":"2024-07-27T03:10:09.076281+0000","last_became_peered":"2024-07-27T03:10:09.076281+0000","last_unstale":"2024-07-27T03:10:10.063577+0000","last_undegraded":"2024-07-27T03:10:10.063577+0000","last_fullsized":"2024-07-27T03:10:10.063577+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:36:52.893665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269872+0000","last_change":"2024-07-27T03:10:09.075707+0000","last_active":"2024-07-27T03:10:10.269872+0000","last_peered":"2024-07-27T03:10:10.269872+0000","last_clean":"2024-07-27T03:10:10.269872+0000","last_became_active":"2024-07-27T03:10:09.075246+0000","last_became_peered":"2024-07-27T03:10:09.075246+0000","last_unstale":"2024-07-27T03:10:10.269872+0000","last_undegraded":"2024-07-27T03:10:10.269872+0000","last_fullsized":"2024-07-27T03:10:10.269872+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:33:02.588360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062183+0000","last_change":"2024-07-27T03:10:09.074790+0000","last_active":"2024-07-27T03:10:10.062183+0000","last_peered":"2024-07-27T03:10:10.062183+0000","last_clean":"2024-07-27T03:10:10.062183+0000","last_became_active":"2024-07-27T03:10:09.074489+0000","last_became_peered":"2024-07-27T03:10:09.074489+0000","last_unstale":"2024-07-27T03:10:10.062183+0000","last_undegraded":"2024-07-27T03:10:10.062183+0000","last_fullsized":"2024-07-27T03:10:10.062183+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:27.181877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074363+0000","last_change":"2024-07-27T03:10:09.074392+0000","last_active":"2024-07-27T03:10:10.074363+0000","last_peered":"2024-07-27T03:10:10.074363+0000","last_clean":"2024-07-27T03:10:10.074363+0000","last_became_active":"2024-07-27T03:10:09.074107+0000","last_became_peered":"2024-07-27T03:10:09.074107+0000","last_unstale":"2024-07-27T03:10:10.074363+0000","last_undegraded":"2024-07-27T03:10:10.074363+0000","last_fullsized":"2024-07-27T03:10:10.074363+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:52:26.648777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268665+0000","last_change":"2024-07-27T03:10:09.077898+0000","last_active":"2024-07-27T03:10:10.268665+0000","last_peered":"2024-07-27T03:10:10.268665+0000","last_clean":"2024-07-27T03:10:10.268665+0000","last_became_active":"2024-07-27T03:10:09.077021+0000","last_became_peered":"2024-07-27T03:10:09.077021+0000","last_unstale":"2024-07-27T03:10:10.268665+0000","last_undegraded":"2024-07-27T03:10:10.268665+0000","last_fullsized":"2024-07-27T03:10:10.268665+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:09:03.236747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269741+0000","last_change":"2024-07-27T03:10:09.078175+0000","last_active":"2024-07-27T03:10:10.269741+0000","last_peered":"2024-07-27T03:10:10.269741+0000","last_clean":"2024-07-27T03:10:10.269741+0000","last_became_active":"2024-07-27T03:10:09.077829+0000","last_became_peered":"2024-07-27T03:10:09.077829+0000","last_unstale":"2024-07-27T03:10:10.269741+0000","last_undegraded":"2024-07-27T03:10:10.269741+0000","last_fullsized":"2024-07-27T03:10:10.269741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:04:18.314025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268922+0000","last_change":"2024-07-27T03:10:09.071459+0000","last_active":"2024-07-27T03:10:10.268922+0000","last_peered":"2024-07-27T03:10:10.268922+0000","last_clean":"2024-07-27T03:10:10.268922+0000","last_became_active":"2024-07-27T03:10:09.071133+0000","last_became_peered":"2024-07-27T03:10:09.071133+0000","last_unstale":"2024-07-27T03:10:10.268922+0000","last_undegraded":"2024-07-27T03:10:10.268922+0000","last_fullsized":"2024-07-27T03:10:10.268922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:38:24.313977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269935+0000","last_change":"2024-07-27T03:10:09.081144+0000","last_active":"2024-07-27T03:10:10.269935+0000","last_peered":"2024-07-27T03:10:10.269935+0000","last_clean":"2024-07-27T03:10:10.269935+0000","last_became_active":"2024-07-27T03:10:09.080638+0000","last_became_peered":"2024-07-27T03:10:09.080638+0000","last_unstale":"2024-07-27T03:10:10.269935+0000","last_undegraded":"2024-07-27T03:10:10.269935+0000","last_fullsized":"2024-07-27T03:10:10.269935+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:57:09.812686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062100+0000","last_change":"2024-07-27T03:10:09.085552+0000","last_active":"2024-07-27T03:10:10.062100+0000","last_peered":"2024-07-27T03:10:10.062100+0000","last_clean":"2024-07-27T03:10:10.062100+0000","last_became_active":"2024-07-27T03:10:09.085158+0000","last_became_peered":"2024-07-27T03:10:09.085158+0000","last_unstale":"2024-07-27T03:10:10.062100+0000","last_undegraded":"2024-07-27T03:10:10.062100+0000","last_fullsized":"2024-07-27T03:10:10.062100+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:00:30.058473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.064021+0000","last_change":"2024-07-27T03:10:09.067477+0000","last_active":"2024-07-27T03:10:10.064021+0000","last_peered":"2024-07-27T03:10:10.064021+0000","last_clean":"2024-07-27T03:10:10.064021+0000","last_became_active":"2024-07-27T03:10:09.067121+0000","last_became_peered":"2024-07-27T03:10:09.067121+0000","last_unstale":"2024-07-27T03:10:10.064021+0000","last_undegraded":"2024-07-27T03:10:10.064021+0000","last_fullsized":"2024-07-27T03:10:10.064021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:36:41.934134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063684+0000","last_change":"2024-07-27T03:10:09.072273+0000","last_active":"2024-07-27T03:10:10.063684+0000","last_peered":"2024-07-27T03:10:10.063684+0000","last_clean":"2024-07-27T03:10:10.063684+0000","last_became_active":"2024-07-27T03:10:09.071903+0000","last_became_peered":"2024-07-27T03:10:09.071903+0000","last_unstale":"2024-07-27T03:10:10.063684+0000","last_undegraded":"2024-07-27T03:10:10.063684+0000","last_fullsized":"2024-07-27T03:10:10.063684+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:32:55.036511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269218+0000","last_change":"2024-07-27T03:10:09.079947+0000","last_active":"2024-07-27T03:10:10.269218+0000","last_peered":"2024-07-27T03:10:10.269218+0000","last_clean":"2024-07-27T03:10:10.269218+0000","last_became_active":"2024-07-27T03:10:09.079268+0000","last_became_peered":"2024-07-27T03:10:09.079268+0000","last_unstale":"2024-07-27T03:10:10.269218+0000","last_undegraded":"2024-07-27T03:10:10.269218+0000","last_fullsized":"2024-07-27T03:10:10.269218+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:06:19.621019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062831+0000","last_change":"2024-07-27T03:10:09.069811+0000","last_active":"2024-07-27T03:10:10.062831+0000","last_peered":"2024-07-27T03:10:10.062831+0000","last_clean":"2024-07-27T03:10:10.062831+0000","last_became_active":"2024-07-27T03:10:09.068689+0000","last_became_peered":"2024-07-27T03:10:09.068689+0000","last_unstale":"2024-07-27T03:10:10.062831+0000","last_undegraded":"2024-07-27T03:10:10.062831+0000","last_fullsized":"2024-07-27T03:10:10.062831+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:05.293014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074202+0000","last_change":"2024-07-27T03:10:09.072900+0000","last_active":"2024-07-27T03:10:10.074202+0000","last_peered":"2024-07-27T03:10:10.074202+0000","last_clean":"2024-07-27T03:10:10.074202+0000","last_became_active":"2024-07-27T03:10:09.072070+0000","last_became_peered":"2024-07-27T03:10:09.072070+0000","last_unstale":"2024-07-27T03:10:10.074202+0000","last_undegraded":"2024-07-27T03:10:10.074202+0000","last_fullsized":"2024-07-27T03:10:10.074202+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:40:22.610145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.061997+0000","last_change":"2024-07-27T03:10:09.076752+0000","last_active":"2024-07-27T03:10:10.061997+0000","last_peered":"2024-07-27T03:10:10.061997+0000","last_clean":"2024-07-27T03:10:10.061997+0000","last_became_active":"2024-07-27T03:10:09.076441+0000","last_became_peered":"2024-07-27T03:10:09.076441+0000","last_unstale":"2024-07-27T03:10:10.061997+0000","last_undegraded":"2024-07-27T03:10:10.061997+0000","last_fullsized":"2024-07-27T03:10:10.061997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:39:04.022323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268253+0000","last_change":"2024-07-27T03:10:09.066742+0000","last_active":"2024-07-27T03:10:10.268253+0000","last_peered":"2024-07-27T03:10:10.268253+0000","last_clean":"2024-07-27T03:10:10.268253+0000","last_became_active":"2024-07-27T03:10:09.065821+0000","last_became_peered":"2024-07-27T03:10:09.065821+0000","last_unstale":"2024-07-27T03:10:10.268253+0000","last_undegraded":"2024-07-27T03:10:10.268253+0000","last_fullsized":"2024-07-27T03:10:10.268253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:06:49.863301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074658+0000","last_change":"2024-07-27T03:10:08.057878+0000","last_active":"2024-07-27T03:10:10.074658+0000","last_peered":"2024-07-27T03:10:10.074658+0000","last_clean":"2024-07-27T03:10:10.074658+0000","last_became_active":"2024-07-27T03:10:08.057580+0000","last_became_peered":"2024-07-27T03:10:08.057580+0000","last_unstale":"2024-07-27T03:10:10.074658+0000","last_undegraded":"2024-07-27T03:10:10.074658+0000","last_fullsized":"2024-07-27T03:10:10.074658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:36:40.927367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.270069+0000","last_change":"2024-07-27T03:10:09.078809+0000","last_active":"2024-07-27T03:10:10.270069+0000","last_peered":"2024-07-27T03:10:10.270069+0000","last_clean":"2024-07-27T03:10:10.270069+0000","last_became_active":"2024-07-27T03:10:09.078447+0000","last_became_peered":"2024-07-27T03:10:09.078447+0000","last_unstale":"2024-07-27T03:10:10.270069+0000","last_undegraded":"2024-07-27T03:10:10.270069+0000","last_fullsized":"2024-07-27T03:10:10.270069+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:23:53.164134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063663+0000","last_change":"2024-07-27T03:10:08.055214+0000","last_active":"2024-07-27T03:10:10.063663+0000","last_peered":"2024-07-27T03:10:10.063663+0000","last_clean":"2024-07-27T03:10:10.063663+0000","last_became_active":"2024-07-27T03:10:08.054923+0000","last_became_peered":"2024-07-27T03:10:08.054923+0000","last_unstale":"2024-07-27T03:10:10.063663+0000","last_undegraded":"2024-07-27T03:10:10.063663+0000","last_fullsized":"2024-07-27T03:10:10.063663+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:53:20.853027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063902+0000","last_change":"2024-07-27T03:10:09.072898+0000","last_active":"2024-07-27T03:10:10.063902+0000","last_peered":"2024-07-27T03:10:10.063902+0000","last_clean":"2024-07-27T03:10:10.063902+0000","last_became_active":"2024-07-27T03:10:09.072389+0000","last_became_peered":"2024-07-27T03:10:09.072389+0000","last_unstale":"2024-07-27T03:10:10.063902+0000","last_undegraded":"2024-07-27T03:10:10.063902+0000","last_fullsized":"2024-07-27T03:10:10.063902+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:31:58.970960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268788+0000","last_change":"2024-07-27T03:10:08.062648+0000","last_active":"2024-07-27T03:10:10.268788+0000","last_peered":"2024-07-27T03:10:10.268788+0000","last_clean":"2024-07-27T03:10:10.268788+0000","last_became_active":"2024-07-27T03:10:08.062108+0000","last_became_peered":"2024-07-27T03:10:08.062108+0000","last_unstale":"2024-07-27T03:10:10.268788+0000","last_undegraded":"2024-07-27T03:10:10.268788+0000","last_fullsized":"2024-07-27T03:10:10.268788+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:06:18.614252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268883+0000","last_change":"2024-07-27T03:10:09.073412+0000","last_active":"2024-07-27T03:10:10.268883+0000","last_peered":"2024-07-27T03:10:10.268883+0000","last_clean":"2024-07-27T03:10:10.268883+0000","last_became_active":"2024-07-27T03:10:09.073115+0000","last_became_peered":"2024-07-27T03:10:09.073115+0000","last_unstale":"2024-07-27T03:10:10.268883+0000","last_undegraded":"2024-07-27T03:10:10.268883+0000","last_fullsized":"2024-07-27T03:10:10.268883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:57:09.812686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269442+0000","last_change":"2024-07-27T03:10:08.051365+0000","last_active":"2024-07-27T03:10:10.269442+0000","last_peered":"2024-07-27T03:10:10.269442+0000","last_clean":"2024-07-27T03:10:10.269442+0000","last_became_active":"2024-07-27T03:10:08.051023+0000","last_became_peered":"2024-07-27T03:10:08.051023+0000","last_unstale":"2024-07-27T03:10:10.269442+0000","last_undegraded":"2024-07-27T03:10:10.269442+0000","last_fullsized":"2024-07-27T03:10:10.269442+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:24:51.679234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.064167+0000","last_change":"2024-07-27T03:10:09.077457+0000","last_active":"2024-07-27T03:10:10.064167+0000","last_peered":"2024-07-27T03:10:10.064167+0000","last_clean":"2024-07-27T03:10:10.064167+0000","last_became_active":"2024-07-27T03:10:09.077158+0000","last_became_peered":"2024-07-27T03:10:09.077158+0000","last_unstale":"2024-07-27T03:10:10.064167+0000","last_undegraded":"2024-07-27T03:10:10.064167+0000","last_fullsized":"2024-07-27T03:10:10.064167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:12:11.298424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074505+0000","last_change":"2024-07-27T03:10:08.053873+0000","last_active":"2024-07-27T03:10:10.074505+0000","last_peered":"2024-07-27T03:10:10.074505+0000","last_clean":"2024-07-27T03:10:10.074505+0000","last_became_active":"2024-07-27T03:10:08.053435+0000","last_became_peered":"2024-07-27T03:10:08.053435+0000","last_unstale":"2024-07-27T03:10:10.074505+0000","last_undegraded":"2024-07-27T03:10:10.074505+0000","last_fullsized":"2024-07-27T03:10:10.074505+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:44:50.112900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268511+0000","last_change":"2024-07-27T03:10:09.074407+0000","last_active":"2024-07-27T03:10:10.268511+0000","last_peered":"2024-07-27T03:10:10.268511+0000","last_clean":"2024-07-27T03:10:10.268511+0000","last_became_active":"2024-07-27T03:10:09.074180+0000","last_became_peered":"2024-07-27T03:10:09.074180+0000","last_unstale":"2024-07-27T03:10:10.268511+0000","last_undegraded":"2024-07-27T03:10:10.268511+0000","last_fullsized":"2024-07-27T03:10:10.268511+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:11:49.293852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063664+0000","last_change":"2024-07-27T03:10:08.053558+0000","last_active":"2024-07-27T03:10:10.063664+0000","last_peered":"2024-07-27T03:10:10.063664+0000","last_clean":"2024-07-27T03:10:10.063664+0000","last_became_active":"2024-07-27T03:10:08.053048+0000","last_became_peered":"2024-07-27T03:10:08.053048+0000","last_unstale":"2024-07-27T03:10:10.063664+0000","last_undegraded":"2024-07-27T03:10:10.063664+0000","last_fullsized":"2024-07-27T03:10:10.063664+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:07:19.938603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268065+0000","last_change":"2024-07-27T03:10:09.081832+0000","last_active":"2024-07-27T03:10:10.268065+0000","last_peered":"2024-07-27T03:10:10.268065+0000","last_clean":"2024-07-27T03:10:10.268065+0000","last_became_active":"2024-07-27T03:10:09.081491+0000","last_became_peered":"2024-07-27T03:10:09.081491+0000","last_unstale":"2024-07-27T03:10:10.268065+0000","last_undegraded":"2024-07-27T03:10:10.268065+0000","last_fullsized":"2024-07-27T03:10:10.268065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:04:52.875974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062992+0000","last_change":"2024-07-27T03:10:08.056579+0000","last_active":"2024-07-27T03:10:10.062992+0000","last_peered":"2024-07-27T03:10:10.062992+0000","last_clean":"2024-07-27T03:10:10.062992+0000","last_became_active":"2024-07-27T03:10:08.056287+0000","last_became_peered":"2024-07-27T03:10:08.056287+0000","last_unstale":"2024-07-27T03:10:10.062992+0000","last_undegraded":"2024-07-27T03:10:10.062992+0000","last_fullsized":"2024-07-27T03:10:10.062992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:03:41.401965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268862+0000","last_change":"2024-07-27T03:10:09.078165+0000","last_active":"2024-07-27T03:10:10.268862+0000","last_peered":"2024-07-27T03:10:10.268862+0000","last_clean":"2024-07-27T03:10:10.268862+0000","last_became_active":"2024-07-27T03:10:09.077042+0000","last_became_peered":"2024-07-27T03:10:09.077042+0000","last_unstale":"2024-07-27T03:10:10.268862+0000","last_undegraded":"2024-07-27T03:10:10.268862+0000","last_fullsized":"2024-07-27T03:10:10.268862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:15:36.952540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268144+0000","last_change":"2024-07-27T03:10:08.059489+0000","last_active":"2024-07-27T03:10:10.268144+0000","last_peered":"2024-07-27T03:10:10.268144+0000","last_clean":"2024-07-27T03:10:10.268144+0000","last_became_active":"2024-07-27T03:10:08.059189+0000","last_became_peered":"2024-07-27T03:10:08.059189+0000","last_unstale":"2024-07-27T03:10:10.268144+0000","last_undegraded":"2024-07-27T03:10:10.268144+0000","last_fullsized":"2024-07-27T03:10:10.268144+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:54:26.175110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063630+0000","last_change":"2024-07-27T03:10:09.069482+0000","last_active":"2024-07-27T03:10:10.063630+0000","last_peered":"2024-07-27T03:10:10.063630+0000","last_clean":"2024-07-27T03:10:10.063630+0000","last_became_active":"2024-07-27T03:10:09.069171+0000","last_became_peered":"2024-07-27T03:10:09.069171+0000","last_unstale":"2024-07-27T03:10:10.063630+0000","last_undegraded":"2024-07-27T03:10:10.063630+0000","last_fullsized":"2024-07-27T03:10:10.063630+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:11:21.581936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063398+0000","last_change":"2024-07-27T03:10:08.057942+0000","last_active":"2024-07-27T03:10:10.063398+0000","last_peered":"2024-07-27T03:10:10.063398+0000","last_clean":"2024-07-27T03:10:10.063398+0000","last_became_active":"2024-07-27T03:10:08.057613+0000","last_became_peered":"2024-07-27T03:10:08.057613+0000","last_unstale":"2024-07-27T03:10:10.063398+0000","last_undegraded":"2024-07-27T03:10:10.063398+0000","last_fullsized":"2024-07-27T03:10:10.063398+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:16:56.016010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.270093+0000","last_change":"2024-07-27T03:10:09.073368+0000","last_active":"2024-07-27T03:10:10.270093+0000","last_peered":"2024-07-27T03:10:10.270093+0000","last_clean":"2024-07-27T03:10:10.270093+0000","last_became_active":"2024-07-27T03:10:09.073025+0000","last_became_peered":"2024-07-27T03:10:09.073025+0000","last_unstale":"2024-07-27T03:10:10.270093+0000","last_undegraded":"2024-07-27T03:10:10.270093+0000","last_fullsized":"2024-07-27T03:10:10.270093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:55:49.958867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269077+0000","last_change":"2024-07-27T03:10:08.058799+0000","last_active":"2024-07-27T03:10:10.269077+0000","last_peered":"2024-07-27T03:10:10.269077+0000","last_clean":"2024-07-27T03:10:10.269077+0000","last_became_active":"2024-07-27T03:10:08.058488+0000","last_became_peered":"2024-07-27T03:10:08.058488+0000","last_unstale":"2024-07-27T03:10:10.269077+0000","last_undegraded":"2024-07-27T03:10:10.269077+0000","last_fullsized":"2024-07-27T03:10:10.269077+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:15:32.151502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074576+0000","last_change":"2024-07-27T03:10:09.080279+0000","last_active":"2024-07-27T03:10:10.074576+0000","last_peered":"2024-07-27T03:10:10.074576+0000","last_clean":"2024-07-27T03:10:10.074576+0000","last_became_active":"2024-07-27T03:10:09.079881+0000","last_became_peered":"2024-07-27T03:10:09.079881+0000","last_unstale":"2024-07-27T03:10:10.074576+0000","last_undegraded":"2024-07-27T03:10:10.074576+0000","last_fullsized":"2024-07-27T03:10:10.074576+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:39:28.425091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269871+0000","last_change":"2024-07-27T03:10:08.055592+0000","last_active":"2024-07-27T03:10:10.269871+0000","last_peered":"2024-07-27T03:10:10.269871+0000","last_clean":"2024-07-27T03:10:10.269871+0000","last_became_active":"2024-07-27T03:10:08.054236+0000","last_became_peered":"2024-07-27T03:10:08.054236+0000","last_unstale":"2024-07-27T03:10:10.269871+0000","last_undegraded":"2024-07-27T03:10:10.269871+0000","last_fullsized":"2024-07-27T03:10:10.269871+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:53:35.599348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269709+0000","last_change":"2024-07-27T03:10:09.080262+0000","last_active":"2024-07-27T03:10:10.269709+0000","last_peered":"2024-07-27T03:10:10.269709+0000","last_clean":"2024-07-27T03:10:10.269709+0000","last_became_active":"2024-07-27T03:10:09.079953+0000","last_became_peered":"2024-07-27T03:10:09.079953+0000","last_unstale":"2024-07-27T03:10:10.269709+0000","last_undegraded":"2024-07-27T03:10:10.269709+0000","last_fullsized":"2024-07-27T03:10:10.269709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:32:55.036511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062307+0000","last_change":"2024-07-27T03:10:08.061069+0000","last_active":"2024-07-27T03:10:10.062307+0000","last_peered":"2024-07-27T03:10:10.062307+0000","last_clean":"2024-07-27T03:10:10.062307+0000","last_became_active":"2024-07-27T03:10:08.060741+0000","last_became_peered":"2024-07-27T03:10:08.060741+0000","last_unstale":"2024-07-27T03:10:10.062307+0000","last_undegraded":"2024-07-27T03:10:10.062307+0000","last_fullsized":"2024-07-27T03:10:10.062307+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:00:34.352608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269773+0000","last_change":"2024-07-27T03:10:09.074670+0000","last_active":"2024-07-27T03:10:10.269773+0000","last_peered":"2024-07-27T03:10:10.269773+0000","last_clean":"2024-07-27T03:10:10.269773+0000","last_became_active":"2024-07-27T03:10:09.074337+0000","last_became_peered":"2024-07-27T03:10:09.074337+0000","last_unstale":"2024-07-27T03:10:10.269773+0000","last_undegraded":"2024-07-27T03:10:10.269773+0000","last_fullsized":"2024-07-27T03:10:10.269773+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:06:49.863301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074511+0000","last_change":"2024-07-27T03:10:08.059186+0000","last_active":"2024-07-27T03:10:10.074511+0000","last_peered":"2024-07-27T03:10:10.074511+0000","last_clean":"2024-07-27T03:10:10.074511+0000","last_became_active":"2024-07-27T03:10:08.058906+0000","last_became_peered":"2024-07-27T03:10:08.058906+0000","last_unstale":"2024-07-27T03:10:10.074511+0000","last_undegraded":"2024-07-27T03:10:10.074511+0000","last_fullsized":"2024-07-27T03:10:10.074511+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:27:55.300365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268718+0000","last_change":"2024-07-27T03:10:09.069088+0000","last_active":"2024-07-27T03:10:10.268718+0000","last_peered":"2024-07-27T03:10:10.268718+0000","last_clean":"2024-07-27T03:10:10.268718+0000","last_became_active":"2024-07-27T03:10:09.068808+0000","last_became_peered":"2024-07-27T03:10:09.068808+0000","last_unstale":"2024-07-27T03:10:10.268718+0000","last_undegraded":"2024-07-27T03:10:10.268718+0000","last_fullsized":"2024-07-27T03:10:10.268718+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:26:33.849063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269327+0000","last_change":"2024-07-27T03:10:08.056502+0000","last_active":"2024-07-27T03:10:10.269327+0000","last_peered":"2024-07-27T03:10:10.269327+0000","last_clean":"2024-07-27T03:10:10.269327+0000","last_became_active":"2024-07-27T03:10:08.056132+0000","last_became_peered":"2024-07-27T03:10:08.056132+0000","last_unstale":"2024-07-27T03:10:10.269327+0000","last_undegraded":"2024-07-27T03:10:10.269327+0000","last_fullsized":"2024-07-27T03:10:10.269327+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:04:51.869207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074131+0000","last_change":"2024-07-27T03:10:09.071518+0000","last_active":"2024-07-27T03:10:10.074131+0000","last_peered":"2024-07-27T03:10:10.074131+0000","last_clean":"2024-07-27T03:10:10.074131+0000","last_became_active":"2024-07-27T03:10:09.071233+0000","last_became_peered":"2024-07-27T03:10:09.071233+0000","last_unstale":"2024-07-27T03:10:10.074131+0000","last_undegraded":"2024-07-27T03:10:10.074131+0000","last_fullsized":"2024-07-27T03:10:10.074131+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:57:39.756834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074290+0000","last_change":"2024-07-27T03:10:08.060288+0000","last_active":"2024-07-27T03:10:10.074290+0000","last_peered":"2024-07-27T03:10:10.074290+0000","last_clean":"2024-07-27T03:10:10.074290+0000","last_became_active":"2024-07-27T03:10:08.059433+0000","last_became_peered":"2024-07-27T03:10:08.059433+0000","last_unstale":"2024-07-27T03:10:10.074290+0000","last_undegraded":"2024-07-27T03:10:10.074290+0000","last_fullsized":"2024-07-27T03:10:10.074290+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:02:45.555740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.270060+0000","last_change":"2024-07-27T03:10:09.079168+0000","last_active":"2024-07-27T03:10:10.270060+0000","last_peered":"2024-07-27T03:10:10.270060+0000","last_clean":"2024-07-27T03:10:10.270060+0000","last_became_active":"2024-07-27T03:10:09.078259+0000","last_became_peered":"2024-07-27T03:10:09.078259+0000","last_unstale":"2024-07-27T03:10:10.270060+0000","last_undegraded":"2024-07-27T03:10:10.270060+0000","last_fullsized":"2024-07-27T03:10:10.270060+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:16:39.564178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268194+0000","last_change":"2024-07-27T03:10:08.061580+0000","last_active":"2024-07-27T03:10:10.268194+0000","last_peered":"2024-07-27T03:10:10.268194+0000","last_clean":"2024-07-27T03:10:10.268194+0000","last_became_active":"2024-07-27T03:10:08.061085+0000","last_became_peered":"2024-07-27T03:10:08.061085+0000","last_unstale":"2024-07-27T03:10:10.268194+0000","last_undegraded":"2024-07-27T03:10:10.268194+0000","last_fullsized":"2024-07-27T03:10:10.268194+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:25:58.867061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062090+0000","last_change":"2024-07-27T03:10:09.082734+0000","last_active":"2024-07-27T03:10:10.062090+0000","last_peered":"2024-07-27T03:10:10.062090+0000","last_clean":"2024-07-27T03:10:10.062090+0000","last_became_active":"2024-07-27T03:10:09.082398+0000","last_became_peered":"2024-07-27T03:10:09.082398+0000","last_unstale":"2024-07-27T03:10:10.062090+0000","last_undegraded":"2024-07-27T03:10:10.062090+0000","last_fullsized":"2024-07-27T03:10:10.062090+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:15:33.158269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.061941+0000","last_change":"2024-07-27T03:10:08.057979+0000","last_active":"2024-07-27T03:10:10.061941+0000","last_peered":"2024-07-27T03:10:10.061941+0000","last_clean":"2024-07-27T03:10:10.061941+0000","last_became_active":"2024-07-27T03:10:08.057612+0000","last_became_peered":"2024-07-27T03:10:08.057612+0000","last_unstale":"2024-07-27T03:10:10.061941+0000","last_undegraded":"2024-07-27T03:10:10.061941+0000","last_fullsized":"2024-07-27T03:10:10.061941+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:45:28.711632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269166+0000","last_change":"2024-07-27T03:10:09.070486+0000","last_active":"2024-07-27T03:10:10.269166+0000","last_peered":"2024-07-27T03:10:10.269166+0000","last_clean":"2024-07-27T03:10:10.269166+0000","last_became_active":"2024-07-27T03:10:09.070206+0000","last_became_peered":"2024-07-27T03:10:09.070206+0000","last_unstale":"2024-07-27T03:10:10.269166+0000","last_undegraded":"2024-07-27T03:10:10.269166+0000","last_fullsized":"2024-07-27T03:10:10.269166+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:48:46.873968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063715+0000","last_change":"2024-07-27T03:10:08.061075+0000","last_active":"2024-07-27T03:10:10.063715+0000","last_peered":"2024-07-27T03:10:10.063715+0000","last_clean":"2024-07-27T03:10:10.063715+0000","last_became_active":"2024-07-27T03:10:08.060656+0000","last_became_peered":"2024-07-27T03:10:08.060656+0000","last_unstale":"2024-07-27T03:10:10.063715+0000","last_undegraded":"2024-07-27T03:10:10.063715+0000","last_fullsized":"2024-07-27T03:10:10.063715+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:15:35.945773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269328+0000","last_change":"2024-07-27T03:10:09.072384+0000","last_active":"2024-07-27T03:10:10.269328+0000","last_peered":"2024-07-27T03:10:10.269328+0000","last_clean":"2024-07-27T03:10:10.269328+0000","last_became_active":"2024-07-27T03:10:09.071935+0000","last_became_peered":"2024-07-27T03:10:09.071935+0000","last_unstale":"2024-07-27T03:10:10.269328+0000","last_undegraded":"2024-07-27T03:10:10.269328+0000","last_fullsized":"2024-07-27T03:10:10.269328+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:52:50.889663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063143+0000","last_change":"2024-07-27T03:10:08.063876+0000","last_active":"2024-07-27T03:10:10.063143+0000","last_peered":"2024-07-27T03:10:10.063143+0000","last_clean":"2024-07-27T03:10:10.063143+0000","last_became_active":"2024-07-27T03:10:08.063533+0000","last_became_peered":"2024-07-27T03:10:08.063533+0000","last_unstale":"2024-07-27T03:10:10.063143+0000","last_undegraded":"2024-07-27T03:10:10.063143+0000","last_fullsized":"2024-07-27T03:10:10.063143+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:03:08.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269492+0000","last_change":"2024-07-27T03:10:09.081301+0000","last_active":"2024-07-27T03:10:10.269492+0000","last_peered":"2024-07-27T03:10:10.269492+0000","last_clean":"2024-07-27T03:10:10.269492+0000","last_became_active":"2024-07-27T03:10:09.080771+0000","last_became_peered":"2024-07-27T03:10:09.080771+0000","last_unstale":"2024-07-27T03:10:10.269492+0000","last_undegraded":"2024-07-27T03:10:10.269492+0000","last_fullsized":"2024-07-27T03:10:10.269492+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:43:11.921367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074588+0000","last_change":"2024-07-27T03:10:08.057169+0000","last_active":"2024-07-27T03:10:10.074588+0000","last_peered":"2024-07-27T03:10:10.074588+0000","last_clean":"2024-07-27T03:10:10.074588+0000","last_became_active":"2024-07-27T03:10:08.056850+0000","last_became_peered":"2024-07-27T03:10:08.056850+0000","last_unstale":"2024-07-27T03:10:10.074588+0000","last_undegraded":"2024-07-27T03:10:10.074588+0000","last_fullsized":"2024-07-27T03:10:10.074588+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:09:41.137312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074233+0000","last_change":"2024-07-27T03:10:09.080183+0000","last_active":"2024-07-27T03:10:10.074233+0000","last_peered":"2024-07-27T03:10:10.074233+0000","last_clean":"2024-07-27T03:10:10.074233+0000","last_became_active":"2024-07-27T03:10:09.079863+0000","last_became_peered":"2024-07-27T03:10:09.079863+0000","last_unstale":"2024-07-27T03:10:10.074233+0000","last_undegraded":"2024-07-27T03:10:10.074233+0000","last_fullsized":"2024-07-27T03:10:10.074233+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:59:20.060583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074639+0000","last_change":"2024-07-27T03:10:08.054887+0000","last_active":"2024-07-27T03:10:10.074639+0000","last_peered":"2024-07-27T03:10:10.074639+0000","last_clean":"2024-07-27T03:10:10.074639+0000","last_became_active":"2024-07-27T03:10:08.054547+0000","last_became_peered":"2024-07-27T03:10:08.054547+0000","last_unstale":"2024-07-27T03:10:10.074639+0000","last_undegraded":"2024-07-27T03:10:10.074639+0000","last_fullsized":"2024-07-27T03:10:10.074639+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:43:12.149689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268398+0000","last_change":"2024-07-27T03:10:09.065007+0000","last_active":"2024-07-27T03:10:10.268398+0000","last_peered":"2024-07-27T03:10:10.268398+0000","last_clean":"2024-07-27T03:10:10.268398+0000","last_became_active":"2024-07-27T03:10:09.064722+0000","last_became_peered":"2024-07-27T03:10:09.064722+0000","last_unstale":"2024-07-27T03:10:10.268398+0000","last_undegraded":"2024-07-27T03:10:10.268398+0000","last_fullsized":"2024-07-27T03:10:10.268398+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:33:02.588360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062845+0000","last_change":"2024-07-27T03:10:08.061634+0000","last_active":"2024-07-27T03:10:10.062845+0000","last_peered":"2024-07-27T03:10:10.062845+0000","last_clean":"2024-07-27T03:10:10.062845+0000","last_became_active":"2024-07-27T03:10:08.061239+0000","last_became_peered":"2024-07-27T03:10:08.061239+0000","last_unstale":"2024-07-27T03:10:10.062845+0000","last_undegraded":"2024-07-27T03:10:10.062845+0000","last_fullsized":"2024-07-27T03:10:10.062845+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:49:29.997187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.061991+0000","last_change":"2024-07-27T03:10:09.077563+0000","last_active":"2024-07-27T03:10:10.061991+0000","last_peered":"2024-07-27T03:10:10.061991+0000","last_clean":"2024-07-27T03:10:10.061991+0000","last_became_active":"2024-07-27T03:10:09.077284+0000","last_became_peered":"2024-07-27T03:10:09.077284+0000","last_unstale":"2024-07-27T03:10:10.061991+0000","last_undegraded":"2024-07-27T03:10:10.061991+0000","last_fullsized":"2024-07-27T03:10:10.061991+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:41:38.621082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268315+0000","last_change":"2024-07-27T03:10:08.058770+0000","last_active":"2024-07-27T03:10:10.268315+0000","last_peered":"2024-07-27T03:10:10.268315+0000","last_clean":"2024-07-27T03:10:10.268315+0000","last_became_active":"2024-07-27T03:10:08.058426+0000","last_became_peered":"2024-07-27T03:10:08.058426+0000","last_unstale":"2024-07-27T03:10:10.268315+0000","last_undegraded":"2024-07-27T03:10:10.268315+0000","last_fullsized":"2024-07-27T03:10:10.268315+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:41:04.021449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268059+0000","last_change":"2024-07-27T03:10:09.077519+0000","last_active":"2024-07-27T03:10:10.268059+0000","last_peered":"2024-07-27T03:10:10.268059+0000","last_clean":"2024-07-27T03:10:10.268059+0000","last_became_active":"2024-07-27T03:10:09.077215+0000","last_became_peered":"2024-07-27T03:10:09.077215+0000","last_unstale":"2024-07-27T03:10:10.268059+0000","last_undegraded":"2024-07-27T03:10:10.268059+0000","last_fullsized":"2024-07-27T03:10:10.268059+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:53:36.606115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268991+0000","last_change":"2024-07-27T03:10:08.061434+0000","last_active":"2024-07-27T03:10:10.268991+0000","last_peered":"2024-07-27T03:10:10.268991+0000","last_clean":"2024-07-27T03:10:10.268991+0000","last_became_active":"2024-07-27T03:10:08.061012+0000","last_became_peered":"2024-07-27T03:10:08.061012+0000","last_unstale":"2024-07-27T03:10:10.268991+0000","last_undegraded":"2024-07-27T03:10:10.268991+0000","last_fullsized":"2024-07-27T03:10:10.268991+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:03:08.276325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.270135+0000","last_change":"2024-07-27T03:10:09.076099+0000","last_active":"2024-07-27T03:10:10.270135+0000","last_peered":"2024-07-27T03:10:10.270135+0000","last_clean":"2024-07-27T03:10:10.270135+0000","last_became_active":"2024-07-27T03:10:09.075402+0000","last_became_peered":"2024-07-27T03:10:09.075402+0000","last_unstale":"2024-07-27T03:10:10.270135+0000","last_undegraded":"2024-07-27T03:10:10.270135+0000","last_fullsized":"2024-07-27T03:10:10.270135+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:57:05.293014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074717+0000","last_change":"2024-07-27T03:10:08.052094+0000","last_active":"2024-07-27T03:10:10.074717+0000","last_peered":"2024-07-27T03:10:10.074717+0000","last_clean":"2024-07-27T03:10:10.074717+0000","last_became_active":"2024-07-27T03:10:08.051179+0000","last_became_peered":"2024-07-27T03:10:08.051179+0000","last_unstale":"2024-07-27T03:10:10.074717+0000","last_undegraded":"2024-07-27T03:10:10.074717+0000","last_fullsized":"2024-07-27T03:10:10.074717+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:12:10.291656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268608+0000","last_change":"2024-07-27T03:10:09.071969+0000","last_active":"2024-07-27T03:10:10.268608+0000","last_peered":"2024-07-27T03:10:10.268608+0000","last_clean":"2024-07-27T03:10:10.268608+0000","last_became_active":"2024-07-27T03:10:09.071688+0000","last_became_peered":"2024-07-27T03:10:09.071688+0000","last_unstale":"2024-07-27T03:10:10.268608+0000","last_undegraded":"2024-07-27T03:10:10.268608+0000","last_fullsized":"2024-07-27T03:10:10.268608+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:57:37.863112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.270010+0000","last_change":"2024-07-27T03:10:08.055310+0000","last_active":"2024-07-27T03:10:10.270010+0000","last_peered":"2024-07-27T03:10:10.270010+0000","last_clean":"2024-07-27T03:10:10.270010+0000","last_became_active":"2024-07-27T03:10:08.055017+0000","last_became_peered":"2024-07-27T03:10:08.055017+0000","last_unstale":"2024-07-27T03:10:10.270010+0000","last_undegraded":"2024-07-27T03:10:10.270010+0000","last_fullsized":"2024-07-27T03:10:10.270010+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:41:43.450346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269862+0000","last_change":"2024-07-27T03:10:09.077646+0000","last_active":"2024-07-27T03:10:10.269862+0000","last_peered":"2024-07-27T03:10:10.269862+0000","last_clean":"2024-07-27T03:10:10.269862+0000","last_became_active":"2024-07-27T03:10:09.077343+0000","last_became_peered":"2024-07-27T03:10:09.077343+0000","last_unstale":"2024-07-27T03:10:10.269862+0000","last_undegraded":"2024-07-27T03:10:10.269862+0000","last_fullsized":"2024-07-27T03:10:10.269862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:48:46.873968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268482+0000","last_change":"2024-07-27T03:10:08.061409+0000","last_active":"2024-07-27T03:10:10.268482+0000","last_peered":"2024-07-27T03:10:10.268482+0000","last_clean":"2024-07-27T03:10:10.268482+0000","last_became_active":"2024-07-27T03:10:08.061106+0000","last_became_peered":"2024-07-27T03:10:08.061106+0000","last_unstale":"2024-07-27T03:10:10.268482+0000","last_undegraded":"2024-07-27T03:10:10.268482+0000","last_fullsized":"2024-07-27T03:10:10.268482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:38:23.307210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074387+0000","last_change":"2024-07-27T03:10:09.074528+0000","last_active":"2024-07-27T03:10:10.074387+0000","last_peered":"2024-07-27T03:10:10.074387+0000","last_clean":"2024-07-27T03:10:10.074387+0000","last_became_active":"2024-07-27T03:10:09.074224+0000","last_became_peered":"2024-07-27T03:10:09.074224+0000","last_unstale":"2024-07-27T03:10:10.074387+0000","last_undegraded":"2024-07-27T03:10:10.074387+0000","last_fullsized":"2024-07-27T03:10:10.074387+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:22:14.612591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269495+0000","last_change":"2024-07-27T03:10:08.055344+0000","last_active":"2024-07-27T03:10:10.269495+0000","last_peered":"2024-07-27T03:10:10.269495+0000","last_clean":"2024-07-27T03:10:10.269495+0000","last_became_active":"2024-07-27T03:10:08.054304+0000","last_became_peered":"2024-07-27T03:10:08.054304+0000","last_unstale":"2024-07-27T03:10:10.269495+0000","last_undegraded":"2024-07-27T03:10:10.269495+0000","last_fullsized":"2024-07-27T03:10:10.269495+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:24:05.695647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.074393+0000","last_change":"2024-07-27T03:10:09.080739+0000","last_active":"2024-07-27T03:10:10.074393+0000","last_peered":"2024-07-27T03:10:10.074393+0000","last_clean":"2024-07-27T03:10:10.074393+0000","last_became_active":"2024-07-27T03:10:09.080362+0000","last_became_peered":"2024-07-27T03:10:09.080362+0000","last_unstale":"2024-07-27T03:10:10.074393+0000","last_undegraded":"2024-07-27T03:10:10.074393+0000","last_fullsized":"2024-07-27T03:10:10.074393+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:37:04.437095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063895+0000","last_change":"2024-07-27T03:10:08.051755+0000","last_active":"2024-07-27T03:10:10.063895+0000","last_peered":"2024-07-27T03:10:10.063895+0000","last_clean":"2024-07-27T03:10:10.063895+0000","last_became_active":"2024-07-27T03:10:08.050784+0000","last_became_peered":"2024-07-27T03:10:08.050784+0000","last_unstale":"2024-07-27T03:10:10.063895+0000","last_undegraded":"2024-07-27T03:10:10.063895+0000","last_fullsized":"2024-07-27T03:10:10.063895+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:38:23.307210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.062862+0000","last_change":"2024-07-27T03:10:09.075221+0000","last_active":"2024-07-27T03:10:10.062862+0000","last_peered":"2024-07-27T03:10:10.062862+0000","last_clean":"2024-07-27T03:10:10.062862+0000","last_became_active":"2024-07-27T03:10:09.074616+0000","last_became_peered":"2024-07-27T03:10:09.074616+0000","last_unstale":"2024-07-27T03:10:10.062862+0000","last_undegraded":"2024-07-27T03:10:10.062862+0000","last_fullsized":"2024-07-27T03:10:10.062862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:09:03.236747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268193+0000","last_change":"2024-07-27T03:10:08.064636+0000","last_active":"2024-07-27T03:10:10.268193+0000","last_peered":"2024-07-27T03:10:10.268193+0000","last_clean":"2024-07-27T03:10:10.268193+0000","last_became_active":"2024-07-27T03:10:08.064310+0000","last_became_peered":"2024-07-27T03:10:08.064310+0000","last_unstale":"2024-07-27T03:10:10.268193+0000","last_undegraded":"2024-07-27T03:10:10.268193+0000","last_fullsized":"2024-07-27T03:10:10.268193+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:27:18.932485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063277+0000","last_change":"2024-07-27T03:10:09.071133+0000","last_active":"2024-07-27T03:10:10.063277+0000","last_peered":"2024-07-27T03:10:10.063277+0000","last_clean":"2024-07-27T03:10:10.063277+0000","last_became_active":"2024-07-27T03:10:09.070652+0000","last_became_peered":"2024-07-27T03:10:09.070652+0000","last_unstale":"2024-07-27T03:10:10.063277+0000","last_undegraded":"2024-07-27T03:10:10.063277+0000","last_fullsized":"2024-07-27T03:10:10.063277+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:29:26.833973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.268251+0000","last_change":"2024-07-27T03:10:08.061822+0000","last_active":"2024-07-27T03:10:10.268251+0000","last_peered":"2024-07-27T03:10:10.268251+0000","last_clean":"2024-07-27T03:10:10.268251+0000","last_became_active":"2024-07-27T03:10:08.061513+0000","last_became_peered":"2024-07-27T03:10:08.061513+0000","last_unstale":"2024-07-27T03:10:10.268251+0000","last_undegraded":"2024-07-27T03:10:10.268251+0000","last_fullsized":"2024-07-27T03:10:10.268251+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:54:47.622823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269037+0000","last_change":"2024-07-27T03:10:09.069158+0000","last_active":"2024-07-27T03:10:10.269037+0000","last_peered":"2024-07-27T03:10:10.269037+0000","last_clean":"2024-07-27T03:10:10.269037+0000","last_became_active":"2024-07-27T03:10:09.068838+0000","last_became_peered":"2024-07-27T03:10:09.068838+0000","last_unstale":"2024-07-27T03:10:10.269037+0000","last_undegraded":"2024-07-27T03:10:10.269037+0000","last_fullsized":"2024-07-27T03:10:10.269037+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:08.036352+0000","last_clean_scrub_stamp":"2024-07-27T03:10:08.036352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:31:58.970960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.063220+0000","last_change":"2024-07-27T03:10:08.053861+0000","last_active":"2024-07-27T03:10:10.063220+0000","last_peered":"2024-07-27T03:10:10.063220+0000","last_clean":"2024-07-27T03:10:10.063220+0000","last_became_active":"2024-07-27T03:10:08.053505+0000","last_became_peered":"2024-07-27T03:10:08.053505+0000","last_unstale":"2024-07-27T03:10:10.063220+0000","last_undegraded":"2024-07-27T03:10:10.063220+0000","last_fullsized":"2024-07-27T03:10:10.063220+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:10:07.029584+0000","last_clean_scrub_stamp":"2024-07-27T03:10:07.029584+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:24:05.695647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":150,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-07-27T03:10:10.269170+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:10:10.269170+0000","last_peered":"2024-07-27T03:10:10.269170+0000","last_clean":"2024-07-27T03:10:10.269170+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:10:10.269170+0000","last_undegraded":"2024-07-27T03:10:10.269170+0000","last_fullsized":"2024-07-27T03:10:10.269170+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":795128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":512000,"data_stored":204740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35852,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335988,"statfs":{"total":96636764160,"available":96600051712,"internally_reserved":0,"allocated":520192,"data_stored":205308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":524288,"data_stored":206304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":795072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31692,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340148,"statfs":{"total":96636764160,"available":96604311552,"internally_reserved":0,"allocated":516096,"data_stored":205342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31692,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340148,"statfs":{"total":96636764160,"available":96604311552,"internally_reserved":0,"allocated":520192,"data_stored":206282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":512000,"data_stored":204740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:10:17.942 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-27T03:10:17.942 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-07-27T03:10:18.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.098+0000 7fd01e643640 1 -- 172.21.15.120:0/1082143990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0180733c0 msgr2=0x7fd0180737d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:18.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.098+0000 7fd01e643640 1 --2- 172.21.15.120:0/1082143990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0180733c0 0x7fd0180737d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd010005fd0 tx=0x7fd01002a980 comp rx=0 tx=0).stop 2024-07-27T03:10:18.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.098+0000 7fd01e643640 1 -- 172.21.15.120:0/1082143990 shutdown_connections 2024-07-27T03:10:18.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.098+0000 7fd01e643640 1 --2- 172.21.15.120:0/1082143990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0180733c0 0x7fd0180737d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.098+0000 7fd01e643640 1 --2- 172.21.15.120:0/1082143990 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0180d0450 0x7fd01815f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.098+0000 7fd01e643640 1 -- 172.21.15.120:0/1082143990 >> 172.21.15.120:0/1082143990 conn(0x7fd0180d0df0 msgr2=0x7fd0180d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:18.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.098+0000 7fd01e643640 1 -- 172.21.15.120:0/1082143990 shutdown_connections 2024-07-27T03:10:18.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.098+0000 7fd01e643640 1 -- 172.21.15.120:0/1082143990 wait complete. 2024-07-27T03:10:18.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.100+0000 7fd01e643640 1 Processor -- start 2024-07-27T03:10:18.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.100+0000 7fd01e643640 1 -- start start 2024-07-27T03:10:18.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.101+0000 7fd01e643640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0180718c0 0x7fd0181f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:18.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.101+0000 7fd01e643640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0180733c0 0x7fd0180ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:18.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.101+0000 7fd01e643640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0180d0450 0x7fd01806c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:18.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.101+0000 7fd01e643640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd01815bb50 con 0x7fd0180718c0 2024-07-27T03:10:18.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.101+0000 7fd01e643640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd01815b9d0 con 0x7fd0180733c0 2024-07-27T03:10:18.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.101+0000 7fd01e643640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd01815bcd0 con 0x7fd0180d0450 2024-07-27T03:10:18.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.101+0000 7fd017fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0180718c0 0x7fd0181f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:18.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.101+0000 7fd017fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0180718c0 0x7fd0181f5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58304/0 (socket says 172.21.15.120:58304) 2024-07-27T03:10:18.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.101+0000 7fd017fff640 1 -- 172.21.15.120:0/4157810869 learned_addr learned my addr 172.21.15.120:0/4157810869 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:18.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.101+0000 7fd00ffff640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0180733c0 0x7fd0180ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.101+0000 7fd01cbe0640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0180d0450 0x7fd01806c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.102+0000 7fd017fff640 1 -- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0180d0450 msgr2=0x7fd01806c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.102+0000 7fd017fff640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0180d0450 0x7fd01806c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.102+0000 7fd017fff640 1 -- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0180733c0 msgr2=0x7fd0180ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.102+0000 7fd017fff640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0180733c0 0x7fd0180ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.102+0000 7fd017fff640 1 -- 172.21.15.120:0/4157810869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0180ae0f0 con 0x7fd0180718c0 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.102+0000 7fd017fff640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0180718c0 0x7fd0181f5a00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd00800e7c0 tx=0x7fd00800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.102+0000 7fd0157fa640 1 -- 172.21.15.120:0/4157810869 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00800ccc0 con 0x7fd0180718c0 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.102+0000 7fd0157fa640 1 -- 172.21.15.120:0/4157810869 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd008010430 con 0x7fd0180718c0 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.102+0000 7fd01e643640 1 -- 172.21.15.120:0/4157810869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0180ae3d0 con 0x7fd0180718c0 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.102+0000 7fd0157fa640 1 -- 172.21.15.120:0/4157810869 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008010860 con 0x7fd0180718c0 2024-07-27T03:10:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.102+0000 7fd01e643640 1 -- 172.21.15.120:0/4157810869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0180ae990 con 0x7fd0180718c0 2024-07-27T03:10:18.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.103+0000 7fd01e643640 1 -- 172.21.15.120:0/4157810869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01815d370 con 0x7fd0180718c0 2024-07-27T03:10:18.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.104+0000 7fd0157fa640 1 -- 172.21.15.120:0/4157810869 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd008010a00 con 0x7fd0180718c0 2024-07-27T03:10:18.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.104+0000 7fd0157fa640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcff8077010 0x7fcff8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:18.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.104+0000 7fd0157fa640 1 -- 172.21.15.120:0/4157810869 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fd008099110 con 0x7fd0180718c0 2024-07-27T03:10:18.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.104+0000 7fd00ffff640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcff8077010 0x7fcff8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:18.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.105+0000 7fd00ffff640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcff8077010 0x7fcff8079520 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd0180b0bd0 tx=0x7fd000009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:18.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.109+0000 7fd0157fa640 1 -- 172.21.15.120:0/4157810869 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd008061de0 con 0x7fd0180718c0 2024-07-27T03:10:18.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.361+0000 7fd01e643640 1 -- 172.21.15.120:0/4157810869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd0180cf3c0 con 0x7fd0180718c0 2024-07-27T03:10:18.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.364+0000 7fd0157fa640 1 -- 172.21.15.120:0/4157810869 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7fd008066330 con 0x7fd0180718c0 2024-07-27T03:10:18.367 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-07-27T03:10:18.367 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmI8baMRAArCIL9NNNVlevij0JAWwGwg== 2024-07-27T03:10:18.367 INFO:teuthology.orchestra.run.smithi120.stdout: caps mds = "allow" 2024-07-27T03:10:18.367 INFO:teuthology.orchestra.run.smithi120.stdout: caps mon = "allow r" 2024-07-27T03:10:18.367 INFO:teuthology.orchestra.run.smithi120.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-07-27T03:10:18.367 INFO:teuthology.orchestra.run.smithi120.stderr:updated caps for client.0 2024-07-27T03:10:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 -- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcff8077010 msgr2=0x7fcff8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcff8077010 0x7fcff8079520 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd0180b0bd0 tx=0x7fd000009040 comp rx=0 tx=0).stop 2024-07-27T03:10:18.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 -- 172.21.15.120:0/4157810869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0180718c0 msgr2=0x7fd0181f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:18.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0180718c0 0x7fd0181f5a00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd00800e7c0 tx=0x7fd00800ec80 comp rx=0 tx=0).stop 2024-07-27T03:10:18.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 -- 172.21.15.120:0/4157810869 shutdown_connections 2024-07-27T03:10:18.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcff8077010 0x7fcff8079520 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd0180d0450 0x7fd01806c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0180733c0 0x7fd0180ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 --2- 172.21.15.120:0/4157810869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0180718c0 0x7fd0181f5a00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 -- 172.21.15.120:0/4157810869 >> 172.21.15.120:0/4157810869 conn(0x7fd0180d0df0 msgr2=0x7fd0180d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:18.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 -- 172.21.15.120:0/4157810869 shutdown_connections 2024-07-27T03:10:18.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.366+0000 7fd01e643640 1 -- 172.21.15.120:0/4157810869 wait complete. 2024-07-27T03:10:18.381 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:10:18.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.492+0000 7efdea5c7640 1 -- 172.21.15.120:0/2479899784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde40d27e0 msgr2=0x7efde40d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:18.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.492+0000 7efdea5c7640 1 --2- 172.21.15.120:0/2479899784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde40d27e0 0x7efde40d2bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009830 tx=0x7efdd802a510 comp rx=0 tx=0).stop 2024-07-27T03:10:18.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.492+0000 7efdea5c7640 1 -- 172.21.15.120:0/2479899784 shutdown_connections 2024-07-27T03:10:18.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.492+0000 7efdea5c7640 1 --2- 172.21.15.120:0/2479899784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde40d27e0 0x7efde40d2bf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.492+0000 7efdea5c7640 1 --2- 172.21.15.120:0/2479899784 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efde40b4740 0x7efde40b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.492+0000 7efdea5c7640 1 -- 172.21.15.120:0/2479899784 >> 172.21.15.120:0/2479899784 conn(0x7efde408d690 msgr2=0x7efde409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:18.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.492+0000 7efdea5c7640 1 -- 172.21.15.120:0/2479899784 shutdown_connections 2024-07-27T03:10:18.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.492+0000 7efdea5c7640 1 -- 172.21.15.120:0/2479899784 wait complete. 2024-07-27T03:10:18.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.493+0000 7efdea5c7640 1 Processor -- start 2024-07-27T03:10:18.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.494+0000 7efdea5c7640 1 -- start start 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efdea5c7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde40b4740 0x7efde41524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efdea5c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efde40d09c0 0x7efde409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efdea5c7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efde40d27e0 0x7efde40b8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efdea5c7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efde40cef70 con 0x7efde40d09c0 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efdea5c7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efde40cedf0 con 0x7efde40b4740 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efdea5c7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efde40cf0f0 con 0x7efde40d27e0 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efde37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efde40d09c0 0x7efde409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efde37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efde40d09c0 0x7efde409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58310/0 (socket says 172.21.15.120:58310) 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efde37fe640 1 -- 172.21.15.120:0/1647294710 learned_addr learned my addr 172.21.15.120:0/1647294710 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efde3fff640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde40b4740 0x7efde41524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efde8b64640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efde40d27e0 0x7efde40b8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:18.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efde37fe640 1 -- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efde40d27e0 msgr2=0x7efde40b8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:18.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efde37fe640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efde40d27e0 0x7efde40b8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efde37fe640 1 -- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde40b4740 msgr2=0x7efde41524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:18.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efde37fe640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde40b4740 0x7efde41524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.495+0000 7efde37fe640 1 -- 172.21.15.120:0/1647294710 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde41f5540 con 0x7efde40d09c0 2024-07-27T03:10:18.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.496+0000 7efde37fe640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efde40d09c0 0x7efde409dc30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efdd8000c00 tx=0x7efdd8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:18.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.496+0000 7efde0ff9640 1 -- 172.21.15.120:0/1647294710 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8031d60 con 0x7efde40d09c0 2024-07-27T03:10:18.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.496+0000 7efde0ff9640 1 -- 172.21.15.120:0/1647294710 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdd8033e10 con 0x7efde40d09c0 2024-07-27T03:10:18.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.496+0000 7efdea5c7640 1 -- 172.21.15.120:0/1647294710 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde41f5820 con 0x7efde40d09c0 2024-07-27T03:10:18.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.496+0000 7efde0ff9640 1 -- 172.21.15.120:0/1647294710 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8033310 con 0x7efde40d09c0 2024-07-27T03:10:18.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.496+0000 7efdea5c7640 1 -- 172.21.15.120:0/1647294710 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde41f5de0 con 0x7efde40d09c0 2024-07-27T03:10:18.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.497+0000 7efdea5c7640 1 -- 172.21.15.120:0/1647294710 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde40d2bf0 con 0x7efde40d09c0 2024-07-27T03:10:18.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.498+0000 7efde0ff9640 1 -- 172.21.15.120:0/1647294710 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7efdd80334b0 con 0x7efde40d09c0 2024-07-27T03:10:18.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.498+0000 7efde0ff9640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efdd0077070 0x7efdd0079580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:18.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.498+0000 7efde0ff9640 1 -- 172.21.15.120:0/1647294710 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7efdd80b9ac0 con 0x7efde40d09c0 2024-07-27T03:10:18.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.499+0000 7efde3fff640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efdd0077070 0x7efdd0079580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:18.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.499+0000 7efde3fff640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efdd0077070 0x7efdd0079580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009530 tx=0x7efdd4009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:18.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.503+0000 7efde0ff9640 1 -- 172.21.15.120:0/1647294710 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7efdd803f030 con 0x7efde40d09c0 2024-07-27T03:10:18.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.723+0000 7efdea5c7640 1 -- 172.21.15.120:0/1647294710 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efde4075da0 con 0x7efde40d09c0 2024-07-27T03:10:18.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.724+0000 7efde0ff9640 1 -- 172.21.15.120:0/1647294710 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5229 (secure 0 0 0) 0x7efdd8082680 con 0x7efde40d09c0 2024-07-27T03:10:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:18.727 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":34,"btime":"2024-07-27T03:10:12:081716+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/296895260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":296895260},{"type":"v1","addr":"172.21.15.121:6837","nonce":296895260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/1978820402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1978820402},{"type":"v1","addr":"172.21.15.121:6836","nonce":1978820402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5325,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/1425775647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1425775647},{"type":"v1","addr":"172.21.15.120:6834","nonce":1425775647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:10:08.410648+0000","modified":"2024-07-27T03:10:11.449906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/890762307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":890762307},{"type":"v1","addr":"172.21.15.120:6835","nonce":890762307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-07-27T03:10:18.727 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 34 2024-07-27T03:10:18.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 -- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efdd0077070 msgr2=0x7efdd0079580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:18.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efdd0077070 0x7efdd0079580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009530 tx=0x7efdd4009260 comp rx=0 tx=0).stop 2024-07-27T03:10:18.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 -- 172.21.15.120:0/1647294710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efde40d09c0 msgr2=0x7efde409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:18.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efde40d09c0 0x7efde409dc30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efdd8000c00 tx=0x7efdd8033c20 comp rx=0 tx=0).stop 2024-07-27T03:10:18.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 -- 172.21.15.120:0/1647294710 shutdown_connections 2024-07-27T03:10:18.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efdd0077070 0x7efdd0079580 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efde40d09c0 0x7efde409dc30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efde40d27e0 0x7efde40b8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 --2- 172.21.15.120:0/1647294710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efde40b4740 0x7efde41524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:18.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 -- 172.21.15.120:0/1647294710 >> 172.21.15.120:0/1647294710 conn(0x7efde408d690 msgr2=0x7efde40b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:18.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 -- 172.21.15.120:0/1647294710 shutdown_connections 2024-07-27T03:10:18.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:18.726+0000 7efdea5c7640 1 -- 172.21.15.120:0/1647294710 wait complete. 2024-07-27T03:10:19.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:10:08.410648+0000', 'modified': '2024-07-27T03:10:11.449906+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5328}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5328': {'gid': 5328, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6835/890762307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6833', 'nonce': 890762307}, {'type': 'v1', 'addr': '172.21.15.120:6835', 'nonce': 890762307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5328, 'qdb_cluster': [5328]} 2024-07-27T03:10:19.143 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-27T03:10:19.143 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-07-27T03:10:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.255+0000 7fc574cf2640 1 -- 172.21.15.120:0/1223378983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc55c003a50 msgr2=0x7fc55c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.255+0000 7fc574cf2640 1 --2- 172.21.15.120:0/1223378983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc55c003a50 0x7fc55c003ec0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc560001d90 tx=0x7fc55c005830 comp rx=0 tx=0).stop 2024-07-27T03:10:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.256+0000 7fc574cf2640 1 -- 172.21.15.120:0/1223378983 shutdown_connections 2024-07-27T03:10:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.256+0000 7fc574cf2640 1 --2- 172.21.15.120:0/1223378983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc55c003a50 0x7fc55c003ec0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.256+0000 7fc574cf2640 1 -- 172.21.15.120:0/1223378983 >> 172.21.15.120:0/1223378983 conn(0x7fc57006cba0 msgr2=0x7fc57006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.256+0000 7fc574cf2640 1 -- 172.21.15.120:0/1223378983 shutdown_connections 2024-07-27T03:10:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.256+0000 7fc574cf2640 1 -- 172.21.15.120:0/1223378983 wait complete. 2024-07-27T03:10:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.257+0000 7fc574cf2640 1 Processor -- start 2024-07-27T03:10:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.258+0000 7fc574cf2640 1 -- start start 2024-07-27T03:10:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc574cf2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc55c003a50 0x7fc5700ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc574cf2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5701f38e0 0x7fc570158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc574cf2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc570156700 0x7fc570158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc574cf2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc57015efb0 con 0x7fc5701f38e0 2024-07-27T03:10:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc574cf2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc57015ee30 con 0x7fc55c003a50 2024-07-27T03:10:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc574cf2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc57015f130 con 0x7fc570156700 2024-07-27T03:10:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc56dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5701f38e0 0x7fc570158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc56dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5701f38e0 0x7fc570158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58336/0 (socket says 172.21.15.120:58336) 2024-07-27T03:10:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc56dd9b640 1 -- 172.21.15.120:0/2228814378 learned_addr learned my addr 172.21.15.120:0/2228814378 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc56e59c640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc55c003a50 0x7fc5700ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc56ed9d640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc570156700 0x7fc570158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc56dd9b640 1 -- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc570156700 msgr2=0x7fc570158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc56dd9b640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc570156700 0x7fc570158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc56dd9b640 1 -- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc55c003a50 msgr2=0x7fc5700ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc56dd9b640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc55c003a50 0x7fc5700ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc56dd9b640 1 -- 172.21.15.120:0/2228814378 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5701f0b80 con 0x7fc5701f38e0 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc56dd9b640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5701f38e0 0x7fc570158120 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc558001eb0 tx=0x7fc55800ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.259+0000 7fc566ffd640 1 -- 172.21.15.120:0/2228814378 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558015070 con 0x7fc5701f38e0 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.260+0000 7fc566ffd640 1 -- 172.21.15.120:0/2228814378 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc55800c9e0 con 0x7fc5701f38e0 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.260+0000 7fc566ffd640 1 -- 172.21.15.120:0/2228814378 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55800ce30 con 0x7fc5701f38e0 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.260+0000 7fc574cf2640 1 -- 172.21.15.120:0/2228814378 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5701f0e60 con 0x7fc5701f38e0 2024-07-27T03:10:19.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.260+0000 7fc574cf2640 1 -- 172.21.15.120:0/2228814378 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5701f1420 con 0x7fc5701f38e0 2024-07-27T03:10:19.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.261+0000 7fc566ffd640 1 -- 172.21.15.120:0/2228814378 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc558018070 con 0x7fc5701f38e0 2024-07-27T03:10:19.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.262+0000 7fc566ffd640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc550077010 0x7fc550079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.262+0000 7fc566ffd640 1 -- 172.21.15.120:0/2228814378 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fc558098c60 con 0x7fc5701f38e0 2024-07-27T03:10:19.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.262+0000 7fc56e59c640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc550077010 0x7fc550079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.263+0000 7fc56e59c640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc550077010 0x7fc550079520 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc560032000 tx=0x7fc560001510 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:19.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.263+0000 7fc57bc0a740 1 Processor -- start 2024-07-27T03:10:19.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.263+0000 7fc57bc0a740 1 -- start start 2024-07-27T03:10:19.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.264+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b7884a5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.264+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b78808f3b0 0x55b788487e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.264+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b788097590 0x55b788488380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.264+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b7883d0360 con 0x55b7880b8270 2024-07-27T03:10:19.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.264+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b7883bf860 con 0x55b788097590 2024-07-27T03:10:19.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.264+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55b7883c38a0 con 0x55b78808f3b0 2024-07-27T03:10:19.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.264+0000 7fc56e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b7884a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.264+0000 7fc56e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b7884a5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58348/0 (socket says 172.21.15.120:58348) 2024-07-27T03:10:19.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.264+0000 7fc56e59c640 1 -- 172.21.15.120:0/3325893464 learned_addr learned my addr 172.21.15.120:0/3325893464 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:19.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.264+0000 7fc56ed9d640 1 --2- 172.21.15.120:0/3325893464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b788097590 0x55b788488380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.264+0000 7fc56dd9b640 1 --2- 172.21.15.120:0/3325893464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b78808f3b0 0x55b788487e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.265+0000 7fc56e59c640 1 -- 172.21.15.120:0/3325893464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b78808f3b0 msgr2=0x55b788487e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:19.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.265+0000 7fc56e59c640 1 --2- 172.21.15.120:0/3325893464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b78808f3b0 0x55b788487e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.265+0000 7fc56e59c640 1 -- 172.21.15.120:0/3325893464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b788097590 msgr2=0x55b788488380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:19.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.265+0000 7fc56e59c640 1 --2- 172.21.15.120:0/3325893464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b788097590 0x55b788488380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.265+0000 7fc56e59c640 1 -- 172.21.15.120:0/3325893464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b78834f360 con 0x55b7880b8270 2024-07-27T03:10:19.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.265+0000 7fc56e59c640 1 --2- 172.21.15.120:0/3325893464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b7884a5170 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc560001e80 tx=0x7fc56003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4803b230b88a9 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:19.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.265+0000 7fc54ffff640 1 -- 172.21.15.120:0/3325893464 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560033680 con 0x55b7880b8270 2024-07-27T03:10:19.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.265+0000 7fc54ffff640 1 -- 172.21.15.120:0/3325893464 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc560033910 con 0x55b7880b8270 2024-07-27T03:10:19.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.265+0000 7fc54ffff640 1 -- 172.21.15.120:0/3325893464 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560033d40 con 0x55b7880b8270 2024-07-27T03:10:19.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.266+0000 7fc57bc0a740 1 -- 172.21.15.120:0/3325893464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 msgr2=0x55b7884a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.266+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/3325893464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b7884a5170 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc560001e80 tx=0x7fc56003e000 comp rx=0 tx=0).stop 2024-07-27T03:10:19.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.266+0000 7fc57bc0a740 1 -- 172.21.15.120:0/3325893464 shutdown_connections 2024-07-27T03:10:19.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.266+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/3325893464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b788097590 0x55b788488380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.266+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/3325893464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b78808f3b0 0x55b788487e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.266+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/3325893464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b7884a5170 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.266+0000 7fc57bc0a740 1 -- 172.21.15.120:0/3325893464 >> 172.21.15.120:0/3325893464 conn(0x55b7880ac3c0 msgr2=0x55b78845e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:19.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.266+0000 7fc57bc0a740 1 -- 172.21.15.120:0/3325893464 shutdown_connections 2024-07-27T03:10:19.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.266+0000 7fc57bc0a740 1 -- 172.21.15.120:0/3325893464 wait complete. 2024-07-27T03:10:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.267+0000 7fc57bc0a740 1 -- start start 2024-07-27T03:10:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.267+0000 7fc57bc0a740 1 Processor -- start 2024-07-27T03:10:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.268+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78808f3b0 0x55b7884766f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.268+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b788097590 0x55b788483680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.268+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78849aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.268+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b788132620 con 0x55b7880b8270 2024-07-27T03:10:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.268+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b78835b140 con 0x55b78808f3b0 2024-07-27T03:10:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.268+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55b788484170 con 0x55b788097590 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.268+0000 7fc57bc0a740 10 client.0 _ll_register_callbacks cb 0x55b7883b8c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.268+0000 7fc56ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78849aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc56ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78849aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58356/0 (socket says 172.21.15.120:58356) 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc56ed9d640 1 -- 172.21.15.120:0/922674637 learned_addr learned my addr 172.21.15.120:0/922674637 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc56dd9b640 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b788097590 0x55b788483680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc56e59c640 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78808f3b0 0x55b7884766f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc56ed9d640 1 -- 172.21.15.120:0/922674637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b788097590 msgr2=0x55b788483680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc56ed9d640 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b788097590 0x55b788483680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc56ed9d640 1 -- 172.21.15.120:0/922674637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78808f3b0 msgr2=0x55b7884766f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc56ed9d640 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78808f3b0 0x55b7884766f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc56ed9d640 1 -- 172.21.15.120:0/922674637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b788123850 con 0x55b7880b8270 2024-07-27T03:10:19.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc56ed9d640 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78849aaf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc5700b1b50 tx=0x7fc568012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e67e21892c4148 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc54d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc54d7fa640 1 -- 172.21.15.120:0/922674637 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568011650 con 0x55b7880b8270 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc54d7fa640 1 -- 172.21.15.120:0/922674637 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fc56801dad0 con 0x55b7880b8270 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc57bc0a740 1 -- 172.21.15.120:0/922674637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc560033910 con 0x55b7880b8270 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc54d7fa640 1 -- 172.21.15.120:0/922674637 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc56801dcd0 con 0x55b7880b8270 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc57bc0a740 10 client.5475 fetch_fsmap learned FSMap version 34 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc57bc0a740 1 -- 172.21.15.120:0/922674637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55b78819a6b0 con 0x55b7880b8270 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc54d7fa640 1 -- 172.21.15.120:0/922674637 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc560033910 con 0x55b7880b8270 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.269+0000 7fc54d7fa640 1 -- 172.21.15.120:0/922674637 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7fc568024050 con 0x55b7880b8270 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.270+0000 7fc57bc0a740 10 client.5475 fetch_fsmap finished waiting for FSMap version 34 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.270+0000 7fc57bc0a740 10 client.5475 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.270+0000 7fc57bc0a740 20 client.5475 populate_metadata read hostname 'smithi120' 2024-07-27T03:10:19.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.270+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x55b788076e40 0x55b7884b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.270+0000 7fc57bc0a740 4 client.5475 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.270+0000 7fc57bc0a740 1 -- 172.21.15.120:0/922674637 --> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7883d22b0 con 0x55b788076e40 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.270+0000 7fc56e59c640 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x55b788076e40 0x55b7884b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.270+0000 7fc54d7fa640 10 client.5475 ms_handle_connect on v2:172.21.15.120:6833/890762307 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.270+0000 7fc56e59c640 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x55b788076e40 0x55b7884b2200 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c777aec5e72f9e7 server_cookie=9edf41fd2b503a49 in_seq=0 out_seq=0 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc54d7fa640 1 -- 172.21.15.120:0/922674637 <== mds.0 v2:172.21.15.120:6833/890762307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7883d22b0 con 0x55b788076e40 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc54d7fa640 10 client.5475 handle_command_reply: tid=0 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 1 client.5475 shutdown 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 1 -- 172.21.15.120:0/922674637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 msgr2=0x55b78849aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78849aaf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc5700b1b50 tx=0x7fc568012820 comp rx=0 tx=0).stop 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 1 -- 172.21.15.120:0/922674637 shutdown_connections 2024-07-27T03:10:19.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x55b788076e40 0x55b7884b2200 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78849aaf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b788097590 0x55b788483680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/922674637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b78808f3b0 0x55b7884766f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc54d7fa640 0 client.5475 ms_handle_reset on v2:172.21.15.120:6833/890762307 2024-07-27T03:10:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 1 -- 172.21.15.120:0/922674637 >> 172.21.15.120:0/922674637 conn(0x55b7880ac3c0 msgr2=0x55b78845e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 1 -- 172.21.15.120:0/922674637 shutdown_connections 2024-07-27T03:10:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 1 -- 172.21.15.120:0/922674637 wait complete. 2024-07-27T03:10:19.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.271+0000 7fc57bc0a740 20 client.5475 trim_cache size 0 max 16384 2024-07-27T03:10:19.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.290+0000 7fc57bc0a740 1 Processor -- start 2024-07-27T03:10:19.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.290+0000 7fc57bc0a740 1 -- start start 2024-07-27T03:10:19.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.291+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b78808f3b0 0x55b78845edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.291+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b788097590 0x55b7884a5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.291+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78845e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.291+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc5701fc900 con 0x55b7880b8270 2024-07-27T03:10:19.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.291+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc5701f2890 con 0x55b788097590 2024-07-27T03:10:19.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.291+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc5701fc340 con 0x55b78808f3b0 2024-07-27T03:10:19.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78845e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78845e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58362/0 (socket says 172.21.15.120:58362) 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56ed9d640 1 -- 172.21.15.120:0/1751309656 learned_addr learned my addr 172.21.15.120:0/1751309656 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56dd9b640 1 --2- 172.21.15.120:0/1751309656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b788097590 0x55b7884a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56e59c640 1 --2- 172.21.15.120:0/1751309656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b78808f3b0 0x55b78845edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56ed9d640 1 -- 172.21.15.120:0/1751309656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b78808f3b0 msgr2=0x55b78845edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56ed9d640 1 --2- 172.21.15.120:0/1751309656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b78808f3b0 0x55b78845edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56ed9d640 1 -- 172.21.15.120:0/1751309656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b788097590 msgr2=0x55b7884a5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56ed9d640 1 --2- 172.21.15.120:0/1751309656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b788097590 0x55b7884a5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56ed9d640 1 -- 172.21.15.120:0/1751309656 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b78845ae50 con 0x55b7880b8270 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56dd9b640 1 --2- 172.21.15.120:0/1751309656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b788097590 0x55b7884a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc56ed9d640 1 --2- 172.21.15.120:0/1751309656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78845e110 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc568011750 tx=0x7fc568011780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8def35fbefc7ebfa server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc54f7fe640 1 -- 172.21.15.120:0/1751309656 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568011a30 con 0x55b7880b8270 2024-07-27T03:10:19.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc54f7fe640 1 -- 172.21.15.120:0/1751309656 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc56802b070 con 0x55b7880b8270 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.292+0000 7fc54f7fe640 1 -- 172.21.15.120:0/1751309656 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568011e70 con 0x55b7880b8270 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.293+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1751309656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 msgr2=0x55b78845e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.293+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/1751309656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78845e110 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc568011750 tx=0x7fc568011780 comp rx=0 tx=0).stop 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.293+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1751309656 shutdown_connections 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.293+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/1751309656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b7880b8270 0x55b78845e110 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.293+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/1751309656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b788097590 0x55b7884a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.293+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/1751309656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b78808f3b0 0x55b78845edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.293+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1751309656 >> 172.21.15.120:0/1751309656 conn(0x55b7880ac3c0 msgr2=0x55b788498bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.293+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1751309656 shutdown_connections 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.293+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1751309656 wait complete. 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.294+0000 7fc57bc0a740 1 -- start start 2024-07-27T03:10:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.294+0000 7fc57bc0a740 1 Processor -- start 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.295+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b78808f3b0 0x55b78851acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.295+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b788097590 0x55b78849e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.295+0000 7fc57bc0a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b7880b8270 0x55b78849e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.295+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b78849b030 con 0x55b78808f3b0 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.295+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b788483eb0 con 0x55b7880b8270 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.295+0000 7fc57bc0a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55b78849c8a0 con 0x55b788097590 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.295+0000 7fc57bc0a740 10 client.0 _ll_register_callbacks cb 0x7fc56800d9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.295+0000 7fc56e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b78808f3b0 0x55b78851acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.295+0000 7fc56e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b78808f3b0 0x55b78851acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58366/0 (socket says 172.21.15.120:58366) 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.295+0000 7fc56e59c640 1 -- 172.21.15.120:0/1231569558 learned_addr learned my addr 172.21.15.120:0/1231569558 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc56e59c640 1 -- 172.21.15.120:0/1231569558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b788097590 msgr2=0x55b78849e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc56dd9b640 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b788097590 0x55b78849e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc56ed9d640 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b7880b8270 0x55b78849e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc56e59c640 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b788097590 0x55b78849e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc56e59c640 1 -- 172.21.15.120:0/1231569558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b7880b8270 msgr2=0x55b78849e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc56e59c640 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b7880b8270 0x55b78849e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc56e59c640 1 -- 172.21.15.120:0/1231569558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7884780f0 con 0x55b78808f3b0 2024-07-27T03:10:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc56e59c640 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b78808f3b0 0x55b78851acd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc56002ac70 tx=0x7fc56002ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c6aaaf6ac6e542 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc54d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:10:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc54d7fa640 1 -- 172.21.15.120:0/1231569558 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560033480 con 0x55b78808f3b0 2024-07-27T03:10:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc54d7fa640 1 -- 172.21.15.120:0/1231569558 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fc560052040 con 0x55b78808f3b0 2024-07-27T03:10:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1231569558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc56802b070 con 0x55b78808f3b0 2024-07-27T03:10:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc54d7fa640 1 -- 172.21.15.120:0/1231569558 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc56006a050 con 0x55b78808f3b0 2024-07-27T03:10:19.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc57bc0a740 10 client.5481 fetch_fsmap learned FSMap version 34 2024-07-27T03:10:19.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1231569558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55b7884b61a0 con 0x55b78808f3b0 2024-07-27T03:10:19.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc54d7fa640 1 -- 172.21.15.120:0/1231569558 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc56802b070 con 0x55b78808f3b0 2024-07-27T03:10:19.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc54d7fa640 1 -- 172.21.15.120:0/1231569558 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7fc56006d020 con 0x55b78808f3b0 2024-07-27T03:10:19.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc57bc0a740 10 client.5481 fetch_fsmap finished waiting for FSMap version 34 2024-07-27T03:10:19.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc57bc0a740 10 client.5481 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:10:19.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc57bc0a740 20 client.5481 populate_metadata read hostname 'smithi120' 2024-07-27T03:10:19.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x55b7885280f0 0x55b788528500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc57bc0a740 4 client.5481 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:10:19.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.296+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1231569558 --> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] -- command(tid 0: {"prefix": "status"}) -- 0x55b7883cdd50 con 0x55b7885280f0 2024-07-27T03:10:19.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.297+0000 7fc56dd9b640 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x55b7885280f0 0x55b788528500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.297+0000 7fc54d7fa640 10 client.5481 ms_handle_connect on v2:172.21.15.120:6833/890762307 2024-07-27T03:10:19.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.297+0000 7fc56dd9b640 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x55b7885280f0 0x55b788528500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=957a93eeef2474f5 server_cookie=3a7a9bf2a53f2c87 in_seq=0 out_seq=0 2024-07-27T03:10:19.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.297+0000 7fc54d7fa640 1 -- 172.21.15.120:0/1231569558 <== mds.0 v2:172.21.15.120:6833/890762307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b7883cdd50 con 0x55b7885280f0 2024-07-27T03:10:19.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.297+0000 7fc54d7fa640 10 client.5481 handle_command_reply: tid=0 2024-07-27T03:10:19.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.297+0000 7fc57bc0a740 1 client.5481 shutdown 2024-07-27T03:10:19.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.297+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1231569558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b78808f3b0 msgr2=0x55b78851acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.297+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b78808f3b0 0x55b78851acd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc56002ac70 tx=0x7fc56002ae40 comp rx=0 tx=0).stop 2024-07-27T03:10:19.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1231569558 shutdown_connections 2024-07-27T03:10:19.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x55b7885280f0 0x55b788528500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b7880b8270 0x55b78849e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b788097590 0x55b78849e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc54d7fa640 0 client.5481 ms_handle_reset on v2:172.21.15.120:6833/890762307 2024-07-27T03:10:19.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc57bc0a740 1 --2- 172.21.15.120:0/1231569558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b78808f3b0 0x55b78851acd0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1231569558 >> 172.21.15.120:0/1231569558 conn(0x55b7880ac3c0 msgr2=0x55b7884b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:19.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1231569558 shutdown_connections 2024-07-27T03:10:19.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc57bc0a740 1 -- 172.21.15.120:0/1231569558 wait complete. 2024-07-27T03:10:19.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc57bc0a740 20 client.5481 trim_cache size 0 max 16384 2024-07-27T03:10:19.307 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:10:19.308 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:10:19.308 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-07-27T03:10:19.308 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5328, 2024-07-27T03:10:19.308 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:10:19.308 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:10:19.308 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:10:19.308 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 10.231696294000001, 2024-07-27T03:10:19.308 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 34, 2024-07-27T03:10:19.308 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 44, 2024-07-27T03:10:19.308 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 44, 2024-07-27T03:10:19.308 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 14.905441100000001 2024-07-27T03:10:19.309 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:10:19.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 -- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc550077010 msgr2=0x7fc550079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc550077010 0x7fc550079520 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc560032000 tx=0x7fc560001510 comp rx=0 tx=0).stop 2024-07-27T03:10:19.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 -- 172.21.15.120:0/2228814378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5701f38e0 msgr2=0x7fc570158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5701f38e0 0x7fc570158120 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc558001eb0 tx=0x7fc55800ea00 comp rx=0 tx=0).stop 2024-07-27T03:10:19.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 -- 172.21.15.120:0/2228814378 shutdown_connections 2024-07-27T03:10:19.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc550077010 0x7fc550079520 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5701f38e0 0x7fc570158120 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc570156700 0x7fc570158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 --2- 172.21.15.120:0/2228814378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc55c003a50 0x7fc5700ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 -- 172.21.15.120:0/2228814378 >> 172.21.15.120:0/2228814378 conn(0x7fc57006cba0 msgr2=0x7fc570075750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:19.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 -- 172.21.15.120:0/2228814378 shutdown_connections 2024-07-27T03:10:19.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.298+0000 7fc574cf2640 1 -- 172.21.15.120:0/2228814378 wait complete. 2024-07-27T03:10:19.312 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-27T03:10:19.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.423+0000 7f0b28a75640 1 -- 172.21.15.120:0/795659926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b2406eb00 msgr2=0x7f0b2406ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.423+0000 7f0b28a75640 1 --2- 172.21.15.120:0/795659926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b2406eb00 0x7f0b2406ef10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c005fd0 tx=0x7f0b1c02aa00 comp rx=0 tx=0).stop 2024-07-27T03:10:19.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.423+0000 7f0b28a75640 1 -- 172.21.15.120:0/795659926 shutdown_connections 2024-07-27T03:10:19.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.423+0000 7f0b28a75640 1 --2- 172.21.15.120:0/795659926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b2406eb00 0x7f0b2406ef10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.423+0000 7f0b28a75640 1 --2- 172.21.15.120:0/795659926 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b2415c000 0x7f0b2415c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.423+0000 7f0b28a75640 1 -- 172.21.15.120:0/795659926 >> 172.21.15.120:0/795659926 conn(0x7f0b240b1a10 msgr2=0x7f0b240b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:19.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.423+0000 7f0b28a75640 1 -- 172.21.15.120:0/795659926 shutdown_connections 2024-07-27T03:10:19.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.423+0000 7f0b28a75640 1 -- 172.21.15.120:0/795659926 wait complete. 2024-07-27T03:10:19.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.425+0000 7f0b28a75640 1 Processor -- start 2024-07-27T03:10:19.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.425+0000 7f0b28a75640 1 -- start start 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b28a75640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b2406eb00 0x7f0b24153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b28a75640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b241585d0 0x7f0b24155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b28a75640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b2415c000 0x7f0b24155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b28a75640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2406e600 con 0x7f0b241585d0 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b28a75640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2406e480 con 0x7f0b2415c000 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b28a75640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2406e780 con 0x7f0b2406eb00 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b21d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b241585d0 0x7f0b24155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b21d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b241585d0 0x7f0b24155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58372/0 (socket says 172.21.15.120:58372) 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b21d9b640 1 -- 172.21.15.120:0/449413279 learned_addr learned my addr 172.21.15.120:0/449413279 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b22d9d640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b2415c000 0x7f0b24155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b2259c640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b2406eb00 0x7f0b24153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b21d9b640 1 -- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b2406eb00 msgr2=0x7f0b24153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b21d9b640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b2406eb00 0x7f0b24153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b21d9b640 1 -- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b2415c000 msgr2=0x7f0b24155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b21d9b640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b2415c000 0x7f0b24155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b21d9b640 1 -- 172.21.15.120:0/449413279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b24156500 con 0x7f0b241585d0 2024-07-27T03:10:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b21d9b640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b241585d0 0x7f0b24155760 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0b18007850 tx=0x7f0b18007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b12ffd640 1 -- 172.21.15.120:0/449413279 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18019020 con 0x7f0b241585d0 2024-07-27T03:10:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b12ffd640 1 -- 172.21.15.120:0/449413279 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b18005020 con 0x7f0b241585d0 2024-07-27T03:10:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b28a75640 1 -- 172.21.15.120:0/449413279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b241567e0 con 0x7f0b241585d0 2024-07-27T03:10:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b12ffd640 1 -- 172.21.15.120:0/449413279 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18005450 con 0x7f0b241585d0 2024-07-27T03:10:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.427+0000 7f0b28a75640 1 -- 172.21.15.120:0/449413279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b24156da0 con 0x7f0b241585d0 2024-07-27T03:10:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.428+0000 7f0b28a75640 1 -- 172.21.15.120:0/449413279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b2406ef10 con 0x7f0b241585d0 2024-07-27T03:10:19.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.429+0000 7f0b12ffd640 1 -- 172.21.15.120:0/449413279 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0b180047a0 con 0x7f0b241585d0 2024-07-27T03:10:19.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.429+0000 7f0b12ffd640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0b04077010 0x7f0b04079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:19.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.430+0000 7f0b12ffd640 1 -- 172.21.15.120:0/449413279 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f0b1809a330 con 0x7f0b241585d0 2024-07-27T03:10:19.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.430+0000 7f0b2259c640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0b04077010 0x7f0b04079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:19.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.430+0000 7f0b2259c640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0b04077010 0x7f0b04079520 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0b2409e0b0 tx=0x7f0b14009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.434+0000 7f0b12ffd640 1 -- 172.21.15.120:0/449413279 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f0b18023020 con 0x7f0b241585d0 2024-07-27T03:10:19.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.659+0000 7f0b28a75640 1 -- 172.21.15.120:0/449413279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0b24156290 con 0x7f0b241585d0 2024-07-27T03:10:19.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.659+0000 7f0b12ffd640 1 -- 172.21.15.120:0/449413279 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7f0b18063000 con 0x7f0b241585d0 2024-07-27T03:10:19.662 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-27T03:10:19.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 -- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0b04077010 msgr2=0x7f0b04079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0b04077010 0x7f0b04079520 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0b2409e0b0 tx=0x7f0b14009060 comp rx=0 tx=0).stop 2024-07-27T03:10:19.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 -- 172.21.15.120:0/449413279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b241585d0 msgr2=0x7f0b24155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:19.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b241585d0 0x7f0b24155760 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0b18007850 tx=0x7f0b18007d10 comp rx=0 tx=0).stop 2024-07-27T03:10:19.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 -- 172.21.15.120:0/449413279 shutdown_connections 2024-07-27T03:10:19.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0b04077010 0x7f0b04079520 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b241585d0 0x7f0b24155760 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b2415c000 0x7f0b24155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 --2- 172.21.15.120:0/449413279 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0b2406eb00 0x7f0b24153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:19.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 -- 172.21.15.120:0/449413279 >> 172.21.15.120:0/449413279 conn(0x7f0b240b1a10 msgr2=0x7f0b240b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:19.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 -- 172.21.15.120:0/449413279 shutdown_connections 2024-07-27T03:10:19.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19.661+0000 7f0b28a75640 1 -- 172.21.15.120:0/449413279 wait complete. 2024-07-27T03:10:19.675 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-07-27T03:10:19.675 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-27T03:10:19.676 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-07-27T03:10:19.676 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-07-27T03:10:19.676 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-27T03:10:19.676 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-07-27T03:10:19.676 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-07-27T03:10:19.676 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-27T03:10:19.676 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:10:19.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:10:19.676 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-07-27T03:10:19.692 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:10:19.692 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:10:19.692 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:10:19.692 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:10:19.692 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-07-27T03:10:19.692 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42657sec preferred_lft 42657sec 2024-07-27T03:10:19.693 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 1a:04:15:6c:cf:e1 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::d44a:78ff:feef:fe4e/64 scope link 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether d2:ac:2a:c4:e4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::d0ac:2aff:fec4:e45e/64 scope link 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-27T03:10:19.694 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 1a:04:15:6c:cf:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-07-27T03:10:19.695 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::1804:15ff:fe6c:cfe1/64 scope link 2024-07-27T03:10:19.695 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:10:19.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:10:19.695 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-27T03:10:19.755 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-07-27T03:10:19.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:10:19.757 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-07-27T03:10:19.813 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-07-27T03:10:19.813 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-27T03:10:19.813 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-27T03:10:19.813 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-27T03:10:19.813 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-27T03:10:19.814 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:10:19.814 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:10:19.814 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-27T03:10:19.814 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-27T03:10:19.814 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-27T03:10:19.814 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:10:19.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:10:19.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:10:19.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:10:19.940 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-07-27T03:10:19.955 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-07-27T03:10:19.955 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-27T03:10:19.956 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:10:19.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:10:19.956 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-07-27T03:10:20.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:10:20.022 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-07-27T03:10:20.075 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:10:20.076 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:10:20.076 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-07-27T03:10:20.131 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-07-27T03:10:20.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:10:20.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:10:20.226 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:10:20.226 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:10:20.233 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:10:20.233 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:10:20.233 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-07-27T03:10:20.233 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: trying mount with new device syntax: 0@81c6fc84-d59a-4d77-bf87-f698cf0d6963.cephfs=/ 2024-07-27T03:10:20.234 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.120:3300/172.21.15.121:3300/172.21.15.121:3301" will pass to kernel 2024-07-27T03:10:20.234 INFO:teuthology.orchestra.run.smithi120.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-07-27T03:10:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: You just mounted a file system that supports labels which does not 2024-07-27T03:10:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-27T03:10:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: applications will generate AVC messages and not be allowed access to 2024-07-27T03:10:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-27T03:10:20.236 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-27T03:10:20.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:10:20.236 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-07-27T03:10:20.261 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:10:20.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:10:20.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:10:20.365 INFO:teuthology.orchestra.run.smithi120.stdout:client5263 2024-07-27T03:10:20.365 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:10:20.365 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:10:20.380 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-07-27T03:10:20.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.535+0000 7feed9576640 1 -- 172.21.15.120:0/2543036357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feec0003a00 msgr2=0x7feec0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.535+0000 7feed9576640 1 --2- 172.21.15.120:0/2543036357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feec0003a00 0x7feec0003e70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7feecc002230 tx=0x7feec0005830 comp rx=0 tx=0).stop 2024-07-27T03:10:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.535+0000 7feed37fe640 1 -- 172.21.15.120:0/2543036357 reap_dead start 2024-07-27T03:10:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.535+0000 7feed9576640 1 -- 172.21.15.120:0/2543036357 shutdown_connections 2024-07-27T03:10:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.535+0000 7feed9576640 1 -- 172.21.15.120:0/2543036357 >> 172.21.15.120:0/2543036357 conn(0x7feed40d1dd0 msgr2=0x7feed40d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.535+0000 7feed9576640 1 -- 172.21.15.120:0/2543036357 shutdown_connections 2024-07-27T03:10:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.535+0000 7feed9576640 1 -- 172.21.15.120:0/2543036357 wait complete. 2024-07-27T03:10:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.537+0000 7feed9576640 1 Processor -- start 2024-07-27T03:10:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.537+0000 7feed9576640 1 -- start start 2024-07-27T03:10:20.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed9576640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec0003a00 0x7feed41e3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:20.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed9576640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feed41def10 0x7feed40af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:20.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed9576640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed41de3b0 0x7feed41de7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:20.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed9576640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7feed40b1b00 con 0x7feed41de3b0 2024-07-27T03:10:20.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed9576640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feed40b1980 con 0x7feec0003a00 2024-07-27T03:10:20.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed9576640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7feed40b1c80 con 0x7feed41def10 2024-07-27T03:10:20.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed41de3b0 0x7feed41de7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:20.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed41de3b0 0x7feed41de7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58392/0 (socket says 172.21.15.120:58392) 2024-07-27T03:10:20.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed37fe640 1 -- 172.21.15.120:0/2805030332 learned_addr learned my addr 172.21.15.120:0/2805030332 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:20.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed2ffd640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec0003a00 0x7feed41e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:20.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed27fc640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feed41def10 0x7feed40af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:20.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed37fe640 1 -- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feed41def10 msgr2=0x7feed40af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:20.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed37fe640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feed41def10 0x7feed40af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:20.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed37fe640 1 -- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec0003a00 msgr2=0x7feed41e3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:20.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed37fe640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec0003a00 0x7feed41e3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:20.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed37fe640 1 -- 172.21.15.120:0/2805030332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed41df780 con 0x7feed41de3b0 2024-07-27T03:10:20.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.538+0000 7feed2ffd640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec0003a00 0x7feed41e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:10:20.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.539+0000 7feed37fe640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed41de3b0 0x7feed41de7c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7feed4069c60 tx=0x7feec4011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:20.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.539+0000 7feecb7fe640 1 -- 172.21.15.120:0/2805030332 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec401f070 con 0x7feed41de3b0 2024-07-27T03:10:20.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.539+0000 7feecb7fe640 1 -- 172.21.15.120:0/2805030332 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feec400fb40 con 0x7feed41de3b0 2024-07-27T03:10:20.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.539+0000 7feed9576640 1 -- 172.21.15.120:0/2805030332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed41ded00 con 0x7feed41de3b0 2024-07-27T03:10:20.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.539+0000 7feecb7fe640 1 -- 172.21.15.120:0/2805030332 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4012450 con 0x7feed41de3b0 2024-07-27T03:10:20.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.539+0000 7feed9576640 1 -- 172.21.15.120:0/2805030332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed40cbeb0 con 0x7feed41de3b0 2024-07-27T03:10:20.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.540+0000 7feed9576640 1 -- 172.21.15.120:0/2805030332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feed40cb940 con 0x7feed41de3b0 2024-07-27T03:10:20.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.540+0000 7feecb7fe640 1 -- 172.21.15.120:0/2805030332 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7feec4022070 con 0x7feed41de3b0 2024-07-27T03:10:20.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.541+0000 7feecb7fe640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feeb4077040 0x7feeb4079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:20.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.541+0000 7feecb7fe640 1 -- 172.21.15.120:0/2805030332 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7feec4099230 con 0x7feed41de3b0 2024-07-27T03:10:20.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.541+0000 7feed2ffd640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feeb4077040 0x7feeb4079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:20.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.542+0000 7feed2ffd640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feeb4077040 0x7feeb4079550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feecc033000 tx=0x7feecc038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:20.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.545+0000 7feecb7fe640 1 -- 172.21.15.120:0/2805030332 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7feec4061e70 con 0x7feed41de3b0 2024-07-27T03:10:20.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.766+0000 7feed9576640 1 -- 172.21.15.120:0/2805030332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7feed406a610 con 0x7feed41de3b0 2024-07-27T03:10:20.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.931+0000 7feecb7fe640 1 -- 172.21.15.120:0/2805030332 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v35) ==== 105+0+0 (secure 0 0 0) 0x7feed406a610 con 0x7feed41de3b0 2024-07-27T03:10:20.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.934+0000 7feed9576640 1 -- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feeb4077040 msgr2=0x7feeb4079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:20.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.934+0000 7feed9576640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feeb4077040 0x7feeb4079550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feecc033000 tx=0x7feecc038040 comp rx=0 tx=0).stop 2024-07-27T03:10:20.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.934+0000 7feed9576640 1 -- 172.21.15.120:0/2805030332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed41de3b0 msgr2=0x7feed41de7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:20.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.934+0000 7feed9576640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed41de3b0 0x7feed41de7c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7feed4069c60 tx=0x7feec4011b10 comp rx=0 tx=0).stop 2024-07-27T03:10:20.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.934+0000 7feed9576640 1 -- 172.21.15.120:0/2805030332 shutdown_connections 2024-07-27T03:10:20.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.934+0000 7feed9576640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feeb4077040 0x7feeb4079550 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:20.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.934+0000 7feed9576640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed41de3b0 0x7feed41de7c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:20.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.934+0000 7feed9576640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feed41def10 0x7feed40af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:20.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.934+0000 7feed9576640 1 --2- 172.21.15.120:0/2805030332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec0003a00 0x7feed41e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:20.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.934+0000 7feed9576640 1 -- 172.21.15.120:0/2805030332 >> 172.21.15.120:0/2805030332 conn(0x7feed40d1dd0 msgr2=0x7feed41e8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:20.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.934+0000 7feed9576640 1 -- 172.21.15.120:0/2805030332 shutdown_connections 2024-07-27T03:10:20.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:20.935+0000 7feed9576640 1 -- 172.21.15.120:0/2805030332 wait complete. 2024-07-27T03:10:20.953 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:10:21.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.064+0000 7f4121414640 1 -- 172.21.15.120:0/3190450845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f411c0d27e0 msgr2=0x7f411c0d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:21.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.064+0000 7f4121414640 1 --2- 172.21.15.120:0/3190450845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f411c0d27e0 0x7f411c0d2bf0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f411c0b3b30 tx=0x7f411002a560 comp rx=0 tx=0).stop 2024-07-27T03:10:21.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.064+0000 7f4121414640 1 -- 172.21.15.120:0/3190450845 shutdown_connections 2024-07-27T03:10:21.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.064+0000 7f4121414640 1 --2- 172.21.15.120:0/3190450845 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f411c0d27e0 0x7f411c0d2bf0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:21.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.064+0000 7f4121414640 1 --2- 172.21.15.120:0/3190450845 >> v2:172.21.15.121:3300/0 conn(0x7f411c0b4740 0x7f411c0b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:21.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.064+0000 7f4121414640 1 -- 172.21.15.120:0/3190450845 >> 172.21.15.120:0/3190450845 conn(0x7f411c08d690 msgr2=0x7f411c09d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:21.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.064+0000 7f4121414640 1 -- 172.21.15.120:0/3190450845 shutdown_connections 2024-07-27T03:10:21.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.064+0000 7f4121414640 1 -- 172.21.15.120:0/3190450845 wait complete. 2024-07-27T03:10:21.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.066+0000 7f4121414640 1 Processor -- start 2024-07-27T03:10:21.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.066+0000 7f4121414640 1 -- start start 2024-07-27T03:10:21.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f4121414640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f411c0b4740 0x7f411c152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:21.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f4121414640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f411c0d09c0 0x7f411c0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f4121414640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f411c0d27e0 0x7f411c0b8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f4121414640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f411c0cef70 con 0x7f411c0d09c0 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f4121414640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f411c0cedf0 con 0x7f411c0b4740 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f4121414640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f411c0cf0f0 con 0x7f411c0d27e0 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f411a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f411c0d09c0 0x7f411c0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f411a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f411c0d09c0 0x7f411c0c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58404/0 (socket says 172.21.15.120:58404) 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f411a7fc640 1 -- 172.21.15.120:0/225843352 learned_addr learned my addr 172.21.15.120:0/225843352 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f411affd640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f411c0b4740 0x7f411c152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f411b7fe640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f411c0d27e0 0x7f411c0b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f411a7fc640 1 -- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f411c0d27e0 msgr2=0x7f411c0b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f411a7fc640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f411c0d27e0 0x7f411c0b8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f411a7fc640 1 -- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f411c0b4740 msgr2=0x7f411c152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:21.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f411a7fc640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f411c0b4740 0x7f411c152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:21.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f411a7fc640 1 -- 172.21.15.120:0/225843352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411c0ca430 con 0x7f411c0d09c0 2024-07-27T03:10:21.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.067+0000 7f411a7fc640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f411c0d09c0 0x7f411c0c9ef0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4110000c00 tx=0x7f4110003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:21.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.068+0000 7f41037fe640 1 -- 172.21.15.120:0/225843352 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411003e030 con 0x7f411c0d09c0 2024-07-27T03:10:21.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.068+0000 7f41037fe640 1 -- 172.21.15.120:0/225843352 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4110003e00 con 0x7f411c0d09c0 2024-07-27T03:10:21.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.068+0000 7f41037fe640 1 -- 172.21.15.120:0/225843352 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110035040 con 0x7f411c0d09c0 2024-07-27T03:10:21.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.068+0000 7f4121414640 1 -- 172.21.15.120:0/225843352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411c152b70 con 0x7f411c0d09c0 2024-07-27T03:10:21.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.068+0000 7f4121414640 1 -- 172.21.15.120:0/225843352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f411c0c8310 con 0x7f411c0d09c0 2024-07-27T03:10:21.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.069+0000 7f4121414640 1 -- 172.21.15.120:0/225843352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411c0d2bf0 con 0x7f411c0d09c0 2024-07-27T03:10:21.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.069+0000 7f41037fe640 1 -- 172.21.15.120:0/225843352 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4110041030 con 0x7f411c0d09c0 2024-07-27T03:10:21.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.070+0000 7f41037fe640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4108077040 0x7f4108079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:21.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.070+0000 7f41037fe640 1 -- 172.21.15.120:0/225843352 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f41100b9100 con 0x7f411c0d09c0 2024-07-27T03:10:21.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.070+0000 7f411affd640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4108077040 0x7f4108079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:21.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.071+0000 7f411affd640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4108077040 0x7f4108079550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f410c005fd0 tx=0x7f410c0097d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:21.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.074+0000 7f41037fe640 1 -- 172.21.15.120:0/225843352 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f4110082300 con 0x7f411c0d09c0 2024-07-27T03:10:21.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.297+0000 7f4121414640 1 -- 172.21.15.120:0/225843352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f411c0c7dc0 con 0x7f411c0d09c0 2024-07-27T03:10:21.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.298+0000 7f41037fe640 1 -- 172.21.15.120:0/225843352 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5245 (secure 0 0 0) 0x7f4110081c00 con 0x7f411c0d09c0 2024-07-27T03:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:21.301 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"btime":"2024-07-27T03:10:20:931049+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/296895260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":296895260},{"type":"v1","addr":"172.21.15.121:6837","nonce":296895260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/1978820402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1978820402},{"type":"v1","addr":"172.21.15.121:6836","nonce":1978820402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:10:08.410648+0000","modified":"2024-07-27T03:10:20.931031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":5328,"mds_1":5325},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5325":{"gid":5325,"name":"a","rank":1,"incarnation":35,"state":"up:creating","state_seq":1,"addr":"172.21.15.120:6834/1425775647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1425775647},{"type":"v1","addr":"172.21.15.120:6834","nonce":1425775647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/890762307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":890762307},{"type":"v1","addr":"172.21.15.120:6835","nonce":890762307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-07-27T03:10:21.301 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 35 2024-07-27T03:10:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 -- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4108077040 msgr2=0x7f4108079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4108077040 0x7f4108079550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f410c005fd0 tx=0x7f410c0097d0 comp rx=0 tx=0).stop 2024-07-27T03:10:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 -- 172.21.15.120:0/225843352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f411c0d09c0 msgr2=0x7f411c0c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f411c0d09c0 0x7f411c0c9ef0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4110000c00 tx=0x7f4110003910 comp rx=0 tx=0).stop 2024-07-27T03:10:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 -- 172.21.15.120:0/225843352 shutdown_connections 2024-07-27T03:10:21.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4108077040 0x7f4108079550 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f411c0d09c0 0x7f411c0c9ef0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f411c0d27e0 0x7f411c0b8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 --2- 172.21.15.120:0/225843352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f411c0b4740 0x7f411c152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 -- 172.21.15.120:0/225843352 >> 172.21.15.120:0/225843352 conn(0x7f411c08d690 msgr2=0x7f411c0b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 -- 172.21.15.120:0/225843352 shutdown_connections 2024-07-27T03:10:21.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:21.300+0000 7f4121414640 1 -- 172.21.15.120:0/225843352 wait complete. 2024-07-27T03:10:21.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:10:08.410648+0000', 'modified': '2024-07-27T03:10:20.931031+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 5328, 'mds_1': 5325}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5325': {'gid': 5325, 'name': 'a', 'rank': 1, 'incarnation': 35, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.120:6834/1425775647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6832', 'nonce': 1425775647}, {'type': 'v1', 'addr': '172.21.15.120:6834', 'nonce': 1425775647}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5328': {'gid': 5328, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6835/890762307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6833', 'nonce': 890762307}, {'type': 'v1', 'addr': '172.21.15.120:6835', 'nonce': 890762307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5328, 'qdb_cluster': [5328]} 2024-07-27T03:10:21.718 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5325:up:creating 2024-07-27T03:10:22.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:10:22.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.844+0000 7f759d67d640 1 -- 172.21.15.120:0/348083134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75980b4740 msgr2=0x7f75980b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:22.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.844+0000 7f759d67d640 1 --2- 172.21.15.120:0/348083134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75980b4740 0x7f75980b2c40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7588005fd0 tx=0x7f758802a8a0 comp rx=0 tx=0).stop 2024-07-27T03:10:22.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.844+0000 7f759d67d640 1 -- 172.21.15.120:0/348083134 shutdown_connections 2024-07-27T03:10:22.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.844+0000 7f759d67d640 1 --2- 172.21.15.120:0/348083134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f75980d10d0 0x7f75980d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:22.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.844+0000 7f759d67d640 1 --2- 172.21.15.120:0/348083134 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75980b4740 0x7f75980b2c40 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.844+0000 7f759d67d640 1 -- 172.21.15.120:0/348083134 >> 172.21.15.120:0/348083134 conn(0x7f759808d690 msgr2=0x7f759809d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.844+0000 7f759d67d640 1 -- 172.21.15.120:0/348083134 shutdown_connections 2024-07-27T03:10:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.844+0000 7f759d67d640 1 -- 172.21.15.120:0/348083134 wait complete. 2024-07-27T03:10:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.846+0000 7f759d67d640 1 Processor -- start 2024-07-27T03:10:22.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.846+0000 7f759d67d640 1 -- start start 2024-07-27T03:10:22.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.847+0000 7f759d67d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75980b4740 0x7f75980b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:22.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.847+0000 7f759d67d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f75980d27e0 0x7f75980ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:22.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.847+0000 7f759d67d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75981f83d0 0x7f75981f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:22.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.847+0000 7f759d67d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f75980cefb0 con 0x7f75980b4740 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.847+0000 7f759d67d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f75980cee30 con 0x7f75981f83d0 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.847+0000 7f759d67d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f75980cf130 con 0x7f75980d27e0 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f7596ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75980b4740 0x7f75980b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f7596ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75980b4740 0x7f75980b8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35490/0 (socket says 172.21.15.120:35490) 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f7596ffd640 1 -- 172.21.15.120:0/2229630087 learned_addr learned my addr 172.21.15.120:0/2229630087 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f75967fc640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f75980d27e0 0x7f75980ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f75977fe640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75981f83d0 0x7f75981f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f7596ffd640 1 -- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f75980d27e0 msgr2=0x7f75980ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f7596ffd640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f75980d27e0 0x7f75980ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f7596ffd640 1 -- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75981f83d0 msgr2=0x7f75981f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f7596ffd640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75981f83d0 0x7f75981f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f7596ffd640 1 -- 172.21.15.120:0/2229630087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75981f8d20 con 0x7f75980b4740 2024-07-27T03:10:22.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f75977fe640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75981f83d0 0x7f75981f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:22.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f7596ffd640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75980b4740 0x7f75980b8c20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f758802ae90 tx=0x7f7588032db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:22.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f758f7fe640 1 -- 172.21.15.120:0/2229630087 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588041070 con 0x7f75980b4740 2024-07-27T03:10:22.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f758f7fe640 1 -- 172.21.15.120:0/2229630087 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7588004450 con 0x7f75980b4740 2024-07-27T03:10:22.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f759d67d640 1 -- 172.21.15.120:0/2229630087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75980b7600 con 0x7f75980b4740 2024-07-27T03:10:22.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f758f7fe640 1 -- 172.21.15.120:0/2229630087 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588031430 con 0x7f75980b4740 2024-07-27T03:10:22.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.848+0000 7f759d67d640 1 -- 172.21.15.120:0/2229630087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75980b7bc0 con 0x7f75980b4740 2024-07-27T03:10:22.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.849+0000 7f759d67d640 1 -- 172.21.15.120:0/2229630087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75980d2bf0 con 0x7f75980b4740 2024-07-27T03:10:22.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.850+0000 7f758f7fe640 1 -- 172.21.15.120:0/2229630087 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f7588044070 con 0x7f75980b4740 2024-07-27T03:10:22.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.851+0000 7f758f7fe640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7578077040 0x7f7578079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:22.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.851+0000 7f758f7fe640 1 -- 172.21.15.120:0/2229630087 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f758802e020 con 0x7f75980b4740 2024-07-27T03:10:22.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.851+0000 7f75967fc640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7578077040 0x7f7578079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:22.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.851+0000 7f75967fc640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7578077040 0x7f7578079550 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7580001610 tx=0x7f7580009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:22.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:22.855+0000 7f758f7fe640 1 -- 172.21.15.120:0/2229630087 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f758804b030 con 0x7f75980b4740 2024-07-27T03:10:23.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.074+0000 7f759d67d640 1 -- 172.21.15.120:0/2229630087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f759806d820 con 0x7f75980b4740 2024-07-27T03:10:23.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.074+0000 7f758f7fe640 1 -- 172.21.15.120:0/2229630087 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5267 (secure 0 0 0) 0x7f75981f8d20 con 0x7f75980b4740 2024-07-27T03:10:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:23.077 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":38,"btime":"2024-07-27T03:10:22:939278+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/296895260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":296895260},{"type":"v1","addr":"172.21.15.121:6837","nonce":296895260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:10:08.410648+0000","modified":"2024-07-27T03:10:22.939271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5328,"mds_1":5325,"mds_2":5134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5134":{"gid":5134,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6836/1978820402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1978820402},{"type":"v1","addr":"172.21.15.121:6836","nonce":1978820402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5325":{"gid":5325,"name":"a","rank":1,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/1425775647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1425775647},{"type":"v1","addr":"172.21.15.120:6834","nonce":1425775647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/890762307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":890762307},{"type":"v1","addr":"172.21.15.120:6835","nonce":890762307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5134,5325,5328]},"id":3}]} 2024-07-27T03:10:23.077 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 38 2024-07-27T03:10:23.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 -- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7578077040 msgr2=0x7f7578079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7578077040 0x7f7578079550 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7580001610 tx=0x7f7580009040 comp rx=0 tx=0).stop 2024-07-27T03:10:23.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 -- 172.21.15.120:0/2229630087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75980b4740 msgr2=0x7f75980b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75980b4740 0x7f75980b8c20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f758802ae90 tx=0x7f7588032db0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 -- 172.21.15.120:0/2229630087 shutdown_connections 2024-07-27T03:10:23.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7578077040 0x7f7578079550 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75981f83d0 0x7f75981f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f75980d27e0 0x7f75980ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 --2- 172.21.15.120:0/2229630087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f75980b4740 0x7f75980b8c20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 -- 172.21.15.120:0/2229630087 >> 172.21.15.120:0/2229630087 conn(0x7f759808d690 msgr2=0x7f759806db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 -- 172.21.15.120:0/2229630087 shutdown_connections 2024-07-27T03:10:23.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.077+0000 7f759d67d640 1 -- 172.21.15.120:0/2229630087 wait complete. 2024-07-27T03:10:23.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:10:08.410648+0000', 'modified': '2024-07-27T03:10:22.939271+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 5328, 'mds_1': 5325, 'mds_2': 5134}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5134': {'gid': 5134, 'name': 'd', 'rank': 2, 'incarnation': 37, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.121:6836/1978820402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 1978820402}, {'type': 'v1', 'addr': '172.21.15.121:6836', 'nonce': 1978820402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5325': {'gid': 5325, 'name': 'a', 'rank': 1, 'incarnation': 35, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.120:6834/1425775647', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6832', 'nonce': 1425775647}, {'type': 'v1', 'addr': '172.21.15.120:6834', 'nonce': 1425775647}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5328': {'gid': 5328, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6835/890762307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6833', 'nonce': 890762307}, {'type': 'v1', 'addr': '172.21.15.120:6835', 'nonce': 890762307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5328, 'qdb_cluster': [5134, 5325, 5328]} 2024-07-27T03:10:23.494 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-07-27T03:10:23.494 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-07-27T03:10:23.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.607+0000 7f8383a43640 1 -- 172.21.15.120:0/1401721158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837c0b4740 msgr2=0x7f837c0b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.607+0000 7f8383a43640 1 --2- 172.21.15.120:0/1401721158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837c0b4740 0x7f837c0b2c40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8378009830 tx=0x7f837802a500 comp rx=0 tx=0).stop 2024-07-27T03:10:23.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.607+0000 7f8383a43640 1 -- 172.21.15.120:0/1401721158 shutdown_connections 2024-07-27T03:10:23.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.607+0000 7f8383a43640 1 --2- 172.21.15.120:0/1401721158 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f837c0d10d0 0x7f837c0d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.607+0000 7f8383a43640 1 --2- 172.21.15.120:0/1401721158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837c0b4740 0x7f837c0b2c40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.607+0000 7f8383a43640 1 -- 172.21.15.120:0/1401721158 >> 172.21.15.120:0/1401721158 conn(0x7f837c08d690 msgr2=0x7f837c09d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.607+0000 7f8383a43640 1 -- 172.21.15.120:0/1401721158 shutdown_connections 2024-07-27T03:10:23.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.607+0000 7f8383a43640 1 -- 172.21.15.120:0/1401721158 wait complete. 2024-07-27T03:10:23.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.609+0000 7f8383a43640 1 Processor -- start 2024-07-27T03:10:23.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.609+0000 7f8383a43640 1 -- start start 2024-07-27T03:10:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.610+0000 7f8383a43640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f837c0b4740 0x7f837c0b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.610+0000 7f8383a43640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837c0d27e0 0x7f837c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.610+0000 7f8383a43640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f837c1f83d0 0x7f837c1f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.610+0000 7f8383a43640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f837c0cefb0 con 0x7f837c0b4740 2024-07-27T03:10:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.610+0000 7f8383a43640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f837c0cee30 con 0x7f837c0d27e0 2024-07-27T03:10:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.610+0000 7f8383a43640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f837c0cf130 con 0x7f837c1f83d0 2024-07-27T03:10:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.610+0000 7f83817df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f837c0b4740 0x7f837c0b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.610+0000 7f83817df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f837c0b4740 0x7f837c0b8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35506/0 (socket says 172.21.15.120:35506) 2024-07-27T03:10:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.610+0000 7f83817df640 1 -- 172.21.15.120:0/1946750907 learned_addr learned my addr 172.21.15.120:0/1946750907 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f8381fe0640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f837c1f83d0 0x7f837c1f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f8380fde640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837c0d27e0 0x7f837c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f83817df640 1 -- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f837c1f83d0 msgr2=0x7f837c1f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f83817df640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f837c1f83d0 0x7f837c1f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f83817df640 1 -- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837c0d27e0 msgr2=0x7f837c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f83817df640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837c0d27e0 0x7f837c0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f83817df640 1 -- 172.21.15.120:0/1946750907 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c1f8d20 con 0x7f837c0b4740 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f83817df640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f837c0b4740 0x7f837c0b8c20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8378009950 tx=0x7f8378033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f8371ffb640 1 -- 172.21.15.120:0/1946750907 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378005c90 con 0x7f837c0b4740 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f8383a43640 1 -- 172.21.15.120:0/1946750907 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837c0b7600 con 0x7f837c0b4740 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f8371ffb640 1 -- 172.21.15.120:0/1946750907 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8378031e50 con 0x7f837c0b4740 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f8371ffb640 1 -- 172.21.15.120:0/1946750907 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378005260 con 0x7f837c0b4740 2024-07-27T03:10:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.611+0000 7f8383a43640 1 -- 172.21.15.120:0/1946750907 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837c0b7bc0 con 0x7f837c0b4740 2024-07-27T03:10:23.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.613+0000 7f8371ffb640 1 -- 172.21.15.120:0/1946750907 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8378005400 con 0x7f837c0b4740 2024-07-27T03:10:23.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.614+0000 7f8371ffb640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8360077040 0x7f8360079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.614+0000 7f8371ffb640 1 -- 172.21.15.120:0/1946750907 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f83780b9a00 con 0x7f837c0b4740 2024-07-27T03:10:23.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.614+0000 7f8380fde640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8360077040 0x7f8360079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.615+0000 7f8380fde640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8360077040 0x7f8360079550 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f836c001610 tx=0x7f836c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.615+0000 7f838a967740 1 Processor -- start 2024-07-27T03:10:23.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.615+0000 7f838a967740 1 -- start start 2024-07-27T03:10:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f838a967740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b979879170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f838a967740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b9794633b0 0x55b97985be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f838a967740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b97985c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f838a967740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b9797a4360 con 0x55b97946b590 2024-07-27T03:10:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f838a967740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b979793860 con 0x55b9794633b0 2024-07-27T03:10:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f838a967740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55b9797978a0 con 0x55b97948c270 2024-07-27T03:10:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f8381fe0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b97985c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f8381fe0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b97985c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35514/0 (socket says 172.21.15.120:35514) 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f8381fe0640 1 -- 172.21.15.120:0/1200269795 learned_addr learned my addr 172.21.15.120:0/1200269795 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f8380fde640 1 --2- 172.21.15.120:0/1200269795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b9794633b0 0x55b97985be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f83817df640 1 --2- 172.21.15.120:0/1200269795 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b979879170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f8381fe0640 1 -- 172.21.15.120:0/1200269795 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 msgr2=0x55b979879170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f8381fe0640 1 --2- 172.21.15.120:0/1200269795 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b979879170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f8381fe0640 1 -- 172.21.15.120:0/1200269795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b9794633b0 msgr2=0x55b97985be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f8381fe0640 1 --2- 172.21.15.120:0/1200269795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b9794633b0 0x55b97985be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.616+0000 7f8381fe0640 1 -- 172.21.15.120:0/1200269795 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b979723360 con 0x55b97946b590 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.617+0000 7f8381fe0640 1 --2- 172.21.15.120:0/1200269795 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b97985c380 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8374009f00 tx=0x7f83740107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cb408bd0c955ef server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.617+0000 7f8366ffd640 1 -- 172.21.15.120:0/1200269795 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8374003b70 con 0x55b97946b590 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.617+0000 7f8366ffd640 1 -- 172.21.15.120:0/1200269795 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8374015070 con 0x55b97946b590 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.617+0000 7f8366ffd640 1 -- 172.21.15.120:0/1200269795 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8374004280 con 0x55b97946b590 2024-07-27T03:10:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.617+0000 7f838a967740 1 -- 172.21.15.120:0/1200269795 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 msgr2=0x55b97985c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.618+0000 7f838a967740 1 --2- 172.21.15.120:0/1200269795 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b97985c380 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8374009f00 tx=0x7f83740107a0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.618+0000 7f838a967740 1 -- 172.21.15.120:0/1200269795 shutdown_connections 2024-07-27T03:10:23.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.618+0000 7f838a967740 1 --2- 172.21.15.120:0/1200269795 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b97985c380 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.618+0000 7f838a967740 1 --2- 172.21.15.120:0/1200269795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b9794633b0 0x55b97985be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.618+0000 7f838a967740 1 --2- 172.21.15.120:0/1200269795 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b979879170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.618+0000 7f838a967740 1 -- 172.21.15.120:0/1200269795 >> 172.21.15.120:0/1200269795 conn(0x55b9794803c0 msgr2=0x55b979832060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.618+0000 7f838a967740 1 -- 172.21.15.120:0/1200269795 shutdown_connections 2024-07-27T03:10:23.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.618+0000 7f838a967740 1 -- 172.21.15.120:0/1200269795 wait complete. 2024-07-27T03:10:23.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.618+0000 7f838a967740 1 -- start start 2024-07-27T03:10:23.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.619+0000 7f838a967740 1 Processor -- start 2024-07-27T03:10:23.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f838a967740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b97984a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f838a967740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97946b590 0x55b979885d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f838a967740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b97985aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f838a967740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b979506620 con 0x55b9794633b0 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f838a967740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b97972f140 con 0x55b97946b590 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f838a967740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55b9798759f0 con 0x55b97948c270 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f838a967740 10 client.0 _ll_register_callbacks cb 0x55b97978cc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f83817df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b97984a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f83817df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b97984a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35522/0 (socket says 172.21.15.120:35522) 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f83817df640 1 -- 172.21.15.120:0/1363259684 learned_addr learned my addr 172.21.15.120:0/1363259684 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f8381fe0640 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b97985aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f8380fde640 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97946b590 0x55b979885d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f83817df640 1 -- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 msgr2=0x55b97985aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f83817df640 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b97985aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f83817df640 1 -- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97946b590 msgr2=0x55b979885d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f83817df640 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97946b590 0x55b979885d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f83817df640 1 -- 172.21.15.120:0/1363259684 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9794f7850 con 0x55b9794633b0 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f8381fe0640 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b97985aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.620+0000 7f8380fde640 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97946b590 0x55b979885d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f83817df640 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b97984a080 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8378009920 tx=0x7f8378082ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ef14ccd8c1f7f8 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f835bfff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f835bfff640 1 -- 172.21.15.120:0/1363259684 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83780a0060 con 0x55b9794633b0 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f835bfff640 1 -- 172.21.15.120:0/1363259684 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f8378081700 con 0x55b9794633b0 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f838a967740 1 -- 172.21.15.120:0/1363259684 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8374015070 con 0x55b9794633b0 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f835bfff640 1 -- 172.21.15.120:0/1363259684 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f837809b070 con 0x55b9794633b0 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f838a967740 10 client.5517 fetch_fsmap learned FSMap version 38 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f838a967740 1 -- 172.21.15.120:0/1363259684 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55b97956e6b0 con 0x55b9794633b0 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f835bfff640 1 -- 172.21.15.120:0/1363259684 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8374015070 con 0x55b9794633b0 2024-07-27T03:10:23.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f835bfff640 1 -- 172.21.15.120:0/1363259684 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 38) ==== 3542+0+0 (secure 0 0 0) 0x7f83780a2300 con 0x55b9794633b0 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f838a967740 10 client.5517 fetch_fsmap finished waiting for FSMap version 38 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f838a967740 10 client.5517 resolve_mds: resolved name 'd' to daemon mds.d 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f838a967740 20 client.5517 populate_metadata read hostname 'smithi120' 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f838a967740 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:6834/1978820402,v1:172.21.15.121:6836/1978820402] conn(0x55b97944ae40 0x55b9798891f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f838a967740 4 client.5517 mds_command: new command op to 5134 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.621+0000 7f838a967740 1 -- 172.21.15.120:0/1363259684 --> [v2:172.21.15.121:6834/1978820402,v1:172.21.15.121:6836/1978820402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9797a62b0 con 0x55b97944ae40 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.622+0000 7f8380fde640 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:6834/1978820402,v1:172.21.15.121:6836/1978820402] conn(0x55b97944ae40 0x55b9798891f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.622+0000 7f835bfff640 10 client.5517 ms_handle_connect on v2:172.21.15.121:6834/1978820402 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.622+0000 7f8380fde640 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:6834/1978820402,v1:172.21.15.121:6836/1978820402] conn(0x55b97944ae40 0x55b9798891f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=484fb95032e0d1e5 server_cookie=e41909fabf5bce04 in_seq=0 out_seq=0 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f835bfff640 1 -- 172.21.15.120:0/1363259684 <== mds.2 v2:172.21.15.121:6834/1978820402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9797a62b0 con 0x55b97944ae40 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f835bfff640 10 client.5517 handle_command_reply: tid=0 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 1 client.5517 shutdown 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 1 -- 172.21.15.120:0/1363259684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 msgr2=0x55b97984a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b97984a080 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8378009920 tx=0x7f8378082ac0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 1 -- 172.21.15.120:0/1363259684 shutdown_connections 2024-07-27T03:10:23.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:6834/1978820402,v1:172.21.15.121:6836/1978820402] conn(0x55b97944ae40 0x55b9798891f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b97985aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97946b590 0x55b979885d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f835bfff640 0 client.5517 ms_handle_reset on v2:172.21.15.121:6834/1978820402 2024-07-27T03:10:23.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 1 --2- 172.21.15.120:0/1363259684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b97984a080 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 1 -- 172.21.15.120:0/1363259684 >> 172.21.15.120:0/1363259684 conn(0x55b9794803c0 msgr2=0x55b97984c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 1 -- 172.21.15.120:0/1363259684 shutdown_connections 2024-07-27T03:10:23.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 1 -- 172.21.15.120:0/1363259684 wait complete. 2024-07-27T03:10:23.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.623+0000 7f838a967740 20 client.5517 trim_cache size 0 max 16384 2024-07-27T03:10:23.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.642+0000 7f838a967740 1 Processor -- start 2024-07-27T03:10:23.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.642+0000 7f838a967740 1 -- start start 2024-07-27T03:10:23.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f838a967740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b979877500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f838a967740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97946b590 0x55b9798996b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f838a967740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b979899bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f838a967740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f837c200f80 con 0x55b9794633b0 2024-07-27T03:10:23.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f838a967740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f837c201650 con 0x55b97946b590 2024-07-27T03:10:23.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f838a967740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f837c1603b0 con 0x55b97948c270 2024-07-27T03:10:23.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f83817df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b979877500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f83817df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b979877500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35538/0 (socket says 172.21.15.120:35538) 2024-07-27T03:10:23.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f83817df640 1 -- 172.21.15.120:0/2127503744 learned_addr learned my addr 172.21.15.120:0/2127503744 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f8380fde640 1 --2- 172.21.15.120:0/2127503744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97946b590 0x55b9798996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f8381fe0640 1 --2- 172.21.15.120:0/2127503744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b979899bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f83817df640 1 -- 172.21.15.120:0/2127503744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 msgr2=0x55b979899bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f83817df640 1 --2- 172.21.15.120:0/2127503744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b979899bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f83817df640 1 -- 172.21.15.120:0/2127503744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97946b590 msgr2=0x55b9798996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f83817df640 1 --2- 172.21.15.120:0/2127503744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97946b590 0x55b9798996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.643+0000 7f83817df640 1 -- 172.21.15.120:0/2127503744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b979858a70 con 0x55b9794633b0 2024-07-27T03:10:23.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.644+0000 7f83817df640 1 --2- 172.21.15.120:0/2127503744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b979877500 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f837807f710 tx=0x7f8378082ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4df334d5fc8f828 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.644+0000 7f83667fc640 1 -- 172.21.15.120:0/2127503744 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378048070 con 0x55b9794633b0 2024-07-27T03:10:23.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.644+0000 7f83667fc640 1 -- 172.21.15.120:0/2127503744 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8378086aa0 con 0x55b9794633b0 2024-07-27T03:10:23.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.644+0000 7f83667fc640 1 -- 172.21.15.120:0/2127503744 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378082270 con 0x55b9794633b0 2024-07-27T03:10:23.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.644+0000 7f838a967740 1 -- 172.21.15.120:0/2127503744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 msgr2=0x55b979877500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.644+0000 7f838a967740 1 --2- 172.21.15.120:0/2127503744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b979877500 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f837807f710 tx=0x7f8378082ba0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.644+0000 7f838a967740 1 -- 172.21.15.120:0/2127503744 shutdown_connections 2024-07-27T03:10:23.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.644+0000 7f838a967740 1 --2- 172.21.15.120:0/2127503744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b97948c270 0x55b979899bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.644+0000 7f838a967740 1 --2- 172.21.15.120:0/2127503744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97946b590 0x55b9798996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.644+0000 7f838a967740 1 --2- 172.21.15.120:0/2127503744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b9794633b0 0x55b979877500 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.645+0000 7f838a967740 1 -- 172.21.15.120:0/2127503744 >> 172.21.15.120:0/2127503744 conn(0x55b9794803c0 msgr2=0x55b979876560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.645+0000 7f838a967740 1 -- 172.21.15.120:0/2127503744 shutdown_connections 2024-07-27T03:10:23.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.645+0000 7f838a967740 1 -- 172.21.15.120:0/2127503744 wait complete. 2024-07-27T03:10:23.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.645+0000 7f838a967740 1 -- start start 2024-07-27T03:10:23.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.645+0000 7f838a967740 1 Processor -- start 2024-07-27T03:10:23.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f838a967740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b9794633b0 0x55b9798786f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f838a967740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b9798f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f838a967740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97948c270 0x55b9798f3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f838a967740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b97985af80 con 0x55b97946b590 2024-07-27T03:10:23.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f838a967740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b979872120 con 0x55b97948c270 2024-07-27T03:10:23.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f838a967740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55b979874950 con 0x55b9794633b0 2024-07-27T03:10:23.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f838a967740 10 client.0 _ll_register_callbacks cb 0x7f8378005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:10:23.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f8380fde640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b9798f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f8380fde640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b9798f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35552/0 (socket says 172.21.15.120:35552) 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f8380fde640 1 -- 172.21.15.120:0/1384270003 learned_addr learned my addr 172.21.15.120:0/1384270003 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f83817df640 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b9794633b0 0x55b9798786f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f8381fe0640 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97948c270 0x55b9798f3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f8380fde640 1 -- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b9794633b0 msgr2=0x55b9798786f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f8380fde640 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b9794633b0 0x55b9798786f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f8380fde640 1 -- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97948c270 msgr2=0x55b9798f3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f8380fde640 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97948c270 0x55b9798f3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f8380fde640 1 -- 172.21.15.120:0/1384270003 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b979857700 con 0x55b97946b590 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f8380fde640 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b9798f7d10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f836c001260 tx=0x7f836c004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100eb625ab762976 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.647+0000 7f835bfff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f835bfff640 1 -- 172.21.15.120:0/1384270003 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c015a90 con 0x55b97946b590 2024-07-27T03:10:23.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f835bfff640 1 -- 172.21.15.120:0/1384270003 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f836c010040 con 0x55b97946b590 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f838a967740 1 -- 172.21.15.120:0/1384270003 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8378086aa0 con 0x55b97946b590 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f835bfff640 1 -- 172.21.15.120:0/1384270003 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f836c03a050 con 0x55b97946b590 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f838a967740 10 client.5523 fetch_fsmap learned FSMap version 38 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f838a967740 1 -- 172.21.15.120:0/1384270003 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55b97982c500 con 0x55b97946b590 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f835bfff640 1 -- 172.21.15.120:0/1384270003 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8378086aa0 con 0x55b97946b590 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f835bfff640 1 -- 172.21.15.120:0/1384270003 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 38) ==== 3542+0+0 (secure 0 0 0) 0x7f836c030020 con 0x55b97946b590 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f838a967740 10 client.5523 fetch_fsmap finished waiting for FSMap version 38 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f838a967740 10 client.5523 resolve_mds: resolved name 'd' to daemon mds.d 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f838a967740 20 client.5523 populate_metadata read hostname 'smithi120' 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f838a967740 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:6834/1978820402,v1:172.21.15.121:6836/1978820402] conn(0x55b97984a270 0x55b979884220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f838a967740 4 client.5523 mds_command: new command op to 5134 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:10:23.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f838a967740 1 -- 172.21.15.120:0/1384270003 --> [v2:172.21.15.121:6834/1978820402,v1:172.21.15.121:6836/1978820402] -- command(tid 0: {"prefix": "status"}) -- 0x55b9797a1d50 con 0x55b97984a270 2024-07-27T03:10:23.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.648+0000 7f83817df640 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:6834/1978820402,v1:172.21.15.121:6836/1978820402] conn(0x55b97984a270 0x55b979884220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f835bfff640 10 client.5523 ms_handle_connect on v2:172.21.15.121:6834/1978820402 2024-07-27T03:10:23.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f83817df640 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:6834/1978820402,v1:172.21.15.121:6836/1978820402] conn(0x55b97984a270 0x55b979884220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a96ed2022f827590 server_cookie=be4b914c2d34f600 in_seq=0 out_seq=0 2024-07-27T03:10:23.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f835bfff640 1 -- 172.21.15.120:0/1384270003 <== mds.2 v2:172.21.15.121:6834/1978820402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55b9797a1d50 con 0x55b97984a270 2024-07-27T03:10:23.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f835bfff640 10 client.5523 handle_command_reply: tid=0 2024-07-27T03:10:23.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 1 client.5523 shutdown 2024-07-27T03:10:23.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 1 -- 172.21.15.120:0/1384270003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 msgr2=0x55b9798f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b9798f7d10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f836c001260 tx=0x7f836c004620 comp rx=0 tx=0).stop 2024-07-27T03:10:23.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 1 -- 172.21.15.120:0/1384270003 shutdown_connections 2024-07-27T03:10:23.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:6834/1978820402,v1:172.21.15.121:6836/1978820402] conn(0x55b97984a270 0x55b979884220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b97946b590 0x55b9798f7d10 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f835bfff640 0 client.5523 ms_handle_reset on v2:172.21.15.121:6834/1978820402 2024-07-27T03:10:23.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b97948c270 0x55b9798f3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 1 --2- 172.21.15.120:0/1384270003 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55b9794633b0 0x55b9798786f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 1 -- 172.21.15.120:0/1384270003 >> 172.21.15.120:0/1384270003 conn(0x55b9794803c0 msgr2=0x55b979833290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 1 -- 172.21.15.120:0/1384270003 shutdown_connections 2024-07-27T03:10:23.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 1 -- 172.21.15.120:0/1384270003 wait complete. 2024-07-27T03:10:23.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.649+0000 7f838a967740 20 client.5523 trim_cache size 0 max 16384 2024-07-27T03:10:23.659 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:10:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:10:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 2, 2024-07-27T03:10:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5134, 2024-07-27T03:10:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:10:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:10:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:10:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 1.7095034549999999, 2024-07-27T03:10:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 38, 2024-07-27T03:10:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 46, 2024-07-27T03:10:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 46, 2024-07-27T03:10:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 19.258817384 2024-07-27T03:10:23.660 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:10:23.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 -- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8360077040 msgr2=0x7f8360079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8360077040 0x7f8360079550 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f836c001610 tx=0x7f836c009040 comp rx=0 tx=0).stop 2024-07-27T03:10:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 -- 172.21.15.120:0/1946750907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f837c0b4740 msgr2=0x7f837c0b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f837c0b4740 0x7f837c0b8c20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8378009950 tx=0x7f8378033c20 comp rx=0 tx=0).stop 2024-07-27T03:10:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 -- 172.21.15.120:0/1946750907 shutdown_connections 2024-07-27T03:10:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8360077040 0x7f8360079550 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f837c1f83d0 0x7f837c1f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837c0d27e0 0x7f837c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 --2- 172.21.15.120:0/1946750907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f837c0b4740 0x7f837c0b8c20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 -- 172.21.15.120:0/1946750907 >> 172.21.15.120:0/1946750907 conn(0x7f837c08d690 msgr2=0x7f837c06db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 -- 172.21.15.120:0/1946750907 shutdown_connections 2024-07-27T03:10:23.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.650+0000 7f8383a43640 1 -- 172.21.15.120:0/1946750907 wait complete. 2024-07-27T03:10:23.664 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-07-27T03:10:23.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.776+0000 7f40cd884640 1 -- 172.21.15.120:0/1066202854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40c80d10d0 msgr2=0x7f40c80cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.776+0000 7f40cd884640 1 --2- 172.21.15.120:0/1066202854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40c80d10d0 0x7f40c80cebe0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f40c0005fd0 tx=0x7f40c002a940 comp rx=0 tx=0).stop 2024-07-27T03:10:23.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.776+0000 7f40cd884640 1 -- 172.21.15.120:0/1066202854 shutdown_connections 2024-07-27T03:10:23.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.776+0000 7f40cd884640 1 --2- 172.21.15.120:0/1066202854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40c80d10d0 0x7f40c80cebe0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.776+0000 7f40cd884640 1 -- 172.21.15.120:0/1066202854 >> 172.21.15.120:0/1066202854 conn(0x7f40c808d690 msgr2=0x7f40c809d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.776+0000 7f40cd884640 1 -- 172.21.15.120:0/1066202854 shutdown_connections 2024-07-27T03:10:23.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.776+0000 7f40cd884640 1 -- 172.21.15.120:0/1066202854 wait complete. 2024-07-27T03:10:23.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.778+0000 7f40cd884640 1 Processor -- start 2024-07-27T03:10:23.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.778+0000 7f40cd884640 1 -- start start 2024-07-27T03:10:23.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40cd884640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40c80b2c40 0x7f40c814f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40cd884640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40c80b4740 0x7f40c81f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40cd884640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40c815b3d0 0x7f40c81e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40cd884640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f40c80cf2a0 con 0x7f40c80b2c40 2024-07-27T03:10:23.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40cd884640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f40c80cf120 con 0x7f40c80b4740 2024-07-27T03:10:23.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40cd884640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f40c80cf420 con 0x7f40c815b3d0 2024-07-27T03:10:23.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40c6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40c80b2c40 0x7f40c814f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40c6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40c80b2c40 0x7f40c814f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35570/0 (socket says 172.21.15.120:35570) 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40c6ffd640 1 -- 172.21.15.120:0/427488375 learned_addr learned my addr 172.21.15.120:0/427488375 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40c67fc640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40c80b4740 0x7f40c81f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40c77fe640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40c815b3d0 0x7f40c81e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40c6ffd640 1 -- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40c815b3d0 msgr2=0x7f40c81e72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40c815b3d0 0x7f40c81e72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40c6ffd640 1 -- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40c80b4740 msgr2=0x7f40c81f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.779+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40c80b4740 0x7f40c81f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.780+0000 7f40c6ffd640 1 -- 172.21.15.120:0/427488375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c81f59d0 con 0x7f40c80b2c40 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.780+0000 7f40c67fc640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40c80b4740 0x7f40c81f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.780+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40c80b2c40 0x7f40c814f450 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f40b800c400 tx=0x7f40b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.780+0000 7f40affff640 1 -- 172.21.15.120:0/427488375 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b8017070 con 0x7f40c80b2c40 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.780+0000 7f40affff640 1 -- 172.21.15.120:0/427488375 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40b80053c0 con 0x7f40c80b2c40 2024-07-27T03:10:23.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.780+0000 7f40cd884640 1 -- 172.21.15.120:0/427488375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c81f5c70 con 0x7f40c80b2c40 2024-07-27T03:10:23.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.780+0000 7f40affff640 1 -- 172.21.15.120:0/427488375 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b8003850 con 0x7f40c80b2c40 2024-07-27T03:10:23.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.780+0000 7f40cd884640 1 -- 172.21.15.120:0/427488375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c81f6230 con 0x7f40c80b2c40 2024-07-27T03:10:23.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.782+0000 7f40affff640 1 -- 172.21.15.120:0/427488375 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f40b801a070 con 0x7f40c80b2c40 2024-07-27T03:10:23.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.782+0000 7f40affff640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f40b4077010 0x7f40b4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.782+0000 7f40affff640 1 -- 172.21.15.120:0/427488375 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f40b8097e30 con 0x7f40c80b2c40 2024-07-27T03:10:23.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.782+0000 7f40c67fc640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f40b4077010 0x7f40b4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.783+0000 7f40c67fc640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f40b4077010 0x7f40b4079520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f40c81f9ba0 tx=0x7f40bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.783+0000 7f40d4798740 1 Processor -- start 2024-07-27T03:10:23.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.783+0000 7f40d4798740 1 -- start start 2024-07-27T03:10:23.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40d4798740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40d4798740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x5601471ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40d4798740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146dbc590 0x5601471ad380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40d4798740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5601470f5360 con 0x560146ddd270 2024-07-27T03:10:23.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40d4798740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5601470e4860 con 0x560146dbc590 2024-07-27T03:10:23.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40d4798740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5601470e88a0 con 0x560146db43b0 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40c6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40c6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35580/0 (socket says 172.21.15.120:35580) 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40c6ffd640 1 -- 172.21.15.120:0/2744966410 learned_addr learned my addr 172.21.15.120:0/2744966410 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40c67fc640 1 --2- 172.21.15.120:0/2744966410 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x5601471ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40c77fe640 1 --2- 172.21.15.120:0/2744966410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146dbc590 0x5601471ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40c6ffd640 1 -- 172.21.15.120:0/2744966410 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 msgr2=0x5601471ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/2744966410 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x5601471ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40c6ffd640 1 -- 172.21.15.120:0/2744966410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146dbc590 msgr2=0x5601471ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/2744966410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146dbc590 0x5601471ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40c6ffd640 1 -- 172.21.15.120:0/2744966410 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560147074360 con 0x560146ddd270 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/2744966410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471ca170 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f40b800cfd0 tx=0x7f40b8061080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce213a7a968afad6 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40ad7fa640 1 -- 172.21.15.120:0/2744966410 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b807a070 con 0x560146ddd270 2024-07-27T03:10:23.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.785+0000 7f40ad7fa640 1 -- 172.21.15.120:0/2744966410 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40b8064f80 con 0x560146ddd270 2024-07-27T03:10:23.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.786+0000 7f40ad7fa640 1 -- 172.21.15.120:0/2744966410 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b805fe40 con 0x560146ddd270 2024-07-27T03:10:23.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.786+0000 7f40d4798740 1 -- 172.21.15.120:0/2744966410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 msgr2=0x5601471ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.786+0000 7f40d4798740 1 --2- 172.21.15.120:0/2744966410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471ca170 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f40b800cfd0 tx=0x7f40b8061080 comp rx=0 tx=0).stop 2024-07-27T03:10:23.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.786+0000 7f40d4798740 1 -- 172.21.15.120:0/2744966410 shutdown_connections 2024-07-27T03:10:23.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.786+0000 7f40d4798740 1 --2- 172.21.15.120:0/2744966410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146dbc590 0x5601471ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.786+0000 7f40d4798740 1 --2- 172.21.15.120:0/2744966410 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x5601471ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.786+0000 7f40d4798740 1 --2- 172.21.15.120:0/2744966410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471ca170 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.786+0000 7f40d4798740 1 -- 172.21.15.120:0/2744966410 >> 172.21.15.120:0/2744966410 conn(0x560146dd13c0 msgr2=0x560147183060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.786+0000 7f40d4798740 1 -- 172.21.15.120:0/2744966410 shutdown_connections 2024-07-27T03:10:23.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.786+0000 7f40d4798740 1 -- 172.21.15.120:0/2744966410 wait complete. 2024-07-27T03:10:23.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.787+0000 7f40d4798740 1 -- start start 2024-07-27T03:10:23.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.787+0000 7f40d4798740 1 Processor -- start 2024-07-27T03:10:23.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40d4798740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x5601471c8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40d4798740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40d4798740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146ddd270 0x5601471da000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40d4798740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560146e57620 con 0x560146dbc590 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40d4798740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560147080140 con 0x560146ddd270 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40d4798740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5601471c25e0 con 0x560146db43b0 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40d4798740 10 client.0 _ll_register_callbacks cb 0x5601470ddc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40c67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40c67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471a9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35592/0 (socket says 172.21.15.120:35592) 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40c67fc640 1 -- 172.21.15.120:0/1637703240 learned_addr learned my addr 172.21.15.120:0/1637703240 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x5601471c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40c77fe640 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146ddd270 0x5601471da000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40c67fc640 1 -- 172.21.15.120:0/1637703240 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 msgr2=0x5601471c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40c67fc640 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x5601471c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40c67fc640 1 -- 172.21.15.120:0/1637703240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146ddd270 msgr2=0x5601471da000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40c67fc640 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146ddd270 0x5601471da000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40c67fc640 1 -- 172.21.15.120:0/1637703240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560146e48850 con 0x560146dbc590 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40c67fc640 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471a9610 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00ea10 tx=0x7f40bc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9fd07bf9e52896 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40a67fc640 1 -- 172.21.15.120:0/1637703240 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc028060 con 0x560146dbc590 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.789+0000 7f40a67fc640 1 -- 172.21.15.120:0/1637703240 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f40bc010040 con 0x560146dbc590 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40d4798740 1 -- 172.21.15.120:0/1637703240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40b8064f80 con 0x560146dbc590 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40a67fc640 1 -- 172.21.15.120:0/1637703240 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f40bc003af0 con 0x560146dbc590 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40d4798740 10 client.5538 fetch_fsmap learned FSMap version 38 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40d4798740 1 -- 172.21.15.120:0/1637703240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x560146ebf6b0 con 0x560146dbc590 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40a67fc640 1 -- 172.21.15.120:0/1637703240 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40b8064f80 con 0x560146dbc590 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40a67fc640 1 -- 172.21.15.120:0/1637703240 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 38) ==== 3542+0+0 (secure 0 0 0) 0x7f40bc003c90 con 0x560146dbc590 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40d4798740 10 client.5538 fetch_fsmap finished waiting for FSMap version 38 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40d4798740 10 client.5538 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40d4798740 20 client.5538 populate_metadata read hostname 'smithi120' 2024-07-27T03:10:23.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40d4798740 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.120:6832/1425775647,v1:172.21.15.120:6834/1425775647] conn(0x560146d9be40 0x5601471d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40d4798740 4 client.5538 mds_command: new command op to 5325 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40d4798740 1 -- 172.21.15.120:0/1637703240 --> [v2:172.21.15.120:6832/1425775647,v1:172.21.15.120:6834/1425775647] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601470f72b0 con 0x560146d9be40 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.120:6832/1425775647,v1:172.21.15.120:6834/1425775647] conn(0x560146d9be40 0x5601471d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40a67fc640 10 client.5538 ms_handle_connect on v2:172.21.15.120:6832/1425775647 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.790+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.120:6832/1425775647,v1:172.21.15.120:6834/1425775647] conn(0x560146d9be40 0x5601471d6a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d3e59542bbc1d836 server_cookie=8edbcf56c6a5d23b in_seq=0 out_seq=0 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40a67fc640 1 -- 172.21.15.120:0/1637703240 <== mds.1 v2:172.21.15.120:6832/1425775647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601470f72b0 con 0x560146d9be40 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40a67fc640 10 client.5538 handle_command_reply: tid=0 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 1 client.5538 shutdown 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 1 -- 172.21.15.120:0/1637703240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 msgr2=0x5601471a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471a9610 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00ea10 tx=0x7f40bc000ed0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 1 -- 172.21.15.120:0/1637703240 shutdown_connections 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.120:6832/1425775647,v1:172.21.15.120:6834/1425775647] conn(0x560146d9be40 0x5601471d6a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471a9610 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146ddd270 0x5601471da000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40a67fc640 0 client.5538 ms_handle_reset on v2:172.21.15.120:6832/1425775647 2024-07-27T03:10:23.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 1 --2- 172.21.15.120:0/1637703240 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x5601471c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 1 -- 172.21.15.120:0/1637703240 >> 172.21.15.120:0/1637703240 conn(0x560146dd13c0 msgr2=0x5601471c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 1 -- 172.21.15.120:0/1637703240 shutdown_connections 2024-07-27T03:10:23.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 1 -- 172.21.15.120:0/1637703240 wait complete. 2024-07-27T03:10:23.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.791+0000 7f40d4798740 20 client.5538 trim_cache size 0 max 16384 2024-07-27T03:10:23.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.810+0000 7f40d4798740 1 Processor -- start 2024-07-27T03:10:23.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.811+0000 7f40d4798740 1 -- start start 2024-07-27T03:10:23.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40d4798740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x560147184190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40d4798740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146dbc590 0x5601471c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40d4798740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40d4798740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f40c8200f00 con 0x560146ddd270 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40d4798740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f40c82015d0 con 0x560146dbc590 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40d4798740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f40c81f97e0 con 0x560146db43b0 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40c77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40c77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35604/0 (socket says 172.21.15.120:35604) 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40c77fe640 1 -- 172.21.15.120:0/895538104 learned_addr learned my addr 172.21.15.120:0/895538104 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40c67fc640 1 --2- 172.21.15.120:0/895538104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146dbc590 0x5601471c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/895538104 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x560147184190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40c77fe640 1 -- 172.21.15.120:0/895538104 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 msgr2=0x560147184190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40c77fe640 1 --2- 172.21.15.120:0/895538104 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x560147184190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40c77fe640 1 -- 172.21.15.120:0/895538104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146dbc590 msgr2=0x5601471c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40c77fe640 1 --2- 172.21.15.120:0/895538104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146dbc590 0x5601471c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.812+0000 7f40c77fe640 1 -- 172.21.15.120:0/895538104 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014717fe50 con 0x560146ddd270 2024-07-27T03:10:23.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.813+0000 7f40c77fe640 1 --2- 172.21.15.120:0/895538104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471c8840 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009ca0 tx=0x7f40c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96311d528c3616f3 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.813+0000 7f40acff9640 1 -- 172.21.15.120:0/895538104 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c004a070 con 0x560146ddd270 2024-07-27T03:10:23.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.813+0000 7f40acff9640 1 -- 172.21.15.120:0/895538104 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40c00306c0 con 0x560146ddd270 2024-07-27T03:10:23.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.813+0000 7f40acff9640 1 -- 172.21.15.120:0/895538104 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0030ab0 con 0x560146ddd270 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.813+0000 7f40d4798740 1 -- 172.21.15.120:0/895538104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 msgr2=0x5601471c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.813+0000 7f40d4798740 1 --2- 172.21.15.120:0/895538104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471c8840 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009ca0 tx=0x7f40c0004ab0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.814+0000 7f40d4798740 1 -- 172.21.15.120:0/895538104 shutdown_connections 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.814+0000 7f40d4798740 1 --2- 172.21.15.120:0/895538104 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146ddd270 0x5601471c8840 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.814+0000 7f40d4798740 1 --2- 172.21.15.120:0/895538104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146dbc590 0x5601471c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.814+0000 7f40d4798740 1 --2- 172.21.15.120:0/895538104 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x560147184190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.814+0000 7f40d4798740 1 -- 172.21.15.120:0/895538104 >> 172.21.15.120:0/895538104 conn(0x560146dd13c0 msgr2=0x5601471ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.814+0000 7f40d4798740 1 -- 172.21.15.120:0/895538104 shutdown_connections 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.814+0000 7f40d4798740 1 -- 172.21.15.120:0/895538104 wait complete. 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.814+0000 7f40d4798740 1 -- start start 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.814+0000 7f40d4798740 1 Processor -- start 2024-07-27T03:10:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40d4798740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x560147243aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40d4798740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40d4798740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146ddd270 0x5601471c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40d4798740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5601471dac10 con 0x560146dbc590 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40d4798740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5601471c2210 con 0x560146ddd270 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40d4798740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5601471a7030 con 0x560146db43b0 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40d4798740 10 client.0 _ll_register_callbacks cb 0x7f40bc0053b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40c67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40c67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35620/0 (socket says 172.21.15.120:35620) 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40c67fc640 1 -- 172.21.15.120:0/1788472839 learned_addr learned my addr 172.21.15.120:0/1788472839 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x560147243aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40c77fe640 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146ddd270 0x5601471c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40c67fc640 1 -- 172.21.15.120:0/1788472839 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 msgr2=0x560147243aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40c67fc640 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x560147243aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40c67fc640 1 -- 172.21.15.120:0/1788472839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146ddd270 msgr2=0x5601471c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40c67fc640 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146ddd270 0x5601471c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40c67fc640 1 -- 172.21.15.120:0/1788472839 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601471a5a90 con 0x560146dbc590 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40c67fc640 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471c82e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x56014719d010 tx=0x7f40bc013810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975072bd67fa8a08 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.816+0000 7f40a67fc640 1 -- 172.21.15.120:0/1788472839 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc0138c0 con 0x560146dbc590 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40a67fc640 1 -- 172.21.15.120:0/1788472839 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f40bc010040 con 0x560146dbc590 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40d4798740 1 -- 172.21.15.120:0/1788472839 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40c00306c0 con 0x560146dbc590 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40a67fc640 1 -- 172.21.15.120:0/1788472839 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f40bc013a60 con 0x560146dbc590 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40d4798740 10 client.5544 fetch_fsmap learned FSMap version 38 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40d4798740 1 -- 172.21.15.120:0/1788472839 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x5601471d60a0 con 0x560146dbc590 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40a67fc640 1 -- 172.21.15.120:0/1788472839 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40c00306c0 con 0x560146dbc590 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40a67fc640 1 -- 172.21.15.120:0/1788472839 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 38) ==== 3542+0+0 (secure 0 0 0) 0x7f40bc013c00 con 0x560146dbc590 2024-07-27T03:10:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40d4798740 10 client.5544 fetch_fsmap finished waiting for FSMap version 38 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40d4798740 10 client.5544 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40d4798740 20 client.5544 populate_metadata read hostname 'smithi120' 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40d4798740 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.120:6832/1425775647,v1:172.21.15.120:6834/1425775647] conn(0x5601471d0690 0x5601471c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40d4798740 4 client.5544 mds_command: new command op to 5325 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40d4798740 1 -- 172.21.15.120:0/1788472839 --> [v2:172.21.15.120:6832/1425775647,v1:172.21.15.120:6834/1425775647] -- command(tid 0: {"prefix": "status"}) -- 0x5601470f2d50 con 0x5601471d0690 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.120:6832/1425775647,v1:172.21.15.120:6834/1425775647] conn(0x5601471d0690 0x5601471c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.817+0000 7f40a67fc640 10 client.5544 ms_handle_connect on v2:172.21.15.120:6832/1425775647 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40c6ffd640 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.120:6832/1425775647,v1:172.21.15.120:6834/1425775647] conn(0x5601471d0690 0x5601471c70c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9a9181d42381af05 server_cookie=9d46ec62417928d8 in_seq=0 out_seq=0 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40a67fc640 1 -- 172.21.15.120:0/1788472839 <== mds.1 v2:172.21.15.120:6832/1425775647 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5601470f2d50 con 0x5601471d0690 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40a67fc640 10 client.5544 handle_command_reply: tid=0 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 1 client.5544 shutdown 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 1 -- 172.21.15.120:0/1788472839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 msgr2=0x5601471c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471c82e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x56014719d010 tx=0x7f40bc013810 comp rx=0 tx=0).stop 2024-07-27T03:10:23.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 1 -- 172.21.15.120:0/1788472839 shutdown_connections 2024-07-27T03:10:23.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.120:6832/1425775647,v1:172.21.15.120:6834/1425775647] conn(0x5601471d0690 0x5601471c70c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560146dbc590 0x5601471c82e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560146ddd270 0x5601471c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40a67fc640 0 client.5544 ms_handle_reset on v2:172.21.15.120:6832/1425775647 2024-07-27T03:10:23.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 1 --2- 172.21.15.120:0/1788472839 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560146db43b0 0x560147243aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 1 -- 172.21.15.120:0/1788472839 >> 172.21.15.120:0/1788472839 conn(0x560146dd13c0 msgr2=0x560147182ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 1 -- 172.21.15.120:0/1788472839 shutdown_connections 2024-07-27T03:10:23.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 1 -- 172.21.15.120:0/1788472839 wait complete. 2024-07-27T03:10:23.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.818+0000 7f40d4798740 20 client.5544 trim_cache size 0 max 16384 2024-07-27T03:10:23.826 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 1, 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5325, 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 2.8859051880000002, 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 38, 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 46, 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 46, 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 19.426034927 2024-07-27T03:10:23.827 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:10:23.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 -- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f40b4077010 msgr2=0x7f40b4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f40b4077010 0x7f40b4079520 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f40c81f9ba0 tx=0x7f40bc009040 comp rx=0 tx=0).stop 2024-07-27T03:10:23.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 -- 172.21.15.120:0/427488375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40c80b2c40 msgr2=0x7f40c814f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40c80b2c40 0x7f40c814f450 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f40b800c400 tx=0x7f40b800c8c0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 -- 172.21.15.120:0/427488375 shutdown_connections 2024-07-27T03:10:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f40b4077010 0x7f40b4079520 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40c815b3d0 0x7f40c81e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40c80b4740 0x7f40c81f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 --2- 172.21.15.120:0/427488375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40c80b2c40 0x7f40c814f450 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 -- 172.21.15.120:0/427488375 >> 172.21.15.120:0/427488375 conn(0x7f40c808d690 msgr2=0x7f40c806e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 -- 172.21.15.120:0/427488375 shutdown_connections 2024-07-27T03:10:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.819+0000 7f40cd884640 1 -- 172.21.15.120:0/427488375 wait complete. 2024-07-27T03:10:23.833 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-07-27T03:10:23.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.945+0000 7f55cc37d640 1 -- 172.21.15.120:0/1383779739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55c40cf4e0 msgr2=0x7f55c409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.945+0000 7f55cc37d640 1 --2- 172.21.15.120:0/1383779739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55c40cf4e0 0x7f55c409aa30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f55c40b2180 tx=0x7f55b402a560 comp rx=0 tx=0).stop 2024-07-27T03:10:23.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.946+0000 7f55cc37d640 1 -- 172.21.15.120:0/1383779739 shutdown_connections 2024-07-27T03:10:23.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.946+0000 7f55cc37d640 1 --2- 172.21.15.120:0/1383779739 >> v2:172.21.15.121:3300/0 conn(0x7f55c409af70 0x7f55c415ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.946+0000 7f55cc37d640 1 --2- 172.21.15.120:0/1383779739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55c40cf4e0 0x7f55c409aa30 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.946+0000 7f55cc37d640 1 --2- 172.21.15.120:0/1383779739 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55c409b640 0x7f55c40b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.946+0000 7f55cc37d640 1 -- 172.21.15.120:0/1383779739 >> 172.21.15.120:0/1383779739 conn(0x7f55c40d20a0 msgr2=0x7f55c40d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.946+0000 7f55cc37d640 1 -- 172.21.15.120:0/1383779739 shutdown_connections 2024-07-27T03:10:23.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.946+0000 7f55cc37d640 1 -- 172.21.15.120:0/1383779739 wait complete. 2024-07-27T03:10:23.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.947+0000 7f55cc37d640 1 Processor -- start 2024-07-27T03:10:23.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.947+0000 7f55cc37d640 1 -- start start 2024-07-27T03:10:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55cc37d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55c409af70 0x7f55c41f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55cc37d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c409b640 0x7f55c415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55cc37d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55c40cf4e0 0x7f55c409c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55cc37d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f55c41607e0 con 0x7f55c40cf4e0 2024-07-27T03:10:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55cc37d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4160660 con 0x7f55c409b640 2024-07-27T03:10:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55cc37d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f55c4160960 con 0x7f55c409af70 2024-07-27T03:10:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55ca91a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55c40cf4e0 0x7f55c409c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55ca91a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55c40cf4e0 0x7f55c409c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35630/0 (socket says 172.21.15.120:35630) 2024-07-27T03:10:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55ca91a640 1 -- 172.21.15.120:0/2157344686 learned_addr learned my addr 172.21.15.120:0/2157344686 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55ca119640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55c409af70 0x7f55c41f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55c9918640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c409b640 0x7f55c415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55ca91a640 1 -- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55c409af70 msgr2=0x7f55c41f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55ca91a640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55c409af70 0x7f55c41f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55ca91a640 1 -- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c409b640 msgr2=0x7f55c415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55ca91a640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c409b640 0x7f55c415c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55ca91a640 1 -- 172.21.15.120:0/2157344686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c41f3b40 con 0x7f55c40cf4e0 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55ca119640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55c409af70 0x7f55c41f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55c9918640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c409b640 0x7f55c415c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55ca91a640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55c40cf4e0 0x7f55c409c230 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00e8e0 tx=0x7f55bc00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55baffd640 1 -- 172.21.15.120:0/2157344686 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc004d20 con 0x7f55c40cf4e0 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.949+0000 7f55baffd640 1 -- 172.21.15.120:0/2157344686 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55bc00ca60 con 0x7f55c40cf4e0 2024-07-27T03:10:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.950+0000 7f55cc37d640 1 -- 172.21.15.120:0/2157344686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c40b1790 con 0x7f55c40cf4e0 2024-07-27T03:10:23.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.950+0000 7f55baffd640 1 -- 172.21.15.120:0/2157344686 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc005020 con 0x7f55c40cf4e0 2024-07-27T03:10:23.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.950+0000 7f55cc37d640 1 -- 172.21.15.120:0/2157344686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c41f40a0 con 0x7f55c40cf4e0 2024-07-27T03:10:23.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.951+0000 7f55baffd640 1 -- 172.21.15.120:0/2157344686 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f55bc0051c0 con 0x7f55c40cf4e0 2024-07-27T03:10:23.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.952+0000 7f55baffd640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55a8077010 0x7f55a8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.952+0000 7f55baffd640 1 -- 172.21.15.120:0/2157344686 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f55bc099240 con 0x7f55c40cf4e0 2024-07-27T03:10:23.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.952+0000 7f55ca119640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55a8077010 0x7f55a8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.952+0000 7f55ca119640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55a8077010 0x7f55a8079520 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009a80 tx=0x7f55c0005cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.953+0000 7f55d3374740 1 Processor -- start 2024-07-27T03:10:23.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.953+0000 7f55d3374740 1 -- start start 2024-07-27T03:10:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.954+0000 7f55d3374740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55899169a270 0x558991a8b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.954+0000 7f55d3374740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589916713b0 0x558991a6e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.954+0000 7f55d3374740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a6e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.954+0000 7f55d3374740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5589919b2360 con 0x558991679590 2024-07-27T03:10:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.954+0000 7f55d3374740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5589919a1860 con 0x55899169a270 2024-07-27T03:10:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.954+0000 7f55d3374740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5589919a58a0 con 0x5589916713b0 2024-07-27T03:10:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.954+0000 7f55ca91a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a6e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.954+0000 7f55ca91a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a6e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35646/0 (socket says 172.21.15.120:35646) 2024-07-27T03:10:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.954+0000 7f55ca91a640 1 -- 172.21.15.120:0/1018745472 learned_addr learned my addr 172.21.15.120:0/1018745472 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.954+0000 7f55ca119640 1 --2- 172.21.15.120:0/1018745472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55899169a270 0x558991a8b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.954+0000 7f55c9918640 1 --2- 172.21.15.120:0/1018745472 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589916713b0 0x558991a6e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.955+0000 7f55ca91a640 1 -- 172.21.15.120:0/1018745472 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589916713b0 msgr2=0x558991a6e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.955+0000 7f55ca91a640 1 --2- 172.21.15.120:0/1018745472 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589916713b0 0x558991a6e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.955+0000 7f55ca91a640 1 -- 172.21.15.120:0/1018745472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55899169a270 msgr2=0x558991a8b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.955+0000 7f55ca91a640 1 --2- 172.21.15.120:0/1018745472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55899169a270 0x558991a8b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.955+0000 7f55ca91a640 1 -- 172.21.15.120:0/1018745472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558991931360 con 0x558991679590 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.955+0000 7f55ca119640 1 --2- 172.21.15.120:0/1018745472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55899169a270 0x558991a8b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.955+0000 7f55ca91a640 1 --2- 172.21.15.120:0/1018745472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a6e790 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f55bc05dd90 tx=0x7f55bc062410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c908582d61951e1 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.955+0000 7f55a7fff640 1 -- 172.21.15.120:0/1018745472 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc01f040 con 0x558991679590 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.955+0000 7f55a7fff640 1 -- 172.21.15.120:0/1018745472 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55bc06ad30 con 0x558991679590 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.955+0000 7f55a7fff640 1 -- 172.21.15.120:0/1018745472 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc097b50 con 0x558991679590 2024-07-27T03:10:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.956+0000 7f55d3374740 1 -- 172.21.15.120:0/1018745472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 msgr2=0x558991a6e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.956+0000 7f55d3374740 1 --2- 172.21.15.120:0/1018745472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a6e790 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f55bc05dd90 tx=0x7f55bc062410 comp rx=0 tx=0).stop 2024-07-27T03:10:23.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.956+0000 7f55d3374740 1 -- 172.21.15.120:0/1018745472 shutdown_connections 2024-07-27T03:10:23.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.956+0000 7f55d3374740 1 --2- 172.21.15.120:0/1018745472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a6e790 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.956+0000 7f55d3374740 1 --2- 172.21.15.120:0/1018745472 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589916713b0 0x558991a6e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.956+0000 7f55d3374740 1 --2- 172.21.15.120:0/1018745472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55899169a270 0x558991a8b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.956+0000 7f55d3374740 1 -- 172.21.15.120:0/1018745472 >> 172.21.15.120:0/1018745472 conn(0x55899168e3c0 msgr2=0x558991a44470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.956+0000 7f55d3374740 1 -- 172.21.15.120:0/1018745472 shutdown_connections 2024-07-27T03:10:23.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.956+0000 7f55d3374740 1 -- 172.21.15.120:0/1018745472 wait complete. 2024-07-27T03:10:23.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.957+0000 7f55d3374740 1 -- start start 2024-07-27T03:10:23.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.957+0000 7f55d3374740 1 Processor -- start 2024-07-27T03:10:23.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.958+0000 7f55d3374740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991a82c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.958+0000 7f55d3374740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.958+0000 7f55d3374740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a4c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.958+0000 7f55d3374740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558991714620 con 0x558991679590 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.958+0000 7f55d3374740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55899193d140 con 0x5589916713b0 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.958+0000 7f55d3374740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x558991a85090 con 0x55899169a270 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.958+0000 7f55d3374740 10 client.0 _ll_register_callbacks cb 0x55899199ac90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.958+0000 7f55c9918640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.958+0000 7f55c9918640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35660/0 (socket says 172.21.15.120:35660) 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.958+0000 7f55c9918640 1 -- 172.21.15.120:0/678720686 learned_addr learned my addr 172.21.15.120:0/678720686 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55ca91a640 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a4c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55ca119640 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991a82c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55c9918640 1 -- 172.21.15.120:0/678720686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 msgr2=0x558991a4c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55c9918640 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a4c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55c9918640 1 -- 172.21.15.120:0/678720686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 msgr2=0x558991a82c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55c9918640 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991a82c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55c9918640 1 -- 172.21.15.120:0/678720686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558991705850 con 0x558991679590 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55c9918640 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bdc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009850 tx=0x7f55b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb712cea98b60a64 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55a57fa640 1 -- 172.21.15.120:0/678720686 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b403f070 con 0x558991679590 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55a57fa640 1 -- 172.21.15.120:0/678720686 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f55b40037f0 con 0x558991679590 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55d3374740 1 -- 172.21.15.120:0/678720686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55bc06ad30 con 0x558991679590 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55a57fa640 1 -- 172.21.15.120:0/678720686 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f55b4035070 con 0x558991679590 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55d3374740 10 client.5556 fetch_fsmap learned FSMap version 38 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55d3374740 1 -- 172.21.15.120:0/678720686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55899177c6b0 con 0x558991679590 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55a57fa640 1 -- 172.21.15.120:0/678720686 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55bc06ad30 con 0x558991679590 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55a57fa640 1 -- 172.21.15.120:0/678720686 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 38) ==== 3542+0+0 (secure 0 0 0) 0x7f55b4003c00 con 0x558991679590 2024-07-27T03:10:23.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.959+0000 7f55d3374740 10 client.5556 fetch_fsmap finished waiting for FSMap version 38 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.960+0000 7f55d3374740 10 client.5556 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.960+0000 7f55d3374740 20 client.5556 populate_metadata read hostname 'smithi120' 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.960+0000 7f55d3374740 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x558991658e40 0x558991aa6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.960+0000 7f55d3374740 4 client.5556 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.960+0000 7f55d3374740 1 -- 172.21.15.120:0/678720686 --> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589919b42b0 con 0x558991658e40 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.960+0000 7f55ca119640 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x558991658e40 0x558991aa6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.960+0000 7f55a57fa640 10 client.5556 ms_handle_connect on v2:172.21.15.120:6833/890762307 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.960+0000 7f55ca119640 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x558991658e40 0x558991aa6120 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaf10fa1c4b0e5b7 server_cookie=592fef4d4f5178b in_seq=0 out_seq=0 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55a57fa640 1 -- 172.21.15.120:0/678720686 <== mds.0 v2:172.21.15.120:6833/890762307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5589919b42b0 con 0x558991658e40 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55a57fa640 10 client.5556 handle_command_reply: tid=0 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 1 client.5556 shutdown 2024-07-27T03:10:23.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 1 -- 172.21.15.120:0/678720686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 msgr2=0x558991a4bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bdc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009850 tx=0x7f55b4004270 comp rx=0 tx=0).stop 2024-07-27T03:10:23.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 1 -- 172.21.15.120:0/678720686 shutdown_connections 2024-07-27T03:10:23.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x558991658e40 0x558991aa6120 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bdc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a4c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 1 --2- 172.21.15.120:0/678720686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991a82c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55a57fa640 0 client.5556 ms_handle_reset on v2:172.21.15.120:6833/890762307 2024-07-27T03:10:23.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 1 -- 172.21.15.120:0/678720686 >> 172.21.15.120:0/678720686 conn(0x55899168e3c0 msgr2=0x558991a444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 1 -- 172.21.15.120:0/678720686 shutdown_connections 2024-07-27T03:10:23.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 1 -- 172.21.15.120:0/678720686 wait complete. 2024-07-27T03:10:23.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.961+0000 7f55d3374740 20 client.5556 trim_cache size 0 max 16384 2024-07-27T03:10:23.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.980+0000 7f55d3374740 1 Processor -- start 2024-07-27T03:10:23.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.980+0000 7f55d3374740 1 -- start start 2024-07-27T03:10:23.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.981+0000 7f55d3374740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991a8c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.981+0000 7f55d3374740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.981+0000 7f55d3374740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a45340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.981+0000 7f55d3374740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f55c406f3f0 con 0x558991679590 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.981+0000 7f55d3374740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55c409e1b0 con 0x5589916713b0 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.981+0000 7f55d3374740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f55c41e6550 con 0x55899169a270 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.981+0000 7f55c9918640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.981+0000 7f55c9918640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35676/0 (socket says 172.21.15.120:35676) 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.981+0000 7f55c9918640 1 -- 172.21.15.120:0/2344691472 learned_addr learned my addr 172.21.15.120:0/2344691472 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.982+0000 7f55ca119640 1 --2- 172.21.15.120:0/2344691472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991a8c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.982+0000 7f55ca91a640 1 --2- 172.21.15.120:0/2344691472 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a45340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.982+0000 7f55c9918640 1 -- 172.21.15.120:0/2344691472 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 msgr2=0x558991a45340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.982+0000 7f55c9918640 1 --2- 172.21.15.120:0/2344691472 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a45340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.982+0000 7f55c9918640 1 -- 172.21.15.120:0/2344691472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 msgr2=0x558991a8c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.982+0000 7f55c9918640 1 --2- 172.21.15.120:0/2344691472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991a8c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.982+0000 7f55c9918640 1 -- 172.21.15.120:0/2344691472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558991a6e9e0 con 0x558991679590 2024-07-27T03:10:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.982+0000 7f55c9918640 1 --2- 172.21.15.120:0/2344691472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bea0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f55b40047c0 tx=0x7f55b402aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b536c39368029cf server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.982+0000 7f55a77fe640 1 -- 172.21.15.120:0/2344691472 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b403f070 con 0x558991679590 2024-07-27T03:10:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.982+0000 7f55a77fe640 1 -- 172.21.15.120:0/2344691472 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55b40036e0 con 0x558991679590 2024-07-27T03:10:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.982+0000 7f55a77fe640 1 -- 172.21.15.120:0/2344691472 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b4004c60 con 0x558991679590 2024-07-27T03:10:23.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.983+0000 7f55d3374740 1 -- 172.21.15.120:0/2344691472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 msgr2=0x558991a4bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.983+0000 7f55d3374740 1 --2- 172.21.15.120:0/2344691472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bea0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f55b40047c0 tx=0x7f55b402aa60 comp rx=0 tx=0).stop 2024-07-27T03:10:23.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.983+0000 7f55d3374740 1 -- 172.21.15.120:0/2344691472 shutdown_connections 2024-07-27T03:10:23.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.983+0000 7f55d3374740 1 --2- 172.21.15.120:0/2344691472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a4bea0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.983+0000 7f55d3374740 1 --2- 172.21.15.120:0/2344691472 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a45340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.983+0000 7f55d3374740 1 --2- 172.21.15.120:0/2344691472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991a8c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.983+0000 7f55d3374740 1 -- 172.21.15.120:0/2344691472 >> 172.21.15.120:0/2344691472 conn(0x55899168e3c0 msgr2=0x558991a43310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.983+0000 7f55d3374740 1 -- 172.21.15.120:0/2344691472 shutdown_connections 2024-07-27T03:10:23.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.983+0000 7f55d3374740 1 -- 172.21.15.120:0/2344691472 wait complete. 2024-07-27T03:10:23.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.984+0000 7f55d3374740 1 -- start start 2024-07-27T03:10:23.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.984+0000 7f55d3374740 1 Processor -- start 2024-07-27T03:10:23.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.985+0000 7f55d3374740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991af8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.985+0000 7f55d3374740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a45340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.985+0000 7f55d3374740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a45880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.985+0000 7f55d3374740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558991a5c8a0 con 0x558991679590 2024-07-27T03:10:23.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.985+0000 7f55d3374740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558991a4ce40 con 0x5589916713b0 2024-07-27T03:10:23.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.985+0000 7f55d3374740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x558991a4d980 con 0x55899169a270 2024-07-27T03:10:23.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.985+0000 7f55d3374740 10 client.0 _ll_register_callbacks cb 0x7f55b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:10:23.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.985+0000 7f55c9918640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a45340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.985+0000 7f55c9918640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a45340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35682/0 (socket says 172.21.15.120:35682) 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.985+0000 7f55c9918640 1 -- 172.21.15.120:0/1797117797 learned_addr learned my addr 172.21.15.120:0/1797117797 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55ca91a640 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a45880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55c9918640 1 -- 172.21.15.120:0/1797117797 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 msgr2=0x558991a45880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55c9918640 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a45880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55ca119640 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991af8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55c9918640 1 -- 172.21.15.120:0/1797117797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 msgr2=0x558991af8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55c9918640 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991af8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55c9918640 1 -- 172.21.15.120:0/1797117797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558991a41260 con 0x558991679590 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55c9918640 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a45340 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009850 tx=0x7f55b4004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863c387f9e53e897 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55a57fa640 1 -- 172.21.15.120:0/1797117797 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b405d060 con 0x558991679590 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55a57fa640 1 -- 172.21.15.120:0/1797117797 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f55b4058640 con 0x558991679590 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55d3374740 1 -- 172.21.15.120:0/1797117797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55b40036e0 con 0x558991679590 2024-07-27T03:10:23.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55a57fa640 1 -- 172.21.15.120:0/1797117797 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f55b4063050 con 0x558991679590 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55d3374740 10 client.5562 fetch_fsmap learned FSMap version 38 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55d3374740 1 -- 172.21.15.120:0/1797117797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x558991aa2ca0 con 0x558991679590 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55a57fa640 1 -- 172.21.15.120:0/1797117797 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55b40036e0 con 0x558991679590 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55a57fa640 1 -- 172.21.15.120:0/1797117797 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 38) ==== 3542+0+0 (secure 0 0 0) 0x7f55b4066020 con 0x558991679590 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55d3374740 10 client.5562 fetch_fsmap finished waiting for FSMap version 38 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55d3374740 10 client.5562 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.986+0000 7f55d3374740 20 client.5562 populate_metadata read hostname 'smithi120' 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55d3374740 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x558991a443a0 0x558991a4a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55d3374740 4 client.5562 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55d3374740 1 -- 172.21.15.120:0/1797117797 --> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] -- command(tid 0: {"prefix": "status"}) -- 0x5589919afd50 con 0x558991a443a0 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55ca119640 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x558991a443a0 0x558991a4a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55a57fa640 10 client.5562 ms_handle_connect on v2:172.21.15.120:6833/890762307 2024-07-27T03:10:23.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55ca119640 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x558991a443a0 0x558991a4a030 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d520c7df61d7cbe server_cookie=4cc3dd1ceac516b9 in_seq=0 out_seq=0 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55a57fa640 1 -- 172.21.15.120:0/1797117797 <== mds.0 v2:172.21.15.120:6833/890762307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5589919afd50 con 0x558991a443a0 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55a57fa640 10 client.5562 handle_command_reply: tid=0 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55d3374740 1 client.5562 shutdown 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55d3374740 1 -- 172.21.15.120:0/1797117797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 msgr2=0x558991a45340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55d3374740 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a45340 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009850 tx=0x7f55b4004ee0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.987+0000 7f55d3374740 1 -- 172.21.15.120:0/1797117797 shutdown_connections 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55d3374740 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.120:6833/890762307,v1:172.21.15.120:6835/890762307] conn(0x558991a443a0 0x558991a4a030 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55d3374740 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558991679590 0x558991a45340 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55d3374740 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55899169a270 0x558991a45880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55a57fa640 0 client.5562 ms_handle_reset on v2:172.21.15.120:6833/890762307 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55d3374740 1 --2- 172.21.15.120:0/1797117797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589916713b0 0x558991af8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55d3374740 1 -- 172.21.15.120:0/1797117797 >> 172.21.15.120:0/1797117797 conn(0x55899168e3c0 msgr2=0x558991a433a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55d3374740 1 -- 172.21.15.120:0/1797117797 shutdown_connections 2024-07-27T03:10:23.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55d3374740 1 -- 172.21.15.120:0/1797117797 wait complete. 2024-07-27T03:10:23.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55d3374740 20 client.5562 trim_cache size 0 max 16384 2024-07-27T03:10:23.996 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:10:23.996 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:10:23.996 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-07-27T03:10:23.996 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5328, 2024-07-27T03:10:23.996 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:10:23.996 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:10:23.996 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:10:23.996 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 14.921670103, 2024-07-27T03:10:23.996 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 38, 2024-07-27T03:10:23.996 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 46, 2024-07-27T03:10:23.997 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 46, 2024-07-27T03:10:23.997 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 19.595414614999999 2024-07-27T03:10:23.997 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:10:23.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 -- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55a8077010 msgr2=0x7f55a8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55a8077010 0x7f55a8079520 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009a80 tx=0x7f55c0005cc0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 -- 172.21.15.120:0/2157344686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55c40cf4e0 msgr2=0x7f55c409c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:23.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55c40cf4e0 0x7f55c409c230 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00e8e0 tx=0x7f55bc00eda0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 -- 172.21.15.120:0/2157344686 shutdown_connections 2024-07-27T03:10:23.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55a8077010 0x7f55a8079520 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55c40cf4e0 0x7f55c409c230 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c409b640 0x7f55c415c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 --2- 172.21.15.120:0/2157344686 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55c409af70 0x7f55c41f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:23.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 -- 172.21.15.120:0/2157344686 >> 172.21.15.120:0/2157344686 conn(0x7f55c40d20a0 msgr2=0x7f55c40b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:23.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 -- 172.21.15.120:0/2157344686 shutdown_connections 2024-07-27T03:10:23.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:23.988+0000 7f55cc37d640 1 -- 172.21.15.120:0/2157344686 wait complete. 2024-07-27T03:10:24.002 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:10:24.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.115+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2922460278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2e006ec80 msgr2=0x7fd2e00ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:24.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.115+0000 7fd2e6d6f640 1 --2- 172.21.15.120:0/2922460278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2e006ec80 0x7fd2e00ad0b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00af850 tx=0x7fd2d402a530 comp rx=0 tx=0).stop 2024-07-27T03:10:24.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.115+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2922460278 shutdown_connections 2024-07-27T03:10:24.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.115+0000 7fd2e6d6f640 1 --2- 172.21.15.120:0/2922460278 >> v2:172.21.15.121:3300/0 conn(0x7fd2e00aebf0 0x7fd2e00af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:24.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.115+0000 7fd2e6d6f640 1 --2- 172.21.15.120:0/2922460278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2e006ec80 0x7fd2e00ad0b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:24.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.115+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2922460278 >> 172.21.15.120:0/2922460278 conn(0x7fd2e00b1a10 msgr2=0x7fd2e00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:24.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.115+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2922460278 shutdown_connections 2024-07-27T03:10:24.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.115+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2922460278 wait complete. 2024-07-27T03:10:24.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.116+0000 7fd2e6d6f640 1 Processor -- start 2024-07-27T03:10:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.117+0000 7fd2e6d6f640 1 -- start start 2024-07-27T03:10:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2e6d6f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2e006ec80 0x7fd2e013d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2e6d6f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2e00aebf0 0x7fd2e01f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2e6d6f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e015fce0 0x7fd2e01f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2e6d6f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e00737c0 con 0x7fd2e00aebf0 2024-07-27T03:10:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2e6d6f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0142c60 con 0x7fd2e015fce0 2024-07-27T03:10:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2e6d6f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e0073940 con 0x7fd2e006ec80 2024-07-27T03:10:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2e00aebf0 0x7fd2e01f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2dffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2e00aebf0 0x7fd2e01f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35700/0 (socket says 172.21.15.120:35700) 2024-07-27T03:10:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2dffff640 1 -- 172.21.15.120:0/2967611663 learned_addr learned my addr 172.21.15.120:0/2967611663 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:24.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2e4b0b640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2e006ec80 0x7fd2e013d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2e530c640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e015fce0 0x7fd2e01f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2dffff640 1 -- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2e006ec80 msgr2=0x7fd2e013d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2dffff640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2e006ec80 0x7fd2e013d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2dffff640 1 -- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e015fce0 msgr2=0x7fd2e01f69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2dffff640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e015fce0 0x7fd2e01f69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2dffff640 1 -- 172.21.15.120:0/2967611663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e01f7270 con 0x7fd2e00aebf0 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2e530c640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e015fce0 0x7fd2e01f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.118+0000 7fd2e4b0b640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2e006ec80 0x7fd2e013d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.119+0000 7fd2dffff640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2e00aebf0 0x7fd2e01f6460 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c970 tx=0x7fd2cc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.119+0000 7fd2dd7fa640 1 -- 172.21.15.120:0/2967611663 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc007bb0 con 0x7fd2e00aebf0 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.119+0000 7fd2dd7fa640 1 -- 172.21.15.120:0/2967611663 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2cc007e40 con 0x7fd2e00aebf0 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.119+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2967611663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e013efa0 con 0x7fd2e00aebf0 2024-07-27T03:10:24.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.119+0000 7fd2dd7fa640 1 -- 172.21.15.120:0/2967611663 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc005280 con 0x7fd2e00aebf0 2024-07-27T03:10:24.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.119+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2967611663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e01409e0 con 0x7fd2e00aebf0 2024-07-27T03:10:24.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.120+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2967611663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e0160970 con 0x7fd2e00aebf0 2024-07-27T03:10:24.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.120+0000 7fd2dd7fa640 1 -- 172.21.15.120:0/2967611663 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd2cc005420 con 0x7fd2e00aebf0 2024-07-27T03:10:24.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.121+0000 7fd2dd7fa640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd2c4077010 0x7fd2c4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:24.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.121+0000 7fd2dd7fa640 1 -- 172.21.15.120:0/2967611663 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fd2cc098ce0 con 0x7fd2e00aebf0 2024-07-27T03:10:24.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.121+0000 7fd2e4b0b640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd2c4077010 0x7fd2c4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:24.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.122+0000 7fd2e4b0b640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd2c4077010 0x7fd2c4079520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4034000 tx=0x7fd2d4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:24.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.125+0000 7fd2dd7fa640 1 -- 172.21.15.120:0/2967611663 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd2cc014030 con 0x7fd2e00aebf0 2024-07-27T03:10:24.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.343+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2967611663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2e01f7000 con 0x7fd2e00aebf0 2024-07-27T03:10:24.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.344+0000 7fd2dd7fa640 1 -- 172.21.15.120:0/2967611663 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5267 (secure 0 0 0) 0x7fd2cc061ff0 con 0x7fd2e00aebf0 2024-07-27T03:10:24.346 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:10:24.347 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":38,"btime":"2024-07-27T03:10:22:939278+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/296895260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":296895260},{"type":"v1","addr":"172.21.15.121:6837","nonce":296895260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:10:08.410648+0000","modified":"2024-07-27T03:10:22.939271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5328,"mds_1":5325,"mds_2":5134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5134":{"gid":5134,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6836/1978820402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1978820402},{"type":"v1","addr":"172.21.15.121:6836","nonce":1978820402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5325":{"gid":5325,"name":"a","rank":1,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/1425775647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1425775647},{"type":"v1","addr":"172.21.15.120:6834","nonce":1425775647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/890762307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":890762307},{"type":"v1","addr":"172.21.15.120:6835","nonce":890762307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5134,5325,5328]},"id":3}]} 2024-07-27T03:10:24.347 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 38 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd2c4077010 msgr2=0x7fd2c4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd2c4077010 0x7fd2c4079520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4034000 tx=0x7fd2d4004730 comp rx=0 tx=0).stop 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2967611663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2e00aebf0 msgr2=0x7fd2e01f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2e00aebf0 0x7fd2e01f6460 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c970 tx=0x7fd2cc00ce30 comp rx=0 tx=0).stop 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2967611663 shutdown_connections 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd2c4077010 0x7fd2c4079520 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2e00aebf0 0x7fd2e01f6460 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2e015fce0 0x7fd2e01f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 --2- 172.21.15.120:0/2967611663 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd2e006ec80 0x7fd2e013d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2967611663 >> 172.21.15.120:0/2967611663 conn(0x7fd2e00b1a10 msgr2=0x7fd2e00af820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2967611663 shutdown_connections 2024-07-27T03:10:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.346+0000 7fd2e6d6f640 1 -- 172.21.15.120:0/2967611663 wait complete. 2024-07-27T03:10:24.360 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs balance_automate true 2024-07-27T03:10:24.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.476+0000 7fef9a805640 1 -- 172.21.15.120:0/2688614639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef7c0039e0 msgr2=0x7fef7c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:24.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.476+0000 7fef9a805640 1 --2- 172.21.15.120:0/2688614639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef7c0039e0 0x7fef7c003e10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fef84009b20 tx=0x7fef7c005830 comp rx=0 tx=0).stop 2024-07-27T03:10:24.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.476+0000 7fef98da2640 1 -- 172.21.15.120:0/2688614639 reap_dead start 2024-07-27T03:10:24.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.476+0000 7fef9a805640 1 -- 172.21.15.120:0/2688614639 shutdown_connections 2024-07-27T03:10:24.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.476+0000 7fef9a805640 1 -- 172.21.15.120:0/2688614639 >> 172.21.15.120:0/2688614639 conn(0x7fef940d20a0 msgr2=0x7fef940d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:24.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.476+0000 7fef9a805640 1 -- 172.21.15.120:0/2688614639 shutdown_connections 2024-07-27T03:10:24.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.476+0000 7fef9a805640 1 -- 172.21.15.120:0/2688614639 wait complete. 2024-07-27T03:10:24.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.477+0000 7fef9a805640 1 Processor -- start 2024-07-27T03:10:24.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.478+0000 7fef9a805640 1 -- start start 2024-07-27T03:10:24.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef9a805640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fef7c0039e0 0x7fef941f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:24.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef9a805640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef941e99d0 0x7fef941f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:24.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef9a805640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef94071c40 0x7fef94072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:24.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef9a805640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fef940ccf40 con 0x7fef941e99d0 2024-07-27T03:10:24.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef9a805640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fef940b7460 con 0x7fef94071c40 2024-07-27T03:10:24.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef9a805640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fef940cd0c0 con 0x7fef7c0039e0 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef937fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef941e99d0 0x7fef941f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef937fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef941e99d0 0x7fef941f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35710/0 (socket says 172.21.15.120:35710) 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef937fe640 1 -- 172.21.15.120:0/3301663040 learned_addr learned my addr 172.21.15.120:0/3301663040 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef937fe640 1 -- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fef7c0039e0 msgr2=0x7fef941f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef937fe640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fef7c0039e0 0x7fef941f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef937fe640 1 -- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef94071c40 msgr2=0x7fef94072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef98da2640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef94071c40 0x7fef94072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef937fe640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef94071c40 0x7fef94072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef937fe640 1 -- 172.21.15.120:0/3301663040 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef94072590 con 0x7fef941e99d0 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.479+0000 7fef937fe640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef941e99d0 0x7fef941f8dd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fef88000c00 tx=0x7fef8800eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.480+0000 7fef90ff9640 1 -- 172.21.15.120:0/3301663040 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef88015070 con 0x7fef941e99d0 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.480+0000 7fef90ff9640 1 -- 172.21.15.120:0/3301663040 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef8800ca00 con 0x7fef941e99d0 2024-07-27T03:10:24.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.480+0000 7fef9a805640 1 -- 172.21.15.120:0/3301663040 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef941e9de0 con 0x7fef941e99d0 2024-07-27T03:10:24.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.480+0000 7fef90ff9640 1 -- 172.21.15.120:0/3301663040 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8800ce30 con 0x7fef941e99d0 2024-07-27T03:10:24.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.480+0000 7fef9a805640 1 -- 172.21.15.120:0/3301663040 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef941f5b30 con 0x7fef941e99d0 2024-07-27T03:10:24.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.481+0000 7fef9a805640 1 -- 172.21.15.120:0/3301663040 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef940cd620 con 0x7fef941e99d0 2024-07-27T03:10:24.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.482+0000 7fef90ff9640 1 -- 172.21.15.120:0/3301663040 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fef88018070 con 0x7fef941e99d0 2024-07-27T03:10:24.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.482+0000 7fef90ff9640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fef80077040 0x7fef80079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:24.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.482+0000 7fef90ff9640 1 -- 172.21.15.120:0/3301663040 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fef88098c70 con 0x7fef941e99d0 2024-07-27T03:10:24.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.482+0000 7fef93fff640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fef80077040 0x7fef80079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:24.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.483+0000 7fef93fff640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fef80077040 0x7fef80079550 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef84035000 tx=0x7fef84004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:24.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.487+0000 7fef90ff9640 1 -- 172.21.15.120:0/3301663040 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fef94072590 con 0x7fef941e99d0 2024-07-27T03:10:24.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:24.706+0000 7fef9a805640 1 -- 172.21.15.120:0/3301663040 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fef941f55e0 con 0x7fef941e99d0 2024-07-27T03:10:25.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.144+0000 7fef90ff9640 1 -- 172.21.15.120:0/3301663040 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v39) ==== 117+0+0 (secure 0 0 0) 0x7fef88061ec0 con 0x7fef941e99d0 2024-07-27T03:10:25.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 -- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fef80077040 msgr2=0x7fef80079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:25.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fef80077040 0x7fef80079550 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef84035000 tx=0x7fef84004730 comp rx=0 tx=0).stop 2024-07-27T03:10:25.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 -- 172.21.15.120:0/3301663040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef941e99d0 msgr2=0x7fef941f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:25.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef941e99d0 0x7fef941f8dd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fef88000c00 tx=0x7fef8800eab0 comp rx=0 tx=0).stop 2024-07-27T03:10:25.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 -- 172.21.15.120:0/3301663040 shutdown_connections 2024-07-27T03:10:25.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fef80077040 0x7fef80079550 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:25.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef941e99d0 0x7fef941f8dd0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:25.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef94071c40 0x7fef94072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:25.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 --2- 172.21.15.120:0/3301663040 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fef7c0039e0 0x7fef941f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:25.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 -- 172.21.15.120:0/3301663040 >> 172.21.15.120:0/3301663040 conn(0x7fef940d20a0 msgr2=0x7fef941e6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:25.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 -- 172.21.15.120:0/3301663040 shutdown_connections 2024-07-27T03:10:25.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25.146+0000 7fef9a805640 1 -- 172.21.15.120:0/3301663040 wait complete. 2024-07-27T03:10:25.160 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/a') 2024-07-27T03:10:25.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:10:25.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:10:25.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:10:25.222 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.bal.mask -v 2 1) 2024-07-27T03:10:25.239 INFO:tasks.cephfs.cephfs_test_case:_wait_subtrees test=[('/1', 2)] status={ "btime": "2024-07-27T03:10:22:939278+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 3, "epoch": 38, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 3, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-07-27T03:10:08.410648+0000", "damaged": [], "data_pools": [ 7 ], "enabled": true, "epoch": 38, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_5134": { "addr": "172.21.15.121:6836/1978820402", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6834", "nonce": 1978820402, "type": "v2" }, { "addr": "172.21.15.121:6836", "nonce": 1978820402, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5134, "incarnation": 37, "join_fscid": -1, "name": "d", "rank": 2, "state": "up:active", "state_seq": 6 }, "gid_5325": { "addr": "172.21.15.120:6834/1425775647", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 1425775647, "type": "v2" }, { "addr": "172.21.15.120:6834", "nonce": 1425775647, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5325, "incarnation": 35, "join_fscid": -1, "name": "a", "rank": 1, "state": "up:active", "state_seq": 6 }, "gid_5328": { "addr": "172.21.15.120:6835/890762307", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6833", "nonce": 890762307, "type": "v2" }, { "addr": "172.21.15.120:6835", "nonce": 890762307, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5328, "incarnation": 30, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 6, "modified": "2024-07-27T03:10:22.939271+0000", "qdb_cluster": [ 5134, 5325, 5328 ], "qdb_leader": 5328, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5328, "mds_1": 5325, "mds_2": 5134 } } } ], "standbys": [ { "addr": "172.21.15.121:6837/296895260", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6835", "nonce": 296895260, "type": "v2" }, { "addr": "172.21.15.121:6837", "nonce": 296895260, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 29, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4934, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } rank=2 timeout=30 sleep=2 action=None path=None 2024-07-27T03:10:25.240 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-07-27T03:10:25.369 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:10:25.369 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:25.370 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/1', 2)] 2024-07-27T03:10:27.371 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-07-27T03:10:27.508 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:10:27.508 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:27.508 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/1', 2)] 2024-07-27T03:10:29.510 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-07-27T03:10:29.651 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:10:29.651 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:29.651 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/1', 2)] 2024-07-27T03:10:31.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-07-27T03:10:31.789 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:10:31.790 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:31.790 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/1', 2)] 2024-07-27T03:10:33.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-07-27T03:10:33.930 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:10:33.930 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:33.931 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/1', 2)] 2024-07-27T03:10:35.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-07-27T03:10:36.070 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:10:36.071 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:36.071 INFO:tasks.cephfs.cephfs_test_case:[('/1', 2)] =?= [('/1', 2)] 2024-07-27T03:10:36.071 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:10:36.071 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:10:36.091 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:10:36.092 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:10:36.093 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:10:36.094 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:10:36.094 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:10:36.094 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:10:36.094 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:10:36.094 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:10:36.094 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:10:36.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:10:40.419 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:10:40.422 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:10:46.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_export_ephemeral_distributed True 2024-07-27T03:10:46.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.751+0000 7f1faef0d640 1 -- 172.21.15.120:0/1517557861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa815ec10 msgr2=0x7f1fa815f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:46.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.751+0000 7f1faef0d640 1 --2- 172.21.15.120:0/1517557861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa815ec10 0x7f1fa815f020 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0005fd0 tx=0x7f1fa002a4a0 comp rx=0 tx=0).stop 2024-07-27T03:10:46.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.751+0000 7f1faef0d640 1 -- 172.21.15.120:0/1517557861 shutdown_connections 2024-07-27T03:10:46.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.751+0000 7f1faef0d640 1 --2- 172.21.15.120:0/1517557861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa815ec10 0x7f1fa815f020 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:46.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.751+0000 7f1faef0d640 1 --2- 172.21.15.120:0/1517557861 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1fa806e270 0x7f1fa8073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:46.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.751+0000 7f1faef0d640 1 -- 172.21.15.120:0/1517557861 >> 172.21.15.120:0/1517557861 conn(0x7f1fa80b1a10 msgr2=0x7f1fa80b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:46.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.751+0000 7f1faef0d640 1 -- 172.21.15.120:0/1517557861 shutdown_connections 2024-07-27T03:10:46.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.751+0000 7f1faef0d640 1 -- 172.21.15.120:0/1517557861 wait complete. 2024-07-27T03:10:46.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.753+0000 7f1faef0d640 1 Processor -- start 2024-07-27T03:10:46.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.753+0000 7f1faef0d640 1 -- start start 2024-07-27T03:10:46.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.754+0000 7f1faef0d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1fa806e270 0x7f1fa81f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:46.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.754+0000 7f1faef0d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fa81522e0 0x7f1fa8144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.754+0000 7f1faef0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa815ec10 0x7f1fa8156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.754+0000 7f1faef0d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa815f8f0 con 0x7f1fa815ec10 2024-07-27T03:10:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.754+0000 7f1faef0d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa815f770 con 0x7f1fa81522e0 2024-07-27T03:10:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.754+0000 7f1faef0d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa815fa70 con 0x7f1fa806e270 2024-07-27T03:10:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.754+0000 7f1fad4aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa815ec10 0x7f1fa8156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.754+0000 7f1fad4aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa815ec10 0x7f1fa8156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33168/0 (socket says 172.21.15.120:33168) 2024-07-27T03:10:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.754+0000 7f1fad4aa640 1 -- 172.21.15.120:0/2574514868 learned_addr learned my addr 172.21.15.120:0/2574514868 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:10:46.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1facca9640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1fa806e270 0x7f1fa81f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1fa7fff640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fa81522e0 0x7f1fa8144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1fad4aa640 1 -- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1fa806e270 msgr2=0x7f1fa81f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1fad4aa640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1fa806e270 0x7f1fa81f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1fad4aa640 1 -- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fa81522e0 msgr2=0x7f1fa8144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1fad4aa640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fa81522e0 0x7f1fa8144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1fad4aa640 1 -- 172.21.15.120:0/2574514868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa81450b0 con 0x7f1fa815ec10 2024-07-27T03:10:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1fad4aa640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa815ec10 0x7f1fa8156010 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0034040 tx=0x7f1fa00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:46.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1fa57fa640 1 -- 172.21.15.120:0/2574514868 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa003e030 con 0x7f1fa815ec10 2024-07-27T03:10:46.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1fa57fa640 1 -- 172.21.15.120:0/2574514868 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fa00047a0 con 0x7f1fa815ec10 2024-07-27T03:10:46.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1faef0d640 1 -- 172.21.15.120:0/2574514868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa8145390 con 0x7f1fa815ec10 2024-07-27T03:10:46.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1fa57fa640 1 -- 172.21.15.120:0/2574514868 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0035040 con 0x7f1fa815ec10 2024-07-27T03:10:46.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.755+0000 7f1faef0d640 1 -- 172.21.15.120:0/2574514868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa81f57e0 con 0x7f1fa815ec10 2024-07-27T03:10:46.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.756+0000 7f1faef0d640 1 -- 172.21.15.120:0/2574514868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa815f020 con 0x7f1fa815ec10 2024-07-27T03:10:46.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.757+0000 7f1fa57fa640 1 -- 172.21.15.120:0/2574514868 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1fa0041030 con 0x7f1fa815ec10 2024-07-27T03:10:46.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.757+0000 7f1fa57fa640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f88077010 0x7f1f88079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:10:46.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.757+0000 7f1fa57fa640 1 -- 172.21.15.120:0/2574514868 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f1fa00b90c0 con 0x7f1fa815ec10 2024-07-27T03:10:46.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.758+0000 7f1facca9640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f88077010 0x7f1f88079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:10:46.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.758+0000 7f1facca9640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f88077010 0x7f1f88079520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800b450 tx=0x7f1f9800d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:10:46.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.762+0000 7f1fa57fa640 1 -- 172.21.15.120:0/2574514868 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f1fa0081c30 con 0x7f1fa815ec10 2024-07-27T03:10:46.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.944+0000 7f1faef0d640 1 -- 172.21.15.120:0/2574514868 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mds_export_ephemeral_distributed}] v 0) -- 0x7f1fa8144e40 con 0x7f1fa815ec10 2024-07-27T03:10:46.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.950+0000 7f1fa57fa640 1 -- 172.21.15.120:0/2574514868 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_export_ephemeral_distributed}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7f1fa0086180 con 0x7f1fa815ec10 2024-07-27T03:10:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 -- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f88077010 msgr2=0x7f1f88079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f88077010 0x7f1f88079520 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800b450 tx=0x7f1f9800d040 comp rx=0 tx=0).stop 2024-07-27T03:10:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 -- 172.21.15.120:0/2574514868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa815ec10 msgr2=0x7f1fa8156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:10:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa815ec10 0x7f1fa8156010 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0034040 tx=0x7f1fa00039e0 comp rx=0 tx=0).stop 2024-07-27T03:10:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 -- 172.21.15.120:0/2574514868 shutdown_connections 2024-07-27T03:10:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f88077010 0x7f1f88079520 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa815ec10 0x7f1fa8156010 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:46.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fa81522e0 0x7f1fa8144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:46.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 --2- 172.21.15.120:0/2574514868 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1fa806e270 0x7f1fa81f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:10:46.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 -- 172.21.15.120:0/2574514868 >> 172.21.15.120:0/2574514868 conn(0x7f1fa80b1a10 msgr2=0x7f1fa80b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:10:46.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 -- 172.21.15.120:0/2574514868 shutdown_connections 2024-07-27T03:10:46.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:46.952+0000 7f1faef0d640 1 -- 172.21.15.120:0/2574514868 wait complete. 2024-07-27T03:10:46.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:10:46.967 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin.distributed -v 1 1) 2024-07-27T03:10:46.985 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:10:46.985 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:10:47.041 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:10:47.041 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:10:47.042 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:10:47.043 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:10:47.043 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:10:47.043 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:10:47.043 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:10:47.043 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:10:47.044 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:10:47.045 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:10:48.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:10:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:10:48.022 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-07-27T03:10:48.158 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"1205","version":"1205","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:10:48.159 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1205", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "1205" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:48.160 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "1205", "version": "1205", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 1 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "8", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds2", "dirfrag": "0x102", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } } ] 2024-07-27T03:10:48.160 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-07-27T03:10:48.296 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:10:48.296 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:48.297 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } } ] 2024-07-27T03:10:48.297 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-07-27T03:10:48.422 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"14","version":"12","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":1},"nref":5}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-07-27T03:10:48.423 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 1, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 5, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "12" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-07-27T03:10:48.424 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "14", "version": "12", "committing_version": "1", "committed_version": "1", "is_rep": true, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "replicated": 1, "dirty": 1, "authpin": 1 }, "nref": 5 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds0", "dirfrag": "0x100", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "3", "version": "3", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } } ] 2024-07-27T03:10:48.424 INFO:tasks.cephfs.cephfs_test_case:len=0 [] 2024-07-27T03:10:53.425 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-07-27T03:10:53.563 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"1205","version":"1205","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:10:53.566 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1205", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "1205" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:53.567 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "1205", "version": "1205", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 1 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "8", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds2", "dirfrag": "0x102", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } } ] 2024-07-27T03:10:53.567 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-07-27T03:10:53.705 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:10:53.706 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:53.706 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } } ] 2024-07-27T03:10:53.706 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-07-27T03:10:53.830 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"14","version":"14","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-07-27T03:10:53.830 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": false } ] 2024-07-27T03:10:53.831 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "14", "version": "14", "committing_version": "1", "committed_version": "1", "is_rep": true, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds0", "dirfrag": "0x100", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "3", "version": "3", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } } ] 2024-07-27T03:10:53.831 INFO:tasks.cephfs.cephfs_test_case:len=0 [] 2024-07-27T03:10:58.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-07-27T03:10:58.970 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.001*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"frozen":0,"subtree":1,"replicated":1,"dirty":0,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.000*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"frozen":0,"subtree":1,"replicated":1,"dirty":0,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":1,"dir":{"path":"/1","dirfrag":"0x10000000000.010*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"frozen":0,"subtree":1,"replicated":1,"dirty":0,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.011*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"frozen":0,"subtree":1,"replicated":1,"dirty":0,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":1,"dir":{"path":"/1","dirfrag":"0x10000000000.100*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"frozen":0,"subtree":1,"replicated":1,"dirty":0,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.101*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"frozen":0,"subtree":1,"replicated":1,"dirty":0,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.110*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"frozen":0,"subtree":1,"replicated":1,"dirty":0,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.111*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"frozen":0,"subtree":1,"replicated":1,"dirty":0,"authpin":1},"nref":4}}] 2024-07-27T03:10:58.971 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 1, "auth_state": { "replicas": { "0": 2 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "2", "dirfrag": "0x10000000000.001*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 1, "child": 1, "dirty": 0, "frozen": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 1, "auth_state": { "replicas": { "0": 2 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "2", "dirfrag": "0x10000000000.000*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 1, "child": 1, "dirty": 0, "frozen": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 1, "auth_state": { "replicas": { "0": 2 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "2", "dirfrag": "0x10000000000.010*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 1, "child": 1, "dirty": 0, "frozen": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 1, "auth_state": { "replicas": { "0": 2 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "2", "dirfrag": "0x10000000000.011*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 1, "child": 1, "dirty": 0, "frozen": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 1, "auth_state": { "replicas": { "0": 2 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "2", "dirfrag": "0x10000000000.100*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 1, "child": 1, "dirty": 0, "frozen": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 1, "auth_state": { "replicas": { "0": 2 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "2", "dirfrag": "0x10000000000.101*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 1, "child": 1, "dirty": 0, "frozen": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 1, "auth_state": { "replicas": { "0": 2 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "2", "dirfrag": "0x10000000000.110*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 1, "child": 1, "dirty": 0, "frozen": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 1, "auth_state": { "replicas": { "0": 2 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "2", "dirfrag": "0x10000000000.111*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 1, "child": 1, "dirty": 0, "frozen": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:58.972 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "8", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds2", "dirfrag": "0x102", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.001*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.000*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.010*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.011*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.100*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.101*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.110*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.111*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 1 }, "nref": 4 } } ] 2024-07-27T03:10:58.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-07-27T03:10:59.110 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-07-27T03:10:59.110 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:10:59.111 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } } ] 2024-07-27T03:10:59.111 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-07-27T03:10:59.236 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"16","version":"16","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.000*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.001*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":1,"dir":{"path":"/1","dirfrag":"0x10000000000.010*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.011*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":1,"dir":{"path":"/1","dirfrag":"0x10000000000.100*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.101*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.110*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.111*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}}] 2024-07-27T03:10:59.237 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "16", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "16" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000.000*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000.001*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000.010*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000.011*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000.100*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000.101*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000.110*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000.111*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": false } ] 2024-07-27T03:10:59.237 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "16", "version": "16", "committing_version": "1", "committed_version": "1", "is_rep": true, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds0", "dirfrag": "0x100", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.000*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.001*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.010*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.011*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.100*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.101*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.110*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.111*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } } ] 2024-07-27T03:10:59.238 INFO:tasks.cephfs.cephfs_test_case:len=3 [ { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.000*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.011*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.101*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 1, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 1 }, "nref": 4 } } ] 2024-07-27T03:11:04.239 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-07-27T03:11:04.375 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.001*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.000*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"frozen":0,"subtree":1,"replicated":1,"dirty":0,"authpin":0},"nref":3}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":1,"dir":{"path":"/1","dirfrag":"0x10000000000.010*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.011*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"frozen":0,"subtree":1,"replicated":1,"dirty":0,"authpin":0},"nref":3}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":1,"dir":{"path":"/1","dirfrag":"0x10000000000.100*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.101*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"frozen":0,"subtree":1,"replicated":1,"dirty":0,"authpin":0},"nref":3}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.110*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.111*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-07-27T03:11:04.377 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "0", "dirfrag": "0x10000000000.001*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "1206", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 2 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "2", "dirfrag": "0x10000000000.000*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "1", "dirfrag": "0x10000000000.010*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "1206", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 2 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "2", "dirfrag": "0x10000000000.011*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "1", "dirfrag": "0x10000000000.100*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "1206", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 2 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "2", "dirfrag": "0x10000000000.101*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "0", "dirfrag": "0x10000000000.110*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "1206", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "0", "dirfrag": "0x10000000000.111*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "1206", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": false } ] 2024-07-27T03:11:04.377 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "8", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds2", "dirfrag": "0x102", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.001*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 1, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.000*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 0 }, "nref": 3 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.010*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 1, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.011*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 0 }, "nref": 3 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.100*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 1, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.101*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 0 }, "nref": 3 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.110*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 1, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.111*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 1, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } } ] 2024-07-27T03:11:04.378 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-07-27T03:11:04.516 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"18","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":1,"dir":{"path":"/1","dirfrag":"0x10000000000.100*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1},"nref":3}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":1,"dir":{"path":"/1","dirfrag":"0x10000000000.010*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"0":2,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1},"nref":3}}] 2024-07-27T03:11:04.516 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "18" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 2, "2": 1 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "1", "dirfrag": "0x10000000000.100*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1", "pins": { "child": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 2, "2": 1 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "1", "dirfrag": "0x10000000000.010*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1", "pins": { "child": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:11:04.517 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "18", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.100*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2, "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1 }, "nref": 3 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.010*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2, "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1 }, "nref": 3 } } ] 2024-07-27T03:11:04.517 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-07-27T03:11:04.641 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"18","version":"18","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":2,"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.000*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.001*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1},"nref":3}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":1,"dir":{"path":"/1","dirfrag":"0x10000000000.010*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.011*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":1,"dir":{"path":"/1","dirfrag":"0x10000000000.100*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":2,"dir":{"path":"/1","dirfrag":"0x10000000000.101*","snapid_first":2,"projected_version":"3","version":"1206","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1},"nref":1}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.110*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":true,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":0,"dir":{"path":"/1","dirfrag":"0x10000000000.111*","snapid_first":2,"projected_version":"1206","version":"1206","committing_version":"1206","committed_version":"1206","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1},"nref":3}}] 2024-07-27T03:11:04.642 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 2, "2": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "18", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "18" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000.000*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "0", "dirfrag": "0x10000000000.001*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1", "pins": { "child": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000.010*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000.011*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000.100*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000.101*", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1", "pins": { "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "0", "dirfrag": "0x10000000000.110*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1", "pins": { "child": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "1206", "committing_version": "1206", "dir_auth": "0", "dirfrag": "0x10000000000.111*", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1", "pins": { "child": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "1206", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1206" }, "distributed_ephemeral_pin": true, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:11:04.643 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "18", "version": "18", "committing_version": "1", "committed_version": "1", "is_rep": true, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 2, "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds0", "dirfrag": "0x100", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.000*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.001*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1 }, "nref": 3 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.010*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.011*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.100*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.101*", "snapid_first": 2, "projected_version": "3", "version": "1206", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1 }, "nref": 1 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.110*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1 }, "nref": 3 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.111*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1 }, "nref": 3 } } ] 2024-07-27T03:11:04.644 INFO:tasks.cephfs.cephfs_test_case:len=8 [ { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.000*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 0 }, "nref": 3 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.011*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 0 }, "nref": 3 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 2, "dir": { "path": "/1", "dirfrag": "0x10000000000.101*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "frozen": 0, "subtree": 1, "replicated": 1, "dirty": 0, "authpin": 0 }, "nref": 3 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.100*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2, "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1 }, "nref": 3 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 1, "dir": { "path": "/1", "dirfrag": "0x10000000000.010*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 2, "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1 }, "nref": 3 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.001*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1 }, "nref": 3 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.110*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1 }, "nref": 3 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": true, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": 0, "dir": { "path": "/1", "dirfrag": "0x10000000000.111*", "snapid_first": 2, "projected_version": "1206", "version": "1206", "committing_version": "1206", "committed_version": "1206", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1 }, "nref": 3 } } ] 2024-07-27T03:11:04.644 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-07-27T03:11:04.644 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:11:04.682 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:11:04.722 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-07-27T03:11:04.722 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:11:04.722 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:04.722 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:04.739 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:04.739 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:04.795 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-27T03:11:04.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.948+0000 7f103b388640 1 -- 172.21.15.120:0/3746118521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c005330 msgr2=0x7f101c00b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:04.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.948+0000 7f103b388640 1 --2- 172.21.15.120:0/3746118521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c005330 0x7f101c00b9e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f102c00c780 tx=0x7f101c005830 comp rx=0 tx=0).stop 2024-07-27T03:11:04.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.948+0000 7f103b388640 1 -- 172.21.15.120:0/3746118521 shutdown_connections 2024-07-27T03:11:04.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.948+0000 7f103b388640 1 --2- 172.21.15.120:0/3746118521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f101c005330 0x7f101c00b9e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:04.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.948+0000 7f103b388640 1 -- 172.21.15.120:0/3746118521 >> 172.21.15.120:0/3746118521 conn(0x7f10340b1a10 msgr2=0x7f10340b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:04.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.948+0000 7f103b388640 1 -- 172.21.15.120:0/3746118521 shutdown_connections 2024-07-27T03:11:04.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.948+0000 7f103b388640 1 -- 172.21.15.120:0/3746118521 wait complete. 2024-07-27T03:11:04.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.949+0000 7f103b388640 1 Processor -- start 2024-07-27T03:11:04.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.950+0000 7f103b388640 1 -- start start 2024-07-27T03:11:04.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f103b388640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f101c005330 0x7f10341526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:04.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f103b388640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10340b0a00 0x7f10340b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f103b388640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034155b80 0x7f1034155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f103b388640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1034155830 con 0x7f1034155b80 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f103b388640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10341556b0 con 0x7f101c005330 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f103b388640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f10340b4f90 con 0x7f10340b0a00 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1039925640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034155b80 0x7f1034155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1039925640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034155b80 0x7f1034155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47090/0 (socket says 172.21.15.120:47090) 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1039925640 1 -- 172.21.15.120:0/2091053109 learned_addr learned my addr 172.21.15.120:0/2091053109 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1038923640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10340b0a00 0x7f10340b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1039124640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f101c005330 0x7f10341526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1039925640 1 -- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10340b0a00 msgr2=0x7f10340b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1039925640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10340b0a00 0x7f10340b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1039925640 1 -- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f101c005330 msgr2=0x7f10341526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1039925640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f101c005330 0x7f10341526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:04.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1039925640 1 -- 172.21.15.120:0/2091053109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10340b1350 con 0x7f1034155b80 2024-07-27T03:11:04.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1039925640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034155b80 0x7f1034155f90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f102c02b690 tx=0x7f102c0012c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:04.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.951+0000 7f1031ffb640 1 -- 172.21.15.120:0/2091053109 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c02b9e0 con 0x7f1034155b80 2024-07-27T03:11:04.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.952+0000 7f1031ffb640 1 -- 172.21.15.120:0/2091053109 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f102c02bb80 con 0x7f1034155b80 2024-07-27T03:11:04.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.952+0000 7f1031ffb640 1 -- 172.21.15.120:0/2091053109 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c006070 con 0x7f1034155b80 2024-07-27T03:11:04.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.952+0000 7f103b388640 1 -- 172.21.15.120:0/2091053109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1034158e20 con 0x7f1034155b80 2024-07-27T03:11:04.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.952+0000 7f103b388640 1 -- 172.21.15.120:0/2091053109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10341593e0 con 0x7f1034155b80 2024-07-27T03:11:04.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.953+0000 7f103b388640 1 -- 172.21.15.120:0/2091053109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1034073e30 con 0x7f1034155b80 2024-07-27T03:11:04.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.953+0000 7f1031ffb640 1 -- 172.21.15.120:0/2091053109 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f102c006210 con 0x7f1034155b80 2024-07-27T03:11:04.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.954+0000 7f1031ffb640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077040 0x7f1020079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:04.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.954+0000 7f1031ffb640 1 -- 172.21.15.120:0/2091053109 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f102c0b8360 con 0x7f1034155b80 2024-07-27T03:11:04.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.954+0000 7f1039124640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077040 0x7f1020079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:04.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.955+0000 7f1039124640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077040 0x7f1020079550 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1024004610 tx=0x7f102400b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:04.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:04.959+0000 7f1031ffb640 1 -- 172.21.15.120:0/2091053109 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f10340b1350 con 0x7f1034155b80 2024-07-27T03:11:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.158+0000 7f103b388640 1 -- 172.21.15.120:0/2091053109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1034158ba0 con 0x7f1034155b80 2024-07-27T03:11:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.158+0000 7f1031ffb640 1 -- 172.21.15.120:0/2091053109 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) ==== 80+0+0 (secure 0 0 0) 0x7f1034158ba0 con 0x7f1034155b80 2024-07-27T03:11:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-07-27T03:11:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 -- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077040 msgr2=0x7f1020079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077040 0x7f1020079550 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1024004610 tx=0x7f102400b260 comp rx=0 tx=0).stop 2024-07-27T03:11:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 -- 172.21.15.120:0/2091053109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034155b80 msgr2=0x7f1034155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034155b80 0x7f1034155f90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f102c02b690 tx=0x7f102c0012c0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 -- 172.21.15.120:0/2091053109 shutdown_connections 2024-07-27T03:11:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1020077040 0x7f1020079550 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1034155b80 0x7f1034155f90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f10340b0a00 0x7f10340b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 --2- 172.21.15.120:0/2091053109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f101c005330 0x7f10341526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 -- 172.21.15.120:0/2091053109 >> 172.21.15.120:0/2091053109 conn(0x7f10340b1a10 msgr2=0x7f1034154660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:05.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 -- 172.21.15.120:0/2091053109 shutdown_connections 2024-07-27T03:11:05.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.161+0000 7f103b388640 1 -- 172.21.15.120:0/2091053109 wait complete. 2024-07-27T03:11:05.174 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-07-27T03:11:05.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:11:05.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-07-27T03:11:05.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:11:05.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:11:05.257 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-07-27T03:11:05.272 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:11:05.272 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:11:05.272 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:05.289 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:11:05.289 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:11:05.289 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:05.290 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:05.328 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:11:05.329 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:11:05.329 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:11:05.329 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:05.345 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:11:05.346 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:11:05.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.478+0000 7fea450d2640 1 -- 172.21.15.120:0/3614046152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea400b30d0 msgr2=0x7fea400b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:05.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.478+0000 7fea450d2640 1 --2- 172.21.15.120:0/3614046152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea400b30d0 0x7fea400b34e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fea38005fd0 tx=0x7fea3802a820 comp rx=0 tx=0).stop 2024-07-27T03:11:05.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.478+0000 7fea450d2640 1 -- 172.21.15.120:0/3614046152 shutdown_connections 2024-07-27T03:11:05.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.478+0000 7fea450d2640 1 --2- 172.21.15.120:0/3614046152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea400b30d0 0x7fea400b34e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.478+0000 7fea450d2640 1 -- 172.21.15.120:0/3614046152 >> 172.21.15.120:0/3614046152 conn(0x7fea400b1a10 msgr2=0x7fea400b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.478+0000 7fea450d2640 1 -- 172.21.15.120:0/3614046152 shutdown_connections 2024-07-27T03:11:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.479+0000 7fea450d2640 1 -- 172.21.15.120:0/3614046152 wait complete. 2024-07-27T03:11:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.480+0000 7fea450d2640 1 Processor -- start 2024-07-27T03:11:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.481+0000 7fea450d2640 1 -- start start 2024-07-27T03:11:05.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea450d2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea4006e270 0x7fea401657c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:05.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea450d2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fea400b30d0 0x7fea401f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:05.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea450d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea401522e0 0x7fea40072fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:05.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea450d2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fea400b3fa0 con 0x7fea4006e270 2024-07-27T03:11:05.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea450d2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fea400b3e20 con 0x7fea401522e0 2024-07-27T03:11:05.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea450d2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fea400b4120 con 0x7fea400b30d0 2024-07-27T03:11:05.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea4006e270 0x7fea401657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:05.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea4006e270 0x7fea401657c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47108/0 (socket says 172.21.15.120:47108) 2024-07-27T03:11:05.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3ed9d640 1 -- 172.21.15.120:0/3909371101 learned_addr learned my addr 172.21.15.120:0/3909371101 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:05.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3f59e640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea401522e0 0x7fea40072fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:05.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3e59c640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fea400b30d0 0x7fea401f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3ed9d640 1 -- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fea400b30d0 msgr2=0x7fea401f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3ed9d640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fea400b30d0 0x7fea401f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3ed9d640 1 -- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea401522e0 msgr2=0x7fea40072fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3ed9d640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea401522e0 0x7fea40072fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3ed9d640 1 -- 172.21.15.120:0/3909371101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4014b180 con 0x7fea4006e270 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3e59c640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fea400b30d0 0x7fea401f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.482+0000 7fea3ed9d640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea4006e270 0x7fea401657c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fea3000b3e0 tx=0x7fea3000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.483+0000 7fea277fe640 1 -- 172.21.15.120:0/3909371101 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30015020 con 0x7fea4006e270 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.483+0000 7fea277fe640 1 -- 172.21.15.120:0/3909371101 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea30011940 con 0x7fea4006e270 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.483+0000 7fea277fe640 1 -- 172.21.15.120:0/3909371101 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30011d90 con 0x7fea4006e270 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.483+0000 7fea450d2640 1 -- 172.21.15.120:0/3909371101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea4014b460 con 0x7fea4006e270 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.483+0000 7fea450d2640 1 -- 172.21.15.120:0/3909371101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea4014e430 con 0x7fea4006e270 2024-07-27T03:11:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.484+0000 7fea450d2640 1 -- 172.21.15.120:0/3909371101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea400cfa10 con 0x7fea4006e270 2024-07-27T03:11:05.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.484+0000 7fea277fe640 1 -- 172.21.15.120:0/3909371101 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fea30018020 con 0x7fea4006e270 2024-07-27T03:11:05.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.485+0000 7fea277fe640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fea2c077010 0x7fea2c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:05.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.485+0000 7fea277fe640 1 -- 172.21.15.120:0/3909371101 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fea300988e0 con 0x7fea4006e270 2024-07-27T03:11:05.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.485+0000 7fea3e59c640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fea2c077010 0x7fea2c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:05.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.486+0000 7fea3e59c640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fea2c077010 0x7fea2c079520 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fea400cf690 tx=0x7fea34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:05.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.489+0000 7fea277fe640 1 -- 172.21.15.120:0/3909371101 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fea400cfa10 con 0x7fea4006e270 2024-07-27T03:11:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.709+0000 7fea450d2640 1 -- 172.21.15.120:0/3909371101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea4014b630 con 0x7fea4006e270 2024-07-27T03:11:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.710+0000 7fea277fe640 1 -- 172.21.15.120:0/3909371101 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5271 (secure 0 0 0) 0x7fea3001f020 con 0x7fea4006e270 2024-07-27T03:11:05.712 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:05.712 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"btime":"2024-07-27T03:10:59:971326+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/296895260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":296895260},{"type":"v1","addr":"172.21.15.121:6837","nonce":296895260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":42,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:10:08.410648+0000","modified":"2024-07-27T03:10:59.395060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5328,"mds_1":5325,"mds_2":5134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5134":{"gid":5134,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6836/1978820402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1978820402},{"type":"v1","addr":"172.21.15.121:6836","nonce":1978820402}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5325":{"gid":5325,"name":"a","rank":1,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/1425775647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1425775647},{"type":"v1","addr":"172.21.15.120:6834","nonce":1425775647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/890762307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":890762307},{"type":"v1","addr":"172.21.15.120:6835","nonce":890762307}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5134,5325,5328]},"id":3}]} 2024-07-27T03:11:05.713 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2024-07-27T03:11:05.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 -- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fea2c077010 msgr2=0x7fea2c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fea2c077010 0x7fea2c079520 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fea400cf690 tx=0x7fea34009040 comp rx=0 tx=0).stop 2024-07-27T03:11:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 -- 172.21.15.120:0/3909371101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea4006e270 msgr2=0x7fea401657c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea4006e270 0x7fea401657c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fea3000b3e0 tx=0x7fea3000b8a0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 -- 172.21.15.120:0/3909371101 shutdown_connections 2024-07-27T03:11:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fea2c077010 0x7fea2c079520 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea401522e0 0x7fea40072fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fea400b30d0 0x7fea401f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 --2- 172.21.15.120:0/3909371101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea4006e270 0x7fea401657c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 -- 172.21.15.120:0/3909371101 >> 172.21.15.120:0/3909371101 conn(0x7fea400b1a10 msgr2=0x7fea400b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 -- 172.21.15.120:0/3909371101 shutdown_connections 2024-07-27T03:11:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.712+0000 7fea450d2640 1 -- 172.21.15.120:0/3909371101 wait complete. 2024-07-27T03:11:05.726 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:11:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.837+0000 7ff5263ac640 1 -- 172.21.15.120:0/143091180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50c003a00 msgr2=0x7ff50c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.837+0000 7ff5263ac640 1 --2- 172.21.15.120:0/143091180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50c003a00 0x7ff50c003e70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff52006d7a0 tx=0x7ff50c005830 comp rx=0 tx=0).stop 2024-07-27T03:11:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.837+0000 7ff524949640 1 -- 172.21.15.120:0/143091180 reap_dead start 2024-07-27T03:11:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.837+0000 7ff5263ac640 1 -- 172.21.15.120:0/143091180 shutdown_connections 2024-07-27T03:11:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.837+0000 7ff5263ac640 1 -- 172.21.15.120:0/143091180 >> 172.21.15.120:0/143091180 conn(0x7ff5200b1a10 msgr2=0x7ff5200b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.837+0000 7ff5263ac640 1 -- 172.21.15.120:0/143091180 shutdown_connections 2024-07-27T03:11:05.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.837+0000 7ff5263ac640 1 -- 172.21.15.120:0/143091180 wait complete. 2024-07-27T03:11:05.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.839+0000 7ff5263ac640 1 Processor -- start 2024-07-27T03:11:05.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.839+0000 7ff5263ac640 1 -- start start 2024-07-27T03:11:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.840+0000 7ff5263ac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50c003a00 0x7ff520158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.840+0000 7ff5263ac640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff520159e20 0x7ff5201f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.840+0000 7ff5263ac640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff52009bf90 0x7ff52009c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.840+0000 7ff5263ac640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff5200af410 con 0x7ff50c003a00 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.840+0000 7ff5263ac640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff5200af290 con 0x7ff52009bf90 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.840+0000 7ff5263ac640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff5200af590 con 0x7ff520159e20 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50c003a00 0x7ff520158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50c003a00 0x7ff520158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47132/0 (socket says 172.21.15.120:47132) 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51ffff640 1 -- 172.21.15.120:0/3459841569 learned_addr learned my addr 172.21.15.120:0/3459841569 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff524949640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff52009bf90 0x7ff52009c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff517fff640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff520159e20 0x7ff5201f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51ffff640 1 -- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff520159e20 msgr2=0x7ff5201f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51ffff640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff520159e20 0x7ff5201f2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51ffff640 1 -- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff52009bf90 msgr2=0x7ff52009c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51ffff640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff52009bf90 0x7ff52009c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:05.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51ffff640 1 -- 172.21.15.120:0/3459841569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5201f3e30 con 0x7ff50c003a00 2024-07-27T03:11:05.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51ffff640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50c003a00 0x7ff520158100 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff510000c00 tx=0x7ff510001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:05.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51d7fa640 1 -- 172.21.15.120:0/3459841569 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510031040 con 0x7ff50c003a00 2024-07-27T03:11:05.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51d7fa640 1 -- 172.21.15.120:0/3459841569 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5100035f0 con 0x7ff50c003a00 2024-07-27T03:11:05.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff5263ac640 1 -- 172.21.15.120:0/3459841569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5201f3870 con 0x7ff50c003a00 2024-07-27T03:11:05.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff51d7fa640 1 -- 172.21.15.120:0/3459841569 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510003a20 con 0x7ff50c003a00 2024-07-27T03:11:05.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.841+0000 7ff5263ac640 1 -- 172.21.15.120:0/3459841569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff52013f040 con 0x7ff50c003a00 2024-07-27T03:11:05.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.842+0000 7ff5263ac640 1 -- 172.21.15.120:0/3459841569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff520072bc0 con 0x7ff50c003a00 2024-07-27T03:11:05.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.843+0000 7ff51d7fa640 1 -- 172.21.15.120:0/3459841569 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff510034070 con 0x7ff50c003a00 2024-07-27T03:11:05.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.843+0000 7ff51d7fa640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff500077040 0x7ff500079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:05.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.843+0000 7ff51d7fa640 1 -- 172.21.15.120:0/3459841569 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7ff5100b8960 con 0x7ff50c003a00 2024-07-27T03:11:05.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.844+0000 7ff517fff640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff500077040 0x7ff500079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:05.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.844+0000 7ff517fff640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff500077040 0x7ff500079550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff520159bb0 tx=0x7ff508005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:05.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:05.848+0000 7ff51d7fa640 1 -- 172.21.15.120:0/3459841569 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff510081c00 con 0x7ff50c003a00 2024-07-27T03:11:06.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.069+0000 7ff5263ac640 1 -- 172.21.15.120:0/3459841569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff520074490 con 0x7ff50c003a00 2024-07-27T03:11:06.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.069+0000 7ff51d7fa640 1 -- 172.21.15.120:0/3459841569 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5271 (secure 0 0 0) 0x7ff510081500 con 0x7ff50c003a00 2024-07-27T03:11:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:06.072 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"btime":"2024-07-27T03:10:59:971326+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/296895260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":296895260},{"type":"v1","addr":"172.21.15.121:6837","nonce":296895260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":42,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:10:08.410648+0000","modified":"2024-07-27T03:10:59.395060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5328,"mds_1":5325,"mds_2":5134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5134":{"gid":5134,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6836/1978820402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1978820402},{"type":"v1","addr":"172.21.15.121:6836","nonce":1978820402}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5325":{"gid":5325,"name":"a","rank":1,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/1425775647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1425775647},{"type":"v1","addr":"172.21.15.120:6834","nonce":1425775647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/890762307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":890762307},{"type":"v1","addr":"172.21.15.120:6835","nonce":890762307}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5134,5325,5328]},"id":3}]} 2024-07-27T03:11:06.073 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2024-07-27T03:11:06.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.071+0000 7ff5263ac640 1 -- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff500077040 msgr2=0x7ff500079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.071+0000 7ff5263ac640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff500077040 0x7ff500079550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff520159bb0 tx=0x7ff508005f90 comp rx=0 tx=0).stop 2024-07-27T03:11:06.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.071+0000 7ff5263ac640 1 -- 172.21.15.120:0/3459841569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50c003a00 msgr2=0x7ff520158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.071+0000 7ff5263ac640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50c003a00 0x7ff520158100 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff510000c00 tx=0x7ff510001d80 comp rx=0 tx=0).stop 2024-07-27T03:11:06.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.072+0000 7ff5263ac640 1 -- 172.21.15.120:0/3459841569 shutdown_connections 2024-07-27T03:11:06.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.072+0000 7ff5263ac640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff500077040 0x7ff500079550 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.072+0000 7ff5263ac640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff52009bf90 0x7ff52009c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.072+0000 7ff5263ac640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff520159e20 0x7ff5201f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.072+0000 7ff5263ac640 1 --2- 172.21.15.120:0/3459841569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff50c003a00 0x7ff520158100 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.072+0000 7ff5263ac640 1 -- 172.21.15.120:0/3459841569 >> 172.21.15.120:0/3459841569 conn(0x7ff5200b1a10 msgr2=0x7ff5200ad0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:06.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.072+0000 7ff5263ac640 1 -- 172.21.15.120:0/3459841569 shutdown_connections 2024-07-27T03:11:06.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.072+0000 7ff5263ac640 1 -- 172.21.15.120:0/3459841569 wait complete. 2024-07-27T03:11:06.086 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:11:06.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.197+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/1699555440 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d280cf580 msgr2=0x7f6d2815ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.197+0000 7f6d2f2f2640 1 --2- 172.21.15.120:0/1699555440 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d280cf580 0x7f6d2815ecc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6d240098e0 tx=0x7f6d2402a5d0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.197+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/1699555440 shutdown_connections 2024-07-27T03:11:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.197+0000 7f6d2f2f2640 1 --2- 172.21.15.120:0/1699555440 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d280cfa50 0x7f6d280ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.197+0000 7f6d2f2f2640 1 --2- 172.21.15.120:0/1699555440 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d280cf580 0x7f6d2815ecc0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.197+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/1699555440 >> 172.21.15.120:0/1699555440 conn(0x7f6d280d01f0 msgr2=0x7f6d280d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.197+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/1699555440 shutdown_connections 2024-07-27T03:11:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.197+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/1699555440 wait complete. 2024-07-27T03:11:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.199+0000 7f6d2f2f2640 1 Processor -- start 2024-07-27T03:11:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.199+0000 7f6d2f2f2640 1 -- start start 2024-07-27T03:11:06.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2f2f2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d280cf580 0x7f6d281f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2f2f2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d280cfa50 0x7f6d2809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2f2f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d28158e30 0x7f6d2809af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2f2f2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6d280cb250 con 0x7f6d280cf580 2024-07-27T03:11:06.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2f2f2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6d280cb0d0 con 0x7f6d28158e30 2024-07-27T03:11:06.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2f2f2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6d280cb3d0 con 0x7f6d280cfa50 2024-07-27T03:11:06.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2d08e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d280cf580 0x7f6d281f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2d08e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d280cf580 0x7f6d281f9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47150/0 (socket says 172.21.15.120:47150) 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2d08e640 1 -- 172.21.15.120:0/3259585805 learned_addr learned my addr 172.21.15.120:0/3259585805 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2c88d640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d280cfa50 0x7f6d2809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2d88f640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d28158e30 0x7f6d2809af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2d08e640 1 -- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d280cfa50 msgr2=0x7f6d2809cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.200+0000 7f6d2d08e640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d280cfa50 0x7f6d2809cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.201+0000 7f6d2d08e640 1 -- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d28158e30 msgr2=0x7f6d2809af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.201+0000 7f6d2d08e640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d28158e30 0x7f6d2809af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.201+0000 7f6d2d08e640 1 -- 172.21.15.120:0/3259585805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d281f9cb0 con 0x7f6d280cf580 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.201+0000 7f6d2d88f640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d28158e30 0x7f6d2809af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.201+0000 7f6d2d08e640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d280cf580 0x7f6d281f9770 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009a00 tx=0x7f6d24005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.201+0000 7f6d1dffb640 1 -- 172.21.15.120:0/3259585805 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2403f070 con 0x7f6d280cf580 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.201+0000 7f6d1dffb640 1 -- 172.21.15.120:0/3259585805 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d24004050 con 0x7f6d280cf580 2024-07-27T03:11:06.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.201+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/3259585805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2809d160 con 0x7f6d280cf580 2024-07-27T03:11:06.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.201+0000 7f6d1dffb640 1 -- 172.21.15.120:0/3259585805 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d240044a0 con 0x7f6d280cf580 2024-07-27T03:11:06.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.201+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/3259585805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2809d6f0 con 0x7f6d280cf580 2024-07-27T03:11:06.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.202+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/3259585805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d280cb880 con 0x7f6d280cf580 2024-07-27T03:11:06.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.203+0000 7f6d1dffb640 1 -- 172.21.15.120:0/3259585805 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6d24042070 con 0x7f6d280cf580 2024-07-27T03:11:06.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.203+0000 7f6d1dffb640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d0c077040 0x7f6d0c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.203+0000 7f6d1dffb640 1 -- 172.21.15.120:0/3259585805 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f6d240b9540 con 0x7f6d280cf580 2024-07-27T03:11:06.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.203+0000 7f6d2c88d640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d0c077040 0x7f6d0c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.204+0000 7f6d2c88d640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d0c077040 0x7f6d0c079550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6d280c9a00 tx=0x7f6d18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:06.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.208+0000 7f6d1dffb640 1 -- 172.21.15.120:0/3259585805 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6d24082820 con 0x7f6d280cf580 2024-07-27T03:11:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.388+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/3259585805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d28074780 con 0x7f6d280cf580 2024-07-27T03:11:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.389+0000 7f6d1dffb640 1 -- 172.21.15.120:0/3259585805 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16729 (secure 0 0 0) 0x7f6d24082120 con 0x7f6d280cf580 2024-07-27T03:11:06.392 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:06.392 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":46,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:10:22.118819+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:10:06.088796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-07-27T03:10:07.376160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.2a","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:11:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d0c077040 msgr2=0x7f6d0c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d0c077040 0x7f6d0c079550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6d280c9a00 tx=0x7f6d18009040 comp rx=0 tx=0).stop 2024-07-27T03:11:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/3259585805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d280cf580 msgr2=0x7f6d281f9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d280cf580 0x7f6d281f9770 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009a00 tx=0x7f6d24005040 comp rx=0 tx=0).stop 2024-07-27T03:11:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/3259585805 shutdown_connections 2024-07-27T03:11:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6d0c077040 0x7f6d0c079550 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d28158e30 0x7f6d2809af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d280cfa50 0x7f6d2809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 --2- 172.21.15.120:0/3259585805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d280cf580 0x7f6d281f9770 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/3259585805 >> 172.21.15.120:0/3259585805 conn(0x7f6d280d01f0 msgr2=0x7f6d28158340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/3259585805 shutdown_connections 2024-07-27T03:11:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.391+0000 7f6d2f2f2640 1 -- 172.21.15.120:0/3259585805 wait complete. 2024-07-27T03:11:06.405 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-07-27T03:11:06.405 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:11:06.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.516+0000 7f9b52f77640 1 -- 172.21.15.120:0/3474031363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b4c0b42f0 msgr2=0x7f9b4c06eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.517+0000 7f9b52f77640 1 --2- 172.21.15.120:0/3474031363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b4c0b42f0 0x7f9b4c06eb00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9b44005fd0 tx=0x7f9b4402a820 comp rx=0 tx=0).stop 2024-07-27T03:11:06.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.517+0000 7f9b52f77640 1 -- 172.21.15.120:0/3474031363 shutdown_connections 2024-07-27T03:11:06.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.517+0000 7f9b52f77640 1 --2- 172.21.15.120:0/3474031363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b4c0b42f0 0x7f9b4c06eb00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.517+0000 7f9b52f77640 1 --2- 172.21.15.120:0/3474031363 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b4c15a8b0 0x7f9b4c0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.517+0000 7f9b52f77640 1 -- 172.21.15.120:0/3474031363 >> 172.21.15.120:0/3474031363 conn(0x7f9b4c0b1a10 msgr2=0x7f9b4c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:06.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.517+0000 7f9b52f77640 1 -- 172.21.15.120:0/3474031363 shutdown_connections 2024-07-27T03:11:06.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.517+0000 7f9b52f77640 1 -- 172.21.15.120:0/3474031363 wait complete. 2024-07-27T03:11:06.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.518+0000 7f9b52f77640 1 Processor -- start 2024-07-27T03:11:06.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.518+0000 7f9b52f77640 1 -- start start 2024-07-27T03:11:06.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b52f77640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b4c072b60 0x7f9b4c1480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b52f77640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b4c0b42f0 0x7f9b4c0cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b52f77640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b4c15a8b0 0x7f9b4c09cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b52f77640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c0ad300 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b52f77640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c0ad180 con 0x7f9b4c0b42f0 2024-07-27T03:11:06.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b52f77640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9b4c0ad480 con 0x7f9b4c072b60 2024-07-27T03:11:06.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b51514640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b4c15a8b0 0x7f9b4c09cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b51514640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b4c15a8b0 0x7f9b4c09cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47170/0 (socket says 172.21.15.120:47170) 2024-07-27T03:11:06.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b51514640 1 -- 172.21.15.120:0/141794436 learned_addr learned my addr 172.21.15.120:0/141794436 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:06.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b43fff640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b4c0b42f0 0x7f9b4c0cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b50d13640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b4c072b60 0x7f9b4c1480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b51514640 1 -- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b4c072b60 msgr2=0x7f9b4c1480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b51514640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b4c072b60 0x7f9b4c1480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b51514640 1 -- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b4c0b42f0 msgr2=0x7f9b4c0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b51514640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b4c0b42f0 0x7f9b4c0cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b51514640 1 -- 172.21.15.120:0/141794436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c1485e0 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b51514640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b4c15a8b0 0x7f9b4c09cd80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9b44006010 tx=0x7f9b44032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:06.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.520+0000 7f9b417fa640 1 -- 172.21.15.120:0/141794436 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b44037040 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.521+0000 7f9b417fa640 1 -- 172.21.15.120:0/141794436 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b44042070 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.521+0000 7f9b52f77640 1 -- 172.21.15.120:0/141794436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4c0ce620 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.521+0000 7f9b417fa640 1 -- 172.21.15.120:0/141794436 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b440042a0 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.521+0000 7f9b52f77640 1 -- 172.21.15.120:0/141794436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4c148d90 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.522+0000 7f9b52f77640 1 -- 172.21.15.120:0/141794436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b4c148f60 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.522+0000 7f9b417fa640 1 -- 172.21.15.120:0/141794436 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9b44004440 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.523+0000 7f9b417fa640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9b38077010 0x7f9b38079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.523+0000 7f9b417fa640 1 -- 172.21.15.120:0/141794436 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f9b440ba220 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.523+0000 7f9b50d13640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9b38077010 0x7f9b38079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.524+0000 7f9b50d13640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9b38077010 0x7f9b38079520 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c09e0b0 tx=0x7f9b48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.527+0000 7f9b417fa640 1 -- 172.21.15.120:0/141794436 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f9b4c0ce620 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.747+0000 7f9b52f77640 1 -- 172.21.15.120:0/141794436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b4c0aeab0 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.748+0000 7f9b417fa640 1 -- 172.21.15.120:0/141794436 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5271 (secure 0 0 0) 0x7f9b440835e0 con 0x7f9b4c15a8b0 2024-07-27T03:11:06.751 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:06.751 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"btime":"2024-07-27T03:10:59:971326+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/296895260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":296895260},{"type":"v1","addr":"172.21.15.121:6837","nonce":296895260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":42,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:10:08.410648+0000","modified":"2024-07-27T03:10:59.395060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5328,"mds_1":5325,"mds_2":5134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5134":{"gid":5134,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6836/1978820402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1978820402},{"type":"v1","addr":"172.21.15.121:6836","nonce":1978820402}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5325":{"gid":5325,"name":"a","rank":1,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/1425775647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1425775647},{"type":"v1","addr":"172.21.15.120:6834","nonce":1425775647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/890762307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":890762307},{"type":"v1","addr":"172.21.15.120:6835","nonce":890762307}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5134,5325,5328]},"id":3}]} 2024-07-27T03:11:06.751 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2024-07-27T03:11:06.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 -- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9b38077010 msgr2=0x7f9b38079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9b38077010 0x7f9b38079520 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c09e0b0 tx=0x7f9b48009040 comp rx=0 tx=0).stop 2024-07-27T03:11:06.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 -- 172.21.15.120:0/141794436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b4c15a8b0 msgr2=0x7f9b4c09cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b4c15a8b0 0x7f9b4c09cd80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9b44006010 tx=0x7f9b44032d10 comp rx=0 tx=0).stop 2024-07-27T03:11:06.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 -- 172.21.15.120:0/141794436 shutdown_connections 2024-07-27T03:11:06.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9b38077010 0x7f9b38079520 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b4c15a8b0 0x7f9b4c09cd80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b4c0b42f0 0x7f9b4c0cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 --2- 172.21.15.120:0/141794436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b4c072b60 0x7f9b4c1480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 -- 172.21.15.120:0/141794436 >> 172.21.15.120:0/141794436 conn(0x7f9b4c0b1a10 msgr2=0x7f9b4c159950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:06.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 -- 172.21.15.120:0/141794436 shutdown_connections 2024-07-27T03:11:06.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.750+0000 7f9b52f77640 1 -- 172.21.15.120:0/141794436 wait complete. 2024-07-27T03:11:06.764 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:11:06.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.875+0000 7f715a75d640 1 -- 172.21.15.120:0/3733152335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f713c005350 msgr2=0x7f713c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.875+0000 7f715a75d640 1 --2- 172.21.15.120:0/3733152335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f713c005350 0x7f713c00b9c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f71540c5a60 tx=0x7f713c005830 comp rx=0 tx=0).stop 2024-07-27T03:11:06.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.875+0000 7f715a75d640 1 -- 172.21.15.120:0/3733152335 shutdown_connections 2024-07-27T03:11:06.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.875+0000 7f715a75d640 1 --2- 172.21.15.120:0/3733152335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f713c005350 0x7f713c00b9c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.875+0000 7f715a75d640 1 -- 172.21.15.120:0/3733152335 >> 172.21.15.120:0/3733152335 conn(0x7f715406cba0 msgr2=0x7f715406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:06.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.875+0000 7f715a75d640 1 -- 172.21.15.120:0/3733152335 shutdown_connections 2024-07-27T03:11:06.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.875+0000 7f715a75d640 1 -- 172.21.15.120:0/3733152335 wait complete. 2024-07-27T03:11:06.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.877+0000 7f715a75d640 1 Processor -- start 2024-07-27T03:11:06.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.877+0000 7f715a75d640 1 -- start start 2024-07-27T03:11:06.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f715a75d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f713c005350 0x7f715415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f715a75d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f71541f23a0 0x7f7154152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f715a75d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71540cbe70 0x7f7154152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f715a75d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f715415f3c0 con 0x7f713c005350 2024-07-27T03:11:06.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f715a75d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f715415f240 con 0x7f71540cbe70 2024-07-27T03:11:06.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f715a75d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f715415f540 con 0x7f71541f23a0 2024-07-27T03:11:06.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7153fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f713c005350 0x7f715415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7153fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f713c005350 0x7f715415d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47186/0 (socket says 172.21.15.120:47186) 2024-07-27T03:11:06.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7153fff640 1 -- 172.21.15.120:0/2931809793 learned_addr learned my addr 172.21.15.120:0/2931809793 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:06.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7158cfa640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71540cbe70 0x7f7154152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f71537fe640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f71541f23a0 0x7f7154152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7153fff640 1 -- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f71541f23a0 msgr2=0x7f7154152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7153fff640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f71541f23a0 0x7f7154152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7153fff640 1 -- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71540cbe70 msgr2=0x7f7154152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7153fff640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71540cbe70 0x7f7154152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7153fff640 1 -- 172.21.15.120:0/2931809793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7154155ea0 con 0x7f713c005350 2024-07-27T03:11:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7158cfa640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71540cbe70 0x7f7154152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7153fff640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f713c005350 0x7f715415d0a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7144004d10 tx=0x7f714400e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7150ff9640 1 -- 172.21.15.120:0/2931809793 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144001470 con 0x7f713c005350 2024-07-27T03:11:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7150ff9640 1 -- 172.21.15.120:0/2931809793 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7144001610 con 0x7f713c005350 2024-07-27T03:11:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f715a75d640 1 -- 172.21.15.120:0/2931809793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71541f18c0 con 0x7f713c005350 2024-07-27T03:11:06.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f7150ff9640 1 -- 172.21.15.120:0/2931809793 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144001a00 con 0x7f713c005350 2024-07-27T03:11:06.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.879+0000 7f715a75d640 1 -- 172.21.15.120:0/2931809793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71541f1e80 con 0x7f713c005350 2024-07-27T03:11:06.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.880+0000 7f715a75d640 1 -- 172.21.15.120:0/2931809793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71540b5e90 con 0x7f713c005350 2024-07-27T03:11:06.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.881+0000 7f7150ff9640 1 -- 172.21.15.120:0/2931809793 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f7144001ba0 con 0x7f713c005350 2024-07-27T03:11:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.882+0000 7f7150ff9640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7140077010 0x7f7140079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.882+0000 7f7150ff9640 1 -- 172.21.15.120:0/2931809793 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f714409a680 con 0x7f713c005350 2024-07-27T03:11:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.882+0000 7f71537fe640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7140077010 0x7f7140079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.882+0000 7f71537fe640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7140077010 0x7f7140079520 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7148009bb0 tx=0x7f7148005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:06.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:06.886+0000 7f7150ff9640 1 -- 172.21.15.120:0/2931809793 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f7144063840 con 0x7f713c005350 2024-07-27T03:11:07.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.106+0000 7f715a75d640 1 -- 172.21.15.120:0/2931809793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71540b1dd0 con 0x7f713c005350 2024-07-27T03:11:07.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.107+0000 7f7150ff9640 1 -- 172.21.15.120:0/2931809793 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5271 (secure 0 0 0) 0x7f7144063140 con 0x7f713c005350 2024-07-27T03:11:07.109 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:07.110 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":42,"btime":"2024-07-27T03:10:59:971326+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/296895260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":296895260},{"type":"v1","addr":"172.21.15.121:6837","nonce":296895260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":42,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:10:08.410648+0000","modified":"2024-07-27T03:10:59.395060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5328,"mds_1":5325,"mds_2":5134},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5134":{"gid":5134,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6836/1978820402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1978820402},{"type":"v1","addr":"172.21.15.121:6836","nonce":1978820402}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5325":{"gid":5325,"name":"a","rank":1,"incarnation":35,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/1425775647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1425775647},{"type":"v1","addr":"172.21.15.120:6834","nonce":1425775647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/890762307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":890762307},{"type":"v1","addr":"172.21.15.120:6835","nonce":890762307}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5134,5325,5328]},"id":3}]} 2024-07-27T03:11:07.110 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 42 2024-07-27T03:11:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 -- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7140077010 msgr2=0x7f7140079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7140077010 0x7f7140079520 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7148009bb0 tx=0x7f7148005f90 comp rx=0 tx=0).stop 2024-07-27T03:11:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 -- 172.21.15.120:0/2931809793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f713c005350 msgr2=0x7f715415d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f713c005350 0x7f715415d0a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7144004d10 tx=0x7f714400e840 comp rx=0 tx=0).stop 2024-07-27T03:11:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 -- 172.21.15.120:0/2931809793 shutdown_connections 2024-07-27T03:11:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7140077010 0x7f7140079520 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71540cbe70 0x7f7154152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f71541f23a0 0x7f7154152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 --2- 172.21.15.120:0/2931809793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f713c005350 0x7f715415d0a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 -- 172.21.15.120:0/2931809793 >> 172.21.15.120:0/2931809793 conn(0x7f715406cba0 msgr2=0x7f71541513b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:07.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 -- 172.21.15.120:0/2931809793 shutdown_connections 2024-07-27T03:11:07.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.109+0000 7f715a75d640 1 -- 172.21.15.120:0/2931809793 wait complete. 2024-07-27T03:11:07.123 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:11:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.234+0000 7efe4baf9640 1 -- 172.21.15.120:0/3374427638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe440d27e0 msgr2=0x7efe440d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.234+0000 7efe4baf9640 1 --2- 172.21.15.120:0/3374427638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe440d27e0 0x7efe440d2bf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efe440b3b30 tx=0x7efe3402a560 comp rx=0 tx=0).stop 2024-07-27T03:11:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.234+0000 7efe4baf9640 1 -- 172.21.15.120:0/3374427638 shutdown_connections 2024-07-27T03:11:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.234+0000 7efe4baf9640 1 --2- 172.21.15.120:0/3374427638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efe440d09c0 0x7efe440d0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.234+0000 7efe4baf9640 1 --2- 172.21.15.120:0/3374427638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe440d27e0 0x7efe440d2bf0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.234+0000 7efe4baf9640 1 --2- 172.21.15.120:0/3374427638 >> v2:172.21.15.121:3300/0 conn(0x7efe440b4740 0x7efe440b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.234+0000 7efe4baf9640 1 -- 172.21.15.120:0/3374427638 >> 172.21.15.120:0/3374427638 conn(0x7efe4408d690 msgr2=0x7efe4409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.235+0000 7efe4baf9640 1 -- 172.21.15.120:0/3374427638 shutdown_connections 2024-07-27T03:11:07.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.235+0000 7efe4baf9640 1 -- 172.21.15.120:0/3374427638 wait complete. 2024-07-27T03:11:07.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.236+0000 7efe4baf9640 1 Processor -- start 2024-07-27T03:11:07.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.236+0000 7efe4baf9640 1 -- start start 2024-07-27T03:11:07.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4baf9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efe440b4740 0x7efe44156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4baf9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe440d09c0 0x7efe440cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4baf9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe440d27e0 0x7efe440ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4baf9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efe440ced60 con 0x7efe440d27e0 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4baf9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efe440cebe0 con 0x7efe440d09c0 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4baf9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efe440ceee0 con 0x7efe440b4740 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4a096640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe440d27e0 0x7efe440ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4a096640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe440d27e0 0x7efe440ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47204/0 (socket says 172.21.15.120:47204) 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4a096640 1 -- 172.21.15.120:0/693973094 learned_addr learned my addr 172.21.15.120:0/693973094 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe49895640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efe440b4740 0x7efe44156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe49094640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe440d09c0 0x7efe440cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4a096640 1 -- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efe440b4740 msgr2=0x7efe44156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4a096640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efe440b4740 0x7efe44156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4a096640 1 -- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe440d09c0 msgr2=0x7efe440cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4a096640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe440d09c0 0x7efe440cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4a096640 1 -- 172.21.15.120:0/693973094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe440cb6f0 con 0x7efe440d27e0 2024-07-27T03:11:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe49094640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe440d09c0 0x7efe440cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe49895640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efe440b4740 0x7efe44156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4a096640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe440d27e0 0x7efe440ccf50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00ea10 tx=0x7efe3c00eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe3a7fc640 1 -- 172.21.15.120:0/693973094 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c00cde0 con 0x7efe440d27e0 2024-07-27T03:11:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe3a7fc640 1 -- 172.21.15.120:0/693973094 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe3c004c10 con 0x7efe440d27e0 2024-07-27T03:11:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe3a7fc640 1 -- 172.21.15.120:0/693973094 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c005020 con 0x7efe440d27e0 2024-07-27T03:11:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4baf9640 1 -- 172.21.15.120:0/693973094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe440cb9d0 con 0x7efe440d27e0 2024-07-27T03:11:07.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.238+0000 7efe4baf9640 1 -- 172.21.15.120:0/693973094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe440cbf90 con 0x7efe440d27e0 2024-07-27T03:11:07.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.240+0000 7efe4baf9640 1 -- 172.21.15.120:0/693973094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe440cb460 con 0x7efe440d27e0 2024-07-27T03:11:07.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.240+0000 7efe3a7fc640 1 -- 172.21.15.120:0/693973094 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7efe3c0051c0 con 0x7efe440d27e0 2024-07-27T03:11:07.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.241+0000 7efe3a7fc640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efe28077010 0x7efe28079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.241+0000 7efe3a7fc640 1 -- 172.21.15.120:0/693973094 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7efe3c099630 con 0x7efe440d27e0 2024-07-27T03:11:07.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.241+0000 7efe49895640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efe28077010 0x7efe28079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.241+0000 7efe49895640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efe28077010 0x7efe28079520 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe40009b00 tx=0x7efe40005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:07.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.245+0000 7efe3a7fc640 1 -- 172.21.15.120:0/693973094 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7efe3c062880 con 0x7efe440d27e0 2024-07-27T03:11:07.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.427+0000 7efe4baf9640 1 -- 172.21.15.120:0/693973094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe440cf470 con 0x7efe440d27e0 2024-07-27T03:11:07.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.428+0000 7efe3a7fc640 1 -- 172.21.15.120:0/693973094 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16729 (secure 0 0 0) 0x7efe3c062180 con 0x7efe440d27e0 2024-07-27T03:11:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:07.431 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":46,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:10:22.118819+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:10:06.088796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-07-27T03:10:07.376160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.18","mappings":[{"from":0,"to":4}]},{"pgid":"7.2a","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:11:07.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.430+0000 7efe4baf9640 1 -- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efe28077010 msgr2=0x7efe28079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.430+0000 7efe4baf9640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efe28077010 0x7efe28079520 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe40009b00 tx=0x7efe40005f90 comp rx=0 tx=0).stop 2024-07-27T03:11:07.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.430+0000 7efe4baf9640 1 -- 172.21.15.120:0/693973094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe440d27e0 msgr2=0x7efe440ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.430+0000 7efe4baf9640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe440d27e0 0x7efe440ccf50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00ea10 tx=0x7efe3c00eed0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.430+0000 7efe4baf9640 1 -- 172.21.15.120:0/693973094 shutdown_connections 2024-07-27T03:11:07.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.430+0000 7efe4baf9640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efe28077010 0x7efe28079520 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.430+0000 7efe4baf9640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe440d27e0 0x7efe440ccf50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.430+0000 7efe4baf9640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe440d09c0 0x7efe440cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.430+0000 7efe4baf9640 1 --2- 172.21.15.120:0/693973094 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efe440b4740 0x7efe44156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.430+0000 7efe4baf9640 1 -- 172.21.15.120:0/693973094 >> 172.21.15.120:0/693973094 conn(0x7efe4408d690 msgr2=0x7efe440b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:07.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.431+0000 7efe4baf9640 1 -- 172.21.15.120:0/693973094 shutdown_connections 2024-07-27T03:11:07.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.431+0000 7efe4baf9640 1 -- 172.21.15.120:0/693973094 wait complete. 2024-07-27T03:11:07.444 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-07-27T03:11:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.556+0000 7f0978c99640 1 -- 172.21.15.120:0/395512869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f095c004d40 msgr2=0x7f095c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.556+0000 7f0978c99640 1 --2- 172.21.15.120:0/395512869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f095c004d40 0x7f095c005150 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f097406d830 tx=0x7f095c005830 comp rx=0 tx=0).stop 2024-07-27T03:11:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.556+0000 7f0972d9d640 1 -- 172.21.15.120:0/395512869 reap_dead start 2024-07-27T03:11:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.556+0000 7f0978c99640 1 -- 172.21.15.120:0/395512869 shutdown_connections 2024-07-27T03:11:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.556+0000 7f0978c99640 1 -- 172.21.15.120:0/395512869 >> 172.21.15.120:0/395512869 conn(0x7f09740d0f00 msgr2=0x7f09740d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:07.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.556+0000 7f0978c99640 1 -- 172.21.15.120:0/395512869 shutdown_connections 2024-07-27T03:11:07.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.556+0000 7f0978c99640 1 -- 172.21.15.120:0/395512869 wait complete. 2024-07-27T03:11:07.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.558+0000 7f0978c99640 1 Processor -- start 2024-07-27T03:11:07.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.558+0000 7f0978c99640 1 -- start start 2024-07-27T03:11:07.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0978c99640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f095c004d40 0x7f09741335a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0978c99640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097413f9b0 0x7f09741e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0978c99640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09741e7a30 0x7f09741f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0978c99640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f09740cfee0 con 0x7f095c004d40 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0978c99640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f09740cfd60 con 0x7f097413f9b0 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0978c99640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f09740d0060 con 0x7f09741e7a30 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f097259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f095c004d40 0x7f09741335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f097259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f095c004d40 0x7f09741335a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47214/0 (socket says 172.21.15.120:47214) 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f097259c640 1 -- 172.21.15.120:0/3547894456 learned_addr learned my addr 172.21.15.120:0/3547894456 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0971d9b640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097413f9b0 0x7f09741e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0972d9d640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09741e7a30 0x7f09741f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f097259c640 1 -- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09741e7a30 msgr2=0x7f09741f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f097259c640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09741e7a30 0x7f09741f6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f097259c640 1 -- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097413f9b0 msgr2=0x7f09741e74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f097259c640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097413f9b0 0x7f09741e74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f097259c640 1 -- 172.21.15.120:0/3547894456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09741e7e40 con 0x7f095c004d40 2024-07-27T03:11:07.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0972d9d640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09741e7a30 0x7f09741f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:07.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0971d9b640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097413f9b0 0x7f09741e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:07.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f097259c640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f095c004d40 0x7f09741335a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0964011ab0 tx=0x7f0964011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:07.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0962ffd640 1 -- 172.21.15.120:0/3547894456 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096401e070 con 0x7f095c004d40 2024-07-27T03:11:07.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0962ffd640 1 -- 172.21.15.120:0/3547894456 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f096400fc70 con 0x7f095c004d40 2024-07-27T03:11:07.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0978c99640 1 -- 172.21.15.120:0/3547894456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0974140120 con 0x7f095c004d40 2024-07-27T03:11:07.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0962ffd640 1 -- 172.21.15.120:0/3547894456 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964019670 con 0x7f095c004d40 2024-07-27T03:11:07.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.560+0000 7f0978c99640 1 -- 172.21.15.120:0/3547894456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09740a9fb0 con 0x7f095c004d40 2024-07-27T03:11:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.562+0000 7f0978c99640 1 -- 172.21.15.120:0/3547894456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09740d1e40 con 0x7f095c004d40 2024-07-27T03:11:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.562+0000 7f0962ffd640 1 -- 172.21.15.120:0/3547894456 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0964021070 con 0x7f095c004d40 2024-07-27T03:11:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.562+0000 7f0962ffd640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0954077010 0x7f0954079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.563+0000 7f0962ffd640 1 -- 172.21.15.120:0/3547894456 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f0964099080 con 0x7f095c004d40 2024-07-27T03:11:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.563+0000 7f0971d9b640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0954077010 0x7f0954079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.563+0000 7f0971d9b640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0954077010 0x7f0954079520 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f09741e6db0 tx=0x7f0968005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:07.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.567+0000 7f0962ffd640 1 -- 172.21.15.120:0/3547894456 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f09740d1e40 con 0x7f095c004d40 2024-07-27T03:11:07.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.789+0000 7f0978c99640 1 -- 172.21.15.120:0/3547894456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0974145c70 con 0x7f095c004d40 2024-07-27T03:11:07.792 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-07-27T03:11:07.790+0000 7fd09694b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-27T03:11:07.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.791+0000 7f0962ffd640 1 -- 172.21.15.120:0/3547894456 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) ==== 161+0+0 (secure 0 0 0) 0x7f09741e7e40 con 0x7f095c004d40 2024-07-27T03:11:07.793 INFO:teuthology.orchestra.run.smithi120.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-07-27T03:11:07.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 -- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0954077010 msgr2=0x7f0954079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0954077010 0x7f0954079520 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f09741e6db0 tx=0x7f0968005f90 comp rx=0 tx=0).stop 2024-07-27T03:11:07.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 -- 172.21.15.120:0/3547894456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f095c004d40 msgr2=0x7f09741335a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f095c004d40 0x7f09741335a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0964011ab0 tx=0x7f0964011f70 comp rx=0 tx=0).stop 2024-07-27T03:11:07.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 -- 172.21.15.120:0/3547894456 shutdown_connections 2024-07-27T03:11:07.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0954077010 0x7f0954079520 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09741e7a30 0x7f09741f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097413f9b0 0x7f09741e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 --2- 172.21.15.120:0/3547894456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f095c004d40 0x7f09741335a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 -- 172.21.15.120:0/3547894456 >> 172.21.15.120:0/3547894456 conn(0x7f09740d0f00 msgr2=0x7f0974144bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:07.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 -- 172.21.15.120:0/3547894456 shutdown_connections 2024-07-27T03:11:07.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.794+0000 7f0978c99640 1 -- 172.21.15.120:0/3547894456 wait complete. 2024-07-27T03:11:07.812 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-07-27T03:11:07.858 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-07-27T03:11:07.862 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-07-27T03:11:07.863 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-07-27T03:11:07.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.930+0000 7f3ba7643640 1 -- 172.21.15.120:0/2533919618 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba00d28f0 msgr2=0x7f3ba00cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.930+0000 7f3ba7643640 1 --2- 172.21.15.120:0/2533919618 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba00d28f0 0x7f3ba00cd940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009830 tx=0x7f3b9402a480 comp rx=0 tx=0).stop 2024-07-27T03:11:07.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.930+0000 7f3ba7643640 1 -- 172.21.15.120:0/2533919618 shutdown_connections 2024-07-27T03:11:07.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.930+0000 7f3ba7643640 1 --2- 172.21.15.120:0/2533919618 >> v2:172.21.15.121:3300/0 conn(0x7f3ba00ce840 0x7f3ba00cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.930+0000 7f3ba7643640 1 --2- 172.21.15.120:0/2533919618 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba00d28f0 0x7f3ba00cd940 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.930+0000 7f3ba7643640 1 -- 172.21.15.120:0/2533919618 >> 172.21.15.120:0/2533919618 conn(0x7f3ba00d1dd0 msgr2=0x7f3ba00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:07.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.931+0000 7f3ba7643640 1 -- 172.21.15.120:0/2533919618 shutdown_connections 2024-07-27T03:11:07.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.931+0000 7f3ba7643640 1 -- 172.21.15.120:0/2533919618 wait complete. 2024-07-27T03:11:07.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.932+0000 7f3ba7643640 1 Processor -- start 2024-07-27T03:11:07.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.932+0000 7f3ba7643640 1 -- start start 2024-07-27T03:11:07.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.933+0000 7f3ba7643640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba00b75b0 0x7f3ba01f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba7643640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ba00ce840 0x7f3ba00cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba7643640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ba00d28f0 0x7f3ba0161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba7643640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba0166e30 con 0x7f3ba00d28f0 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba7643640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba0166cb0 con 0x7f3ba00ce840 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba7643640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba0166fb0 con 0x7f3ba00b75b0 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba5be0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ba00d28f0 0x7f3ba0161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba5be0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ba00d28f0 0x7f3ba0161c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47256/0 (socket says 172.21.15.120:47256) 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba5be0640 1 -- 172.21.15.120:0/1807265518 learned_addr learned my addr 172.21.15.120:0/1807265518 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba4bde640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ba00ce840 0x7f3ba00cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba53df640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba00b75b0 0x7f3ba01f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba5be0640 1 -- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba00b75b0 msgr2=0x7f3ba01f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba5be0640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba00b75b0 0x7f3ba01f3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba5be0640 1 -- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ba00ce840 msgr2=0x7f3ba00cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:07.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba5be0640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ba00ce840 0x7f3ba00cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:07.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba5be0640 1 -- 172.21.15.120:0/1807265518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba009bba0 con 0x7f3ba00d28f0 2024-07-27T03:11:07.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba5be0640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ba00d28f0 0x7f3ba0161c20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800ea10 tx=0x7f3b9800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:07.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3b91ffb640 1 -- 172.21.15.120:0/1807265518 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800cde0 con 0x7f3ba00d28f0 2024-07-27T03:11:07.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3ba7643640 1 -- 172.21.15.120:0/1807265518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba015cfd0 con 0x7f3ba00d28f0 2024-07-27T03:11:07.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3b91ffb640 1 -- 172.21.15.120:0/1807265518 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b98004c10 con 0x7f3ba00d28f0 2024-07-27T03:11:07.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.934+0000 7f3b91ffb640 1 -- 172.21.15.120:0/1807265518 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b98005020 con 0x7f3ba00d28f0 2024-07-27T03:11:07.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.935+0000 7f3ba7643640 1 -- 172.21.15.120:0/1807265518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba0160090 con 0x7f3ba00d28f0 2024-07-27T03:11:07.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.936+0000 7f3ba7643640 1 -- 172.21.15.120:0/1807265518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba00cec50 con 0x7f3ba00d28f0 2024-07-27T03:11:07.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.936+0000 7f3b91ffb640 1 -- 172.21.15.120:0/1807265518 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f3b980051c0 con 0x7f3ba00d28f0 2024-07-27T03:11:07.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.936+0000 7f3b91ffb640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b84077040 0x7f3b84079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:07.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.937+0000 7f3b91ffb640 1 -- 172.21.15.120:0/1807265518 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6025+0+0 (secure 0 0 0) 0x7f3b980996c0 con 0x7f3ba00d28f0 2024-07-27T03:11:07.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.937+0000 7f3ba53df640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b84077040 0x7f3b84079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:07.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.937+0000 7f3ba53df640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b84077040 0x7f3b84079550 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c007fd0 tx=0x7f3b9c001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:07.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:07.941+0000 7f3b91ffb640 1 -- 172.21.15.120:0/1807265518 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f3b980620b0 con 0x7f3ba00d28f0 2024-07-27T03:11:08.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.164+0000 7f3ba7643640 1 -- 172.21.15.120:0/1807265518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3ba00d2490 con 0x7f3ba00d28f0 2024-07-27T03:11:08.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.792+0000 7f3b91ffb640 1 -- 172.21.15.120:0/1807265518 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) ==== 104+0+0 (secure 0 0 0) 0x7f3b98066600 con 0x7f3ba00d28f0 2024-07-27T03:11:08.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 -- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b84077040 msgr2=0x7f3b84079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b84077040 0x7f3b84079550 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c007fd0 tx=0x7f3b9c001370 comp rx=0 tx=0).stop 2024-07-27T03:11:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 -- 172.21.15.120:0/1807265518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ba00d28f0 msgr2=0x7f3ba0161c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ba00d28f0 0x7f3ba0161c20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800ea10 tx=0x7f3b9800eed0 comp rx=0 tx=0).stop 2024-07-27T03:11:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 -- 172.21.15.120:0/1807265518 shutdown_connections 2024-07-27T03:11:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3b84077040 0x7f3b84079550 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ba00d28f0 0x7f3ba0161c20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ba00ce840 0x7f3ba00cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 --2- 172.21.15.120:0/1807265518 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3ba00b75b0 0x7f3ba01f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 -- 172.21.15.120:0/1807265518 >> 172.21.15.120:0/1807265518 conn(0x7f3ba00d1dd0 msgr2=0x7f3ba00b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 -- 172.21.15.120:0/1807265518 shutdown_connections 2024-07-27T03:11:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.796+0000 7f3ba7643640 1 -- 172.21.15.120:0/1807265518 wait complete. 2024-07-27T03:11:08.812 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-07-27T03:11:08.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.931+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/2957391796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1cc003a00 msgr2=0x7fe1cc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:08.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.931+0000 7fe1e9f3f640 1 --2- 172.21.15.120:0/2957391796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1cc003a00 0x7fe1cc003e70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009b40 tx=0x7fe1cc005830 comp rx=0 tx=0).stop 2024-07-27T03:11:08.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.931+0000 7fe1e3fff640 1 -- 172.21.15.120:0/2957391796 reap_dead start 2024-07-27T03:11:08.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.931+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/2957391796 shutdown_connections 2024-07-27T03:11:08.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.931+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/2957391796 >> 172.21.15.120:0/2957391796 conn(0x7fe1e408d8f0 msgr2=0x7fe1e409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:08.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.931+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/2957391796 shutdown_connections 2024-07-27T03:11:08.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.931+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/2957391796 wait complete. 2024-07-27T03:11:08.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.933+0000 7fe1e9f3f640 1 Processor -- start 2024-07-27T03:11:08.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.933+0000 7fe1e9f3f640 1 -- start start 2024-07-27T03:11:08.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.934+0000 7fe1e9f3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1cc003a00 0x7fe1e4160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:08.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.934+0000 7fe1e9f3f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1e40cdef0 0x7fe1e4158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:08.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.934+0000 7fe1e9f3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1e40d2350 0x7fe1e40d2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:08.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.934+0000 7fe1e9f3f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e40cf0a0 con 0x7fe1cc003a00 2024-07-27T03:11:08.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.934+0000 7fe1e9f3f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e40cef20 con 0x7fe1e40d2350 2024-07-27T03:11:08.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.934+0000 7fe1e9f3f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e40cf220 con 0x7fe1e40cdef0 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.934+0000 7fe1e37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1cc003a00 0x7fe1e4160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.934+0000 7fe1e37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1cc003a00 0x7fe1e4160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47274/0 (socket says 172.21.15.120:47274) 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.934+0000 7fe1e37fe640 1 -- 172.21.15.120:0/633622509 learned_addr learned my addr 172.21.15.120:0/633622509 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.934+0000 7fe1e2ffd640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1e40cdef0 0x7fe1e4158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.934+0000 7fe1e3fff640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1e40d2350 0x7fe1e40d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1e37fe640 1 -- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1e40cdef0 msgr2=0x7fe1e4158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1e37fe640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1e40cdef0 0x7fe1e4158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1e37fe640 1 -- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1e40d2350 msgr2=0x7fe1e40d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1e37fe640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1e40d2350 0x7fe1e40d2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1e37fe640 1 -- 172.21.15.120:0/633622509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e40d2ca0 con 0x7fe1cc003a00 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1e2ffd640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1e40cdef0 0x7fe1e4158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1e37fe640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1cc003a00 0x7fe1e4160990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4036040 tx=0x7fe1d40336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:08.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1cbfff640 1 -- 172.21.15.120:0/633622509 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4038040 con 0x7fe1cc003a00 2024-07-27T03:11:08.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1cbfff640 1 -- 172.21.15.120:0/633622509 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1d4004030 con 0x7fe1cc003a00 2024-07-27T03:11:08.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/633622509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e4161050 con 0x7fe1cc003a00 2024-07-27T03:11:08.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1cbfff640 1 -- 172.21.15.120:0/633622509 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4004480 con 0x7fe1cc003a00 2024-07-27T03:11:08.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.935+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/633622509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e41f8c30 con 0x7fe1cc003a00 2024-07-27T03:11:08.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.936+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/633622509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e40d0ee0 con 0x7fe1cc003a00 2024-07-27T03:11:08.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.937+0000 7fe1cbfff640 1 -- 172.21.15.120:0/633622509 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe1d40338e0 con 0x7fe1cc003a00 2024-07-27T03:11:08.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.937+0000 7fe1cbfff640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe1d0077010 0x7fe1d0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:08.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.937+0000 7fe1cbfff640 1 -- 172.21.15.120:0/633622509 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6025+0+0 (secure 0 0 0) 0x7fe1d40b9220 con 0x7fe1cc003a00 2024-07-27T03:11:08.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.938+0000 7fe1e2ffd640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe1d0077010 0x7fe1d0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:08.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.938+0000 7fe1e2ffd640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe1d0077010 0x7fe1d0079520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8001d40 tx=0x7fe1d8001cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:08.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:08.942+0000 7fe1cbfff640 1 -- 172.21.15.120:0/633622509 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fe1e40d2ca0 con 0x7fe1cc003a00 2024-07-27T03:11:09.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:09.125+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/633622509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe1e40d4fd0 con 0x7fe1cc003a00 2024-07-27T03:11:10.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.011+0000 7fe1cbfff640 1 -- 172.21.15.120:0/633622509 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) ==== 181+0+0 (secure 0 0 0) 0x7fe1d40822f0 con 0x7fe1cc003a00 2024-07-27T03:11:10.014 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' removed 2024-07-27T03:11:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe1d0077010 msgr2=0x7fe1d0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe1d0077010 0x7fe1d0079520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8001d40 tx=0x7fe1d8001cb0 comp rx=0 tx=0).stop 2024-07-27T03:11:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/633622509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1cc003a00 msgr2=0x7fe1e4160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1cc003a00 0x7fe1e4160990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4036040 tx=0x7fe1d40336f0 comp rx=0 tx=0).stop 2024-07-27T03:11:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/633622509 shutdown_connections 2024-07-27T03:11:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe1d0077010 0x7fe1d0079520 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1e40d2350 0x7fe1e40d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1e40cdef0 0x7fe1e4158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 --2- 172.21.15.120:0/633622509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1cc003a00 0x7fe1e4160990 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:10.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/633622509 >> 172.21.15.120:0/633622509 conn(0x7fe1e408d8f0 msgr2=0x7fe1e40d41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:10.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/633622509 shutdown_connections 2024-07-27T03:11:10.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.014+0000 7fe1e9f3f640 1 -- 172.21.15.120:0/633622509 wait complete. 2024-07-27T03:11:10.033 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-07-27T03:11:10.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.153+0000 7f87ec60c640 1 -- 172.21.15.120:0/2447017906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87d0003a00 msgr2=0x7f87d0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:10.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.153+0000 7f87ec60c640 1 --2- 172.21.15.120:0/2447017906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87d0003a00 0x7f87d0003e70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009b50 tx=0x7f87d0005830 comp rx=0 tx=0).stop 2024-07-27T03:11:10.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.153+0000 7f87eaba9640 1 -- 172.21.15.120:0/2447017906 reap_dead start 2024-07-27T03:11:10.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.153+0000 7f87ec60c640 1 -- 172.21.15.120:0/2447017906 shutdown_connections 2024-07-27T03:11:10.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.153+0000 7f87ec60c640 1 -- 172.21.15.120:0/2447017906 >> 172.21.15.120:0/2447017906 conn(0x7f87e406c780 msgr2=0x7f87e406cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:10.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.153+0000 7f87ec60c640 1 -- 172.21.15.120:0/2447017906 shutdown_connections 2024-07-27T03:11:10.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.153+0000 7f87ec60c640 1 -- 172.21.15.120:0/2447017906 wait complete. 2024-07-27T03:11:10.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.154+0000 7f87ec60c640 1 Processor -- start 2024-07-27T03:11:10.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.155+0000 7f87ec60c640 1 -- start start 2024-07-27T03:11:10.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87ec60c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87d0003a00 0x7f87e40b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:10.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87ec60c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87e41417e0 0x7f87e41420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:10.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87ec60c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e41f5710 0x7f87e41f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:10.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87ec60c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f87e4158d90 con 0x7f87e41417e0 2024-07-27T03:11:10.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87ec60c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87e4158c10 con 0x7f87e41f5710 2024-07-27T03:11:10.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87ec60c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f87e4158f10 con 0x7f87d0003a00 2024-07-27T03:11:10.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87e9ba7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87e41417e0 0x7f87e41420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:10.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87e9ba7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87e41417e0 0x7f87e41420e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47286/0 (socket says 172.21.15.120:47286) 2024-07-27T03:11:10.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87e9ba7640 1 -- 172.21.15.120:0/2899229233 learned_addr learned my addr 172.21.15.120:0/2899229233 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:10.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87ea3a8640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87d0003a00 0x7f87e40b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:10.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87eaba9640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e41f5710 0x7f87e41f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:10.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87e9ba7640 1 -- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87d0003a00 msgr2=0x7f87e40b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:10.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87e9ba7640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87d0003a00 0x7f87e40b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:10.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87e9ba7640 1 -- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e41f5710 msgr2=0x7f87e41f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:10.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87e9ba7640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e41f5710 0x7f87e41f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:10.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87e9ba7640 1 -- 172.21.15.120:0/2899229233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e40b1df0 con 0x7f87e41417e0 2024-07-27T03:11:10.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87e9ba7640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87e41417e0 0x7f87e41420e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f87d400bfa0 tx=0x7f87d4010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:10.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.156+0000 7f87daffd640 1 -- 172.21.15.120:0/2899229233 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d400edd0 con 0x7f87e41417e0 2024-07-27T03:11:10.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.157+0000 7f87daffd640 1 -- 172.21.15.120:0/2899229233 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87d4013650 con 0x7f87e41417e0 2024-07-27T03:11:10.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.157+0000 7f87ec60c640 1 -- 172.21.15.120:0/2899229233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e40b0810 con 0x7f87e41417e0 2024-07-27T03:11:10.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.157+0000 7f87daffd640 1 -- 172.21.15.120:0/2899229233 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4013aa0 con 0x7f87e41417e0 2024-07-27T03:11:10.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.157+0000 7f87ec60c640 1 -- 172.21.15.120:0/2899229233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e40b0dd0 con 0x7f87e41417e0 2024-07-27T03:11:10.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.157+0000 7f87ec60c640 1 -- 172.21.15.120:0/2899229233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e4073d60 con 0x7f87e41417e0 2024-07-27T03:11:10.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.158+0000 7f87daffd640 1 -- 172.21.15.120:0/2899229233 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f87d4013c40 con 0x7f87e41417e0 2024-07-27T03:11:10.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.159+0000 7f87daffd640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87c8077010 0x7f87c8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:10.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.159+0000 7f87daffd640 1 -- 172.21.15.120:0/2899229233 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5587+0+0 (secure 0 0 0) 0x7f87d409ba80 con 0x7f87e41417e0 2024-07-27T03:11:10.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.159+0000 7f87ea3a8640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87c8077010 0x7f87c8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:10.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.160+0000 7f87ea3a8640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87c8077010 0x7f87c8079520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f87e0035000 tx=0x7f87e002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:10.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.163+0000 7f87daffd640 1 -- 172.21.15.120:0/2899229233 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f87d4064cf0 con 0x7f87e41417e0 2024-07-27T03:11:10.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:10.350+0000 7f87ec60c640 1 -- 172.21.15.120:0/2899229233 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f87e4072c30 con 0x7f87e41417e0 2024-07-27T03:11:10.558 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:11:10.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:11:11.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.016+0000 7f87daffd640 1 -- 172.21.15.120:0/2899229233 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) ==== 169+0+0 (secure 0 0 0) 0x7f87d40645f0 con 0x7f87e41417e0 2024-07-27T03:11:11.019 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' removed 2024-07-27T03:11:11.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.020+0000 7f87ec60c640 1 -- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87c8077010 msgr2=0x7f87c8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:11.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.020+0000 7f87ec60c640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87c8077010 0x7f87c8079520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f87e0035000 tx=0x7f87e002d040 comp rx=0 tx=0).stop 2024-07-27T03:11:11.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.020+0000 7f87ec60c640 1 -- 172.21.15.120:0/2899229233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87e41417e0 msgr2=0x7f87e41420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:11.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.020+0000 7f87ec60c640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87e41417e0 0x7f87e41420e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f87d400bfa0 tx=0x7f87d4010e40 comp rx=0 tx=0).stop 2024-07-27T03:11:11.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.021+0000 7f87ec60c640 1 -- 172.21.15.120:0/2899229233 shutdown_connections 2024-07-27T03:11:11.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.021+0000 7f87ec60c640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87c8077010 0x7f87c8079520 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.021+0000 7f87ec60c640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87e41417e0 0x7f87e41420e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.021+0000 7f87ec60c640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e41f5710 0x7f87e41f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.021+0000 7f87ec60c640 1 --2- 172.21.15.120:0/2899229233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87d0003a00 0x7f87e40b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.021+0000 7f87ec60c640 1 -- 172.21.15.120:0/2899229233 >> 172.21.15.120:0/2899229233 conn(0x7f87e406c780 msgr2=0x7f87e415cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:11.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.021+0000 7f87ec60c640 1 -- 172.21.15.120:0/2899229233 shutdown_connections 2024-07-27T03:11:11.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.021+0000 7f87ec60c640 1 -- 172.21.15.120:0/2899229233 wait complete. 2024-07-27T03:11:11.037 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-07-27T03:11:11.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.151+0000 7fc162631640 1 -- 172.21.15.120:0/1776227262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc15c15eb40 msgr2=0x7fc15c15ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:11.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.151+0000 7fc162631640 1 --2- 172.21.15.120:0/1776227262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc15c15eb40 0x7fc15c15ef50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc154005fd0 tx=0x7fc15402a820 comp rx=0 tx=0).stop 2024-07-27T03:11:11.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.151+0000 7fc162631640 1 -- 172.21.15.120:0/1776227262 shutdown_connections 2024-07-27T03:11:11.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.151+0000 7fc162631640 1 --2- 172.21.15.120:0/1776227262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc15c15eb40 0x7fc15c15ef50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.151+0000 7fc162631640 1 --2- 172.21.15.120:0/1776227262 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc15c073e20 0x7fc15c1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.151+0000 7fc162631640 1 -- 172.21.15.120:0/1776227262 >> 172.21.15.120:0/1776227262 conn(0x7fc15c0b1a10 msgr2=0x7fc15c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:11.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.151+0000 7fc162631640 1 -- 172.21.15.120:0/1776227262 shutdown_connections 2024-07-27T03:11:11.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.151+0000 7fc162631640 1 -- 172.21.15.120:0/1776227262 wait complete. 2024-07-27T03:11:11.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.153+0000 7fc162631640 1 Processor -- start 2024-07-27T03:11:11.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.153+0000 7fc162631640 1 -- start start 2024-07-27T03:11:11.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc162631640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc15c06e270 0x7fc15c143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc162631640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc15c073e20 0x7fc15c13ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc162631640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc15c15eb40 0x7fc15c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc162631640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c15f820 con 0x7fc15c06e270 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc162631640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c15f6a0 con 0x7fc15c073e20 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc162631640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc15c0b4fa0 con 0x7fc15c15eb40 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc15bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc15c06e270 0x7fc15c143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc15bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc15c06e270 0x7fc15c143280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47308/0 (socket says 172.21.15.120:47308) 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc15bfff640 1 -- 172.21.15.120:0/2804344016 learned_addr learned my addr 172.21.15.120:0/2804344016 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc160bce640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc15c15eb40 0x7fc15c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc15b7fe640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc15c073e20 0x7fc15c13ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc15bfff640 1 -- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc15c15eb40 msgr2=0x7fc15c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc15bfff640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc15c15eb40 0x7fc15c15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc15bfff640 1 -- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc15c073e20 msgr2=0x7fc15c13ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:11.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc15bfff640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc15c073e20 0x7fc15c13ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc15bfff640 1 -- 172.21.15.120:0/2804344016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c1437c0 con 0x7fc15c06e270 2024-07-27T03:11:11.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc15bfff640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc15c06e270 0x7fc15c143280 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00c3c0 tx=0x7fc14c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:11.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc158ff9640 1 -- 172.21.15.120:0/2804344016 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c017070 con 0x7fc15c06e270 2024-07-27T03:11:11.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc158ff9640 1 -- 172.21.15.120:0/2804344016 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc14c0035f0 con 0x7fc15c06e270 2024-07-27T03:11:11.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc162631640 1 -- 172.21.15.120:0/2804344016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15c1404d0 con 0x7fc15c06e270 2024-07-27T03:11:11.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc158ff9640 1 -- 172.21.15.120:0/2804344016 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c003a80 con 0x7fc15c06e270 2024-07-27T03:11:11.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.155+0000 7fc162631640 1 -- 172.21.15.120:0/2804344016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15c1f5da0 con 0x7fc15c06e270 2024-07-27T03:11:11.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.156+0000 7fc162631640 1 -- 172.21.15.120:0/2804344016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15c1554a0 con 0x7fc15c06e270 2024-07-27T03:11:11.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.157+0000 7fc158ff9640 1 -- 172.21.15.120:0/2804344016 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc14c01a070 con 0x7fc15c06e270 2024-07-27T03:11:11.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.158+0000 7fc158ff9640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc148077040 0x7fc148079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:11.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.158+0000 7fc158ff9640 1 -- 172.21.15.120:0/2804344016 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5115+0+0 (secure 0 0 0) 0x7fc14c097930 con 0x7fc15c06e270 2024-07-27T03:11:11.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.158+0000 7fc15b7fe640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc148077040 0x7fc148079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:11.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.159+0000 7fc15b7fe640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc148077040 0x7fc148079550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc15c146ef0 tx=0x7fc150009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:11.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.162+0000 7fc158ff9640 1 -- 172.21.15.120:0/2804344016 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc15c1437c0 con 0x7fc15c06e270 2024-07-27T03:11:11.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.346+0000 7fc162631640 1 -- 172.21.15.120:0/2804344016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fc15c0b3d30 con 0x7fc15c06e270 2024-07-27T03:11:11.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.349+0000 7fc158ff9640 1 -- 172.21.15.120:0/2804344016 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v32) ==== 71+0+0 (secure 0 0 0) 0x7fc15c074230 con 0x7fc15c06e270 2024-07-27T03:11:11.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 -- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc148077040 msgr2=0x7fc148079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:11.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc148077040 0x7fc148079550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc15c146ef0 tx=0x7fc150009060 comp rx=0 tx=0).stop 2024-07-27T03:11:11.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 -- 172.21.15.120:0/2804344016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc15c06e270 msgr2=0x7fc15c143280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:11.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc15c06e270 0x7fc15c143280 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00c3c0 tx=0x7fc14c00c880 comp rx=0 tx=0).stop 2024-07-27T03:11:11.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 -- 172.21.15.120:0/2804344016 shutdown_connections 2024-07-27T03:11:11.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc148077040 0x7fc148079550 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc15c15eb40 0x7fc15c15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc15c073e20 0x7fc15c13ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 --2- 172.21.15.120:0/2804344016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc15c06e270 0x7fc15c143280 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 -- 172.21.15.120:0/2804344016 >> 172.21.15.120:0/2804344016 conn(0x7fc15c0b1a10 msgr2=0x7fc15c15bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:11.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 -- 172.21.15.120:0/2804344016 shutdown_connections 2024-07-27T03:11:11.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.352+0000 7fc162631640 1 -- 172.21.15.120:0/2804344016 wait complete. 2024-07-27T03:11:11.366 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_pin_overried_rank_mask' 2024-07-27T03:11:11.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.476+0000 7f0f782c1640 1 -- 172.21.15.120:0/3956216153 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f7006e270 msgr2=0x7f0f70073af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:11.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.476+0000 7f0f782c1640 1 --2- 172.21.15.120:0/3956216153 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f7006e270 0x7f0f70073af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f60005fd0 tx=0x7f0f6002a540 comp rx=0 tx=0).stop 2024-07-27T03:11:11.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.476+0000 7f0f782c1640 1 -- 172.21.15.120:0/3956216153 shutdown_connections 2024-07-27T03:11:11.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.476+0000 7f0f782c1640 1 --2- 172.21.15.120:0/3956216153 >> v2:172.21.15.121:3300/0 conn(0x7f0f7015ec10 0x7f0f7015f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.476+0000 7f0f782c1640 1 --2- 172.21.15.120:0/3956216153 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f7006e270 0x7f0f70073af0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.476+0000 7f0f782c1640 1 -- 172.21.15.120:0/3956216153 >> 172.21.15.120:0/3956216153 conn(0x7f0f700b1a10 msgr2=0x7f0f700b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:11.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.476+0000 7f0f782c1640 1 -- 172.21.15.120:0/3956216153 shutdown_connections 2024-07-27T03:11:11.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.476+0000 7f0f782c1640 1 -- 172.21.15.120:0/3956216153 wait complete. 2024-07-27T03:11:11.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.478+0000 7f0f782c1640 1 Processor -- start 2024-07-27T03:11:11.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.478+0000 7f0f782c1640 1 -- start start 2024-07-27T03:11:11.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.479+0000 7f0f782c1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f7006e270 0x7f0f70145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:11.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.479+0000 7f0f782c1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f701522e0 0x7f0f70142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:11.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.479+0000 7f0f782c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f7015ec10 0x7f0f7006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:11.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.479+0000 7f0f782c1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7015f8f0 con 0x7f0f7015ec10 2024-07-27T03:11:11.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.479+0000 7f0f782c1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7015f770 con 0x7f0f701522e0 2024-07-27T03:11:11.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.479+0000 7f0f782c1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7015fa70 con 0x7f0f7006e270 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.479+0000 7f0f7685e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f7015ec10 0x7f0f7006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.479+0000 7f0f7685e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f7015ec10 0x7f0f7006eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47324/0 (socket says 172.21.15.120:47324) 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.479+0000 7f0f7685e640 1 -- 172.21.15.120:0/2179481871 learned_addr learned my addr 172.21.15.120:0/2179481871 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.479+0000 7f0f7585c640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f701522e0 0x7f0f70142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.479+0000 7f0f7605d640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f7006e270 0x7f0f70145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f7685e640 1 -- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f7006e270 msgr2=0x7f0f70145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f7685e640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f7006e270 0x7f0f70145980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f7685e640 1 -- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f701522e0 msgr2=0x7f0f70142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f7685e640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f701522e0 0x7f0f70142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f7685e640 1 -- 172.21.15.120:0/2179481871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f70145ec0 con 0x7f0f7015ec10 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f7585c640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f701522e0 0x7f0f70142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f7685e640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f7015ec10 0x7f0f7006eb00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800ec20 tx=0x7f0f6800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:11.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f66ffd640 1 -- 172.21.15.120:0/2179481871 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68010630 con 0x7f0f7015ec10 2024-07-27T03:11:11.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f66ffd640 1 -- 172.21.15.120:0/2179481871 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f680107d0 con 0x7f0f7015ec10 2024-07-27T03:11:11.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f782c1640 1 -- 172.21.15.120:0/2179481871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f701512b0 con 0x7f0f7015ec10 2024-07-27T03:11:11.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f66ffd640 1 -- 172.21.15.120:0/2179481871 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68010be0 con 0x7f0f7015ec10 2024-07-27T03:11:11.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.480+0000 7f0f782c1640 1 -- 172.21.15.120:0/2179481871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f701f6d20 con 0x7f0f7015ec10 2024-07-27T03:11:11.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.481+0000 7f0f782c1640 1 -- 172.21.15.120:0/2179481871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f701f67b0 con 0x7f0f7015ec10 2024-07-27T03:11:11.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.482+0000 7f0f66ffd640 1 -- 172.21.15.120:0/2179481871 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0f68021430 con 0x7f0f7015ec10 2024-07-27T03:11:11.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.483+0000 7f0f66ffd640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f54077010 0x7f0f54079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:11.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.483+0000 7f0f66ffd640 1 -- 172.21.15.120:0/2179481871 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5115+0+0 (secure 0 0 0) 0x7f0f680994d0 con 0x7f0f7015ec10 2024-07-27T03:11:11.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.483+0000 7f0f7605d640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f54077010 0x7f0f54079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:11.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.483+0000 7f0f7605d640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f54077010 0x7f0f54079520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c001720 tx=0x7f0f6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:11.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.487+0000 7f0f66ffd640 1 -- 172.21.15.120:0/2179481871 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f0f70145ec0 con 0x7f0f7015ec10 2024-07-27T03:11:11.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:11.745+0000 7f0f782c1640 1 -- 172.21.15.120:0/2179481871 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_pin_overried_rank_mask"]} v 0) -- 0x7f0f7015f020 con 0x7f0f7015ec10 2024-07-27T03:11:12.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.018+0000 7f0f66ffd640 1 -- 172.21.15.120:0/2179481871 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_pin_overried_rank_mask"]}]=0 v140) ==== 154+0+0 (secure 0 0 0) 0x7f0f680622d0 con 0x7f0f7015ec10 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.020+0000 7f0f782c1640 1 -- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f54077010 msgr2=0x7f0f54079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.020+0000 7f0f782c1640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f54077010 0x7f0f54079520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c001720 tx=0x7f0f6c009040 comp rx=0 tx=0).stop 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.020+0000 7f0f782c1640 1 -- 172.21.15.120:0/2179481871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f7015ec10 msgr2=0x7f0f7006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.020+0000 7f0f782c1640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f7015ec10 0x7f0f7006eb00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800ec20 tx=0x7f0f6800c6a0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.020+0000 7f0f782c1640 1 -- 172.21.15.120:0/2179481871 shutdown_connections 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.020+0000 7f0f782c1640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f54077010 0x7f0f54079520 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.020+0000 7f0f782c1640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f7015ec10 0x7f0f7006eb00 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.021+0000 7f0f782c1640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f701522e0 0x7f0f70142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.021+0000 7f0f782c1640 1 --2- 172.21.15.120:0/2179481871 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f7006e270 0x7f0f70145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.021+0000 7f0f782c1640 1 -- 172.21.15.120:0/2179481871 >> 172.21.15.120:0/2179481871 conn(0x7f0f700b1a10 msgr2=0x7f0f700723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.021+0000 7f0f782c1640 1 -- 172.21.15.120:0/2179481871 shutdown_connections 2024-07-27T03:11:12.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.021+0000 7f0f782c1640 1 -- 172.21.15.120:0/2179481871 wait complete. 2024-07-27T03:11:12.071 INFO:tasks.cephfs_test_runner:That ephemeral pin overrides ceph.dir.bal.mask ... ok 2024-07-27T03:11:12.071 INFO:tasks.cephfs_test_runner:Starting test: test_ephemeral_random_overried_rank_mask (tasks.cephfs.test_exports.TestBalMask) that ephemeral random overrides ceph.dir.bal.mask. 2024-07-27T03:11:12.071 INFO:tasks.cephfs_test_runner:test_ephemeral_random_overried_rank_mask (tasks.cephfs.test_exports.TestBalMask) 2024-07-27T03:11:12.072 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:11:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.184+0000 7f383470d640 1 -- 172.21.15.120:0/1350989909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f382c0aebf0 msgr2=0x7f382c0af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.184+0000 7f383470d640 1 --2- 172.21.15.120:0/1350989909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f382c0aebf0 0x7f382c0af000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f381c009830 tx=0x7f381c02a510 comp rx=0 tx=0).stop 2024-07-27T03:11:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.184+0000 7f383470d640 1 -- 172.21.15.120:0/1350989909 shutdown_connections 2024-07-27T03:11:12.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.184+0000 7f383470d640 1 --2- 172.21.15.120:0/1350989909 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f382c0723d0 0x7f382c0727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.184+0000 7f383470d640 1 --2- 172.21.15.120:0/1350989909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f382c0aebf0 0x7f382c0af000 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.184+0000 7f383470d640 1 -- 172.21.15.120:0/1350989909 >> 172.21.15.120:0/1350989909 conn(0x7f382c0b1a10 msgr2=0x7f382c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:12.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.184+0000 7f383470d640 1 -- 172.21.15.120:0/1350989909 shutdown_connections 2024-07-27T03:11:12.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.184+0000 7f383470d640 1 -- 172.21.15.120:0/1350989909 wait complete. 2024-07-27T03:11:12.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.186+0000 7f383470d640 1 Processor -- start 2024-07-27T03:11:12.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.186+0000 7f383470d640 1 -- start start 2024-07-27T03:11:12.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.187+0000 7f383470d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f382c0723d0 0x7f382c140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.187+0000 7f383470d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f382c0aebf0 0x7f382c1f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.187+0000 7f383470d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f382c145390 0x7f382c0c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.187+0000 7f383470d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f382c072d20 con 0x7f382c0aebf0 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.187+0000 7f383470d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f382c1451f0 con 0x7f382c145390 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.187+0000 7f383470d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f382c072ea0 con 0x7f382c0723d0 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.187+0000 7f3831ca8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f382c0aebf0 0x7f382c1f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3831ca8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f382c0aebf0 0x7f382c1f6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46006/0 (socket says 172.21.15.120:46006) 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3831ca8640 1 -- 172.21.15.120:0/3686323827 learned_addr learned my addr 172.21.15.120:0/3686323827 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f38324a9640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f382c0723d0 0x7f382c140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3832caa640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f382c145390 0x7f382c0c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3831ca8640 1 -- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f382c0723d0 msgr2=0x7f382c140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3831ca8640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f382c0723d0 0x7f382c140e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3831ca8640 1 -- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f382c145390 msgr2=0x7f382c0c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3831ca8640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f382c145390 0x7f382c0c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3831ca8640 1 -- 172.21.15.120:0/3686323827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c1f3240 con 0x7f382c0aebf0 2024-07-27T03:11:12.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3831ca8640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f382c0aebf0 0x7f382c1f6640 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f381c009950 tx=0x7f381c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:12.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3822ffd640 1 -- 172.21.15.120:0/3686323827 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c005c90 con 0x7f382c0aebf0 2024-07-27T03:11:12.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3822ffd640 1 -- 172.21.15.120:0/3686323827 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f381c031e50 con 0x7f382c0aebf0 2024-07-27T03:11:12.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f383470d640 1 -- 172.21.15.120:0/3686323827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382c1f7370 con 0x7f382c0aebf0 2024-07-27T03:11:12.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f3822ffd640 1 -- 172.21.15.120:0/3686323827 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c005260 con 0x7f382c0aebf0 2024-07-27T03:11:12.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.188+0000 7f383470d640 1 -- 172.21.15.120:0/3686323827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382c1f37e0 con 0x7f382c0aebf0 2024-07-27T03:11:12.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.189+0000 7f383470d640 1 -- 172.21.15.120:0/3686323827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f382c073350 con 0x7f382c0aebf0 2024-07-27T03:11:12.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.190+0000 7f3822ffd640 1 -- 172.21.15.120:0/3686323827 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f381c005400 con 0x7f382c0aebf0 2024-07-27T03:11:12.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.190+0000 7f3822ffd640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3810077010 0x7f3810079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.191+0000 7f3822ffd640 1 -- 172.21.15.120:0/3686323827 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5115+0+0 (secure 0 0 0) 0x7f381c0b9700 con 0x7f382c0aebf0 2024-07-27T03:11:12.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.191+0000 7f38324a9640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3810077010 0x7f3810079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.191+0000 7f38324a9640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3810077010 0x7f3810079520 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3828007fd0 tx=0x7f3828009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:12.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.195+0000 7f3822ffd640 1 -- 172.21.15.120:0/3686323827 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f381c03f030 con 0x7f382c0aebf0 2024-07-27T03:11:12.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.377+0000 7f383470d640 1 -- 172.21.15.120:0/3686323827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f382c1f7100 con 0x7f382c0aebf0 2024-07-27T03:11:12.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.377+0000 7f3822ffd640 1 -- 172.21.15.120:0/3686323827 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+13308 (secure 0 0 0) 0x7f381c082be0 con 0x7f382c0aebf0 2024-07-27T03:11:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:12.380 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":49,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:11:11.012915+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6835/890762307":"2024-07-28T03:11:07.790386+0000","172.21.15.120:6833/890762307":"2024-07-28T03:11:07.790386+0000","172.21.15.121:6834/1978820402":"2024-07-28T03:11:07.790363+0000","172.21.15.120:6834/1425775647":"2024-07-28T03:11:07.790381+0000","172.21.15.121:6836/1978820402":"2024-07-28T03:11:07.790363+0000","172.21.15.120:6832/1425775647":"2024-07-28T03:11:07.790381+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:11:12.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 -- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3810077010 msgr2=0x7f3810079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3810077010 0x7f3810079520 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3828007fd0 tx=0x7f3828009040 comp rx=0 tx=0).stop 2024-07-27T03:11:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 -- 172.21.15.120:0/3686323827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f382c0aebf0 msgr2=0x7f382c1f6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f382c0aebf0 0x7f382c1f6640 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f381c009950 tx=0x7f381c033c20 comp rx=0 tx=0).stop 2024-07-27T03:11:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 -- 172.21.15.120:0/3686323827 shutdown_connections 2024-07-27T03:11:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3810077010 0x7f3810079520 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f382c0aebf0 0x7f382c1f6640 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f382c145390 0x7f382c0c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 --2- 172.21.15.120:0/3686323827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f382c0723d0 0x7f382c140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 -- 172.21.15.120:0/3686323827 >> 172.21.15.120:0/3686323827 conn(0x7f382c0b1a10 msgr2=0x7f382c142e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 -- 172.21.15.120:0/3686323827 shutdown_connections 2024-07-27T03:11:12.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.380+0000 7f383470d640 1 -- 172.21.15.120:0/3686323827 wait complete. 2024-07-27T03:11:12.394 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-27T03:08:28.548271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-07-27T03:11:12.394 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-07-27T03:11:12.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.510+0000 7ff9a0014640 1 -- 172.21.15.120:0/4065906757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff984005270 msgr2=0x7ff98400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.510+0000 7ff9a0014640 1 --2- 172.21.15.120:0/4065906757 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff984005270 0x7ff98400b9c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff990001dc0 tx=0x7ff984005830 comp rx=0 tx=0).stop 2024-07-27T03:11:12.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.510+0000 7ff99e5b1640 1 -- 172.21.15.120:0/4065906757 reap_dead start 2024-07-27T03:11:12.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.510+0000 7ff9a0014640 1 -- 172.21.15.120:0/4065906757 shutdown_connections 2024-07-27T03:11:12.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.510+0000 7ff9a0014640 1 -- 172.21.15.120:0/4065906757 >> 172.21.15.120:0/4065906757 conn(0x7ff9980d20a0 msgr2=0x7ff9980d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:12.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.510+0000 7ff9a0014640 1 -- 172.21.15.120:0/4065906757 shutdown_connections 2024-07-27T03:11:12.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.510+0000 7ff9a0014640 1 -- 172.21.15.120:0/4065906757 wait complete. 2024-07-27T03:11:12.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.512+0000 7ff9a0014640 1 Processor -- start 2024-07-27T03:11:12.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.512+0000 7ff9a0014640 1 -- start start 2024-07-27T03:11:12.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff9a0014640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff984005270 0x7ff998155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff9a0014640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff998159800 0x7ff9980708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff9a0014640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9981562f0 0x7ff998070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff9a0014640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff9980b74a0 con 0x7ff998159800 2024-07-27T03:11:12.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff9a0014640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff9980b7320 con 0x7ff984005270 2024-07-27T03:11:12.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff9a0014640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff9980b5600 con 0x7ff9981562f0 2024-07-27T03:11:12.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99d5af640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff998159800 0x7ff9980708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99d5af640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff998159800 0x7ff9980708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46020/0 (socket says 172.21.15.120:46020) 2024-07-27T03:11:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99d5af640 1 -- 172.21.15.120:0/3970075388 learned_addr learned my addr 172.21.15.120:0/3970075388 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99ddb0640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff984005270 0x7ff998155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99e5b1640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9981562f0 0x7ff998070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99d5af640 1 -- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9981562f0 msgr2=0x7ff998070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99d5af640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9981562f0 0x7ff998070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99d5af640 1 -- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff984005270 msgr2=0x7ff998155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99d5af640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff984005270 0x7ff998155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99d5af640 1 -- 172.21.15.120:0/3970075388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99815a350 con 0x7ff998159800 2024-07-27T03:11:12.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99ddb0640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff984005270 0x7ff998155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:12.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.513+0000 7ff99d5af640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff998159800 0x7ff9980708d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff988004650 tx=0x7ff98800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:12.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.514+0000 7ff98e7fc640 1 -- 172.21.15.120:0/3970075388 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988010850 con 0x7ff998159800 2024-07-27T03:11:12.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.514+0000 7ff98e7fc640 1 -- 172.21.15.120:0/3970075388 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9880109f0 con 0x7ff998159800 2024-07-27T03:11:12.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.514+0000 7ff9a0014640 1 -- 172.21.15.120:0/3970075388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99815a5c0 con 0x7ff998159800 2024-07-27T03:11:12.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.514+0000 7ff98e7fc640 1 -- 172.21.15.120:0/3970075388 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988010e20 con 0x7ff998159800 2024-07-27T03:11:12.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.514+0000 7ff9a0014640 1 -- 172.21.15.120:0/3970075388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99815ab80 con 0x7ff998159800 2024-07-27T03:11:12.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.515+0000 7ff9a0014640 1 -- 172.21.15.120:0/3970075388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99809aa30 con 0x7ff998159800 2024-07-27T03:11:12.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.515+0000 7ff98e7fc640 1 -- 172.21.15.120:0/3970075388 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff988023440 con 0x7ff998159800 2024-07-27T03:11:12.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.516+0000 7ff98e7fc640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff97c077010 0x7ff97c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.516+0000 7ff98e7fc640 1 -- 172.21.15.120:0/3970075388 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5115+0+0 (secure 0 0 0) 0x7ff988099370 con 0x7ff998159800 2024-07-27T03:11:12.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.516+0000 7ff99ddb0640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff97c077010 0x7ff97c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.517+0000 7ff99ddb0640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff97c077010 0x7ff97c079520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff994001180 tx=0x7ff994006740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:12.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.521+0000 7ff98e7fc640 1 -- 172.21.15.120:0/3970075388 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff988062860 con 0x7ff998159800 2024-07-27T03:11:12.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.699+0000 7ff9a0014640 1 -- 172.21.15.120:0/3970075388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff998159d70 con 0x7ff998159800 2024-07-27T03:11:12.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.700+0000 7ff98e7fc640 1 -- 172.21.15.120:0/3970075388 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) ==== 93+0+10 (secure 0 0 0) 0x7ff988062160 con 0x7ff998159800 2024-07-27T03:11:12.703 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-07-27T03:11:12.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 -- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff97c077010 msgr2=0x7ff97c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff97c077010 0x7ff97c079520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff994001180 tx=0x7ff994006740 comp rx=0 tx=0).stop 2024-07-27T03:11:12.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 -- 172.21.15.120:0/3970075388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff998159800 msgr2=0x7ff9980708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff998159800 0x7ff9980708d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff988004650 tx=0x7ff98800ba40 comp rx=0 tx=0).stop 2024-07-27T03:11:12.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 -- 172.21.15.120:0/3970075388 shutdown_connections 2024-07-27T03:11:12.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff97c077010 0x7ff97c079520 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff998159800 0x7ff9980708d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9981562f0 0x7ff998070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 --2- 172.21.15.120:0/3970075388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff984005270 0x7ff998155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 -- 172.21.15.120:0/3970075388 >> 172.21.15.120:0/3970075388 conn(0x7ff9980d20a0 msgr2=0x7ff998071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:12.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 -- 172.21.15.120:0/3970075388 shutdown_connections 2024-07-27T03:11:12.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.702+0000 7ff9a0014640 1 -- 172.21.15.120:0/3970075388 wait complete. 2024-07-27T03:11:12.716 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_random_overried_rank_mask' 2024-07-27T03:11:12.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.837+0000 7ffa4892d640 1 -- 172.21.15.120:0/1518008837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa2c004e50 msgr2=0x7ffa2c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.837+0000 7ffa4892d640 1 --2- 172.21.15.120:0/1518008837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa2c004e50 0x7ffa2c00b9c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00c640 tx=0x7ffa2c005830 comp rx=0 tx=0).stop 2024-07-27T03:11:12.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.837+0000 7ffa42d9d640 1 -- 172.21.15.120:0/1518008837 reap_dead start 2024-07-27T03:11:12.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.837+0000 7ffa4892d640 1 -- 172.21.15.120:0/1518008837 shutdown_connections 2024-07-27T03:11:12.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.837+0000 7ffa4892d640 1 -- 172.21.15.120:0/1518008837 >> 172.21.15.120:0/1518008837 conn(0x7ffa440d1dd0 msgr2=0x7ffa440d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:12.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.837+0000 7ffa4892d640 1 -- 172.21.15.120:0/1518008837 shutdown_connections 2024-07-27T03:11:12.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.837+0000 7ffa4892d640 1 -- 172.21.15.120:0/1518008837 wait complete. 2024-07-27T03:11:12.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.839+0000 7ffa4892d640 1 Processor -- start 2024-07-27T03:11:12.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.840+0000 7ffa4892d640 1 -- start start 2024-07-27T03:11:12.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4892d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa2c004e50 0x7ffa44154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4892d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa4409c290 0x7ffa441f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4892d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4409c6a0 0x7ffa441f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4892d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffa440d08f0 con 0x7ffa2c004e50 2024-07-27T03:11:12.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4892d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffa440d0770 con 0x7ffa4409c6a0 2024-07-27T03:11:12.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4892d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ffa440d0a70 con 0x7ffa4409c290 2024-07-27T03:11:12.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa2c004e50 0x7ffa44154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa2c004e50 0x7ffa44154300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46036/0 (socket says 172.21.15.120:46036) 2024-07-27T03:11:12.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4259c640 1 -- 172.21.15.120:0/3988839594 learned_addr learned my addr 172.21.15.120:0/3988839594 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:12.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa42d9d640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4409c6a0 0x7ffa441f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa41d9b640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa4409c290 0x7ffa441f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4259c640 1 -- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa4409c290 msgr2=0x7ffa441f8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4259c640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa4409c290 0x7ffa441f8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4259c640 1 -- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4409c6a0 msgr2=0x7ffa441f8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:12.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4259c640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4409c6a0 0x7ffa441f8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:12.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.841+0000 7ffa4259c640 1 -- 172.21.15.120:0/3988839594 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4409ee20 con 0x7ffa2c004e50 2024-07-27T03:11:12.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.842+0000 7ffa4259c640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa2c004e50 0x7ffa44154300 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffa34011ab0 tx=0x7ffa34011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:12.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.842+0000 7ffa32ffd640 1 -- 172.21.15.120:0/3988839594 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3401e070 con 0x7ffa2c004e50 2024-07-27T03:11:12.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.842+0000 7ffa32ffd640 1 -- 172.21.15.120:0/3988839594 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa3400fc70 con 0x7ffa2c004e50 2024-07-27T03:11:12.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.842+0000 7ffa4892d640 1 -- 172.21.15.120:0/3988839594 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4409f100 con 0x7ffa2c004e50 2024-07-27T03:11:12.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.842+0000 7ffa32ffd640 1 -- 172.21.15.120:0/3988839594 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34019670 con 0x7ffa2c004e50 2024-07-27T03:11:12.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.842+0000 7ffa4892d640 1 -- 172.21.15.120:0/3988839594 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4409f6c0 con 0x7ffa2c004e50 2024-07-27T03:11:12.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.843+0000 7ffa4892d640 1 -- 172.21.15.120:0/3988839594 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa4415faf0 con 0x7ffa2c004e50 2024-07-27T03:11:12.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.844+0000 7ffa32ffd640 1 -- 172.21.15.120:0/3988839594 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ffa34021070 con 0x7ffa2c004e50 2024-07-27T03:11:12.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.844+0000 7ffa32ffd640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ffa24077040 0x7ffa24079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:12.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.844+0000 7ffa32ffd640 1 -- 172.21.15.120:0/3988839594 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5115+0+0 (secure 0 0 0) 0x7ffa34098f20 con 0x7ffa2c004e50 2024-07-27T03:11:12.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.844+0000 7ffa41d9b640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ffa24077040 0x7ffa24079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:12.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.845+0000 7ffa41d9b640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ffa24077040 0x7ffa24079550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffa4409bef0 tx=0x7ffa38006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:12.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:12.849+0000 7ffa32ffd640 1 -- 172.21.15.120:0/3988839594 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ffa3400fe60 con 0x7ffa2c004e50 2024-07-27T03:11:13.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:13.108+0000 7ffa4892d640 1 -- 172.21.15.120:0/3988839594 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_random_overried_rank_mask"]} v 0) -- 0x7ffa4415dcc0 con 0x7ffa2c004e50 2024-07-27T03:11:14.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.028+0000 7ffa32ffd640 1 -- 172.21.15.120:0/3988839594 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_random_overried_rank_mask"]}]=0 v142) ==== 160+0+0 (secure 0 0 0) 0x7ffa34061ca0 con 0x7ffa2c004e50 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.031+0000 7ffa4892d640 1 -- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ffa24077040 msgr2=0x7ffa24079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.031+0000 7ffa4892d640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ffa24077040 0x7ffa24079550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffa4409bef0 tx=0x7ffa38006b10 comp rx=0 tx=0).stop 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.032+0000 7ffa4892d640 1 -- 172.21.15.120:0/3988839594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa2c004e50 msgr2=0x7ffa44154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.032+0000 7ffa4892d640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa2c004e50 0x7ffa44154300 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffa34011ab0 tx=0x7ffa34011f70 comp rx=0 tx=0).stop 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.032+0000 7ffa4892d640 1 -- 172.21.15.120:0/3988839594 shutdown_connections 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.032+0000 7ffa4892d640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ffa24077040 0x7ffa24079550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.032+0000 7ffa4892d640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa4409c6a0 0x7ffa441f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.032+0000 7ffa4892d640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa4409c290 0x7ffa441f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.032+0000 7ffa4892d640 1 --2- 172.21.15.120:0/3988839594 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa2c004e50 0x7ffa44154300 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.032+0000 7ffa4892d640 1 -- 172.21.15.120:0/3988839594 >> 172.21.15.120:0/3988839594 conn(0x7ffa440d1dd0 msgr2=0x7ffa44070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.032+0000 7ffa4892d640 1 -- 172.21.15.120:0/3988839594 shutdown_connections 2024-07-27T03:11:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.032+0000 7ffa4892d640 1 -- 172.21.15.120:0/3988839594 wait complete. 2024-07-27T03:11:14.048 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-07-27T03:11:14.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.164+0000 7fecffec1640 1 -- 172.21.15.120:0/1181703095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecf80d10d0 msgr2=0x7fecf80cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.164+0000 7fecffec1640 1 --2- 172.21.15.120:0/1181703095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecf80d10d0 0x7fecf80cebe0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fecf0005fd0 tx=0x7fecf002a8b0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.164+0000 7fecffec1640 1 -- 172.21.15.120:0/1181703095 shutdown_connections 2024-07-27T03:11:14.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.164+0000 7fecffec1640 1 --2- 172.21.15.120:0/1181703095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecf80d10d0 0x7fecf80cebe0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.164+0000 7fecffec1640 1 -- 172.21.15.120:0/1181703095 >> 172.21.15.120:0/1181703095 conn(0x7fecf808d690 msgr2=0x7fecf809d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:14.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.164+0000 7fecffec1640 1 -- 172.21.15.120:0/1181703095 shutdown_connections 2024-07-27T03:11:14.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.164+0000 7fecffec1640 1 -- 172.21.15.120:0/1181703095 wait complete. 2024-07-27T03:11:14.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.166+0000 7fecffec1640 1 Processor -- start 2024-07-27T03:11:14.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.166+0000 7fecffec1640 1 -- start start 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.167+0000 7fecffec1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecf80b2c40 0x7fecf80caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.167+0000 7fecffec1640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf80b4740 0x7fecf81524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecffec1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecf815a550 0x7fecf80b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecffec1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fecf80cf2a0 con 0x7fecf815a550 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecffec1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fecf80cf120 con 0x7fecf80b2c40 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecffec1640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fecf80cf420 con 0x7fecf80b4740 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfe45e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecf815a550 0x7fecf80b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfe45e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecf815a550 0x7fecf80b7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46062/0 (socket says 172.21.15.120:46062) 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfe45e640 1 -- 172.21.15.120:0/2320866414 learned_addr learned my addr 172.21.15.120:0/2320866414 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfdc5d640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecf80b2c40 0x7fecf80caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfd45c640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf80b4740 0x7fecf81524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:14.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfe45e640 1 -- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf80b4740 msgr2=0x7fecf81524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfe45e640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf80b4740 0x7fecf81524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfe45e640 1 -- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecf80b2c40 msgr2=0x7fecf80caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfe45e640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecf80b2c40 0x7fecf80caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfe45e640 1 -- 172.21.15.120:0/2320866414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf81529e0 con 0x7fecf815a550 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfd45c640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf80b4740 0x7fecf81524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecfe45e640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecf815a550 0x7fecf80b7f60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009cd0 tx=0x7fecf0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecee7fc640 1 -- 172.21.15.120:0/2320866414 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0031b90 con 0x7fecf815a550 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecee7fc640 1 -- 172.21.15.120:0/2320866414 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecf0031e20 con 0x7fecf815a550 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecffec1640 1 -- 172.21.15.120:0/2320866414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf81f8960 con 0x7fecf815a550 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecee7fc640 1 -- 172.21.15.120:0/2320866414 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf00332f0 con 0x7fecf815a550 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.168+0000 7fecffec1640 1 -- 172.21.15.120:0/2320866414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf81f8f20 con 0x7fecf815a550 2024-07-27T03:11:14.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.169+0000 7fecffec1640 1 -- 172.21.15.120:0/2320866414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf80cebe0 con 0x7fecf815a550 2024-07-27T03:11:14.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.170+0000 7fecee7fc640 1 -- 172.21.15.120:0/2320866414 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fecf0031660 con 0x7fecf815a550 2024-07-27T03:11:14.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.171+0000 7fecee7fc640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fecdc077010 0x7fecdc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:14.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.171+0000 7fecee7fc640 1 -- 172.21.15.120:0/2320866414 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5115+0+0 (secure 0 0 0) 0x7fecf00b9da0 con 0x7fecf815a550 2024-07-27T03:11:14.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.171+0000 7fecfdc5d640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fecdc077010 0x7fecdc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:14.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.172+0000 7fecfdc5d640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fecdc077010 0x7fecdc079520 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fecf40015e0 tx=0x7fecf4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:14.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.175+0000 7fecee7fc640 1 -- 172.21.15.120:0/2320866414 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fecf003f030 con 0x7fecf815a550 2024-07-27T03:11:14.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.358+0000 7fecffec1640 1 -- 172.21.15.120:0/2320866414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fecf808e050 con 0x7fecf815a550 2024-07-27T03:11:14.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.359+0000 7fecee7fc640 1 -- 172.21.15.120:0/2320866414 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v32) ==== 59+0+1998 (secure 0 0 0) 0x7fecf0083e20 con 0x7fecf815a550 2024-07-27T03:11:14.362 INFO:teuthology.orchestra.run.smithi120.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-07-27T03:11:14.362 INFO:teuthology.orchestra.run.smithi120.stdout:mon advanced mon_op_complaint_time 120 2024-07-27T03:11:14.362 INFO:teuthology.orchestra.run.smithi120.stdout:mon dev mon_warn_on_pool_no_app false 2024-07-27T03:11:14.362 INFO:teuthology.orchestra.run.smithi120.stdout:osd advanced osd_op_complaint_time 180.000000 2024-07-27T03:11:14.362 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5257.409462 2024-07-27T03:11:14.362 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6039.326463 2024-07-27T03:11:14.362 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5855.738461 2024-07-27T03:11:14.362 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4876.658742 2024-07-27T03:11:14.362 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4850.335109 2024-07-27T03:11:14.362 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5729.677637 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5061.056911 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5680.764045 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_mds 20/20 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_mds_balancer 20/20 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_ms 2/2 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_debug_frag true 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_debug_scatterstat true 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced mds_op_complaint_time 180.000000 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_verify_scatter true 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced osd_op_complaint_time 180.000000 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced rados_mon_op_timeout 900 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced rados_osd_op_timeout 900 2024-07-27T03:11:14.363 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced client_mount_timeout 600 2024-07-27T03:11:14.364 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced debug_client 20/20 2024-07-27T03:11:14.364 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced debug_ms 1/1 2024-07-27T03:11:14.364 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced rados_mon_op_timeout 900 2024-07-27T03:11:14.364 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced rados_osd_op_timeout 900 2024-07-27T03:11:14.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 -- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fecdc077010 msgr2=0x7fecdc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fecdc077010 0x7fecdc079520 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fecf40015e0 tx=0x7fecf4009040 comp rx=0 tx=0).stop 2024-07-27T03:11:14.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 -- 172.21.15.120:0/2320866414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecf815a550 msgr2=0x7fecf80b7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecf815a550 0x7fecf80b7f60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009cd0 tx=0x7fecf0003ba0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 -- 172.21.15.120:0/2320866414 shutdown_connections 2024-07-27T03:11:14.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fecdc077010 0x7fecdc079520 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecf815a550 0x7fecf80b7f60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fecf80b4740 0x7fecf81524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 --2- 172.21.15.120:0/2320866414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fecf80b2c40 0x7fecf80caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 -- 172.21.15.120:0/2320866414 >> 172.21.15.120:0/2320866414 conn(0x7fecf808d690 msgr2=0x7fecf806e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:14.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 -- 172.21.15.120:0/2320866414 shutdown_connections 2024-07-27T03:11:14.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.361+0000 7fecffec1640 1 -- 172.21.15.120:0/2320866414 wait complete. 2024-07-27T03:11:14.375 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-07-27T03:11:14.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.488+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/1884921278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ee4073f00 msgr2=0x7f0ee415ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.488+0000 7f0ee8cf2640 1 --2- 172.21.15.120:0/1884921278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ee4073f00 0x7f0ee415ec10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0edc005fd0 tx=0x7f0edc02aa30 comp rx=0 tx=0).stop 2024-07-27T03:11:14.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.489+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/1884921278 shutdown_connections 2024-07-27T03:11:14.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.489+0000 7f0ee8cf2640 1 --2- 172.21.15.120:0/1884921278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ee4073f00 0x7f0ee415ec10 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.489+0000 7f0ee8cf2640 1 --2- 172.21.15.120:0/1884921278 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ee41522e0 0x7f0ee406e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.489+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/1884921278 >> 172.21.15.120:0/1884921278 conn(0x7f0ee40b1a10 msgr2=0x7f0ee40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:14.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.489+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/1884921278 shutdown_connections 2024-07-27T03:11:14.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.489+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/1884921278 wait complete. 2024-07-27T03:11:14.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.491+0000 7f0ee8cf2640 1 Processor -- start 2024-07-27T03:11:14.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.491+0000 7f0ee8cf2640 1 -- start start 2024-07-27T03:11:14.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee8cf2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee40733e0 0x7f0ee409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:14.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee8cf2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ee4073f00 0x7f0ee41f4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:14.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee8cf2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ee41522e0 0x7f0ee4154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:14.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee8cf2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee415f9c0 con 0x7f0ee41522e0 2024-07-27T03:11:14.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee8cf2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee415f840 con 0x7f0ee40733e0 2024-07-27T03:11:14.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee8cf2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee415fb40 con 0x7f0ee4073f00 2024-07-27T03:11:14.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee2d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ee41522e0 0x7f0ee4154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:14.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee2d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ee41522e0 0x7f0ee4154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46084/0 (socket says 172.21.15.120:46084) 2024-07-27T03:11:14.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee2d9d640 1 -- 172.21.15.120:0/2810299821 learned_addr learned my addr 172.21.15.120:0/2810299821 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee259c640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee40733e0 0x7f0ee409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ed9d9b640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ee4073f00 0x7f0ee41f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee2d9d640 1 -- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ee4073f00 msgr2=0x7f0ee41f4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee2d9d640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ee4073f00 0x7f0ee41f4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee2d9d640 1 -- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee40733e0 msgr2=0x7f0ee409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee2d9d640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee40733e0 0x7f0ee409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.492+0000 7f0ee2d9d640 1 -- 172.21.15.120:0/2810299821 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee415d8c0 con 0x7f0ee41522e0 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.493+0000 7f0ee2d9d640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ee41522e0 0x7f0ee4154910 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0edc006010 tx=0x7f0edc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.493+0000 7f0edb7fe640 1 -- 172.21.15.120:0/2810299821 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc046070 con 0x7f0ee41522e0 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.493+0000 7f0edb7fe640 1 -- 172.21.15.120:0/2810299821 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0edc0045c0 con 0x7f0ee41522e0 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.493+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/2810299821 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee415dba0 con 0x7f0ee41522e0 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.493+0000 7f0edb7fe640 1 -- 172.21.15.120:0/2810299821 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc033070 con 0x7f0ee41522e0 2024-07-27T03:11:14.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.493+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/2810299821 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee415e160 con 0x7f0ee41522e0 2024-07-27T03:11:14.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.494+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/2810299821 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee415ec10 con 0x7f0ee41522e0 2024-07-27T03:11:14.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.494+0000 7f0edb7fe640 1 -- 172.21.15.120:0/2810299821 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0edc049070 con 0x7f0ee41522e0 2024-07-27T03:11:14.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.495+0000 7f0edb7fe640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0ec4077010 0x7f0ec4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:14.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.495+0000 7f0edb7fe640 1 -- 172.21.15.120:0/2810299821 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5115+0+0 (secure 0 0 0) 0x7f0edc0b9900 con 0x7f0ee41522e0 2024-07-27T03:11:14.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.495+0000 7f0ee259c640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0ec4077010 0x7f0ec4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:14.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.496+0000 7f0ee259c640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0ec4077010 0x7f0ec4079520 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4005fd0 tx=0x7f0ed400a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:14.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.499+0000 7f0edb7fe640 1 -- 172.21.15.120:0/2810299821 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f0edc03e070 con 0x7f0ee41522e0 2024-07-27T03:11:14.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.683+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/2810299821 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0ee40d0b00 con 0x7f0ee41522e0 2024-07-27T03:11:14.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.686+0000 7f0edb7fe640 1 -- 172.21.15.120:0/2810299821 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v33)=0 v33) ==== 122+0+0 (secure 0 0 0) 0x7f0edc082700 con 0x7f0ee41522e0 2024-07-27T03:11:14.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.688+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0ec4077010 msgr2=0x7f0ec4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.688+0000 7f0ee8cf2640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0ec4077010 0x7f0ec4079520 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4005fd0 tx=0x7f0ed400a250 comp rx=0 tx=0).stop 2024-07-27T03:11:14.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.688+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/2810299821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ee41522e0 msgr2=0x7f0ee4154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.688+0000 7f0ee8cf2640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ee41522e0 0x7f0ee4154910 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0edc006010 tx=0x7f0edc003f10 comp rx=0 tx=0).stop 2024-07-27T03:11:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.688+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/2810299821 shutdown_connections 2024-07-27T03:11:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.688+0000 7f0ee8cf2640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0ec4077010 0x7f0ec4079520 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.688+0000 7f0ee8cf2640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ee41522e0 0x7f0ee4154910 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.688+0000 7f0ee8cf2640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ee4073f00 0x7f0ee41f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.688+0000 7f0ee8cf2640 1 --2- 172.21.15.120:0/2810299821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee40733e0 0x7f0ee409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.688+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/2810299821 >> 172.21.15.120:0/2810299821 conn(0x7f0ee40b1a10 msgr2=0x7f0ee40af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.689+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/2810299821 shutdown_connections 2024-07-27T03:11:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:14.689+0000 7f0ee8cf2640 1 -- 172.21.15.120:0/2810299821 wait complete. 2024-07-27T03:11:14.702 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-07-27T03:11:14.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:11:14.740 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:11:14.787 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-07-27T03:11:14.787 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:14.788 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:14.803 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:11:14.803 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:11:14.803 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:14.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:11:14.822 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:14.823 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:14.859 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:11:14.860 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:11:14.860 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:14.880 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:11:14.881 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-07-27T03:11:14.881 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:11:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.010+0000 7f2d44814640 1 -- 172.21.15.120:0/2843666568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d4015f330 msgr2=0x7f2d40152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.010+0000 7f2d44814640 1 --2- 172.21.15.120:0/2843666568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d4015f330 0x7f2d40152160 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2d38005fd0 tx=0x7f2d3802aaa0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.011+0000 7f2d44814640 1 -- 172.21.15.120:0/2843666568 shutdown_connections 2024-07-27T03:11:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.011+0000 7f2d44814640 1 --2- 172.21.15.120:0/2843666568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d4015f330 0x7f2d40152160 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.011+0000 7f2d44814640 1 -- 172.21.15.120:0/2843666568 >> 172.21.15.120:0/2843666568 conn(0x7f2d4006cba0 msgr2=0x7f2d4006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.011+0000 7f2d44814640 1 -- 172.21.15.120:0/2843666568 shutdown_connections 2024-07-27T03:11:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.011+0000 7f2d44814640 1 -- 172.21.15.120:0/2843666568 wait complete. 2024-07-27T03:11:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.013+0000 7f2d44814640 1 Processor -- start 2024-07-27T03:11:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.013+0000 7f2d44814640 1 -- start start 2024-07-27T03:11:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d44814640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d4015c220 0x7f2d40155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d44814640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d4015f330 0x7f2d4014ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d44814640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d40146c30 0x7f2d40146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:15.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d44814640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2d400cdd40 con 0x7f2d4015c220 2024-07-27T03:11:15.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d44814640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2d400cdbc0 con 0x7f2d4015f330 2024-07-27T03:11:15.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d44814640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2d400cdec0 con 0x7f2d40146c30 2024-07-27T03:11:15.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d4015c220 0x7f2d40155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:15.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d4015c220 0x7f2d40155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46110/0 (socket says 172.21.15.120:46110) 2024-07-27T03:11:15.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3e59c640 1 -- 172.21.15.120:0/1050484533 learned_addr learned my addr 172.21.15.120:0/1050484533 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:15.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3dd9b640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d4015f330 0x7f2d4014ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3ed9d640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d40146c30 0x7f2d40146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3e59c640 1 -- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d40146c30 msgr2=0x7f2d40146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3e59c640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d40146c30 0x7f2d40146330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3e59c640 1 -- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d4015f330 msgr2=0x7f2d4014ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3e59c640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d4015f330 0x7f2d4014ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3e59c640 1 -- 172.21.15.120:0/1050484533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d401474b0 con 0x7f2d4015c220 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3dd9b640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d4015f330 0x7f2d4014ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.014+0000 7f2d3e59c640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d4015c220 0x7f2d40155cf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000c400 tx=0x7f2d3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.015+0000 7f2d2effd640 1 -- 172.21.15.120:0/1050484533 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30017070 con 0x7f2d4015c220 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.015+0000 7f2d2effd640 1 -- 172.21.15.120:0/1050484533 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d300053c0 con 0x7f2d4015c220 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.015+0000 7f2d44814640 1 -- 172.21.15.120:0/1050484533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d401502a0 con 0x7f2d4015c220 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.015+0000 7f2d2effd640 1 -- 172.21.15.120:0/1050484533 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30003830 con 0x7f2d4015c220 2024-07-27T03:11:15.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.015+0000 7f2d44814640 1 -- 172.21.15.120:0/1050484533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d4014e770 con 0x7f2d4015c220 2024-07-27T03:11:15.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.016+0000 7f2d44814640 1 -- 172.21.15.120:0/1050484533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d40152160 con 0x7f2d4015c220 2024-07-27T03:11:15.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.017+0000 7f2d2effd640 1 -- 172.21.15.120:0/1050484533 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2d3001a070 con 0x7f2d4015c220 2024-07-27T03:11:15.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.017+0000 7f2d2effd640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d20077040 0x7f2d20079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:15.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.017+0000 7f2d2effd640 1 -- 172.21.15.120:0/1050484533 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5115+0+0 (secure 0 0 0) 0x7f2d30097a20 con 0x7f2d4015c220 2024-07-27T03:11:15.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.017+0000 7f2d3dd9b640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d20077040 0x7f2d20079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:15.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.018+0000 7f2d3dd9b640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d20077040 0x7f2d20079550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2d40155b60 tx=0x7f2d34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:15.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.022+0000 7f2d2effd640 1 -- 172.21.15.120:0/1050484533 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f2d401474b0 con 0x7f2d4015c220 2024-07-27T03:11:15.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.246+0000 7f2d44814640 1 -- 172.21.15.120:0/1050484533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d400cef80 con 0x7f2d4015c220 2024-07-27T03:11:15.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.247+0000 7f2d2effd640 1 -- 172.21.15.120:0/1050484533 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+3920 (secure 0 0 0) 0x7f2d30060f00 con 0x7f2d4015c220 2024-07-27T03:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:15.250 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":44,"btime":"2024-07-27T03:11:08:792096+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/296895260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":296895260},{"type":"v1","addr":"172.21.15.121:6837","nonce":296895260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5135,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/3262746867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":3262746867},{"type":"v1","addr":"172.21.15.121:6836","nonce":3262746867}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/1920519121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1920519121},{"type":"v1","addr":"172.21.15.120:6833","nonce":1920519121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/1405373746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1405373746},{"type":"v1","addr":"172.21.15.120:6835","nonce":1405373746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[]} 2024-07-27T03:11:15.250 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 44 2024-07-27T03:11:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 -- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d20077040 msgr2=0x7f2d20079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d20077040 0x7f2d20079550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2d40155b60 tx=0x7f2d34009040 comp rx=0 tx=0).stop 2024-07-27T03:11:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 -- 172.21.15.120:0/1050484533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d4015c220 msgr2=0x7f2d40155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d4015c220 0x7f2d40155cf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000c400 tx=0x7f2d3000c8c0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 -- 172.21.15.120:0/1050484533 shutdown_connections 2024-07-27T03:11:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d20077040 0x7f2d20079550 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d40146c30 0x7f2d40146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d4015f330 0x7f2d4014ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 --2- 172.21.15.120:0/1050484533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d4015c220 0x7f2d40155cf0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 -- 172.21.15.120:0/1050484533 >> 172.21.15.120:0/1050484533 conn(0x7f2d4006cba0 msgr2=0x7f2d400757c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:15.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 -- 172.21.15.120:0/1050484533 shutdown_connections 2024-07-27T03:11:15.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.249+0000 7f2d44814640 1 -- 172.21.15.120:0/1050484533 wait complete. 2024-07-27T03:11:15.263 INFO:tasks.ceph.mds.a:Restarting daemon 2024-07-27T03:11:15.263 INFO:tasks.ceph.mds.a:Stopping old one... 2024-07-27T03:11:15.264 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-07-27T03:11:15.264 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:11:15.264 INFO:tasks.ceph.mds.c:Restarting daemon 2024-07-27T03:11:15.264 INFO:tasks.ceph.mds.c:Stopping old one... 2024-07-27T03:11:15.264 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-07-27T03:11:15.264 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:11:15.265 INFO:tasks.ceph.mds.b:Restarting daemon 2024-07-27T03:11:15.265 INFO:tasks.ceph.mds.b:Stopping old one... 2024-07-27T03:11:15.265 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-07-27T03:11:15.265 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:11:15.265 INFO:tasks.ceph.mds.d:Restarting daemon 2024-07-27T03:11:15.265 INFO:tasks.ceph.mds.d:Stopping old one... 2024-07-27T03:11:15.266 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-07-27T03:11:15.266 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:11:15.276 INFO:tasks.ceph.mds.a:Stopped 2024-07-27T03:11:15.276 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-07-27T03:11:15.277 INFO:tasks.ceph.mds.c:Stopped 2024-07-27T03:11:15.278 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-07-27T03:11:15.279 INFO:tasks.ceph.mds.b:Stopped 2024-07-27T03:11:15.279 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-07-27T03:11:15.281 INFO:tasks.ceph.mds.d:Stopped 2024-07-27T03:11:15.281 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-07-27T03:11:15.319 INFO:tasks.ceph.mds.a:Started 2024-07-27T03:11:15.319 DEBUG:teuthology.parallel:result is None 2024-07-27T03:11:15.319 INFO:tasks.ceph.mds.c:Started 2024-07-27T03:11:15.320 DEBUG:teuthology.parallel:result is None 2024-07-27T03:11:15.323 INFO:tasks.ceph.mds.b:Started 2024-07-27T03:11:15.323 DEBUG:teuthology.parallel:result is None 2024-07-27T03:11:15.325 INFO:tasks.ceph.mds.d:Started 2024-07-27T03:11:15.325 DEBUG:teuthology.parallel:result is None 2024-07-27T03:11:15.325 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-07-27T03:11:15.406 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-07-27T03:11:15.407 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-07-27T03:11:15.407 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-07-27T03:11:15.405+0000 7f2a116df640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-07-27T03:11:15.418 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-07-27T03:11:15.419 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-07-27T03:11:15.419 INFO:tasks.ceph.mds.d.smithi121.stderr:2024-07-27T03:11:15.417+0000 7fd251ac6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-07-27T03:11:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.444+0000 7f8c8b350640 1 -- 172.21.15.120:0/3840491725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c840d27e0 msgr2=0x7f8c840d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.444+0000 7f8c8b350640 1 --2- 172.21.15.120:0/3840491725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c840d27e0 0x7f8c840d2bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009830 tx=0x7f8c7802a510 comp rx=0 tx=0).stop 2024-07-27T03:11:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.444+0000 7f8c8b350640 1 -- 172.21.15.120:0/3840491725 shutdown_connections 2024-07-27T03:11:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.444+0000 7f8c8b350640 1 --2- 172.21.15.120:0/3840491725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c840d27e0 0x7f8c840d2bf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.444+0000 7f8c8b350640 1 --2- 172.21.15.120:0/3840491725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c840b4740 0x7f8c840b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.444+0000 7f8c8b350640 1 -- 172.21.15.120:0/3840491725 >> 172.21.15.120:0/3840491725 conn(0x7f8c8408d690 msgr2=0x7f8c8409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:15.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.444+0000 7f8c8b350640 1 -- 172.21.15.120:0/3840491725 shutdown_connections 2024-07-27T03:11:15.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.444+0000 7f8c8b350640 1 -- 172.21.15.120:0/3840491725 wait complete. 2024-07-27T03:11:15.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.446+0000 7f8c8b350640 1 Processor -- start 2024-07-27T03:11:15.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.446+0000 7f8c8b350640 1 -- start start 2024-07-27T03:11:15.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.447+0000 7f8c8b350640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c840b4740 0x7f8c841554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:15.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.447+0000 7f8c8b350640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c840d09c0 0x7f8c8409dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:15.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.447+0000 7f8c8b350640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c840d27e0 0x7f8c840b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:15.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.447+0000 7f8c8b350640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8c840cef70 con 0x7f8c840d09c0 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.447+0000 7f8c8b350640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8c840cedf0 con 0x7f8c840b4740 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.447+0000 7f8c8b350640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8c840cf0f0 con 0x7f8c840d27e0 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.447+0000 7f8c888eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c840d09c0 0x7f8c8409dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.447+0000 7f8c888eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c840d09c0 0x7f8c8409dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46164/0 (socket says 172.21.15.120:46164) 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.447+0000 7f8c888eb640 1 -- 172.21.15.120:0/453422645 learned_addr learned my addr 172.21.15.120:0/453422645 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.447+0000 7f8c898ed640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c840d27e0 0x7f8c840b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.447+0000 7f8c890ec640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c840b4740 0x7f8c841554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c888eb640 1 -- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c840d27e0 msgr2=0x7f8c840b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c888eb640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c840d27e0 0x7f8c840b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c888eb640 1 -- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c840b4740 msgr2=0x7f8c841554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c888eb640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c840b4740 0x7f8c841554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c888eb640 1 -- 172.21.15.120:0/453422645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c840cb090 con 0x7f8c840d09c0 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c890ec640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c840b4740 0x7f8c841554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:15.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c888eb640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c840d09c0 0x7f8c8409dd10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009950 tx=0x7f8c78033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:15.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c75ffb640 1 -- 172.21.15.120:0/453422645 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78005c90 con 0x7f8c840d09c0 2024-07-27T03:11:15.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c75ffb640 1 -- 172.21.15.120:0/453422645 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c78031e50 con 0x7f8c840d09c0 2024-07-27T03:11:15.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c8b350640 1 -- 172.21.15.120:0/453422645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c84155a10 con 0x7f8c840d09c0 2024-07-27T03:11:15.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c75ffb640 1 -- 172.21.15.120:0/453422645 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78005260 con 0x7f8c840d09c0 2024-07-27T03:11:15.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.448+0000 7f8c8b350640 1 -- 172.21.15.120:0/453422645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c840cb610 con 0x7f8c840d09c0 2024-07-27T03:11:15.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.449+0000 7f8c8b350640 1 -- 172.21.15.120:0/453422645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c840cddf0 con 0x7f8c840d09c0 2024-07-27T03:11:15.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.450+0000 7f8c75ffb640 1 -- 172.21.15.120:0/453422645 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8c78005400 con 0x7f8c840d09c0 2024-07-27T03:11:15.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.450+0000 7f8c75ffb640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c68077010 0x7f8c68079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:15.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.451+0000 7f8c75ffb640 1 -- 172.21.15.120:0/453422645 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5115+0+0 (secure 0 0 0) 0x7f8c780b97e0 con 0x7f8c840d09c0 2024-07-27T03:11:15.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.451+0000 7f8c890ec640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c68077010 0x7f8c68079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:15.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.451+0000 7f8c890ec640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c68077010 0x7f8c68079520 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c80005fd0 tx=0x7f8c8000f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:15.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.455+0000 7f8c75ffb640 1 -- 172.21.15.120:0/453422645 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f8c840cddf0 con 0x7f8c840d09c0 2024-07-27T03:11:15.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:15.648+0000 7f8c8b350640 1 -- 172.21.15.120:0/453422645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8c840d2bf0 con 0x7f8c840d09c0 2024-07-27T03:11:16.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.055+0000 7f8c75ffb640 1 -- 172.21.15.120:0/453422645 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) ==== 97+0+0 (secure 0 0 0) 0x7f8c7803f030 con 0x7f8c840d09c0 2024-07-27T03:11:16.058 INFO:teuthology.orchestra.run.smithi120.stderr: removed all blocklist entries 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.057+0000 7f8c8b350640 1 -- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c68077010 msgr2=0x7f8c68079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.057+0000 7f8c8b350640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c68077010 0x7f8c68079520 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c80005fd0 tx=0x7f8c8000f360 comp rx=0 tx=0).stop 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.057+0000 7f8c8b350640 1 -- 172.21.15.120:0/453422645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c840d09c0 msgr2=0x7f8c8409dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.057+0000 7f8c8b350640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c840d09c0 0x7f8c8409dd10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009950 tx=0x7f8c78033c90 comp rx=0 tx=0).stop 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.057+0000 7f8c8b350640 1 -- 172.21.15.120:0/453422645 shutdown_connections 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.057+0000 7f8c8b350640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c68077010 0x7f8c68079520 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.057+0000 7f8c8b350640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c840d09c0 0x7f8c8409dd10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.057+0000 7f8c8b350640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c840d27e0 0x7f8c840b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.057+0000 7f8c8b350640 1 --2- 172.21.15.120:0/453422645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c840b4740 0x7f8c841554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.057+0000 7f8c8b350640 1 -- 172.21.15.120:0/453422645 >> 172.21.15.120:0/453422645 conn(0x7f8c8408d690 msgr2=0x7f8c8415f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.058+0000 7f8c8b350640 1 -- 172.21.15.120:0/453422645 shutdown_connections 2024-07-27T03:11:16.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.058+0000 7f8c8b350640 1 -- 172.21.15.120:0/453422645 wait complete. 2024-07-27T03:11:16.073 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-07-27T03:11:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.184+0000 7f65ba9ac640 1 -- 172.21.15.120:0/578047406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65b406eb00 msgr2=0x7f65b406ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.184+0000 7f65ba9ac640 1 --2- 172.21.15.120:0/578047406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65b406eb00 0x7f65b406ef10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005fd0 tx=0x7f65ac02aa10 comp rx=0 tx=0).stop 2024-07-27T03:11:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.184+0000 7f65ba9ac640 1 -- 172.21.15.120:0/578047406 shutdown_connections 2024-07-27T03:11:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.184+0000 7f65ba9ac640 1 --2- 172.21.15.120:0/578047406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65b406eb00 0x7f65b406ef10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.184+0000 7f65ba9ac640 1 --2- 172.21.15.120:0/578047406 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f65b4072b60 0x7f65b406fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.184+0000 7f65ba9ac640 1 -- 172.21.15.120:0/578047406 >> 172.21.15.120:0/578047406 conn(0x7f65b40b1a10 msgr2=0x7f65b40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.184+0000 7f65ba9ac640 1 -- 172.21.15.120:0/578047406 shutdown_connections 2024-07-27T03:11:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.184+0000 7f65ba9ac640 1 -- 172.21.15.120:0/578047406 wait complete. 2024-07-27T03:11:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.186+0000 7f65ba9ac640 1 Processor -- start 2024-07-27T03:11:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.186+0000 7f65ba9ac640 1 -- start start 2024-07-27T03:11:16.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.187+0000 7f65ba9ac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65b406eb00 0x7f65b415be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.187+0000 7f65ba9ac640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b4072b60 0x7f65b415c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.187+0000 7f65ba9ac640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f65b415a8b0 0x7f65b41f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.187+0000 7f65ba9ac640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f65b406e600 con 0x7f65b406eb00 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.187+0000 7f65ba9ac640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f65b406e480 con 0x7f65b4072b60 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.187+0000 7f65ba9ac640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f65b406e780 con 0x7f65b415a8b0 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.187+0000 7f65b3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65b406eb00 0x7f65b415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.187+0000 7f65b3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65b406eb00 0x7f65b415be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46184/0 (socket says 172.21.15.120:46184) 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.187+0000 7f65b3fff640 1 -- 172.21.15.120:0/4029020084 learned_addr learned my addr 172.21.15.120:0/4029020084 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65b8f49640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f65b415a8b0 0x7f65b41f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.187+0000 7f65abfff640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b4072b60 0x7f65b415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65b3fff640 1 -- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f65b415a8b0 msgr2=0x7f65b41f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65b3fff640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f65b415a8b0 0x7f65b41f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65b3fff640 1 -- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b4072b60 msgr2=0x7f65b415c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65b3fff640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b4072b60 0x7f65b415c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65b3fff640 1 -- 172.21.15.120:0/4029020084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b40c8260 con 0x7f65b406eb00 2024-07-27T03:11:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65abfff640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b4072b60 0x7f65b415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65b3fff640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65b406eb00 0x7f65b415be00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f65a400ea60 tx=0x7f65a400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65b17fa640 1 -- 172.21.15.120:0/4029020084 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a400cbc0 con 0x7f65b406eb00 2024-07-27T03:11:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65b17fa640 1 -- 172.21.15.120:0/4029020084 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65a400ce50 con 0x7f65b406eb00 2024-07-27T03:11:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65ba9ac640 1 -- 172.21.15.120:0/4029020084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b41f3440 con 0x7f65b406eb00 2024-07-27T03:11:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65b17fa640 1 -- 172.21.15.120:0/4029020084 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4004260 con 0x7f65b406eb00 2024-07-27T03:11:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.188+0000 7f65ba9ac640 1 -- 172.21.15.120:0/4029020084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b41f3a00 con 0x7f65b406eb00 2024-07-27T03:11:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.189+0000 7f65ba9ac640 1 -- 172.21.15.120:0/4029020084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b406ef10 con 0x7f65b406eb00 2024-07-27T03:11:16.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.190+0000 7f65b17fa640 1 -- 172.21.15.120:0/4029020084 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f65a40035f0 con 0x7f65b406eb00 2024-07-27T03:11:16.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.190+0000 7f65b17fa640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6594077040 0x7f6594079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.190+0000 7f65b17fa640 1 -- 172.21.15.120:0/4029020084 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f65a4098900 con 0x7f65b406eb00 2024-07-27T03:11:16.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.190+0000 7f65abfff640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6594077040 0x7f6594079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.191+0000 7f65abfff640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6594077040 0x7f6594079550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f65b40ae910 tx=0x7f659c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:16.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.195+0000 7f65b17fa640 1 -- 172.21.15.120:0/4029020084 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f65a4061ee0 con 0x7f65b406eb00 2024-07-27T03:11:16.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.447+0000 7f65ba9ac640 1 -- 172.21.15.120:0/4029020084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f65b40b21a0 con 0x7f65b406eb00 2024-07-27T03:11:16.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.448+0000 7f65b17fa640 1 -- 172.21.15.120:0/4029020084 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f65a40617e0 con 0x7f65b406eb00 2024-07-27T03:11:16.451 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:16.454 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:11:16.455 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_dump": [ 2024-07-27T03:11:16.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.455 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.a", 2024-07-27T03:11:16.455 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRm7HVTGBAADA2eiX5COiTN6OTelto+6g==", 2024-07-27T03:11:16.455 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.456 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:11:16.456 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:11:16.456 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:11:16.456 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.456 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.b", 2024-07-27T03:11:16.456 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmMfl8JRAA+4W3m5lICDf6dIU1dELj5Q==", 2024-07-27T03:11:16.457 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.457 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:11:16.457 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:11:16.457 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:11:16.457 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.457 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.458 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.c", 2024-07-27T03:11:16.458 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmDnDuHxAAWKoH2jvhBqPNxL7NrtCJuw==", 2024-07-27T03:11:16.458 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.458 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:11:16.458 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:11:16.458 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:11:16.459 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.459 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.d", 2024-07-27T03:11:16.459 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmxkcwLRAAMzpPET/zdPCxfhbsMeLJuQ==", 2024-07-27T03:11:16.459 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.459 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:11:16.459 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:11:16.460 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:11:16.460 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.460 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.0", 2024-07-27T03:11:16.460 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCCZKRmtTNTChAAYbSo/j1WO/4nocsPhy8JRw==", 2024-07-27T03:11:16.460 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.460 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:11:16.460 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:11:16.461 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.461 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.1", 2024-07-27T03:11:16.461 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCFZKRmLRqlCBAAYgYpmzL3If445MkxGxBKHw==", 2024-07-27T03:11:16.461 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.461 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:11:16.461 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:11:16.462 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.462 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.2", 2024-07-27T03:11:16.462 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCIZKRmDhKBBhAAl6K58lvyVrAqfWffwAr1Mg==", 2024-07-27T03:11:16.462 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.462 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:11:16.463 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:11:16.463 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.463 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.3", 2024-07-27T03:11:16.463 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCLZKRmUDrLBBAAyUyAP/dCtMZVZpzi7TZIzA==", 2024-07-27T03:11:16.463 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.464 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:11:16.464 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:11:16.464 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.464 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.464 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.4", 2024-07-27T03:11:16.464 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCRZKRmXRMoCRAAcfX7u17DIoxM9dK3/TFu8Q==", 2024-07-27T03:11:16.465 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.465 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:11:16.465 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:11:16.465 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.465 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.5", 2024-07-27T03:11:16.466 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCUZKRmyaL0BxAANbxggtK64zbog9+KDXeOew==", 2024-07-27T03:11:16.466 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.466 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:11:16.466 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:11:16.466 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.467 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.6", 2024-07-27T03:11:16.467 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCXZKRmATKrBhAAeEBqJxkOoQozFzw1yeL6lw==", 2024-07-27T03:11:16.467 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.467 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:11:16.467 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:11:16.467 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.468 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.7", 2024-07-27T03:11:16.468 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCaZKRmCh6nBBAA8Cc+xOuBxqDAUgpweyq23A==", 2024-07-27T03:11:16.468 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.468 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:11:16.468 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:11:16.468 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.469 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.0", 2024-07-27T03:11:16.469 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmI8baMRAArCIL9NNNVlevij0JAWwGwg==", 2024-07-27T03:11:16.469 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.469 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:11:16.469 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow r", 2024-07-27T03:11:16.470 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-07-27T03:11:16.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.470 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.1", 2024-07-27T03:11:16.470 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmgOpnORAAkcLaNUd6cnsV/sHwOOI+2w==", 2024-07-27T03:11:16.470 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.471 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:11:16.471 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:11:16.471 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:11:16.471 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:11:16.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.471 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.2", 2024-07-27T03:11:16.471 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmwOSdNRAALgx82wMQ+5fPOrFL/qhj8g==", 2024-07-27T03:11:16.471 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.472 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:11:16.472 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:11:16.472 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:11:16.472 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:11:16.472 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.472 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.3", 2024-07-27T03:11:16.473 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB/ZKRmHh6PARAAZ9nBBam/kVvT6C1aFbNC3g==", 2024-07-27T03:11:16.473 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.473 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:11:16.473 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:11:16.473 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:11:16.473 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:11:16.473 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.473 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.admin", 2024-07-27T03:11:16.473 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB9ZKRmpVPmNRAAay22/X8LO2KsI86ehHZ/MA==", 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.x", 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmFsR+FBAA8tKKAi2Y/Yaxxca+ep3BRQ==", 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.474 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:11:16.475 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2024-07-27T03:11:16.475 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:11:16.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.475 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.y", 2024-07-27T03:11:16.475 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmWLnrDxAAfy1pvcoGJESVPs9k+so+/A==", 2024-07-27T03:11:16.475 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:11:16.475 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:11:16.476 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2024-07-27T03:11:16.476 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:11:16.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-07-27T03:11:16.476 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:11:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 -- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6594077040 msgr2=0x7f6594079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6594077040 0x7f6594079550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f65b40ae910 tx=0x7f659c009040 comp rx=0 tx=0).stop 2024-07-27T03:11:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 -- 172.21.15.120:0/4029020084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65b406eb00 msgr2=0x7f65b415be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65b406eb00 0x7f65b415be00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f65a400ea60 tx=0x7f65a400ef20 comp rx=0 tx=0).stop 2024-07-27T03:11:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 -- 172.21.15.120:0/4029020084 shutdown_connections 2024-07-27T03:11:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6594077040 0x7f6594079550 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f65b415a8b0 0x7f65b41f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b4072b60 0x7f65b415c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 --2- 172.21.15.120:0/4029020084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65b406eb00 0x7f65b415be00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 -- 172.21.15.120:0/4029020084 >> 172.21.15.120:0/4029020084 conn(0x7f65b40b1a10 msgr2=0x7f65b4159520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 -- 172.21.15.120:0/4029020084 shutdown_connections 2024-07-27T03:11:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.450+0000 7f65ba9ac640 1 -- 172.21.15.120:0/4029020084 wait complete. 2024-07-27T03:11:16.480 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-07-27T03:11:16.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.594+0000 7f548f798640 1 -- 172.21.15.120:0/2804718008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54880b1130 msgr2=0x7f54880cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.594+0000 7f548f798640 1 --2- 172.21.15.120:0/2804718008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54880b1130 0x7f54880cf1a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5478005fd0 tx=0x7f547802ab40 comp rx=0 tx=0).stop 2024-07-27T03:11:16.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.594+0000 7f548f798640 1 -- 172.21.15.120:0/2804718008 shutdown_connections 2024-07-27T03:11:16.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.594+0000 7f548f798640 1 --2- 172.21.15.120:0/2804718008 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54880b1130 0x7f54880cf1a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.594+0000 7f548f798640 1 -- 172.21.15.120:0/2804718008 >> 172.21.15.120:0/2804718008 conn(0x7f548809aa30 msgr2=0x7f548809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:16.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.594+0000 7f548f798640 1 -- 172.21.15.120:0/2804718008 shutdown_connections 2024-07-27T03:11:16.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.594+0000 7f548f798640 1 -- 172.21.15.120:0/2804718008 wait complete. 2024-07-27T03:11:16.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.596+0000 7f548f798640 1 Processor -- start 2024-07-27T03:11:16.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.596+0000 7f548f798640 1 -- start start 2024-07-27T03:11:16.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.597+0000 7f548f798640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54880b1130 0x7f54880c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.597+0000 7f548f798640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54880b71d0 0x7f54880b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.597+0000 7f548f798640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54880c9540 0x7f54880b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.597+0000 7f548f798640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f54880d0470 con 0x7f54880c9540 2024-07-27T03:11:16.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.597+0000 7f548f798640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f54880d02f0 con 0x7f54880b1130 2024-07-27T03:11:16.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.597+0000 7f548f798640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f54880d05f0 con 0x7f54880b71d0 2024-07-27T03:11:16.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.597+0000 7f548dd35640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54880c9540 0x7f54880b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.597+0000 7f548dd35640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54880c9540 0x7f54880b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46200/0 (socket says 172.21.15.120:46200) 2024-07-27T03:11:16.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.597+0000 7f548dd35640 1 -- 172.21.15.120:0/524030303 learned_addr learned my addr 172.21.15.120:0/524030303 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:16.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.597+0000 7f548d534640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54880b1130 0x7f54880c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.597+0000 7f548cd33640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54880b71d0 0x7f54880b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f548dd35640 1 -- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54880b71d0 msgr2=0x7f54880b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f548dd35640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54880b71d0 0x7f54880b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f548dd35640 1 -- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54880b1130 msgr2=0x7f54880c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f548dd35640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54880b1130 0x7f54880c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f548dd35640 1 -- 172.21.15.120:0/524030303 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54881f2b80 con 0x7f54880c9540 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f548cd33640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54880b71d0 0x7f54880b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f548dd35640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54880c9540 0x7f54880b61d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5478009bf0 tx=0x7f547802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f5485ffb640 1 -- 172.21.15.120:0/524030303 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478044070 con 0x7f54880c9540 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f5485ffb640 1 -- 172.21.15.120:0/524030303 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5478004250 con 0x7f54880c9540 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f548f798640 1 -- 172.21.15.120:0/524030303 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548814bb30 con 0x7f54880c9540 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f5485ffb640 1 -- 172.21.15.120:0/524030303 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478004680 con 0x7f54880c9540 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.598+0000 7f548f798640 1 -- 172.21.15.120:0/524030303 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548814c0e0 con 0x7f54880c9540 2024-07-27T03:11:16.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.599+0000 7f548f798640 1 -- 172.21.15.120:0/524030303 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54880c9ae0 con 0x7f54880c9540 2024-07-27T03:11:16.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.600+0000 7f5485ffb640 1 -- 172.21.15.120:0/524030303 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5478036400 con 0x7f54880c9540 2024-07-27T03:11:16.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.600+0000 7f5485ffb640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5474077010 0x7f5474079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.600+0000 7f5485ffb640 1 -- 172.21.15.120:0/524030303 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f54780b8e40 con 0x7f54880c9540 2024-07-27T03:11:16.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.601+0000 7f548d534640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5474077010 0x7f5474079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.601+0000 7f548d534640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5474077010 0x7f5474079520 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5480001720 tx=0x7f5480009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:16.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.605+0000 7f5485ffb640 1 -- 172.21.15.120:0/524030303 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5478032030 con 0x7f54880c9540 2024-07-27T03:11:16.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.789+0000 7f548f798640 1 -- 172.21.15.120:0/524030303 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f54880d0aa0 con 0x7f54880c9540 2024-07-27T03:11:16.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.789+0000 7f5485ffb640 1 -- 172.21.15.120:0/524030303 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) ==== 84+0+65 (secure 0 0 0) 0x7f5478004820 con 0x7f54880c9540 2024-07-27T03:11:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:16.793 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-07-27T03:11:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:11:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2024-07-27T03:11:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2024-07-27T03:11:16.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:11:16.793 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-07-27T03:11:16.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 -- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5474077010 msgr2=0x7f5474079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5474077010 0x7f5474079520 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5480001720 tx=0x7f5480009040 comp rx=0 tx=0).stop 2024-07-27T03:11:16.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 -- 172.21.15.120:0/524030303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54880c9540 msgr2=0x7f54880b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54880c9540 0x7f54880b61d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5478009bf0 tx=0x7f547802c8b0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 -- 172.21.15.120:0/524030303 shutdown_connections 2024-07-27T03:11:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5474077010 0x7f5474079520 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54880c9540 0x7f54880b61d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f54880b71d0 0x7f54880b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 --2- 172.21.15.120:0/524030303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54880b1130 0x7f54880c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 -- 172.21.15.120:0/524030303 >> 172.21.15.120:0/524030303 conn(0x7f548809aa30 msgr2=0x7f54880716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 -- 172.21.15.120:0/524030303 shutdown_connections 2024-07-27T03:11:16.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.792+0000 7f548f798640 1 -- 172.21.15.120:0/524030303 wait complete. 2024-07-27T03:11:16.805 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-07-27T03:11:16.805 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-07-27T03:11:16.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.920+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/3918790004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4152060 msgr2=0x7fe2b4073430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.920+0000 7fe2b8ce2640 1 --2- 172.21.15.120:0/3918790004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4152060 0x7fe2b4073430 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40b5c40 tx=0x7fe2a402a560 comp rx=0 tx=0).stop 2024-07-27T03:11:16.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.921+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/3918790004 shutdown_connections 2024-07-27T03:11:16.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.921+0000 7fe2b8ce2640 1 --2- 172.21.15.120:0/3918790004 >> v2:172.21.15.121:3300/0 conn(0x7fe2b415c140 0x7fe2b406f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.921+0000 7fe2b8ce2640 1 --2- 172.21.15.120:0/3918790004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4152060 0x7fe2b4073430 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.921+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/3918790004 >> 172.21.15.120:0/3918790004 conn(0x7fe2b406dec0 msgr2=0x7fe2b40b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:16.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.921+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/3918790004 shutdown_connections 2024-07-27T03:11:16.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.921+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/3918790004 wait complete. 2024-07-27T03:11:16.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.923+0000 7fe2b8ce2640 1 Processor -- start 2024-07-27T03:11:16.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.923+0000 7fe2b8ce2640 1 -- start start 2024-07-27T03:11:16.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b8ce2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4073970 0x7fe2b409d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b8ce2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2b4152060 0x7fe2b41f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b8ce2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2b415c140 0x7fe2b409e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b8ce2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b406fd60 con 0x7fe2b4073970 2024-07-27T03:11:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b8ce2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b406fbe0 con 0x7fe2b4152060 2024-07-27T03:11:16.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b8ce2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b406fee0 con 0x7fe2b415c140 2024-07-27T03:11:16.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4073970 0x7fe2b409d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4073970 0x7fe2b409d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46226/0 (socket says 172.21.15.120:46226) 2024-07-27T03:11:16.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b259c640 1 -- 172.21.15.120:0/2310445253 learned_addr learned my addr 172.21.15.120:0/2310445253 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:16.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b2d9d640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2b415c140 0x7fe2b409e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2a9d9b640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2b4152060 0x7fe2b41f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b259c640 1 -- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2b415c140 msgr2=0x7fe2b409e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b259c640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2b415c140 0x7fe2b409e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b259c640 1 -- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2b4152060 msgr2=0x7fe2b41f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:16.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b259c640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2b4152060 0x7fe2b41f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:16.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b259c640 1 -- 172.21.15.120:0/2310445253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b41f28e0 con 0x7fe2b4073970 2024-07-27T03:11:16.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2b2d9d640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2b415c140 0x7fe2b409e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:16.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.924+0000 7fe2a9d9b640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2b4152060 0x7fe2b41f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:16.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.925+0000 7fe2b259c640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4073970 0x7fe2b409d3b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4034040 tx=0x7fe2a40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:16.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.925+0000 7fe2ab7fe640 1 -- 172.21.15.120:0/2310445253 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a403e030 con 0x7fe2b4073970 2024-07-27T03:11:16.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.925+0000 7fe2ab7fe640 1 -- 172.21.15.120:0/2310445253 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2a40047a0 con 0x7fe2b4073970 2024-07-27T03:11:16.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.925+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/2310445253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b41f2bc0 con 0x7fe2b4073970 2024-07-27T03:11:16.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.925+0000 7fe2ab7fe640 1 -- 172.21.15.120:0/2310445253 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4035040 con 0x7fe2b4073970 2024-07-27T03:11:16.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.925+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/2310445253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b409bf00 con 0x7fe2b4073970 2024-07-27T03:11:16.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.926+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/2310445253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b41f2e00 con 0x7fe2b4073970 2024-07-27T03:11:16.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.926+0000 7fe2ab7fe640 1 -- 172.21.15.120:0/2310445253 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe2a4041030 con 0x7fe2b4073970 2024-07-27T03:11:16.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.927+0000 7fe2ab7fe640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe294077010 0x7fe294079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:16.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.927+0000 7fe2ab7fe640 1 -- 172.21.15.120:0/2310445253 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7fe2a40b8d20 con 0x7fe2b4073970 2024-07-27T03:11:16.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.927+0000 7fe2a9d9b640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe294077010 0x7fe294079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:16.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.928+0000 7fe2a9d9b640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe294077010 0x7fe294079520 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe29c006fd0 tx=0x7fe29c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:16.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:16.931+0000 7fe2ab7fe640 1 -- 172.21.15.120:0/2310445253 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fe2b41f2e00 con 0x7fe2b4073970 2024-07-27T03:11:17.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:17.117+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/2310445253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe2b40adea0 con 0x7fe2b4073970 2024-07-27T03:11:18.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.074+0000 7fe2ab7fe640 1 -- 172.21.15.120:0/2310445253 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) ==== 138+0+0 (secure 0 0 0) 0x7fe2b40adea0 con 0x7fe2b4073970 2024-07-27T03:11:18.077 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2024-07-27T03:11:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe294077010 msgr2=0x7fe294079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe294077010 0x7fe294079520 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe29c006fd0 tx=0x7fe29c008040 comp rx=0 tx=0).stop 2024-07-27T03:11:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/2310445253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4073970 msgr2=0x7fe2b409d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4073970 0x7fe2b409d3b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4034040 tx=0x7fe2a40039e0 comp rx=0 tx=0).stop 2024-07-27T03:11:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/2310445253 shutdown_connections 2024-07-27T03:11:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe294077010 0x7fe294079520 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2b415c140 0x7fe2b409e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2b4152060 0x7fe2b41f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 --2- 172.21.15.120:0/2310445253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2b4073970 0x7fe2b409d3b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/2310445253 >> 172.21.15.120:0/2310445253 conn(0x7fe2b406dec0 msgr2=0x7fe2b40b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/2310445253 shutdown_connections 2024-07-27T03:11:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.077+0000 7fe2b8ce2640 1 -- 172.21.15.120:0/2310445253 wait complete. 2024-07-27T03:11:18.098 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-07-27T03:11:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.221+0000 7ff30e5c7640 1 -- 172.21.15.120:0/1927152567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff30806f210 msgr2=0x7ff30815e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.221+0000 7ff30e5c7640 1 --2- 172.21.15.120:0/1927152567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff30806f210 0x7ff30815e730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff3080721d0 tx=0x7ff2fc02a560 comp rx=0 tx=0).stop 2024-07-27T03:11:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.221+0000 7ff30e5c7640 1 -- 172.21.15.120:0/1927152567 shutdown_connections 2024-07-27T03:11:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.221+0000 7ff30e5c7640 1 --2- 172.21.15.120:0/1927152567 >> v2:172.21.15.121:3300/0 conn(0x7ff30815ec70 0x7ff308150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.221+0000 7ff30e5c7640 1 --2- 172.21.15.120:0/1927152567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff30806f210 0x7ff30815e730 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.221+0000 7ff30e5c7640 1 -- 172.21.15.120:0/1927152567 >> 172.21.15.120:0/1927152567 conn(0x7ff3080b1a10 msgr2=0x7ff3080b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.221+0000 7ff30e5c7640 1 -- 172.21.15.120:0/1927152567 shutdown_connections 2024-07-27T03:11:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.221+0000 7ff30e5c7640 1 -- 172.21.15.120:0/1927152567 wait complete. 2024-07-27T03:11:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.223+0000 7ff30e5c7640 1 Processor -- start 2024-07-27T03:11:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.223+0000 7ff30e5c7640 1 -- start start 2024-07-27T03:11:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.224+0000 7ff30e5c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff30815ad30 0x7ff3081f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.224+0000 7ff30e5c7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff30815ec70 0x7ff3081f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.224+0000 7ff30e5c7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff30809ddb0 0x7ff308144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.224+0000 7ff30e5c7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff308151840 con 0x7ff30815ad30 2024-07-27T03:11:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.224+0000 7ff30e5c7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081516c0 con 0x7ff30815ec70 2024-07-27T03:11:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.224+0000 7ff30e5c7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff3081519c0 con 0x7ff30809ddb0 2024-07-27T03:11:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.224+0000 7ff307fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff30815ad30 0x7ff3081f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.224+0000 7ff307fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff30815ad30 0x7ff3081f66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46252/0 (socket says 172.21.15.120:46252) 2024-07-27T03:11:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.224+0000 7ff307fff640 1 -- 172.21.15.120:0/2567547602 learned_addr learned my addr 172.21.15.120:0/2567547602 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff3077fe640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff30815ec70 0x7ff3081f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff30cb64640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff30809ddb0 0x7ff308144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff307fff640 1 -- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff30809ddb0 msgr2=0x7ff308144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff307fff640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff30809ddb0 0x7ff308144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff307fff640 1 -- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff30815ec70 msgr2=0x7ff3081f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff307fff640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff30815ec70 0x7ff3081f30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff307fff640 1 -- 172.21.15.120:0/2567547602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3081f6bf0 con 0x7ff30815ad30 2024-07-27T03:11:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff30cb64640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff30809ddb0 0x7ff308144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff307fff640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff30815ad30 0x7ff3081f66b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800b3c0 tx=0x7ff2f800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:18.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff304ff9640 1 -- 172.21.15.120:0/2567547602 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8011830 con 0x7ff30815ad30 2024-07-27T03:11:18.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff304ff9640 1 -- 172.21.15.120:0/2567547602 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2f8016070 con 0x7ff30815ad30 2024-07-27T03:11:18.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff30e5c7640 1 -- 172.21.15.120:0/2567547602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3081f6ec0 con 0x7ff30815ad30 2024-07-27T03:11:18.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff304ff9640 1 -- 172.21.15.120:0/2567547602 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8011da0 con 0x7ff30815ad30 2024-07-27T03:11:18.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.225+0000 7ff30e5c7640 1 -- 172.21.15.120:0/2567547602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3081f7480 con 0x7ff30815ad30 2024-07-27T03:11:18.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.226+0000 7ff30e5c7640 1 -- 172.21.15.120:0/2567547602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30815e730 con 0x7ff30815ad30 2024-07-27T03:11:18.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.227+0000 7ff304ff9640 1 -- 172.21.15.120:0/2567547602 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff2f801b460 con 0x7ff30815ad30 2024-07-27T03:11:18.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.227+0000 7ff304ff9640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2f4077010 0x7ff2f4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:18.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.228+0000 7ff304ff9640 1 -- 172.21.15.120:0/2567547602 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5227+0+0 (secure 0 0 0) 0x7ff2f80983b0 con 0x7ff30815ad30 2024-07-27T03:11:18.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.228+0000 7ff3077fe640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2f4077010 0x7ff2f4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:18.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.228+0000 7ff3077fe640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2f4077010 0x7ff2f4079520 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc033000 tx=0x7ff2fc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:18.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.232+0000 7ff304ff9640 1 -- 172.21.15.120:0/2567547602 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff2f8061820 con 0x7ff30815ad30 2024-07-27T03:11:18.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:18.414+0000 7ff30e5c7640 1 -- 172.21.15.120:0/2567547602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff3080b4690 con 0x7ff30815ad30 2024-07-27T03:11:19.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.080+0000 7ff304ff9640 1 -- 172.21.15.120:0/2567547602 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) ==== 170+0+0 (secure 0 0 0) 0x7ff2f8061120 con 0x7ff30815ad30 2024-07-27T03:11:19.084 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2024-07-27T03:11:19.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 -- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2f4077010 msgr2=0x7ff2f4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:19.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2f4077010 0x7ff2f4079520 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc033000 tx=0x7ff2fc004730 comp rx=0 tx=0).stop 2024-07-27T03:11:19.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 -- 172.21.15.120:0/2567547602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff30815ad30 msgr2=0x7ff3081f66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:19.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff30815ad30 0x7ff3081f66b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800b3c0 tx=0x7ff2f800b880 comp rx=0 tx=0).stop 2024-07-27T03:11:19.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 -- 172.21.15.120:0/2567547602 shutdown_connections 2024-07-27T03:11:19.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2f4077010 0x7ff2f4079520 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:19.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff30809ddb0 0x7ff308144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:19.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff30815ec70 0x7ff3081f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:19.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 --2- 172.21.15.120:0/2567547602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff30815ad30 0x7ff3081f66b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:19.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 -- 172.21.15.120:0/2567547602 >> 172.21.15.120:0/2567547602 conn(0x7ff3080b1a10 msgr2=0x7ff30806e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:19.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 -- 172.21.15.120:0/2567547602 shutdown_connections 2024-07-27T03:11:19.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.083+0000 7ff30e5c7640 1 -- 172.21.15.120:0/2567547602 wait complete. 2024-07-27T03:11:19.111 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-07-27T03:11:19.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.228+0000 7fbe70a2b640 1 -- 172.21.15.120:0/391986874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe6c0729b0 msgr2=0x7fbe6c0acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:19.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.228+0000 7fbe70a2b640 1 --2- 172.21.15.120:0/391986874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe6c0729b0 0x7fbe6c0acd60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0b2dc0 tx=0x7fbe5c02a980 comp rx=0 tx=0).stop 2024-07-27T03:11:19.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.228+0000 7fbe70a2b640 1 -- 172.21.15.120:0/391986874 shutdown_connections 2024-07-27T03:11:19.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.228+0000 7fbe70a2b640 1 --2- 172.21.15.120:0/391986874 >> v2:172.21.15.121:3300/0 conn(0x7fbe6c15d4b0 0x7fbe6c0aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:19.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.228+0000 7fbe70a2b640 1 --2- 172.21.15.120:0/391986874 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe6c072dc0 0x7fbe6c15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:19.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.228+0000 7fbe70a2b640 1 --2- 172.21.15.120:0/391986874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe6c0729b0 0x7fbe6c0acd60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:19.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.228+0000 7fbe70a2b640 1 -- 172.21.15.120:0/391986874 >> 172.21.15.120:0/391986874 conn(0x7fbe6c0b1a10 msgr2=0x7fbe6c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:19.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.228+0000 7fbe70a2b640 1 -- 172.21.15.120:0/391986874 shutdown_connections 2024-07-27T03:11:19.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.228+0000 7fbe70a2b640 1 -- 172.21.15.120:0/391986874 wait complete. 2024-07-27T03:11:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.230+0000 7fbe70a2b640 1 Processor -- start 2024-07-27T03:11:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.230+0000 7fbe70a2b640 1 -- start start 2024-07-27T03:11:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.231+0000 7fbe70a2b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe6c0729b0 0x7fbe6c159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.231+0000 7fbe70a2b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe6c072dc0 0x7fbe6c1f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.231+0000 7fbe70a2b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe6c15d4b0 0x7fbe6c1f8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.231+0000 7fbe70a2b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c06f280 con 0x7fbe6c15d4b0 2024-07-27T03:11:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.231+0000 7fbe70a2b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c0af490 con 0x7fbe6c0729b0 2024-07-27T03:11:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.231+0000 7fbe70a2b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbe6c06f400 con 0x7fbe6c072dc0 2024-07-27T03:11:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe6ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe6c15d4b0 0x7fbe6c1f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe6ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe6c15d4b0 0x7fbe6c1f8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46266/0 (socket says 172.21.15.120:46266) 2024-07-27T03:11:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe6ad9d640 1 -- 172.21.15.120:0/1388389803 learned_addr learned my addr 172.21.15.120:0/1388389803 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe6a59c640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe6c0729b0 0x7fbe6c159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe69d9b640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe6c072dc0 0x7fbe6c1f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe6ad9d640 1 -- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe6c072dc0 msgr2=0x7fbe6c1f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:19.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe6ad9d640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe6c072dc0 0x7fbe6c1f8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe6ad9d640 1 -- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe6c0729b0 msgr2=0x7fbe6c159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe6ad9d640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe6c0729b0 0x7fbe6c159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe6ad9d640 1 -- 172.21.15.120:0/1388389803 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6c143c40 con 0x7fbe6c15d4b0 2024-07-27T03:11:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe6ad9d640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe6c15d4b0 0x7fbe6c1f8870 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400d660 tx=0x7fbe6400db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe5affd640 1 -- 172.21.15.120:0/1388389803 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64017070 con 0x7fbe6c15d4b0 2024-07-27T03:11:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe5affd640 1 -- 172.21.15.120:0/1388389803 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe64005310 con 0x7fbe6c15d4b0 2024-07-27T03:11:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe70a2b640 1 -- 172.21.15.120:0/1388389803 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6c143f20 con 0x7fbe6c15d4b0 2024-07-27T03:11:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe5affd640 1 -- 172.21.15.120:0/1388389803 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64009820 con 0x7fbe6c15d4b0 2024-07-27T03:11:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.232+0000 7fbe70a2b640 1 -- 172.21.15.120:0/1388389803 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe6c0b2f90 con 0x7fbe6c15d4b0 2024-07-27T03:11:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.233+0000 7fbe70a2b640 1 -- 172.21.15.120:0/1388389803 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe6c15a080 con 0x7fbe6c15d4b0 2024-07-27T03:11:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.234+0000 7fbe5affd640 1 -- 172.21.15.120:0/1388389803 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fbe640099c0 con 0x7fbe6c15d4b0 2024-07-27T03:11:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.235+0000 7fbe5affd640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbe4c077010 0x7fbe4c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.235+0000 7fbe5affd640 1 -- 172.21.15.120:0/1388389803 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5609+0+0 (secure 0 0 0) 0x7fbe64098860 con 0x7fbe6c15d4b0 2024-07-27T03:11:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.235+0000 7fbe6a59c640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbe4c077010 0x7fbe4c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.235+0000 7fbe6a59c640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbe4c077010 0x7fbe4c079520 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c035000 tx=0x7fbe5c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:19.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.239+0000 7fbe5affd640 1 -- 172.21.15.120:0/1388389803 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fbe64061460 con 0x7fbe6c15d4b0 2024-07-27T03:11:19.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:19.458+0000 7fbe70a2b640 1 -- 172.21.15.120:0/1388389803 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbe6c144440 con 0x7fbe6c15d4b0 2024-07-27T03:11:20.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.082+0000 7fbe5affd640 1 -- 172.21.15.120:0/1388389803 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v47) ==== 172+0+0 (secure 0 0 0) 0x7fbe64098070 con 0x7fbe6c15d4b0 2024-07-27T03:11:20.085 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 8 and data pool 9 2024-07-27T03:11:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.086+0000 7fbe70a2b640 1 -- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbe4c077010 msgr2=0x7fbe4c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.086+0000 7fbe70a2b640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbe4c077010 0x7fbe4c079520 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c035000 tx=0x7fbe5c004ab0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.086+0000 7fbe70a2b640 1 -- 172.21.15.120:0/1388389803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe6c15d4b0 msgr2=0x7fbe6c1f8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.086+0000 7fbe70a2b640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe6c15d4b0 0x7fbe6c1f8870 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400d660 tx=0x7fbe6400db20 comp rx=0 tx=0).stop 2024-07-27T03:11:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.087+0000 7fbe70a2b640 1 -- 172.21.15.120:0/1388389803 shutdown_connections 2024-07-27T03:11:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.087+0000 7fbe70a2b640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbe4c077010 0x7fbe4c079520 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.087+0000 7fbe70a2b640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe6c15d4b0 0x7fbe6c1f8870 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.087+0000 7fbe70a2b640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe6c072dc0 0x7fbe6c1f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.087+0000 7fbe70a2b640 1 --2- 172.21.15.120:0/1388389803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe6c0729b0 0x7fbe6c159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.087+0000 7fbe70a2b640 1 -- 172.21.15.120:0/1388389803 >> 172.21.15.120:0/1388389803 conn(0x7fbe6c0b1a10 msgr2=0x7fbe6c15bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.088+0000 7fbe70a2b640 1 -- 172.21.15.120:0/1388389803 shutdown_connections 2024-07-27T03:11:20.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.088+0000 7fbe70a2b640 1 -- 172.21.15.120:0/1388389803 wait complete. 2024-07-27T03:11:20.121 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:11:20.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.234+0000 7f6ea6e50640 1 -- 172.21.15.120:0/875424810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea00d2290 msgr2=0x7f6ea015ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.234+0000 7f6ea6e50640 1 --2- 172.21.15.120:0/875424810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea00d2290 0x7f6ea015ec60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00d2850 tx=0x7f6e9802aa00 comp rx=0 tx=0).stop 2024-07-27T03:11:20.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.234+0000 7f6ea6e50640 1 -- 172.21.15.120:0/875424810 shutdown_connections 2024-07-27T03:11:20.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.234+0000 7f6ea6e50640 1 --2- 172.21.15.120:0/875424810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea00d2290 0x7f6ea015ec60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.234+0000 7f6ea6e50640 1 --2- 172.21.15.120:0/875424810 >> v2:172.21.15.121:3300/0 conn(0x7f6ea00b1130 0x7f6ea00d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.234+0000 7f6ea6e50640 1 --2- 172.21.15.120:0/875424810 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ea00b71d0 0x7f6ea00cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.234+0000 7f6ea6e50640 1 -- 172.21.15.120:0/875424810 >> 172.21.15.120:0/875424810 conn(0x7f6ea009aa30 msgr2=0x7f6ea009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.234+0000 7f6ea6e50640 1 -- 172.21.15.120:0/875424810 shutdown_connections 2024-07-27T03:11:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.234+0000 7f6ea6e50640 1 -- 172.21.15.120:0/875424810 wait complete. 2024-07-27T03:11:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.236+0000 7f6ea6e50640 1 Processor -- start 2024-07-27T03:11:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.236+0000 7f6ea6e50640 1 -- start start 2024-07-27T03:11:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea6e50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea00b1130 0x7f6ea0154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea6e50640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ea00b71d0 0x7f6ea009e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea6e50640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea00d2290 0x7f6ea009e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea6e50640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea015f530 con 0x7f6ea00b1130 2024-07-27T03:11:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea6e50640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea015f3b0 con 0x7f6ea00d2290 2024-07-27T03:11:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea6e50640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea015f6b0 con 0x7f6ea00b71d0 2024-07-27T03:11:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea4bec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea00b1130 0x7f6ea0154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea4bec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea00b1130 0x7f6ea0154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46288/0 (socket says 172.21.15.120:46288) 2024-07-27T03:11:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea4bec640 1 -- 172.21.15.120:0/1754768694 learned_addr learned my addr 172.21.15.120:0/1754768694 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6e9ffff640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ea00b71d0 0x7f6ea009e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea53ed640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea00d2290 0x7f6ea009e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea4bec640 1 -- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ea00b71d0 msgr2=0x7f6ea009e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea4bec640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ea00b71d0 0x7f6ea009e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea4bec640 1 -- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea00d2290 msgr2=0x7f6ea009e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea4bec640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea00d2290 0x7f6ea009e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea4bec640 1 -- 172.21.15.120:0/1754768694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea01552f0 con 0x7f6ea00b1130 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6e9ffff640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ea00b71d0 0x7f6ea009e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea53ed640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea00d2290 0x7f6ea009e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea4bec640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea00b1130 0x7f6ea0154db0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400c970 tx=0x7f6e9400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6e9d7fa640 1 -- 172.21.15.120:0/1754768694 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94007bb0 con 0x7f6ea00b1130 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6e9d7fa640 1 -- 172.21.15.120:0/1754768694 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e94005020 con 0x7f6ea00b1130 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6e9d7fa640 1 -- 172.21.15.120:0/1754768694 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94007e60 con 0x7f6ea00b1130 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea6e50640 1 -- 172.21.15.120:0/1754768694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea00cb560 con 0x7f6ea00b1130 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.238+0000 7f6ea6e50640 1 -- 172.21.15.120:0/1754768694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea009dad0 con 0x7f6ea00b1130 2024-07-27T03:11:20.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.239+0000 7f6ea6e50640 1 -- 172.21.15.120:0/1754768694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea015fbd0 con 0x7f6ea00b1130 2024-07-27T03:11:20.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.240+0000 7f6e9d7fa640 1 -- 172.21.15.120:0/1754768694 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6e94005470 con 0x7f6ea00b1130 2024-07-27T03:11:20.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.241+0000 7f6e9d7fa640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6e84077010 0x7f6e84079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.241+0000 7f6e9d7fa640 1 -- 172.21.15.120:0/1754768694 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f6e94098ca0 con 0x7f6ea00b1130 2024-07-27T03:11:20.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.241+0000 7f6e9ffff640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6e84077010 0x7f6e84079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.241+0000 7f6e9ffff640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6e84077010 0x7f6e84079520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00d0620 tx=0x7f6e8c005cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:20.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.245+0000 7f6e9d7fa640 1 -- 172.21.15.120:0/1754768694 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6e94014030 con 0x7f6ea00b1130 2024-07-27T03:11:20.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.427+0000 7f6ea6e50640 1 -- 172.21.15.120:0/1754768694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ea015e900 con 0x7f6ea00b1130 2024-07-27T03:11:20.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.428+0000 7f6e9d7fa640 1 -- 172.21.15.120:0/1754768694 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16702 (secure 0 0 0) 0x7f6e94061f40 con 0x7f6ea00b1130 2024-07-27T03:11:20.432 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:20.432 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":56,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:11:19.459362+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:11:17.121357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-07-27T03:11:18.418999+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:11:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 -- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6e84077010 msgr2=0x7f6e84079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6e84077010 0x7f6e84079520 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00d0620 tx=0x7f6e8c005cc0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 -- 172.21.15.120:0/1754768694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea00b1130 msgr2=0x7f6ea0154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea00b1130 0x7f6ea0154db0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400c970 tx=0x7f6e9400ce30 comp rx=0 tx=0).stop 2024-07-27T03:11:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 -- 172.21.15.120:0/1754768694 shutdown_connections 2024-07-27T03:11:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6e84077010 0x7f6e84079520 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ea00d2290 0x7f6ea009e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ea00b71d0 0x7f6ea009e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 --2- 172.21.15.120:0/1754768694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ea00b1130 0x7f6ea0154db0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 -- 172.21.15.120:0/1754768694 >> 172.21.15.120:0/1754768694 conn(0x7f6ea009aa30 msgr2=0x7f6ea015e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 -- 172.21.15.120:0/1754768694 shutdown_connections 2024-07-27T03:11:20.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.430+0000 7f6ea6e50640 1 -- 172.21.15.120:0/1754768694 wait complete. 2024-07-27T03:11:20.445 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:11:20.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.556+0000 7f3f2033c640 1 -- 172.21.15.120:0/2946930653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f04004000 msgr2=0x7f3f04004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.556+0000 7f3f2033c640 1 --2- 172.21.15.120:0/2946930653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f04004000 0x7f3f04004800 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3f18070650 tx=0x7f3f04005830 comp rx=0 tx=0).stop 2024-07-27T03:11:20.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.556+0000 7f3f1e8d9640 1 -- 172.21.15.120:0/2946930653 reap_dead start 2024-07-27T03:11:20.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.556+0000 7f3f2033c640 1 -- 172.21.15.120:0/2946930653 shutdown_connections 2024-07-27T03:11:20.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.556+0000 7f3f2033c640 1 -- 172.21.15.120:0/2946930653 >> 172.21.15.120:0/2946930653 conn(0x7f3f180b1a10 msgr2=0x7f3f180b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:20.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.556+0000 7f3f2033c640 1 -- 172.21.15.120:0/2946930653 shutdown_connections 2024-07-27T03:11:20.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.556+0000 7f3f2033c640 1 -- 172.21.15.120:0/2946930653 wait complete. 2024-07-27T03:11:20.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.558+0000 7f3f2033c640 1 Processor -- start 2024-07-27T03:11:20.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.558+0000 7f3f2033c640 1 -- start start 2024-07-27T03:11:20.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.559+0000 7f3f2033c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f04004000 0x7f3f18151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.559+0000 7f3f2033c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18142fc0 0x7f3f1809ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.559+0000 7f3f2033c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181433d0 0x7f3f1809cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.559+0000 7f3f2033c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3f180b4f90 con 0x7f3f181433d0 2024-07-27T03:11:20.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.559+0000 7f3f2033c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3f180b3f90 con 0x7f3f18142fc0 2024-07-27T03:11:20.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.559+0000 7f3f2033c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f3f18143ad0 con 0x7f3f04004000 2024-07-27T03:11:20.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.559+0000 7f3f1e8d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181433d0 0x7f3f1809cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.559+0000 7f3f1e8d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181433d0 0x7f3f1809cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46320/0 (socket says 172.21.15.120:46320) 2024-07-27T03:11:20.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.559+0000 7f3f1e8d9640 1 -- 172.21.15.120:0/75750380 learned_addr learned my addr 172.21.15.120:0/75750380 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:20.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.559+0000 7f3f1e0d8640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f04004000 0x7f3f18151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.559+0000 7f3f1d8d7640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18142fc0 0x7f3f1809ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.560+0000 7f3f1e8d9640 1 -- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f04004000 msgr2=0x7f3f18151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.560+0000 7f3f1e8d9640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f04004000 0x7f3f18151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.560+0000 7f3f1e8d9640 1 -- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18142fc0 msgr2=0x7f3f1809ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.560+0000 7f3f1e8d9640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18142fc0 0x7f3f1809ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.560+0000 7f3f1e8d9640 1 -- 172.21.15.120:0/75750380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f18156920 con 0x7f3f181433d0 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.560+0000 7f3f1e8d9640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181433d0 0x7f3f1809cf70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3f18072360 tx=0x7f3f100019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.560+0000 7f3f0effd640 1 -- 172.21.15.120:0/75750380 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10011870 con 0x7f3f181433d0 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.560+0000 7f3f0effd640 1 -- 172.21.15.120:0/75750380 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f10017070 con 0x7f3f181433d0 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.560+0000 7f3f2033c640 1 -- 172.21.15.120:0/75750380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f18156c00 con 0x7f3f181433d0 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.560+0000 7f3f0effd640 1 -- 172.21.15.120:0/75750380 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10011d60 con 0x7f3f181433d0 2024-07-27T03:11:20.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.560+0000 7f3f2033c640 1 -- 172.21.15.120:0/75750380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1809d4b0 con 0x7f3f181433d0 2024-07-27T03:11:20.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.561+0000 7f3f2033c640 1 -- 172.21.15.120:0/75750380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f1809c020 con 0x7f3f181433d0 2024-07-27T03:11:20.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.562+0000 7f3f0effd640 1 -- 172.21.15.120:0/75750380 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f3f1001c460 con 0x7f3f181433d0 2024-07-27T03:11:20.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.562+0000 7f3f0effd640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3efc077040 0x7f3efc079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.562+0000 7f3f0effd640 1 -- 172.21.15.120:0/75750380 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f3f10098ea0 con 0x7f3f181433d0 2024-07-27T03:11:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.562+0000 7f3f1e0d8640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3efc077040 0x7f3efc079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.563+0000 7f3f1e0d8640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3efc077040 0x7f3efc079550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009c50 tx=0x7f3f14005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:20.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.566+0000 7f3f0effd640 1 -- 172.21.15.120:0/75750380 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f3f10062130 con 0x7f3f181433d0 2024-07-27T03:11:20.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.751+0000 7f3f2033c640 1 -- 172.21.15.120:0/75750380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f181554f0 con 0x7f3f181433d0 2024-07-27T03:11:20.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.752+0000 7f3f0effd640 1 -- 172.21.15.120:0/75750380 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16702 (secure 0 0 0) 0x7f3f1006a370 con 0x7f3f181433d0 2024-07-27T03:11:20.755 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:20.756 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":56,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:11:19.459362+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:11:17.121357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-07-27T03:11:18.418999+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 -- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3efc077040 msgr2=0x7f3efc079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3efc077040 0x7f3efc079550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009c50 tx=0x7f3f14005f90 comp rx=0 tx=0).stop 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 -- 172.21.15.120:0/75750380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181433d0 msgr2=0x7f3f1809cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181433d0 0x7f3f1809cf70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3f18072360 tx=0x7f3f100019b0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 -- 172.21.15.120:0/75750380 shutdown_connections 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3efc077040 0x7f3efc079550 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181433d0 0x7f3f1809cf70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18142fc0 0x7f3f1809ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 --2- 172.21.15.120:0/75750380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3f04004000 0x7f3f18151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 -- 172.21.15.120:0/75750380 >> 172.21.15.120:0/75750380 conn(0x7f3f180b1a10 msgr2=0x7f3f180758c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 -- 172.21.15.120:0/75750380 shutdown_connections 2024-07-27T03:11:20.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.754+0000 7f3f2033c640 1 -- 172.21.15.120:0/75750380 wait complete. 2024-07-27T03:11:20.769 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-07-27T03:11:20.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.883+0000 7fb3d9b96640 1 -- 172.21.15.120:0/3630811029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3c0003a50 msgr2=0x7fb3c0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.883+0000 7fb3d9b96640 1 --2- 172.21.15.120:0/3630811029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3c0003a50 0x7fb3c0003ec0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009b40 tx=0x7fb3c0005830 comp rx=0 tx=0).stop 2024-07-27T03:11:20.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.883+0000 7fb3d3fff640 1 -- 172.21.15.120:0/3630811029 reap_dead start 2024-07-27T03:11:20.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.883+0000 7fb3d9b96640 1 -- 172.21.15.120:0/3630811029 shutdown_connections 2024-07-27T03:11:20.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.883+0000 7fb3d9b96640 1 -- 172.21.15.120:0/3630811029 >> 172.21.15.120:0/3630811029 conn(0x7fb3d40b2ca0 msgr2=0x7fb3d40b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:20.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.883+0000 7fb3d9b96640 1 -- 172.21.15.120:0/3630811029 shutdown_connections 2024-07-27T03:11:20.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.883+0000 7fb3d9b96640 1 -- 172.21.15.120:0/3630811029 wait complete. 2024-07-27T03:11:20.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.884+0000 7fb3d9b96640 1 Processor -- start 2024-07-27T03:11:20.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.885+0000 7fb3d9b96640 1 -- start start 2024-07-27T03:11:20.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d9b96640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3c0003a50 0x7fb3d41440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d9b96640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d40b40b0 0x7fb3d40b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d9b96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3d40b4a00 0x7fb3d414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d9b96640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d40d0270 con 0x7fb3d40b40b0 2024-07-27T03:11:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d9b96640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d40d00f0 con 0x7fb3d40b4a00 2024-07-27T03:11:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d9b96640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d415f450 con 0x7fb3c0003a50 2024-07-27T03:11:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d40b40b0 0x7fb3d40b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d40b40b0 0x7fb3d40b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46336/0 (socket says 172.21.15.120:46336) 2024-07-27T03:11:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d2ffd640 1 -- 172.21.15.120:0/2330377512 learned_addr learned my addr 172.21.15.120:0/2330377512 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d3fff640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3d40b4a00 0x7fb3d414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d37fe640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3c0003a50 0x7fb3d41440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d2ffd640 1 -- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3c0003a50 msgr2=0x7fb3d41440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d2ffd640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3c0003a50 0x7fb3d41440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d2ffd640 1 -- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3d40b4a00 msgr2=0x7fb3d414dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d2ffd640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3d40b4a00 0x7fb3d414dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d2ffd640 1 -- 172.21.15.120:0/2330377512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d4144610 con 0x7fb3d40b40b0 2024-07-27T03:11:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.886+0000 7fb3d2ffd640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d40b40b0 0x7fb3d40b44c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc006600 tx=0x7fb3bc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.887+0000 7fb3cbfff640 1 -- 172.21.15.120:0/2330377512 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc015070 con 0x7fb3d40b40b0 2024-07-27T03:11:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.887+0000 7fb3cbfff640 1 -- 172.21.15.120:0/2330377512 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3bc011840 con 0x7fb3d40b40b0 2024-07-27T03:11:20.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.887+0000 7fb3d9b96640 1 -- 172.21.15.120:0/2330377512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d40b6540 con 0x7fb3d40b40b0 2024-07-27T03:11:20.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.887+0000 7fb3cbfff640 1 -- 172.21.15.120:0/2330377512 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc011c70 con 0x7fb3d40b40b0 2024-07-27T03:11:20.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.887+0000 7fb3d9b96640 1 -- 172.21.15.120:0/2330377512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d414b8b0 con 0x7fb3d40b40b0 2024-07-27T03:11:20.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.888+0000 7fb3d9b96640 1 -- 172.21.15.120:0/2330377512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d4073560 con 0x7fb3d40b40b0 2024-07-27T03:11:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.888+0000 7fb3cbfff640 1 -- 172.21.15.120:0/2330377512 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb3bc018070 con 0x7fb3d40b40b0 2024-07-27T03:11:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.889+0000 7fb3cbfff640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b4077010 0x7fb3b4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.889+0000 7fb3cbfff640 1 -- 172.21.15.120:0/2330377512 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7fb3bc099390 con 0x7fb3d40b40b0 2024-07-27T03:11:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.889+0000 7fb3d37fe640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b4077010 0x7fb3b4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:20.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.890+0000 7fb3d37fe640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b4077010 0x7fb3b4079520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4035000 tx=0x7fb3c402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:20.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:20.893+0000 7fb3cbfff640 1 -- 172.21.15.120:0/2330377512 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb3d415b640 con 0x7fb3d40b40b0 2024-07-27T03:11:21.051 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-07-27T03:11:21.047+0000 7f2a0b6d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-27T03:11:21.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:21.115+0000 7fb3d9b96640 1 -- 172.21.15.120:0/2330377512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb3d40b4e50 con 0x7fb3d40b40b0 2024-07-27T03:11:22.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.108+0000 7fb3cbfff640 1 -- 172.21.15.120:0/2330377512 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) ==== 118+0+0 (secure 0 0 0) 0x7fb3bc061fd0 con 0x7fb3d40b40b0 2024-07-27T03:11:22.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 -- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b4077010 msgr2=0x7fb3b4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:22.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b4077010 0x7fb3b4079520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4035000 tx=0x7fb3c402d040 comp rx=0 tx=0).stop 2024-07-27T03:11:22.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 -- 172.21.15.120:0/2330377512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d40b40b0 msgr2=0x7fb3d40b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:22.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d40b40b0 0x7fb3d40b44c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc006600 tx=0x7fb3bc0039c0 comp rx=0 tx=0).stop 2024-07-27T03:11:22.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 -- 172.21.15.120:0/2330377512 shutdown_connections 2024-07-27T03:11:22.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b4077010 0x7fb3b4079520 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:22.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d40b40b0 0x7fb3d40b44c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:22.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3d40b4a00 0x7fb3d414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:22.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 --2- 172.21.15.120:0/2330377512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3c0003a50 0x7fb3d41440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:22.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 -- 172.21.15.120:0/2330377512 >> 172.21.15.120:0/2330377512 conn(0x7fb3d40b2ca0 msgr2=0x7fb3d40cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:22.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 -- 172.21.15.120:0/2330377512 shutdown_connections 2024-07-27T03:11:22.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.111+0000 7fb3d9b96640 1 -- 172.21.15.120:0/2330377512 wait complete. 2024-07-27T03:11:22.129 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-07-27T03:11:22.129 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-07-27T03:11:22.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.248+0000 7fd737629640 1 -- 172.21.15.120:0/1394827407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7300b75b0 msgr2=0x7fd7300d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:22.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.248+0000 7fd737629640 1 --2- 172.21.15.120:0/1394827407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7300b75b0 0x7fd7300d0790 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009830 tx=0x7fd72c02a480 comp rx=0 tx=0).stop 2024-07-27T03:11:22.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.248+0000 7fd737629640 1 -- 172.21.15.120:0/1394827407 shutdown_connections 2024-07-27T03:11:22.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.248+0000 7fd737629640 1 --2- 172.21.15.120:0/1394827407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7300b75b0 0x7fd7300d0790 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:22.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.248+0000 7fd737629640 1 -- 172.21.15.120:0/1394827407 >> 172.21.15.120:0/1394827407 conn(0x7fd7300d1dd0 msgr2=0x7fd7300d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:22.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.248+0000 7fd737629640 1 -- 172.21.15.120:0/1394827407 shutdown_connections 2024-07-27T03:11:22.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.248+0000 7fd737629640 1 -- 172.21.15.120:0/1394827407 wait complete. 2024-07-27T03:11:22.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.250+0000 7fd737629640 1 Processor -- start 2024-07-27T03:11:22.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.250+0000 7fd737629640 1 -- start start 2024-07-27T03:11:22.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.251+0000 7fd737629640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7300b75b0 0x7fd7301665b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:22.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.251+0000 7fd737629640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd7300cd940 0x7fd7300b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:22.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.251+0000 7fd737629640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7300d28f0 0x7fd7300b6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.251+0000 7fd737629640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd730167ab0 con 0x7fd7300d28f0 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.251+0000 7fd737629640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd7300b1fc0 con 0x7fd7300b75b0 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.251+0000 7fd737629640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd730167c30 con 0x7fd7300cd940 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd735bc6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7300d28f0 0x7fd7300b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd735bc6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7300d28f0 0x7fd7300b6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50982/0 (socket says 172.21.15.120:50982) 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd735bc6640 1 -- 172.21.15.120:0/1587131759 learned_addr learned my addr 172.21.15.120:0/1587131759 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd7353c5640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7300b75b0 0x7fd7301665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd734bc4640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd7300cd940 0x7fd7300b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd735bc6640 1 -- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd7300cd940 msgr2=0x7fd7300b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd735bc6640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd7300cd940 0x7fd7300b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd735bc6640 1 -- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7300b75b0 msgr2=0x7fd7301665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:22.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd735bc6640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7300b75b0 0x7fd7301665b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd735bc6640 1 -- 172.21.15.120:0/1587131759 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7301f8ff0 con 0x7fd7300d28f0 2024-07-27T03:11:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd7353c5640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7300b75b0 0x7fd7301665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd735bc6640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7300d28f0 0x7fd7300b6650 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd72800c760 tx=0x7fd72800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd725ffb640 1 -- 172.21.15.120:0/1587131759 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728003b70 con 0x7fd7300d28f0 2024-07-27T03:11:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd725ffb640 1 -- 172.21.15.120:0/1587131759 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd728003d30 con 0x7fd7300d28f0 2024-07-27T03:11:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd737629640 1 -- 172.21.15.120:0/1587131759 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7301f92d0 con 0x7fd7300d28f0 2024-07-27T03:11:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.252+0000 7fd725ffb640 1 -- 172.21.15.120:0/1587131759 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7280052d0 con 0x7fd7300d28f0 2024-07-27T03:11:22.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.253+0000 7fd737629640 1 -- 172.21.15.120:0/1587131759 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7301f9890 con 0x7fd7300d28f0 2024-07-27T03:11:22.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.253+0000 7fd737629640 1 -- 172.21.15.120:0/1587131759 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7300cb150 con 0x7fd7300d28f0 2024-07-27T03:11:22.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.254+0000 7fd725ffb640 1 -- 172.21.15.120:0/1587131759 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd728005470 con 0x7fd7300d28f0 2024-07-27T03:11:22.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.255+0000 7fd725ffb640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd714077040 0x7fd714079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:22.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.255+0000 7fd725ffb640 1 -- 172.21.15.120:0/1587131759 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd7280986a0 con 0x7fd7300d28f0 2024-07-27T03:11:22.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.255+0000 7fd7353c5640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd714077040 0x7fd714079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:22.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.256+0000 7fd7353c5640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd714077040 0x7fd714079550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd72c034000 tx=0x7fd72c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:22.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.259+0000 7fd725ffb640 1 -- 172.21.15.120:0/1587131759 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd728061930 con 0x7fd7300d28f0 2024-07-27T03:11:22.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:22.477+0000 7fd737629640 1 -- 172.21.15.120:0/1587131759 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd7300d0790 con 0x7fd7300d28f0 2024-07-27T03:11:23.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.113+0000 7fd725ffb640 1 -- 172.21.15.120:0/1587131759 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v50) ==== 122+0+0 (secure 0 0 0) 0x7fd728061230 con 0x7fd7300d28f0 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 -- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd714077040 msgr2=0x7fd714079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd714077040 0x7fd714079550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd72c034000 tx=0x7fd72c004730 comp rx=0 tx=0).stop 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 -- 172.21.15.120:0/1587131759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7300d28f0 msgr2=0x7fd7300b6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7300d28f0 0x7fd7300b6650 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd72800c760 tx=0x7fd72800cc20 comp rx=0 tx=0).stop 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 -- 172.21.15.120:0/1587131759 shutdown_connections 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd714077040 0x7fd714079550 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7300d28f0 0x7fd7300b6650 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd7300cd940 0x7fd7300b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 --2- 172.21.15.120:0/1587131759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7300b75b0 0x7fd7301665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 -- 172.21.15.120:0/1587131759 >> 172.21.15.120:0/1587131759 conn(0x7fd7300d1dd0 msgr2=0x7fd7300ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 -- 172.21.15.120:0/1587131759 shutdown_connections 2024-07-27T03:11:23.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.116+0000 7fd737629640 1 -- 172.21.15.120:0/1587131759 wait complete. 2024-07-27T03:11:23.133 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-07-27T03:11:23.134 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:11:23.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.249+0000 7fdda4c43640 1 -- 172.21.15.120:0/1641601093 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd8c004080 msgr2=0x7fdd8c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.249+0000 7fdda4c43640 1 --2- 172.21.15.120:0/1641601093 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd8c004080 0x7fdd8c004800 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800bb20 tx=0x7fdd8c005830 comp rx=0 tx=0).stop 2024-07-27T03:11:23.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.249+0000 7fdd9ed9d640 1 -- 172.21.15.120:0/1641601093 reap_dead start 2024-07-27T03:11:23.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.249+0000 7fdda4c43640 1 -- 172.21.15.120:0/1641601093 shutdown_connections 2024-07-27T03:11:23.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.249+0000 7fdda4c43640 1 -- 172.21.15.120:0/1641601093 >> 172.21.15.120:0/1641601093 conn(0x7fdda00d0f00 msgr2=0x7fdda00d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:23.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.249+0000 7fdda4c43640 1 -- 172.21.15.120:0/1641601093 shutdown_connections 2024-07-27T03:11:23.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.249+0000 7fdda4c43640 1 -- 172.21.15.120:0/1641601093 wait complete. 2024-07-27T03:11:23.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.251+0000 7fdda4c43640 1 Processor -- start 2024-07-27T03:11:23.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.252+0000 7fdda4c43640 1 -- start start 2024-07-27T03:11:23.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdda4c43640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c004080 0x7fdda01f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdda4c43640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdda00b20b0 0x7fdda01f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdda4c43640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdda01f2e00 0x7fdda01f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdda4c43640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdda00cfee0 con 0x7fdda01f2e00 2024-07-27T03:11:23.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdda4c43640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdda00cfd60 con 0x7fdd8c004080 2024-07-27T03:11:23.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdda4c43640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fdda00d0060 con 0x7fdda00b20b0 2024-07-27T03:11:23.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdd9ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdda01f2e00 0x7fdda01f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdd9ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdda01f2e00 0x7fdda01f3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51006/0 (socket says 172.21.15.120:51006) 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdd9ed9d640 1 -- 172.21.15.120:0/550468990 learned_addr learned my addr 172.21.15.120:0/550468990 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdd9e59c640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c004080 0x7fdda01f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdd95d9b640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdda00b20b0 0x7fdda01f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdd9ed9d640 1 -- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdda00b20b0 msgr2=0x7fdda01f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdd9ed9d640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdda00b20b0 0x7fdda01f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdd9ed9d640 1 -- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c004080 msgr2=0x7fdda01f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdd9ed9d640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c004080 0x7fdda01f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdd9ed9d640 1 -- 172.21.15.120:0/550468990 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda00b1610 con 0x7fdda01f2e00 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.253+0000 7fdd9ed9d640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdda01f2e00 0x7fdda01f3210 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdd98006fd0 tx=0x7fdd98006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.254+0000 7fdd977fe640 1 -- 172.21.15.120:0/550468990 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9800fc90 con 0x7fdda01f2e00 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.254+0000 7fdd977fe640 1 -- 172.21.15.120:0/550468990 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd98018070 con 0x7fdda01f2e00 2024-07-27T03:11:23.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.254+0000 7fdda4c43640 1 -- 172.21.15.120:0/550468990 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda00af660 con 0x7fdda01f2e00 2024-07-27T03:11:23.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.254+0000 7fdd977fe640 1 -- 172.21.15.120:0/550468990 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98011690 con 0x7fdda01f2e00 2024-07-27T03:11:23.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.254+0000 7fdda4c43640 1 -- 172.21.15.120:0/550468990 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda00b1b90 con 0x7fdda01f2e00 2024-07-27T03:11:23.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.255+0000 7fdda4c43640 1 -- 172.21.15.120:0/550468990 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda00b1440 con 0x7fdda01f2e00 2024-07-27T03:11:23.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.255+0000 7fdd977fe640 1 -- 172.21.15.120:0/550468990 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fdd98011830 con 0x7fdda01f2e00 2024-07-27T03:11:23.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.256+0000 7fdd977fe640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd80077040 0x7fdd80079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.256+0000 7fdd977fe640 1 -- 172.21.15.120:0/550468990 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fdd98098fa0 con 0x7fdda01f2e00 2024-07-27T03:11:23.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.256+0000 7fdd9e59c640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd80077040 0x7fdd80079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.257+0000 7fdd9e59c640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd80077040 0x7fdd80079550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdd90003700 tx=0x7fdd9000b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:23.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.260+0000 7fdd977fe640 1 -- 172.21.15.120:0/550468990 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fdd98061be0 con 0x7fdda01f2e00 2024-07-27T03:11:23.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.481+0000 7fdda4c43640 1 -- 172.21.15.120:0/550468990 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdda00745a0 con 0x7fdda01f2e00 2024-07-27T03:11:23.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.482+0000 7fdd977fe640 1 -- 172.21.15.120:0/550468990 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5235 (secure 0 0 0) 0x7fdd98066130 con 0x7fdda01f2e00 2024-07-27T03:11:23.485 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:23.485 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":50,"btime":"2024-07-27T03:11:23:110568+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/3598257167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3598257167},{"type":"v1","addr":"172.21.15.121:6836","nonce":3598257167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5458,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/2987877930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2987877930},{"type":"v1","addr":"172.21.15.120:6834","nonce":2987877930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1057652547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1057652547},{"type":"v1","addr":"172.21.15.121:6837","nonce":1057652547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:11:19.459319+0000","modified":"2024-07-27T03:11:22.479244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/3550669358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":3550669358},{"type":"v1","addr":"172.21.15.120:6835","nonce":3550669358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5733,"qdb_cluster":[5733]},"id":4}]} 2024-07-27T03:11:23.486 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 50 2024-07-27T03:11:23.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 -- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd80077040 msgr2=0x7fdd80079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd80077040 0x7fdd80079550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdd90003700 tx=0x7fdd9000b260 comp rx=0 tx=0).stop 2024-07-27T03:11:23.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 -- 172.21.15.120:0/550468990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdda01f2e00 msgr2=0x7fdda01f3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdda01f2e00 0x7fdda01f3210 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdd98006fd0 tx=0x7fdd98006720 comp rx=0 tx=0).stop 2024-07-27T03:11:23.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 -- 172.21.15.120:0/550468990 shutdown_connections 2024-07-27T03:11:23.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdd80077040 0x7fdd80079550 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdda01f2e00 0x7fdda01f3210 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdda00b20b0 0x7fdda01f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 --2- 172.21.15.120:0/550468990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c004080 0x7fdda01f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 -- 172.21.15.120:0/550468990 >> 172.21.15.120:0/550468990 conn(0x7fdda00d0f00 msgr2=0x7fdda0144960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:23.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 -- 172.21.15.120:0/550468990 shutdown_connections 2024-07-27T03:11:23.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.484+0000 7fdda4c43640 1 -- 172.21.15.120:0/550468990 wait complete. 2024-07-27T03:11:23.500 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:11:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.610+0000 7fcb22691640 1 -- 172.21.15.120:0/3365103889 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0d09c0 msgr2=0x7fcb1c0d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.610+0000 7fcb22691640 1 --2- 172.21.15.120:0/3365103889 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0d09c0 0x7fcb1c0d0dd0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0b3b30 tx=0x7fcb1402aa30 comp rx=0 tx=0).stop 2024-07-27T03:11:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.610+0000 7fcb22691640 1 -- 172.21.15.120:0/3365103889 shutdown_connections 2024-07-27T03:11:23.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.610+0000 7fcb22691640 1 --2- 172.21.15.120:0/3365103889 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0d09c0 0x7fcb1c0d0dd0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.610+0000 7fcb22691640 1 --2- 172.21.15.120:0/3365103889 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb1c0d27e0 0x7fcb1c0d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.610+0000 7fcb22691640 1 --2- 172.21.15.120:0/3365103889 >> v2:172.21.15.121:3300/0 conn(0x7fcb1c0b4740 0x7fcb1c0b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.610+0000 7fcb22691640 1 -- 172.21.15.120:0/3365103889 >> 172.21.15.120:0/3365103889 conn(0x7fcb1c08d690 msgr2=0x7fcb1c09d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.610+0000 7fcb22691640 1 -- 172.21.15.120:0/3365103889 shutdown_connections 2024-07-27T03:11:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.610+0000 7fcb22691640 1 -- 172.21.15.120:0/3365103889 wait complete. 2024-07-27T03:11:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.612+0000 7fcb22691640 1 Processor -- start 2024-07-27T03:11:23.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.612+0000 7fcb22691640 1 -- start start 2024-07-27T03:11:23.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.613+0000 7fcb22691640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0b4740 0x7fcb1c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.613+0000 7fcb22691640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb1c0d09c0 0x7fcb1c0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.613+0000 7fcb22691640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb1c0d27e0 0x7fcb1c0b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.613+0000 7fcb22691640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c0ced60 con 0x7fcb1c0b4740 2024-07-27T03:11:23.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.613+0000 7fcb22691640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c0cebe0 con 0x7fcb1c0d27e0 2024-07-27T03:11:23.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.613+0000 7fcb22691640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fcb1c0ceee0 con 0x7fcb1c0d09c0 2024-07-27T03:11:23.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0b4740 0x7fcb1c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0b4740 0x7fcb1c14d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51034/0 (socket says 172.21.15.120:51034) 2024-07-27T03:11:23.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb1bfff640 1 -- 172.21.15.120:0/1479895023 learned_addr learned my addr 172.21.15.120:0/1479895023 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:23.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb1b7fe640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb1c0d09c0 0x7fcb1c0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb20c2e640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb1c0d27e0 0x7fcb1c0b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb1bfff640 1 -- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb1c0d09c0 msgr2=0x7fcb1c0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb1bfff640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb1c0d09c0 0x7fcb1c0b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb1bfff640 1 -- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb1c0d27e0 msgr2=0x7fcb1c0b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb1bfff640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb1c0d27e0 0x7fcb1c0b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb1bfff640 1 -- 172.21.15.120:0/1479895023 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c150f60 con 0x7fcb1c0b4740 2024-07-27T03:11:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb1bfff640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0b4740 0x7fcb1c14d8a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00d750 tx=0x7fcb0c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb18ff9640 1 -- 172.21.15.120:0/1479895023 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c017070 con 0x7fcb1c0b4740 2024-07-27T03:11:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb18ff9640 1 -- 172.21.15.120:0/1479895023 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb0c009cc0 con 0x7fcb1c0b4740 2024-07-27T03:11:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb22691640 1 -- 172.21.15.120:0/1479895023 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1c0b0d30 con 0x7fcb1c0b4740 2024-07-27T03:11:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb18ff9640 1 -- 172.21.15.120:0/1479895023 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0106c0 con 0x7fcb1c0b4740 2024-07-27T03:11:23.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.614+0000 7fcb22691640 1 -- 172.21.15.120:0/1479895023 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb1c14dde0 con 0x7fcb1c0b4740 2024-07-27T03:11:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.615+0000 7fcb22691640 1 -- 172.21.15.120:0/1479895023 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb1c0b0b20 con 0x7fcb1c0b4740 2024-07-27T03:11:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.616+0000 7fcb18ff9640 1 -- 172.21.15.120:0/1479895023 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fcb0c01a070 con 0x7fcb1c0b4740 2024-07-27T03:11:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.617+0000 7fcb18ff9640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcb08077010 0x7fcb08079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.617+0000 7fcb18ff9640 1 -- 172.21.15.120:0/1479895023 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fcb0c0988d0 con 0x7fcb1c0b4740 2024-07-27T03:11:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.617+0000 7fcb1b7fe640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcb08077010 0x7fcb08079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.617+0000 7fcb1b7fe640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcb08077010 0x7fcb08079520 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c06d420 tx=0x7fcb1000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:23.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.621+0000 7fcb18ff9640 1 -- 172.21.15.120:0/1479895023 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fcb0c00de60 con 0x7fcb1c0b4740 2024-07-27T03:11:23.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.805+0000 7fcb22691640 1 -- 172.21.15.120:0/1479895023 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb1c0cf400 con 0x7fcb1c0b4740 2024-07-27T03:11:23.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.806+0000 7fcb18ff9640 1 -- 172.21.15.120:0/1479895023 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16689 (secure 0 0 0) 0x7fcb0c061480 con 0x7fcb1c0b4740 2024-07-27T03:11:23.809 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:23.810 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":57,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:11:21.094416+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:11:17.121357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-07-27T03:11:18.418999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:11:23.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 -- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcb08077010 msgr2=0x7fcb08079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcb08077010 0x7fcb08079520 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c06d420 tx=0x7fcb1000b2e0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 -- 172.21.15.120:0/1479895023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0b4740 msgr2=0x7fcb1c14d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0b4740 0x7fcb1c14d8a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00d750 tx=0x7fcb0c00dc10 comp rx=0 tx=0).stop 2024-07-27T03:11:23.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 -- 172.21.15.120:0/1479895023 shutdown_connections 2024-07-27T03:11:23.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcb08077010 0x7fcb08079520 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb1c0d27e0 0x7fcb1c0b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb1c0d09c0 0x7fcb1c0b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 --2- 172.21.15.120:0/1479895023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0b4740 0x7fcb1c14d8a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 -- 172.21.15.120:0/1479895023 >> 172.21.15.120:0/1479895023 conn(0x7fcb1c08d690 msgr2=0x7fcb1c0b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:23.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 -- 172.21.15.120:0/1479895023 shutdown_connections 2024-07-27T03:11:23.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.808+0000 7fcb22691640 1 -- 172.21.15.120:0/1479895023 wait complete. 2024-07-27T03:11:23.823 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-27T03:11:23.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:11:23.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.935+0000 7f5206396640 1 -- 172.21.15.120:0/3158022314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51e8003fd0 msgr2=0x7f51e8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.935+0000 7f5206396640 1 --2- 172.21.15.120:0/3158022314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51e8003fd0 0x7f51e8004800 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f52000b4d10 tx=0x7f51e8005830 comp rx=0 tx=0).stop 2024-07-27T03:11:23.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.935+0000 7f5204933640 1 -- 172.21.15.120:0/3158022314 reap_dead start 2024-07-27T03:11:23.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.935+0000 7f5206396640 1 -- 172.21.15.120:0/3158022314 shutdown_connections 2024-07-27T03:11:23.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.935+0000 7f5206396640 1 -- 172.21.15.120:0/3158022314 >> 172.21.15.120:0/3158022314 conn(0x7f52000b1a10 msgr2=0x7f52000b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:23.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.935+0000 7f5206396640 1 -- 172.21.15.120:0/3158022314 shutdown_connections 2024-07-27T03:11:23.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.935+0000 7f5206396640 1 -- 172.21.15.120:0/3158022314 wait complete. 2024-07-27T03:11:23.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.937+0000 7f5206396640 1 Processor -- start 2024-07-27T03:11:23.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.937+0000 7f5206396640 1 -- start start 2024-07-27T03:11:23.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.938+0000 7f5206396640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51e8003fd0 0x7f520009d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.938+0000 7f5206396640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f52001f4b00 0x7f52000ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.938+0000 7f5206396640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52001567e0 0x7f5200156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.938+0000 7f5206396640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f520006f090 con 0x7f52001567e0 2024-07-27T03:11:23.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.938+0000 7f5206396640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f520006ef10 con 0x7f51e8003fd0 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.938+0000 7f5206396640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f520006f210 con 0x7f52001f4b00 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.938+0000 7f5204933640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52001567e0 0x7f5200156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.938+0000 7f5204933640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52001567e0 0x7f5200156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51056/0 (socket says 172.21.15.120:51056) 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.938+0000 7f5204933640 1 -- 172.21.15.120:0/1674687506 learned_addr learned my addr 172.21.15.120:0/1674687506 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.938+0000 7f51fffff640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51e8003fd0 0x7f520009d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.938+0000 7f51ff7fe640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f52001f4b00 0x7f52000ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f5204933640 1 -- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f52001f4b00 msgr2=0x7f52000ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f5204933640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f52001f4b00 0x7f52000ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f5204933640 1 -- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51e8003fd0 msgr2=0x7f520009d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f5204933640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51e8003fd0 0x7f520009d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f5204933640 1 -- 172.21.15.120:0/1674687506 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5200157130 con 0x7f52001567e0 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f51fffff640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51e8003fd0 0x7f520009d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f51ff7fe640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f52001f4b00 0x7f52000ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:23.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f5204933640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52001567e0 0x7f5200156bf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f52000703e0 tx=0x7f51f8010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:23.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f51fcff9640 1 -- 172.21.15.120:0/1674687506 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f800ed90 con 0x7f52001567e0 2024-07-27T03:11:23.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f51fcff9640 1 -- 172.21.15.120:0/1674687506 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51f8015070 con 0x7f52001567e0 2024-07-27T03:11:23.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f51fcff9640 1 -- 172.21.15.120:0/1674687506 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8003bb0 con 0x7f52001567e0 2024-07-27T03:11:23.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f5206396640 1 -- 172.21.15.120:0/1674687506 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52001f5030 con 0x7f52001567e0 2024-07-27T03:11:23.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.939+0000 7f5206396640 1 -- 172.21.15.120:0/1674687506 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52000cc8c0 con 0x7f52001567e0 2024-07-27T03:11:23.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.940+0000 7f5206396640 1 -- 172.21.15.120:0/1674687506 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f520006e5f0 con 0x7f52001567e0 2024-07-27T03:11:23.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.941+0000 7f51fcff9640 1 -- 172.21.15.120:0/1674687506 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f51f8004030 con 0x7f52001567e0 2024-07-27T03:11:23.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.941+0000 7f51fcff9640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f51ec077010 0x7f51ec079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:23.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.941+0000 7f51fcff9640 1 -- 172.21.15.120:0/1674687506 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f51f8099040 con 0x7f52001567e0 2024-07-27T03:11:23.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.941+0000 7f51fffff640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f51ec077010 0x7f51ec079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:23.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.942+0000 7f51fffff640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f51ec077010 0x7f51ec079520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f520009e0b0 tx=0x7f51f0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:23.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:23.945+0000 7f51fcff9640 1 -- 172.21.15.120:0/1674687506 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5200157130 con 0x7f52001567e0 2024-07-27T03:11:24.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.129+0000 7f5206396640 1 -- 172.21.15.120:0/1674687506 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52000b1ec0 con 0x7f51ec077010 2024-07-27T03:11:24.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.133+0000 7f51fcff9640 1 -- 172.21.15.120:0/1674687506 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238792 (secure 0 0 0) 0x7f52000b1ec0 con 0x7f51ec077010 2024-07-27T03:11:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:24.141 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:11:24.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.136+0000 7f5206396640 1 -- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f51ec077010 msgr2=0x7f51ec079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.136+0000 7f5206396640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f51ec077010 0x7f51ec079520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f520009e0b0 tx=0x7f51f0005f90 comp rx=0 tx=0).stop 2024-07-27T03:11:24.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.136+0000 7f5206396640 1 -- 172.21.15.120:0/1674687506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52001567e0 msgr2=0x7f5200156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.136+0000 7f5206396640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52001567e0 0x7f5200156bf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f52000703e0 tx=0x7f51f8010e50 comp rx=0 tx=0).stop 2024-07-27T03:11:24.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.136+0000 7f5206396640 1 -- 172.21.15.120:0/1674687506 shutdown_connections 2024-07-27T03:11:24.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.136+0000 7f5206396640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f51ec077010 0x7f51ec079520 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.136+0000 7f5206396640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52001567e0 0x7f5200156bf0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.136+0000 7f5206396640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f52001f4b00 0x7f52000ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.136+0000 7f5206396640 1 --2- 172.21.15.120:0/1674687506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51e8003fd0 0x7f520009d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.136+0000 7f5206396640 1 -- 172.21.15.120:0/1674687506 >> 172.21.15.120:0/1674687506 conn(0x7f52000b1a10 msgr2=0x7f52000723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:24.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.137+0000 7f5206396640 1 -- 172.21.15.120:0/1674687506 shutdown_connections 2024-07-27T03:11:24.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.137+0000 7f5206396640 1 -- 172.21.15.120:0/1674687506 wait complete. 2024-07-27T03:11:24.151 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-07-27T03:11:22.574827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":44,"acting":44,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":263900,"kb_used_data":6092,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754710820,"statfs":{"total":773094113280,"available":772823879680,"internally_reserved":0,"allocated":6238208,"data_stored":3245075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.498467"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.082121+0000","last_change":"2024-07-27T03:11:18.082121+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.082121+0000","last_undegraded":"2024-07-27T03:11:18.082121+0000","last_fullsized":"2024-07-27T03:11:18.082121+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081812+0000","last_change":"2024-07-27T03:11:18.081812+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081812+0000","last_undegraded":"2024-07-27T03:11:18.081812+0000","last_fullsized":"2024-07-27T03:11:18.081812+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081669+0000","last_change":"2024-07-27T03:11:18.081669+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081669+0000","last_undegraded":"2024-07-27T03:11:18.081669+0000","last_fullsized":"2024-07-27T03:11:18.081669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.079511+0000","last_change":"2024-07-27T03:11:18.079511+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.079511+0000","last_undegraded":"2024-07-27T03:11:18.079511+0000","last_fullsized":"2024-07-27T03:11:18.079511+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081399+0000","last_change":"2024-07-27T03:11:18.081399+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081399+0000","last_undegraded":"2024-07-27T03:11:18.081399+0000","last_fullsized":"2024-07-27T03:11:18.081399+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.079171+0000","last_change":"2024-07-27T03:11:18.079171+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.079171+0000","last_undegraded":"2024-07-27T03:11:18.079171+0000","last_fullsized":"2024-07-27T03:11:18.079171+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081886+0000","last_change":"2024-07-27T03:11:18.081886+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081886+0000","last_undegraded":"2024-07-27T03:11:18.081886+0000","last_fullsized":"2024-07-27T03:11:18.081886+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.080626+0000","last_change":"2024-07-27T03:11:18.080626+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.080626+0000","last_undegraded":"2024-07-27T03:11:18.080626+0000","last_fullsized":"2024-07-27T03:11:18.080626+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081993+0000","last_change":"2024-07-27T03:11:18.081993+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081993+0000","last_undegraded":"2024-07-27T03:11:18.081993+0000","last_fullsized":"2024-07-27T03:11:18.081993+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081455+0000","last_change":"2024-07-27T03:11:18.081455+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081455+0000","last_undegraded":"2024-07-27T03:11:18.081455+0000","last_fullsized":"2024-07-27T03:11:18.081455+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.078535+0000","last_change":"2024-07-27T03:11:18.078535+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.078535+0000","last_undegraded":"2024-07-27T03:11:18.078535+0000","last_fullsized":"2024-07-27T03:11:18.078535+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081886+0000","last_change":"2024-07-27T03:11:18.081886+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081886+0000","last_undegraded":"2024-07-27T03:11:18.081886+0000","last_fullsized":"2024-07-27T03:11:18.081886+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081031+0000","last_change":"2024-07-27T03:11:18.081031+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081031+0000","last_undegraded":"2024-07-27T03:11:18.081031+0000","last_fullsized":"2024-07-27T03:11:18.081031+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.082793+0000","last_change":"2024-07-27T03:11:18.082793+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.082793+0000","last_undegraded":"2024-07-27T03:11:18.082793+0000","last_fullsized":"2024-07-27T03:11:18.082793+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.078750+0000","last_change":"2024-07-27T03:11:18.078750+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.078750+0000","last_undegraded":"2024-07-27T03:11:18.078750+0000","last_fullsized":"2024-07-27T03:11:18.078750+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081593+0000","last_change":"2024-07-27T03:11:18.081593+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081593+0000","last_undegraded":"2024-07-27T03:11:18.081593+0000","last_fullsized":"2024-07-27T03:11:18.081593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.080899+0000","last_change":"2024-07-27T03:11:18.080899+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.080899+0000","last_undegraded":"2024-07-27T03:11:18.080899+0000","last_fullsized":"2024-07-27T03:11:18.080899+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.079038+0000","last_change":"2024-07-27T03:11:18.079038+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.079038+0000","last_undegraded":"2024-07-27T03:11:18.079038+0000","last_fullsized":"2024-07-27T03:11:18.079038+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081822+0000","last_change":"2024-07-27T03:11:18.081822+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081822+0000","last_undegraded":"2024-07-27T03:11:18.081822+0000","last_fullsized":"2024-07-27T03:11:18.081822+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.078579+0000","last_change":"2024-07-27T03:11:18.078579+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.078579+0000","last_undegraded":"2024-07-27T03:11:18.078579+0000","last_fullsized":"2024-07-27T03:11:18.078579+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.080723+0000","last_change":"2024-07-27T03:11:18.080723+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.080723+0000","last_undegraded":"2024-07-27T03:11:18.080723+0000","last_fullsized":"2024-07-27T03:11:18.080723+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":168,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-07-27T03:11:18.082569+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:11:18.082569+0000","last_peered":"2024-07-27T03:11:18.082569+0000","last_clean":"2024-07-27T03:11:18.082569+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:11:18.082569+0000","last_undegraded":"2024-07-27T03:11:18.082569+0000","last_fullsized":"2024-07-27T03:11:18.082569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1232896,"data_stored":852046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":626688,"data_stored":255861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35976,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335864,"statfs":{"total":96636764160,"available":96599924736,"internally_reserved":0,"allocated":638976,"data_stored":261678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31796,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":626688,"data_stored":255861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1232896,"data_stored":852046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31792,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":626688,"data_stored":255861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35964,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335876,"statfs":{"total":96636764160,"available":96599937024,"internally_reserved":0,"allocated":626688,"data_stored":255861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31792,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":626688,"data_stored":255861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:11:24.156 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:11:24.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.302+0000 7f6dc64eb640 1 -- 172.21.15.120:0/302684145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da80041c0 msgr2=0x7f6da8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.302+0000 7f6dc64eb640 1 --2- 172.21.15.120:0/302684145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6da80041c0 0x7f6da8004800 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00d3f00 tx=0x7f6da8005830 comp rx=0 tx=0).stop 2024-07-27T03:11:24.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.302+0000 7f6dc4a88640 1 -- 172.21.15.120:0/302684145 reap_dead start 2024-07-27T03:11:24.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.302+0000 7f6dc64eb640 1 -- 172.21.15.120:0/302684145 shutdown_connections 2024-07-27T03:11:24.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.302+0000 7f6dc64eb640 1 -- 172.21.15.120:0/302684145 >> 172.21.15.120:0/302684145 conn(0x7f6dc008d690 msgr2=0x7f6dc009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:24.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.302+0000 7f6dc64eb640 1 -- 172.21.15.120:0/302684145 shutdown_connections 2024-07-27T03:11:24.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.302+0000 7f6dc64eb640 1 -- 172.21.15.120:0/302684145 wait complete. 2024-07-27T03:11:24.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.304+0000 7f6dc64eb640 1 Processor -- start 2024-07-27T03:11:24.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.304+0000 7f6dc64eb640 1 -- start start 2024-07-27T03:11:24.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.305+0000 7f6dc64eb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6da80041c0 0x7f6dc01f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:24.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.305+0000 7f6dc64eb640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6dc009dc30 0x7f6dc00caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:24.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.305+0000 7f6dc64eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dc00cb530 0x7f6dc00ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:24.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.305+0000 7f6dc64eb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc00b2dc0 con 0x7f6dc00cb530 2024-07-27T03:11:24.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.305+0000 7f6dc64eb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc00b2c40 con 0x7f6da80041c0 2024-07-27T03:11:24.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.305+0000 7f6dc64eb640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc00b2f40 con 0x7f6dc009dc30 2024-07-27T03:11:24.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.305+0000 7f6dc4a88640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dc00cb530 0x7f6dc00ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:24.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.305+0000 7f6dc4a88640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dc00cb530 0x7f6dc00ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51076/0 (socket says 172.21.15.120:51076) 2024-07-27T03:11:24.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.305+0000 7f6dc4a88640 1 -- 172.21.15.120:0/2326119866 learned_addr learned my addr 172.21.15.120:0/2326119866 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:24.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.305+0000 7f6dbffff640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6da80041c0 0x7f6dc01f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:24.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.305+0000 7f6dbf7fe640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6dc009dc30 0x7f6dc00caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:24.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dc4a88640 1 -- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6dc009dc30 msgr2=0x7f6dc00caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dc4a88640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6dc009dc30 0x7f6dc00caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dc4a88640 1 -- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6da80041c0 msgr2=0x7f6dc01f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dc4a88640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6da80041c0 0x7f6dc01f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dc4a88640 1 -- 172.21.15.120:0/2326119866 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc00cbc70 con 0x7f6dc00cb530 2024-07-27T03:11:24.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dbf7fe640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6dc009dc30 0x7f6dc00caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:24.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dc4a88640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dc00cb530 0x7f6dc00ccf20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6dc008d410 tx=0x7f6db8001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:24.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dbcff9640 1 -- 172.21.15.120:0/2326119866 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8003c40 con 0x7f6dc00cb530 2024-07-27T03:11:24.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dbcff9640 1 -- 172.21.15.120:0/2326119866 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6db8004030 con 0x7f6dc00cb530 2024-07-27T03:11:24.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dc64eb640 1 -- 172.21.15.120:0/2326119866 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc00cbf50 con 0x7f6dc00cb530 2024-07-27T03:11:24.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dbcff9640 1 -- 172.21.15.120:0/2326119866 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8004480 con 0x7f6dc00cb530 2024-07-27T03:11:24.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.306+0000 7f6dc64eb640 1 -- 172.21.15.120:0/2326119866 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc01f5e60 con 0x7f6dc00cb530 2024-07-27T03:11:24.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.307+0000 7f6dc64eb640 1 -- 172.21.15.120:0/2326119866 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc00cb9e0 con 0x7f6dc00cb530 2024-07-27T03:11:24.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.308+0000 7f6dbcff9640 1 -- 172.21.15.120:0/2326119866 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6db8019020 con 0x7f6dc00cb530 2024-07-27T03:11:24.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.308+0000 7f6dbcff9640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6dac077010 0x7f6dac079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:24.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.308+0000 7f6dbcff9640 1 -- 172.21.15.120:0/2326119866 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f6db8098b30 con 0x7f6dc00cb530 2024-07-27T03:11:24.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.308+0000 7f6dbffff640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6dac077010 0x7f6dac079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:24.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.309+0000 7f6dbffff640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6dac077010 0x7f6dac079520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009af0 tx=0x7f6db0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:24.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.312+0000 7f6dbcff9640 1 -- 172.21.15.120:0/2326119866 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6db8061d30 con 0x7f6dc00cb530 2024-07-27T03:11:24.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.488+0000 7f6dc64eb640 1 -- 172.21.15.120:0/2326119866 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6dc00d2e70 con 0x7f6dac077010 2024-07-27T03:11:24.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.493+0000 7f6dbcff9640 1 -- 172.21.15.120:0/2326119866 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238792 (secure 0 0 0) 0x7f6dc00d2e70 con 0x7f6dac077010 2024-07-27T03:11:24.499 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:24.500 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:11:24.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 -- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6dac077010 msgr2=0x7f6dac079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6dac077010 0x7f6dac079520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6db0009af0 tx=0x7f6db0005f90 comp rx=0 tx=0).stop 2024-07-27T03:11:24.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 -- 172.21.15.120:0/2326119866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dc00cb530 msgr2=0x7f6dc00ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dc00cb530 0x7f6dc00ccf20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6dc008d410 tx=0x7f6db8001b80 comp rx=0 tx=0).stop 2024-07-27T03:11:24.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 -- 172.21.15.120:0/2326119866 shutdown_connections 2024-07-27T03:11:24.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6dac077010 0x7f6dac079520 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6dc00cb530 0x7f6dc00ccf20 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6dc009dc30 0x7f6dc00caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 --2- 172.21.15.120:0/2326119866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6da80041c0 0x7f6dc01f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 -- 172.21.15.120:0/2326119866 >> 172.21.15.120:0/2326119866 conn(0x7f6dc008d690 msgr2=0x7f6dc006dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:24.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 -- 172.21.15.120:0/2326119866 shutdown_connections 2024-07-27T03:11:24.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.496+0000 7f6dc64eb640 1 -- 172.21.15.120:0/2326119866 wait complete. 2024-07-27T03:11:24.511 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-07-27T03:11:22.574827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":44,"acting":44,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":263900,"kb_used_data":6092,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754710820,"statfs":{"total":773094113280,"available":772823879680,"internally_reserved":0,"allocated":6238208,"data_stored":3245075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.498467"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.082121+0000","last_change":"2024-07-27T03:11:18.082121+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.082121+0000","last_undegraded":"2024-07-27T03:11:18.082121+0000","last_fullsized":"2024-07-27T03:11:18.082121+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081812+0000","last_change":"2024-07-27T03:11:18.081812+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081812+0000","last_undegraded":"2024-07-27T03:11:18.081812+0000","last_fullsized":"2024-07-27T03:11:18.081812+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081669+0000","last_change":"2024-07-27T03:11:18.081669+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081669+0000","last_undegraded":"2024-07-27T03:11:18.081669+0000","last_fullsized":"2024-07-27T03:11:18.081669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.079511+0000","last_change":"2024-07-27T03:11:18.079511+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.079511+0000","last_undegraded":"2024-07-27T03:11:18.079511+0000","last_fullsized":"2024-07-27T03:11:18.079511+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081399+0000","last_change":"2024-07-27T03:11:18.081399+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081399+0000","last_undegraded":"2024-07-27T03:11:18.081399+0000","last_fullsized":"2024-07-27T03:11:18.081399+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.079171+0000","last_change":"2024-07-27T03:11:18.079171+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.079171+0000","last_undegraded":"2024-07-27T03:11:18.079171+0000","last_fullsized":"2024-07-27T03:11:18.079171+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081886+0000","last_change":"2024-07-27T03:11:18.081886+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081886+0000","last_undegraded":"2024-07-27T03:11:18.081886+0000","last_fullsized":"2024-07-27T03:11:18.081886+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.080626+0000","last_change":"2024-07-27T03:11:18.080626+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.080626+0000","last_undegraded":"2024-07-27T03:11:18.080626+0000","last_fullsized":"2024-07-27T03:11:18.080626+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081993+0000","last_change":"2024-07-27T03:11:18.081993+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081993+0000","last_undegraded":"2024-07-27T03:11:18.081993+0000","last_fullsized":"2024-07-27T03:11:18.081993+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081455+0000","last_change":"2024-07-27T03:11:18.081455+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081455+0000","last_undegraded":"2024-07-27T03:11:18.081455+0000","last_fullsized":"2024-07-27T03:11:18.081455+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.078535+0000","last_change":"2024-07-27T03:11:18.078535+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.078535+0000","last_undegraded":"2024-07-27T03:11:18.078535+0000","last_fullsized":"2024-07-27T03:11:18.078535+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081886+0000","last_change":"2024-07-27T03:11:18.081886+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081886+0000","last_undegraded":"2024-07-27T03:11:18.081886+0000","last_fullsized":"2024-07-27T03:11:18.081886+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081031+0000","last_change":"2024-07-27T03:11:18.081031+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081031+0000","last_undegraded":"2024-07-27T03:11:18.081031+0000","last_fullsized":"2024-07-27T03:11:18.081031+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.082793+0000","last_change":"2024-07-27T03:11:18.082793+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.082793+0000","last_undegraded":"2024-07-27T03:11:18.082793+0000","last_fullsized":"2024-07-27T03:11:18.082793+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.078750+0000","last_change":"2024-07-27T03:11:18.078750+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.078750+0000","last_undegraded":"2024-07-27T03:11:18.078750+0000","last_fullsized":"2024-07-27T03:11:18.078750+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081593+0000","last_change":"2024-07-27T03:11:18.081593+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081593+0000","last_undegraded":"2024-07-27T03:11:18.081593+0000","last_fullsized":"2024-07-27T03:11:18.081593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.080899+0000","last_change":"2024-07-27T03:11:18.080899+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.080899+0000","last_undegraded":"2024-07-27T03:11:18.080899+0000","last_fullsized":"2024-07-27T03:11:18.080899+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.079038+0000","last_change":"2024-07-27T03:11:18.079038+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.079038+0000","last_undegraded":"2024-07-27T03:11:18.079038+0000","last_fullsized":"2024-07-27T03:11:18.079038+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.081822+0000","last_change":"2024-07-27T03:11:18.081822+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.081822+0000","last_undegraded":"2024-07-27T03:11:18.081822+0000","last_fullsized":"2024-07-27T03:11:18.081822+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.078579+0000","last_change":"2024-07-27T03:11:18.078579+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.078579+0000","last_undegraded":"2024-07-27T03:11:18.078579+0000","last_fullsized":"2024-07-27T03:11:18.078579+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-07-27T03:11:18.080723+0000","last_change":"2024-07-27T03:11:18.080723+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.080723+0000","last_undegraded":"2024-07-27T03:11:18.080723+0000","last_fullsized":"2024-07-27T03:11:18.080723+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:19.075228+0000","last_change":"2024-07-27T03:11:19.075228+0000","last_active":"2024-07-27T03:11:19.075228+0000","last_peered":"2024-07-27T03:11:19.075228+0000","last_clean":"2024-07-27T03:11:19.075228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:19.075228+0000","last_undegraded":"2024-07-27T03:11:19.075228+0000","last_fullsized":"2024-07-27T03:11:19.075228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:11:18.072437+0000","last_change":"2024-07-27T03:11:18.072437+0000","last_active":"2024-07-27T03:11:18.072437+0000","last_peered":"2024-07-27T03:11:18.072437+0000","last_clean":"2024-07-27T03:11:18.072437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:11:18.072437+0000","last_undegraded":"2024-07-27T03:11:18.072437+0000","last_fullsized":"2024-07-27T03:11:18.072437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":168,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-07-27T03:11:18.082569+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:11:18.082569+0000","last_peered":"2024-07-27T03:11:18.082569+0000","last_clean":"2024-07-27T03:11:18.082569+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:11:18.082569+0000","last_undegraded":"2024-07-27T03:11:18.082569+0000","last_fullsized":"2024-07-27T03:11:18.082569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1232896,"data_stored":852046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":626688,"data_stored":255861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35976,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335864,"statfs":{"total":96636764160,"available":96599924736,"internally_reserved":0,"allocated":638976,"data_stored":261678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31796,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":626688,"data_stored":255861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1232896,"data_stored":852046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31792,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":626688,"data_stored":255861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35964,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335876,"statfs":{"total":96636764160,"available":96599937024,"internally_reserved":0,"allocated":626688,"data_stored":255861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31792,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":626688,"data_stored":255861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:11:24.517 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:11:24.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.662+0000 7fe0b70eb640 1 -- 172.21.15.120:0/784222059 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0b015f760 msgr2=0x7fe0b006e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.662+0000 7fe0b70eb640 1 --2- 172.21.15.120:0/784222059 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0b015f760 0x7fe0b006e270 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009860 tx=0x7fe0ac02a530 comp rx=0 tx=0).stop 2024-07-27T03:11:24.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.662+0000 7fe0b70eb640 1 -- 172.21.15.120:0/784222059 shutdown_connections 2024-07-27T03:11:24.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.662+0000 7fe0b70eb640 1 --2- 172.21.15.120:0/784222059 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0b015f760 0x7fe0b006e270 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.662+0000 7fe0b70eb640 1 -- 172.21.15.120:0/784222059 >> 172.21.15.120:0/784222059 conn(0x7fe0b00b1a10 msgr2=0x7fe0b00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.662+0000 7fe0b70eb640 1 -- 172.21.15.120:0/784222059 shutdown_connections 2024-07-27T03:11:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.662+0000 7fe0b70eb640 1 -- 172.21.15.120:0/784222059 wait complete. 2024-07-27T03:11:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.664+0000 7fe0b70eb640 1 Processor -- start 2024-07-27T03:11:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.664+0000 7fe0b70eb640 1 -- start start 2024-07-27T03:11:24.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.665+0000 7fe0b70eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0b00cf480 0x7fe0b015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:24.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.665+0000 7fe0b70eb640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0b015f760 0x7fe0b014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:24.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.665+0000 7fe0b70eb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0b015dee0 0x7fe0b014cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:24.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.665+0000 7fe0b70eb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b0155610 con 0x7fe0b00cf480 2024-07-27T03:11:24.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.665+0000 7fe0b70eb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b00aeca0 con 0x7fe0b015dee0 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.665+0000 7fe0b70eb640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b0155790 con 0x7fe0b015f760 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b4e87640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0b00cf480 0x7fe0b015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b4e87640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0b00cf480 0x7fe0b015d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51082/0 (socket says 172.21.15.120:51082) 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b4e87640 1 -- 172.21.15.120:0/2210867547 learned_addr learned my addr 172.21.15.120:0/2210867547 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b5688640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0b015dee0 0x7fe0b014cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0a7fff640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0b015f760 0x7fe0b014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b4e87640 1 -- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0b015f760 msgr2=0x7fe0b014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b4e87640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0b015f760 0x7fe0b014c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b4e87640 1 -- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0b015dee0 msgr2=0x7fe0b014cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b4e87640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0b015dee0 0x7fe0b014cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b4e87640 1 -- 172.21.15.120:0/2210867547 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b014f420 con 0x7fe0b00cf480 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b4e87640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0b00cf480 0x7fe0b015d9a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009980 tx=0x7fe0ac003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0a57fa640 1 -- 172.21.15.120:0/2210867547 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac005c90 con 0x7fe0b00cf480 2024-07-27T03:11:24.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0a57fa640 1 -- 172.21.15.120:0/2210867547 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0ac005020 con 0x7fe0b00cf480 2024-07-27T03:11:24.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b70eb640 1 -- 172.21.15.120:0/2210867547 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b009aad0 con 0x7fe0b00cf480 2024-07-27T03:11:24.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0a57fa640 1 -- 172.21.15.120:0/2210867547 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac005410 con 0x7fe0b00cf480 2024-07-27T03:11:24.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.666+0000 7fe0b70eb640 1 -- 172.21.15.120:0/2210867547 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b009b090 con 0x7fe0b00cf480 2024-07-27T03:11:24.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.668+0000 7fe0b70eb640 1 -- 172.21.15.120:0/2210867547 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b006e270 con 0x7fe0b00cf480 2024-07-27T03:11:24.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.668+0000 7fe0a57fa640 1 -- 172.21.15.120:0/2210867547 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe0ac0317c0 con 0x7fe0b00cf480 2024-07-27T03:11:24.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.669+0000 7fe0a57fa640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe09c077010 0x7fe09c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:24.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.669+0000 7fe0a57fa640 1 -- 172.21.15.120:0/2210867547 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe0ac0b9820 con 0x7fe0b00cf480 2024-07-27T03:11:24.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.669+0000 7fe0a7fff640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe09c077010 0x7fe09c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:24.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.669+0000 7fe0a7fff640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe09c077010 0x7fe09c079520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe0b014e740 tx=0x7fe0a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:24.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.673+0000 7fe0a57fa640 1 -- 172.21.15.120:0/2210867547 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fe0ac03f030 con 0x7fe0b00cf480 2024-07-27T03:11:24.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.850+0000 7fe0b70eb640 1 -- 172.21.15.120:0/2210867547 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0b014d4b0 con 0x7fe09c077010 2024-07-27T03:11:24.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.854+0000 7fe0a57fa640 1 -- 172.21.15.120:0/2210867547 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7fe0b014d4b0 con 0x7fe09c077010 2024-07-27T03:11:24.860 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:24.862 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:11:24.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 -- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe09c077010 msgr2=0x7fe09c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe09c077010 0x7fe09c079520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe0b014e740 tx=0x7fe0a0009040 comp rx=0 tx=0).stop 2024-07-27T03:11:24.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 -- 172.21.15.120:0/2210867547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0b00cf480 msgr2=0x7fe0b015d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:24.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0b00cf480 0x7fe0b015d9a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009980 tx=0x7fe0ac003c10 comp rx=0 tx=0).stop 2024-07-27T03:11:24.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 -- 172.21.15.120:0/2210867547 shutdown_connections 2024-07-27T03:11:24.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe09c077010 0x7fe09c079520 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0b015dee0 0x7fe0b014cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe0b015f760 0x7fe0b014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 --2- 172.21.15.120:0/2210867547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0b00cf480 0x7fe0b015d9a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:24.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 -- 172.21.15.120:0/2210867547 >> 172.21.15.120:0/2210867547 conn(0x7fe0b00b1a10 msgr2=0x7fe0b00735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:24.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 -- 172.21.15.120:0/2210867547 shutdown_connections 2024-07-27T03:11:24.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:24.857+0000 7fe0b70eb640 1 -- 172.21.15.120:0/2210867547 wait complete. 2024-07-27T03:11:24.872 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-07-27T03:11:24.575361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":268456,"kb_used_data":6504,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":754706264,"statfs":{"total":773094113280,"available":772819214336,"internally_reserved":0,"allocated":6660096,"data_stored":3433716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":268095024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001541"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589815+0000","last_change":"2024-07-27T03:11:20.101120+0000","last_active":"2024-07-27T03:11:21.589815+0000","last_peered":"2024-07-27T03:11:21.589815+0000","last_clean":"2024-07-27T03:11:21.589815+0000","last_became_active":"2024-07-27T03:11:20.100402+0000","last_became_peered":"2024-07-27T03:11:20.100402+0000","last_unstale":"2024-07-27T03:11:21.589815+0000","last_undegraded":"2024-07-27T03:11:21.589815+0000","last_fullsized":"2024-07-27T03:11:21.589815+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:27:44.887939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349600+0000","last_change":"2024-07-27T03:11:20.112523+0000","last_active":"2024-07-27T03:11:21.349600+0000","last_peered":"2024-07-27T03:11:21.349600+0000","last_clean":"2024-07-27T03:11:21.349600+0000","last_became_active":"2024-07-27T03:11:20.112152+0000","last_became_peered":"2024-07-27T03:11:20.112152+0000","last_unstale":"2024-07-27T03:11:21.349600+0000","last_undegraded":"2024-07-27T03:11:21.349600+0000","last_fullsized":"2024-07-27T03:11:21.349600+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:43:13.334213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590635+0000","last_change":"2024-07-27T03:11:20.101310+0000","last_active":"2024-07-27T03:11:21.590635+0000","last_peered":"2024-07-27T03:11:21.590635+0000","last_clean":"2024-07-27T03:11:21.590635+0000","last_became_active":"2024-07-27T03:11:20.101014+0000","last_became_peered":"2024-07-27T03:11:20.101014+0000","last_unstale":"2024-07-27T03:11:21.590635+0000","last_undegraded":"2024-07-27T03:11:21.590635+0000","last_fullsized":"2024-07-27T03:11:21.590635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:26:47.403266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112350+0000","last_change":"2024-07-27T03:11:20.108371+0000","last_active":"2024-07-27T03:11:21.112350+0000","last_peered":"2024-07-27T03:11:21.112350+0000","last_clean":"2024-07-27T03:11:21.112350+0000","last_became_active":"2024-07-27T03:11:20.107937+0000","last_became_peered":"2024-07-27T03:11:20.107937+0000","last_unstale":"2024-07-27T03:11:21.112350+0000","last_undegraded":"2024-07-27T03:11:21.112350+0000","last_fullsized":"2024-07-27T03:11:21.112350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:45:21.326718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590195+0000","last_change":"2024-07-27T03:11:20.104726+0000","last_active":"2024-07-27T03:11:21.590195+0000","last_peered":"2024-07-27T03:11:21.590195+0000","last_clean":"2024-07-27T03:11:21.590195+0000","last_became_active":"2024-07-27T03:11:20.104367+0000","last_became_peered":"2024-07-27T03:11:20.104367+0000","last_unstale":"2024-07-27T03:11:21.590195+0000","last_undegraded":"2024-07-27T03:11:21.590195+0000","last_fullsized":"2024-07-27T03:11:21.590195+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:26:04.005879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105457+0000","last_change":"2024-07-27T03:11:20.106461+0000","last_active":"2024-07-27T03:11:21.105457+0000","last_peered":"2024-07-27T03:11:21.105457+0000","last_clean":"2024-07-27T03:11:21.105457+0000","last_became_active":"2024-07-27T03:11:20.106158+0000","last_became_peered":"2024-07-27T03:11:20.106158+0000","last_unstale":"2024-07-27T03:11:21.105457+0000","last_undegraded":"2024-07-27T03:11:21.105457+0000","last_fullsized":"2024-07-27T03:11:21.105457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:04:54.827444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110401+0000","last_change":"2024-07-27T03:11:20.110733+0000","last_active":"2024-07-27T03:11:21.110401+0000","last_peered":"2024-07-27T03:11:21.110401+0000","last_clean":"2024-07-27T03:11:21.110401+0000","last_became_active":"2024-07-27T03:11:20.109313+0000","last_became_peered":"2024-07-27T03:11:20.109313+0000","last_unstale":"2024-07-27T03:11:21.110401+0000","last_undegraded":"2024-07-27T03:11:21.110401+0000","last_fullsized":"2024-07-27T03:11:21.110401+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:38:37.104222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349338+0000","last_change":"2024-07-27T03:11:20.093990+0000","last_active":"2024-07-27T03:11:21.349338+0000","last_peered":"2024-07-27T03:11:21.349338+0000","last_clean":"2024-07-27T03:11:21.349338+0000","last_became_active":"2024-07-27T03:11:20.093667+0000","last_became_peered":"2024-07-27T03:11:20.093667+0000","last_unstale":"2024-07-27T03:11:21.349338+0000","last_undegraded":"2024-07-27T03:11:21.349338+0000","last_fullsized":"2024-07-27T03:11:21.349338+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:48:29.608996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110722+0000","last_change":"2024-07-27T03:11:20.111742+0000","last_active":"2024-07-27T03:11:21.110722+0000","last_peered":"2024-07-27T03:11:21.110722+0000","last_clean":"2024-07-27T03:11:21.110722+0000","last_became_active":"2024-07-27T03:11:20.111348+0000","last_became_peered":"2024-07-27T03:11:20.111348+0000","last_unstale":"2024-07-27T03:11:21.110722+0000","last_undegraded":"2024-07-27T03:11:21.110722+0000","last_fullsized":"2024-07-27T03:11:21.110722+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:27:49.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590278+0000","last_change":"2024-07-27T03:11:20.103525+0000","last_active":"2024-07-27T03:11:21.590278+0000","last_peered":"2024-07-27T03:11:21.590278+0000","last_clean":"2024-07-27T03:11:21.590278+0000","last_became_active":"2024-07-27T03:11:20.103196+0000","last_became_peered":"2024-07-27T03:11:20.103196+0000","last_unstale":"2024-07-27T03:11:21.590278+0000","last_undegraded":"2024-07-27T03:11:21.590278+0000","last_fullsized":"2024-07-27T03:11:21.590278+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:13:07.975210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589975+0000","last_change":"2024-07-27T03:11:20.115324+0000","last_active":"2024-07-27T03:11:21.589975+0000","last_peered":"2024-07-27T03:11:21.589975+0000","last_clean":"2024-07-27T03:11:21.589975+0000","last_became_active":"2024-07-27T03:11:20.115044+0000","last_became_peered":"2024-07-27T03:11:20.115044+0000","last_unstale":"2024-07-27T03:11:21.589975+0000","last_undegraded":"2024-07-27T03:11:21.589975+0000","last_fullsized":"2024-07-27T03:11:21.589975+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:21:49.401456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112363+0000","last_change":"2024-07-27T03:11:20.112333+0000","last_active":"2024-07-27T03:11:21.112363+0000","last_peered":"2024-07-27T03:11:21.112363+0000","last_clean":"2024-07-27T03:11:21.112363+0000","last_became_active":"2024-07-27T03:11:20.111922+0000","last_became_peered":"2024-07-27T03:11:20.111922+0000","last_unstale":"2024-07-27T03:11:21.112363+0000","last_undegraded":"2024-07-27T03:11:21.112363+0000","last_fullsized":"2024-07-27T03:11:21.112363+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:26:22.157427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297947+0000","last_change":"2024-07-27T03:11:20.108166+0000","last_active":"2024-07-27T03:11:21.297947+0000","last_peered":"2024-07-27T03:11:21.297947+0000","last_clean":"2024-07-27T03:11:21.297947+0000","last_became_active":"2024-07-27T03:11:20.107370+0000","last_became_peered":"2024-07-27T03:11:20.107370+0000","last_unstale":"2024-07-27T03:11:21.297947+0000","last_undegraded":"2024-07-27T03:11:21.297947+0000","last_fullsized":"2024-07-27T03:11:21.297947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:04:07.807790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110594+0000","last_change":"2024-07-27T03:11:20.110362+0000","last_active":"2024-07-27T03:11:21.110594+0000","last_peered":"2024-07-27T03:11:21.110594+0000","last_clean":"2024-07-27T03:11:21.110594+0000","last_became_active":"2024-07-27T03:11:20.106686+0000","last_became_peered":"2024-07-27T03:11:20.106686+0000","last_unstale":"2024-07-27T03:11:21.110594+0000","last_undegraded":"2024-07-27T03:11:21.110594+0000","last_fullsized":"2024-07-27T03:11:21.110594+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:50:09.712343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111060+0000","last_change":"2024-07-27T03:11:20.115470+0000","last_active":"2024-07-27T03:11:21.111060+0000","last_peered":"2024-07-27T03:11:21.111060+0000","last_clean":"2024-07-27T03:11:21.111060+0000","last_became_active":"2024-07-27T03:11:20.115128+0000","last_became_peered":"2024-07-27T03:11:20.115128+0000","last_unstale":"2024-07-27T03:11:21.111060+0000","last_undegraded":"2024-07-27T03:11:21.111060+0000","last_fullsized":"2024-07-27T03:11:21.111060+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:17:06.113066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105371+0000","last_change":"2024-07-27T03:11:20.109153+0000","last_active":"2024-07-27T03:11:21.105371+0000","last_peered":"2024-07-27T03:11:21.105371+0000","last_clean":"2024-07-27T03:11:21.105371+0000","last_became_active":"2024-07-27T03:11:20.108478+0000","last_became_peered":"2024-07-27T03:11:20.108478+0000","last_unstale":"2024-07-27T03:11:21.105371+0000","last_undegraded":"2024-07-27T03:11:21.105371+0000","last_fullsized":"2024-07-27T03:11:21.105371+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:00:02.863737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349620+0000","last_change":"2024-07-27T03:11:20.102545+0000","last_active":"2024-07-27T03:11:21.349620+0000","last_peered":"2024-07-27T03:11:21.349620+0000","last_clean":"2024-07-27T03:11:21.349620+0000","last_became_active":"2024-07-27T03:11:20.102270+0000","last_became_peered":"2024-07-27T03:11:20.102270+0000","last_unstale":"2024-07-27T03:11:21.349620+0000","last_undegraded":"2024-07-27T03:11:21.349620+0000","last_fullsized":"2024-07-27T03:11:21.349620+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:32:17.691215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590728+0000","last_change":"2024-07-27T03:11:20.109350+0000","last_active":"2024-07-27T03:11:21.590728+0000","last_peered":"2024-07-27T03:11:21.590728+0000","last_clean":"2024-07-27T03:11:21.590728+0000","last_became_active":"2024-07-27T03:11:20.109004+0000","last_became_peered":"2024-07-27T03:11:20.109004+0000","last_unstale":"2024-07-27T03:11:21.590728+0000","last_undegraded":"2024-07-27T03:11:21.590728+0000","last_fullsized":"2024-07-27T03:11:21.590728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:30:18.070376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589919+0000","last_change":"2024-07-27T03:11:20.100723+0000","last_active":"2024-07-27T03:11:21.589919+0000","last_peered":"2024-07-27T03:11:21.589919+0000","last_clean":"2024-07-27T03:11:21.589919+0000","last_became_active":"2024-07-27T03:11:20.100418+0000","last_became_peered":"2024-07-27T03:11:20.100418+0000","last_unstale":"2024-07-27T03:11:21.589919+0000","last_undegraded":"2024-07-27T03:11:21.589919+0000","last_fullsized":"2024-07-27T03:11:21.589919+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:41:44.860333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349702+0000","last_change":"2024-07-27T03:11:20.110047+0000","last_active":"2024-07-27T03:11:21.349702+0000","last_peered":"2024-07-27T03:11:21.349702+0000","last_clean":"2024-07-27T03:11:21.349702+0000","last_became_active":"2024-07-27T03:11:20.109581+0000","last_became_peered":"2024-07-27T03:11:20.109581+0000","last_unstale":"2024-07-27T03:11:21.349702+0000","last_undegraded":"2024-07-27T03:11:21.349702+0000","last_fullsized":"2024-07-27T03:11:21.349702+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:49:00.372071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590417+0000","last_change":"2024-07-27T03:11:20.106433+0000","last_active":"2024-07-27T03:11:21.590417+0000","last_peered":"2024-07-27T03:11:21.590417+0000","last_clean":"2024-07-27T03:11:21.590417+0000","last_became_active":"2024-07-27T03:11:20.106127+0000","last_became_peered":"2024-07-27T03:11:20.106127+0000","last_unstale":"2024-07-27T03:11:21.590417+0000","last_undegraded":"2024-07-27T03:11:21.590417+0000","last_fullsized":"2024-07-27T03:11:21.590417+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:24:57.993657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349315+0000","last_change":"2024-07-27T03:11:20.104597+0000","last_active":"2024-07-27T03:11:21.349315+0000","last_peered":"2024-07-27T03:11:21.349315+0000","last_clean":"2024-07-27T03:11:21.349315+0000","last_became_active":"2024-07-27T03:11:20.104290+0000","last_became_peered":"2024-07-27T03:11:20.104290+0000","last_unstale":"2024-07-27T03:11:21.349315+0000","last_undegraded":"2024-07-27T03:11:21.349315+0000","last_fullsized":"2024-07-27T03:11:21.349315+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:12:03.777855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590611+0000","last_change":"2024-07-27T03:11:20.098631+0000","last_active":"2024-07-27T03:11:21.590611+0000","last_peered":"2024-07-27T03:11:21.590611+0000","last_clean":"2024-07-27T03:11:21.590611+0000","last_became_active":"2024-07-27T03:11:20.097947+0000","last_became_peered":"2024-07-27T03:11:20.097947+0000","last_unstale":"2024-07-27T03:11:21.590611+0000","last_undegraded":"2024-07-27T03:11:21.590611+0000","last_fullsized":"2024-07-27T03:11:21.590611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:26:22.157427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297964+0000","last_change":"2024-07-27T03:11:20.110392+0000","last_active":"2024-07-27T03:11:21.297964+0000","last_peered":"2024-07-27T03:11:21.297964+0000","last_clean":"2024-07-27T03:11:21.297964+0000","last_became_active":"2024-07-27T03:11:20.110054+0000","last_became_peered":"2024-07-27T03:11:20.110054+0000","last_unstale":"2024-07-27T03:11:21.297964+0000","last_undegraded":"2024-07-27T03:11:21.297964+0000","last_fullsized":"2024-07-27T03:11:21.297964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:23:48.246374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590009+0000","last_change":"2024-07-27T03:11:20.118175+0000","last_active":"2024-07-27T03:11:21.590009+0000","last_peered":"2024-07-27T03:11:21.590009+0000","last_clean":"2024-07-27T03:11:21.590009+0000","last_became_active":"2024-07-27T03:11:20.117513+0000","last_became_peered":"2024-07-27T03:11:20.117513+0000","last_unstale":"2024-07-27T03:11:21.590009+0000","last_undegraded":"2024-07-27T03:11:21.590009+0000","last_fullsized":"2024-07-27T03:11:21.590009+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:33:10.009836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111918+0000","last_change":"2024-07-27T03:11:20.105616+0000","last_active":"2024-07-27T03:11:21.111918+0000","last_peered":"2024-07-27T03:11:21.111918+0000","last_clean":"2024-07-27T03:11:21.111918+0000","last_became_active":"2024-07-27T03:11:20.102991+0000","last_became_peered":"2024-07-27T03:11:20.102991+0000","last_unstale":"2024-07-27T03:11:21.111918+0000","last_undegraded":"2024-07-27T03:11:21.111918+0000","last_fullsized":"2024-07-27T03:11:21.111918+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:28:43.066840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105657+0000","last_change":"2024-07-27T03:11:20.107423+0000","last_active":"2024-07-27T03:11:21.105657+0000","last_peered":"2024-07-27T03:11:21.105657+0000","last_clean":"2024-07-27T03:11:21.105657+0000","last_became_active":"2024-07-27T03:11:20.107081+0000","last_became_peered":"2024-07-27T03:11:20.107081+0000","last_unstale":"2024-07-27T03:11:21.105657+0000","last_undegraded":"2024-07-27T03:11:21.105657+0000","last_fullsized":"2024-07-27T03:11:21.105657+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:26:22.157427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589985+0000","last_change":"2024-07-27T03:11:20.105880+0000","last_active":"2024-07-27T03:11:21.589985+0000","last_peered":"2024-07-27T03:11:21.589985+0000","last_clean":"2024-07-27T03:11:21.589985+0000","last_became_active":"2024-07-27T03:11:20.105585+0000","last_became_peered":"2024-07-27T03:11:20.105585+0000","last_unstale":"2024-07-27T03:11:21.589985+0000","last_undegraded":"2024-07-27T03:11:21.589985+0000","last_fullsized":"2024-07-27T03:11:21.589985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:34:06.075388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349743+0000","last_change":"2024-07-27T03:11:20.112205+0000","last_active":"2024-07-27T03:11:21.349743+0000","last_peered":"2024-07-27T03:11:21.349743+0000","last_clean":"2024-07-27T03:11:21.349743+0000","last_became_active":"2024-07-27T03:11:20.111888+0000","last_became_peered":"2024-07-27T03:11:20.111888+0000","last_unstale":"2024-07-27T03:11:21.349743+0000","last_undegraded":"2024-07-27T03:11:21.349743+0000","last_fullsized":"2024-07-27T03:11:21.349743+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:00:54.320660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590228+0000","last_change":"2024-07-27T03:11:20.093636+0000","last_active":"2024-07-27T03:11:21.590228+0000","last_peered":"2024-07-27T03:11:21.590228+0000","last_clean":"2024-07-27T03:11:21.590228+0000","last_became_active":"2024-07-27T03:11:20.093298+0000","last_became_peered":"2024-07-27T03:11:20.093298+0000","last_unstale":"2024-07-27T03:11:21.590228+0000","last_undegraded":"2024-07-27T03:11:21.590228+0000","last_fullsized":"2024-07-27T03:11:21.590228+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:00:02.863737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589768+0000","last_change":"2024-07-27T03:11:20.117879+0000","last_active":"2024-07-27T03:11:21.589768+0000","last_peered":"2024-07-27T03:11:21.589768+0000","last_clean":"2024-07-27T03:11:21.589768+0000","last_became_active":"2024-07-27T03:11:20.117566+0000","last_became_peered":"2024-07-27T03:11:20.117566+0000","last_unstale":"2024-07-27T03:11:21.589768+0000","last_undegraded":"2024-07-27T03:11:21.589768+0000","last_fullsized":"2024-07-27T03:11:21.589768+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:43:44.053246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105458+0000","last_change":"2024-07-27T03:11:20.109422+0000","last_active":"2024-07-27T03:11:21.105458+0000","last_peered":"2024-07-27T03:11:21.105458+0000","last_clean":"2024-07-27T03:11:21.105458+0000","last_became_active":"2024-07-27T03:11:20.108816+0000","last_became_peered":"2024-07-27T03:11:20.108816+0000","last_unstale":"2024-07-27T03:11:21.105458+0000","last_undegraded":"2024-07-27T03:11:21.105458+0000","last_fullsized":"2024-07-27T03:11:21.105458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:24:57.993657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106010+0000","last_change":"2024-07-27T03:11:20.107884+0000","last_active":"2024-07-27T03:11:21.106010+0000","last_peered":"2024-07-27T03:11:21.106010+0000","last_clean":"2024-07-27T03:11:21.106010+0000","last_became_active":"2024-07-27T03:11:20.107509+0000","last_became_peered":"2024-07-27T03:11:20.107509+0000","last_unstale":"2024-07-27T03:11:21.106010+0000","last_undegraded":"2024-07-27T03:11:21.106010+0000","last_fullsized":"2024-07-27T03:11:21.106010+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:19:25.908150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106004+0000","last_change":"2024-07-27T03:11:19.101102+0000","last_active":"2024-07-27T03:11:21.106004+0000","last_peered":"2024-07-27T03:11:21.106004+0000","last_clean":"2024-07-27T03:11:21.106004+0000","last_became_active":"2024-07-27T03:11:19.100787+0000","last_became_peered":"2024-07-27T03:11:19.100787+0000","last_unstale":"2024-07-27T03:11:21.106004+0000","last_undegraded":"2024-07-27T03:11:21.106004+0000","last_fullsized":"2024-07-27T03:11:21.106004+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:39.555321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590149+0000","last_change":"2024-07-27T03:11:20.114371+0000","last_active":"2024-07-27T03:11:21.590149+0000","last_peered":"2024-07-27T03:11:21.590149+0000","last_clean":"2024-07-27T03:11:21.590149+0000","last_became_active":"2024-07-27T03:11:20.112824+0000","last_became_peered":"2024-07-27T03:11:20.112824+0000","last_unstale":"2024-07-27T03:11:21.590149+0000","last_undegraded":"2024-07-27T03:11:21.590149+0000","last_fullsized":"2024-07-27T03:11:21.590149+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:57:37.434152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349493+0000","last_change":"2024-07-27T03:11:19.101555+0000","last_active":"2024-07-27T03:11:21.349493+0000","last_peered":"2024-07-27T03:11:21.349493+0000","last_clean":"2024-07-27T03:11:21.349493+0000","last_became_active":"2024-07-27T03:11:19.101157+0000","last_became_peered":"2024-07-27T03:11:19.101157+0000","last_unstale":"2024-07-27T03:11:21.349493+0000","last_undegraded":"2024-07-27T03:11:21.349493+0000","last_fullsized":"2024-07-27T03:11:21.349493+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:38:58.534784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106012+0000","last_change":"2024-07-27T03:11:20.116157+0000","last_active":"2024-07-27T03:11:21.106012+0000","last_peered":"2024-07-27T03:11:21.106012+0000","last_clean":"2024-07-27T03:11:21.106012+0000","last_became_active":"2024-07-27T03:11:20.115836+0000","last_became_peered":"2024-07-27T03:11:20.115836+0000","last_unstale":"2024-07-27T03:11:21.106012+0000","last_undegraded":"2024-07-27T03:11:21.106012+0000","last_fullsized":"2024-07-27T03:11:21.106012+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:30:18.070376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106123+0000","last_change":"2024-07-27T03:11:19.098946+0000","last_active":"2024-07-27T03:11:21.106123+0000","last_peered":"2024-07-27T03:11:21.106123+0000","last_clean":"2024-07-27T03:11:21.106123+0000","last_became_active":"2024-07-27T03:11:19.098638+0000","last_became_peered":"2024-07-27T03:11:19.098638+0000","last_unstale":"2024-07-27T03:11:21.106123+0000","last_undegraded":"2024-07-27T03:11:21.106123+0000","last_fullsized":"2024-07-27T03:11:21.106123+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:17:07.949100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105860+0000","last_change":"2024-07-27T03:11:20.108339+0000","last_active":"2024-07-27T03:11:21.105860+0000","last_peered":"2024-07-27T03:11:21.105860+0000","last_clean":"2024-07-27T03:11:21.105860+0000","last_became_active":"2024-07-27T03:11:20.107924+0000","last_became_peered":"2024-07-27T03:11:20.107924+0000","last_unstale":"2024-07-27T03:11:21.105860+0000","last_undegraded":"2024-07-27T03:11:21.105860+0000","last_fullsized":"2024-07-27T03:11:21.105860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:25:24.629300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112422+0000","last_change":"2024-07-27T03:11:19.099329+0000","last_active":"2024-07-27T03:11:21.112422+0000","last_peered":"2024-07-27T03:11:21.112422+0000","last_clean":"2024-07-27T03:11:21.112422+0000","last_became_active":"2024-07-27T03:11:19.098986+0000","last_became_peered":"2024-07-27T03:11:19.098986+0000","last_unstale":"2024-07-27T03:11:21.112422+0000","last_undegraded":"2024-07-27T03:11:21.112422+0000","last_fullsized":"2024-07-27T03:11:21.112422+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:39.555321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349335+0000","last_change":"2024-07-27T03:11:20.103941+0000","last_active":"2024-07-27T03:11:21.349335+0000","last_peered":"2024-07-27T03:11:21.349335+0000","last_clean":"2024-07-27T03:11:21.349335+0000","last_became_active":"2024-07-27T03:11:20.103624+0000","last_became_peered":"2024-07-27T03:11:20.103624+0000","last_unstale":"2024-07-27T03:11:21.349335+0000","last_undegraded":"2024-07-27T03:11:21.349335+0000","last_fullsized":"2024-07-27T03:11:21.349335+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:55:46.633797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110491+0000","last_change":"2024-07-27T03:11:19.098581+0000","last_active":"2024-07-27T03:11:21.110491+0000","last_peered":"2024-07-27T03:11:21.110491+0000","last_clean":"2024-07-27T03:11:21.110491+0000","last_became_active":"2024-07-27T03:11:19.098202+0000","last_became_peered":"2024-07-27T03:11:19.098202+0000","last_unstale":"2024-07-27T03:11:21.110491+0000","last_undegraded":"2024-07-27T03:11:21.110491+0000","last_fullsized":"2024-07-27T03:11:21.110491+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:37:05.353006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349562+0000","last_change":"2024-07-27T03:11:20.111246+0000","last_active":"2024-07-27T03:11:21.349562+0000","last_peered":"2024-07-27T03:11:21.349562+0000","last_clean":"2024-07-27T03:11:21.349562+0000","last_became_active":"2024-07-27T03:11:20.110640+0000","last_became_peered":"2024-07-27T03:11:20.110640+0000","last_unstale":"2024-07-27T03:11:21.349562+0000","last_undegraded":"2024-07-27T03:11:21.349562+0000","last_fullsized":"2024-07-27T03:11:21.349562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:49:37.998416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105367+0000","last_change":"2024-07-27T03:11:19.094008+0000","last_active":"2024-07-27T03:11:21.105367+0000","last_peered":"2024-07-27T03:11:21.105367+0000","last_clean":"2024-07-27T03:11:21.105367+0000","last_became_active":"2024-07-27T03:11:19.093688+0000","last_became_peered":"2024-07-27T03:11:19.093688+0000","last_unstale":"2024-07-27T03:11:21.105367+0000","last_undegraded":"2024-07-27T03:11:21.105367+0000","last_fullsized":"2024-07-27T03:11:21.105367+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:10:00.717705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297867+0000","last_change":"2024-07-27T03:11:20.105810+0000","last_active":"2024-07-27T03:11:21.297867+0000","last_peered":"2024-07-27T03:11:21.297867+0000","last_clean":"2024-07-27T03:11:21.297867+0000","last_became_active":"2024-07-27T03:11:20.105302+0000","last_became_peered":"2024-07-27T03:11:20.105302+0000","last_unstale":"2024-07-27T03:11:21.297867+0000","last_undegraded":"2024-07-27T03:11:21.297867+0000","last_fullsized":"2024-07-27T03:11:21.297867+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:18:24.478934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111733+0000","last_change":"2024-07-27T03:11:19.094528+0000","last_active":"2024-07-27T03:11:21.111733+0000","last_peered":"2024-07-27T03:11:21.111733+0000","last_clean":"2024-07-27T03:11:21.111733+0000","last_became_active":"2024-07-27T03:11:19.094100+0000","last_became_peered":"2024-07-27T03:11:19.094100+0000","last_unstale":"2024-07-27T03:11:21.111733+0000","last_undegraded":"2024-07-27T03:11:21.111733+0000","last_fullsized":"2024-07-27T03:11:21.111733+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:17:07.949100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349410+0000","last_change":"2024-07-27T03:11:20.103192+0000","last_active":"2024-07-27T03:11:21.349410+0000","last_peered":"2024-07-27T03:11:21.349410+0000","last_clean":"2024-07-27T03:11:21.349410+0000","last_became_active":"2024-07-27T03:11:20.102896+0000","last_became_peered":"2024-07-27T03:11:20.102896+0000","last_unstale":"2024-07-27T03:11:21.349410+0000","last_undegraded":"2024-07-27T03:11:21.349410+0000","last_fullsized":"2024-07-27T03:11:21.349410+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:36:46.720760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110426+0000","last_change":"2024-07-27T03:11:19.100553+0000","last_active":"2024-07-27T03:11:21.110426+0000","last_peered":"2024-07-27T03:11:21.110426+0000","last_clean":"2024-07-27T03:11:21.110426+0000","last_became_active":"2024-07-27T03:11:19.100172+0000","last_became_peered":"2024-07-27T03:11:19.100172+0000","last_unstale":"2024-07-27T03:11:21.110426+0000","last_undegraded":"2024-07-27T03:11:21.110426+0000","last_fullsized":"2024-07-27T03:11:21.110426+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:21:48.398665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110787+0000","last_change":"2024-07-27T03:11:20.097619+0000","last_active":"2024-07-27T03:11:21.110787+0000","last_peered":"2024-07-27T03:11:21.110787+0000","last_clean":"2024-07-27T03:11:21.110787+0000","last_became_active":"2024-07-27T03:11:20.097119+0000","last_became_peered":"2024-07-27T03:11:20.097119+0000","last_unstale":"2024-07-27T03:11:21.110787+0000","last_undegraded":"2024-07-27T03:11:21.110787+0000","last_fullsized":"2024-07-27T03:11:21.110787+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:28.965309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590607+0000","last_change":"2024-07-27T03:11:19.105512+0000","last_active":"2024-07-27T03:11:21.590607+0000","last_peered":"2024-07-27T03:11:21.590607+0000","last_clean":"2024-07-27T03:11:21.590607+0000","last_became_active":"2024-07-27T03:11:19.105229+0000","last_became_peered":"2024-07-27T03:11:19.105229+0000","last_unstale":"2024-07-27T03:11:21.590607+0000","last_undegraded":"2024-07-27T03:11:21.590607+0000","last_fullsized":"2024-07-27T03:11:21.590607+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:23:39.476947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590721+0000","last_change":"2024-07-27T03:11:20.115477+0000","last_active":"2024-07-27T03:11:21.590721+0000","last_peered":"2024-07-27T03:11:21.590721+0000","last_clean":"2024-07-27T03:11:21.590721+0000","last_became_active":"2024-07-27T03:11:20.115128+0000","last_became_peered":"2024-07-27T03:11:20.115128+0000","last_unstale":"2024-07-27T03:11:21.590721+0000","last_undegraded":"2024-07-27T03:11:21.590721+0000","last_fullsized":"2024-07-27T03:11:21.590721+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:19:25.908150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349663+0000","last_change":"2024-07-27T03:11:19.100490+0000","last_active":"2024-07-27T03:11:21.349663+0000","last_peered":"2024-07-27T03:11:21.349663+0000","last_clean":"2024-07-27T03:11:21.349663+0000","last_became_active":"2024-07-27T03:11:19.100209+0000","last_became_peered":"2024-07-27T03:11:19.100209+0000","last_unstale":"2024-07-27T03:11:21.349663+0000","last_undegraded":"2024-07-27T03:11:21.349663+0000","last_fullsized":"2024-07-27T03:11:21.349663+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:05:13.024640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589711+0000","last_change":"2024-07-27T03:11:20.107840+0000","last_active":"2024-07-27T03:11:21.589711+0000","last_peered":"2024-07-27T03:11:21.589711+0000","last_clean":"2024-07-27T03:11:21.589711+0000","last_became_active":"2024-07-27T03:11:20.107509+0000","last_became_peered":"2024-07-27T03:11:20.107509+0000","last_unstale":"2024-07-27T03:11:21.589711+0000","last_undegraded":"2024-07-27T03:11:21.589711+0000","last_fullsized":"2024-07-27T03:11:21.589711+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:23:48.246374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590854+0000","last_change":"2024-07-27T03:11:19.104498+0000","last_active":"2024-07-27T03:11:21.590854+0000","last_peered":"2024-07-27T03:11:21.590854+0000","last_clean":"2024-07-27T03:11:21.590854+0000","last_became_active":"2024-07-27T03:11:19.104259+0000","last_became_peered":"2024-07-27T03:11:19.104259+0000","last_unstale":"2024-07-27T03:11:21.590854+0000","last_undegraded":"2024-07-27T03:11:21.590854+0000","last_fullsized":"2024-07-27T03:11:21.590854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:39.555321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590798+0000","last_change":"2024-07-27T03:11:20.115284+0000","last_active":"2024-07-27T03:11:21.590798+0000","last_peered":"2024-07-27T03:11:21.590798+0000","last_clean":"2024-07-27T03:11:21.590798+0000","last_became_active":"2024-07-27T03:11:20.114952+0000","last_became_peered":"2024-07-27T03:11:20.114952+0000","last_unstale":"2024-07-27T03:11:21.590798+0000","last_undegraded":"2024-07-27T03:11:21.590798+0000","last_fullsized":"2024-07-27T03:11:21.590798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:52:57.758643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110960+0000","last_change":"2024-07-27T03:11:19.099210+0000","last_active":"2024-07-27T03:11:21.110960+0000","last_peered":"2024-07-27T03:11:21.110960+0000","last_clean":"2024-07-27T03:11:21.110960+0000","last_became_active":"2024-07-27T03:11:19.098810+0000","last_became_peered":"2024-07-27T03:11:19.098810+0000","last_unstale":"2024-07-27T03:11:21.110960+0000","last_undegraded":"2024-07-27T03:11:21.110960+0000","last_fullsized":"2024-07-27T03:11:21.110960+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:57:36.431361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112193+0000","last_change":"2024-07-27T03:11:20.117668+0000","last_active":"2024-07-27T03:11:21.112193+0000","last_peered":"2024-07-27T03:11:21.112193+0000","last_clean":"2024-07-27T03:11:21.112193+0000","last_became_active":"2024-07-27T03:11:20.117382+0000","last_became_peered":"2024-07-27T03:11:20.117382+0000","last_unstale":"2024-07-27T03:11:21.112193+0000","last_undegraded":"2024-07-27T03:11:21.112193+0000","last_fullsized":"2024-07-27T03:11:21.112193+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:04:54.827444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349497+0000","last_change":"2024-07-27T03:11:19.099784+0000","last_active":"2024-07-27T03:11:21.349497+0000","last_peered":"2024-07-27T03:11:21.349497+0000","last_clean":"2024-07-27T03:11:21.349497+0000","last_became_active":"2024-07-27T03:11:19.099406+0000","last_became_peered":"2024-07-27T03:11:19.099406+0000","last_unstale":"2024-07-27T03:11:21.349497+0000","last_undegraded":"2024-07-27T03:11:21.349497+0000","last_fullsized":"2024-07-27T03:11:21.349497+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:39:54.701882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590305+0000","last_change":"2024-07-27T03:11:20.102789+0000","last_active":"2024-07-27T03:11:21.590305+0000","last_peered":"2024-07-27T03:11:21.590305+0000","last_clean":"2024-07-27T03:11:21.590305+0000","last_became_active":"2024-07-27T03:11:20.102457+0000","last_became_peered":"2024-07-27T03:11:20.102457+0000","last_unstale":"2024-07-27T03:11:21.590305+0000","last_undegraded":"2024-07-27T03:11:21.590305+0000","last_fullsized":"2024-07-27T03:11:21.590305+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:04:54.827444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297790+0000","last_change":"2024-07-27T03:11:19.094598+0000","last_active":"2024-07-27T03:11:21.297790+0000","last_peered":"2024-07-27T03:11:21.297790+0000","last_clean":"2024-07-27T03:11:21.297790+0000","last_became_active":"2024-07-27T03:11:19.094256+0000","last_became_peered":"2024-07-27T03:11:19.094256+0000","last_unstale":"2024-07-27T03:11:21.297790+0000","last_undegraded":"2024-07-27T03:11:21.297790+0000","last_fullsized":"2024-07-27T03:11:21.297790+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:18:44.458256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110499+0000","last_change":"2024-07-27T03:11:20.109587+0000","last_active":"2024-07-27T03:11:21.110499+0000","last_peered":"2024-07-27T03:11:21.110499+0000","last_clean":"2024-07-27T03:11:21.110499+0000","last_became_active":"2024-07-27T03:11:20.104567+0000","last_became_peered":"2024-07-27T03:11:20.104567+0000","last_unstale":"2024-07-27T03:11:21.110499+0000","last_undegraded":"2024-07-27T03:11:21.110499+0000","last_fullsized":"2024-07-27T03:11:21.110499+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:24:10.352884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111763+0000","last_change":"2024-07-27T03:11:19.100330+0000","last_active":"2024-07-27T03:11:21.111763+0000","last_peered":"2024-07-27T03:11:21.111763+0000","last_clean":"2024-07-27T03:11:21.111763+0000","last_became_active":"2024-07-27T03:11:19.099682+0000","last_became_peered":"2024-07-27T03:11:19.099682+0000","last_unstale":"2024-07-27T03:11:21.111763+0000","last_undegraded":"2024-07-27T03:11:21.111763+0000","last_fullsized":"2024-07-27T03:11:21.111763+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:27.739312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590552+0000","last_change":"2024-07-27T03:11:20.098909+0000","last_active":"2024-07-27T03:11:21.590552+0000","last_peered":"2024-07-27T03:11:21.590552+0000","last_clean":"2024-07-27T03:11:21.590552+0000","last_became_active":"2024-07-27T03:11:20.098349+0000","last_became_peered":"2024-07-27T03:11:20.098349+0000","last_unstale":"2024-07-27T03:11:21.590552+0000","last_undegraded":"2024-07-27T03:11:21.590552+0000","last_fullsized":"2024-07-27T03:11:21.590552+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:45:21.326718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590084+0000","last_change":"2024-07-27T03:11:19.101259+0000","last_active":"2024-07-27T03:11:21.590084+0000","last_peered":"2024-07-27T03:11:21.590084+0000","last_clean":"2024-07-27T03:11:21.590084+0000","last_became_active":"2024-07-27T03:11:19.100946+0000","last_became_peered":"2024-07-27T03:11:19.100946+0000","last_unstale":"2024-07-27T03:11:21.590084+0000","last_undegraded":"2024-07-27T03:11:21.590084+0000","last_fullsized":"2024-07-27T03:11:21.590084+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:27.739312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590852+0000","last_change":"2024-07-27T03:11:20.103583+0000","last_active":"2024-07-27T03:11:21.590852+0000","last_peered":"2024-07-27T03:11:21.590852+0000","last_clean":"2024-07-27T03:11:21.590852+0000","last_became_active":"2024-07-27T03:11:20.101980+0000","last_became_peered":"2024-07-27T03:11:20.101980+0000","last_unstale":"2024-07-27T03:11:21.590852+0000","last_undegraded":"2024-07-27T03:11:21.590852+0000","last_fullsized":"2024-07-27T03:11:21.590852+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:06:13.715505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349669+0000","last_change":"2024-07-27T03:11:19.099721+0000","last_active":"2024-07-27T03:11:21.349669+0000","last_peered":"2024-07-27T03:11:21.349669+0000","last_clean":"2024-07-27T03:11:21.349669+0000","last_became_active":"2024-07-27T03:11:19.099380+0000","last_became_peered":"2024-07-27T03:11:19.099380+0000","last_unstale":"2024-07-27T03:11:21.349669+0000","last_undegraded":"2024-07-27T03:11:21.349669+0000","last_fullsized":"2024-07-27T03:11:21.349669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:35:48.351278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111997+0000","last_change":"2024-07-27T03:11:20.117677+0000","last_active":"2024-07-27T03:11:21.111997+0000","last_peered":"2024-07-27T03:11:21.111997+0000","last_clean":"2024-07-27T03:11:21.111997+0000","last_became_active":"2024-07-27T03:11:20.117376+0000","last_became_peered":"2024-07-27T03:11:20.117376+0000","last_unstale":"2024-07-27T03:11:21.111997+0000","last_undegraded":"2024-07-27T03:11:21.111997+0000","last_fullsized":"2024-07-27T03:11:21.111997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:58:12.147091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105888+0000","last_change":"2024-07-27T03:11:19.101480+0000","last_active":"2024-07-27T03:11:21.105888+0000","last_peered":"2024-07-27T03:11:21.105888+0000","last_clean":"2024-07-27T03:11:21.105888+0000","last_became_active":"2024-07-27T03:11:19.101190+0000","last_became_peered":"2024-07-27T03:11:19.101190+0000","last_unstale":"2024-07-27T03:11:21.105888+0000","last_undegraded":"2024-07-27T03:11:21.105888+0000","last_fullsized":"2024-07-27T03:11:21.105888+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:27.739312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349672+0000","last_change":"2024-07-27T03:11:20.094999+0000","last_active":"2024-07-27T03:11:21.349672+0000","last_peered":"2024-07-27T03:11:21.349672+0000","last_clean":"2024-07-27T03:11:21.349672+0000","last_became_active":"2024-07-27T03:11:20.093245+0000","last_became_peered":"2024-07-27T03:11:20.093245+0000","last_unstale":"2024-07-27T03:11:21.349672+0000","last_undegraded":"2024-07-27T03:11:21.349672+0000","last_fullsized":"2024-07-27T03:11:21.349672+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:44:47.888478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112151+0000","last_change":"2024-07-27T03:11:19.099786+0000","last_active":"2024-07-27T03:11:21.112151+0000","last_peered":"2024-07-27T03:11:21.112151+0000","last_clean":"2024-07-27T03:11:21.112151+0000","last_became_active":"2024-07-27T03:11:19.099425+0000","last_became_peered":"2024-07-27T03:11:19.099425+0000","last_unstale":"2024-07-27T03:11:21.112151+0000","last_undegraded":"2024-07-27T03:11:21.112151+0000","last_fullsized":"2024-07-27T03:11:21.112151+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:34:09.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590833+0000","last_change":"2024-07-27T03:11:20.116005+0000","last_active":"2024-07-27T03:11:21.590833+0000","last_peered":"2024-07-27T03:11:21.590833+0000","last_clean":"2024-07-27T03:11:21.590833+0000","last_became_active":"2024-07-27T03:11:20.115439+0000","last_became_peered":"2024-07-27T03:11:20.115439+0000","last_unstale":"2024-07-27T03:11:21.590833+0000","last_undegraded":"2024-07-27T03:11:21.590833+0000","last_fullsized":"2024-07-27T03:11:21.590833+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:11:24.859249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105891+0000","last_change":"2024-07-27T03:11:19.102076+0000","last_active":"2024-07-27T03:11:21.105891+0000","last_peered":"2024-07-27T03:11:21.105891+0000","last_clean":"2024-07-27T03:11:21.105891+0000","last_became_active":"2024-07-27T03:11:19.101792+0000","last_became_peered":"2024-07-27T03:11:19.101792+0000","last_unstale":"2024-07-27T03:11:21.105891+0000","last_undegraded":"2024-07-27T03:11:21.105891+0000","last_fullsized":"2024-07-27T03:11:21.105891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:34:09.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112111+0000","last_change":"2024-07-27T03:11:20.114114+0000","last_active":"2024-07-27T03:11:21.112111+0000","last_peered":"2024-07-27T03:11:21.112111+0000","last_clean":"2024-07-27T03:11:21.112111+0000","last_became_active":"2024-07-27T03:11:20.113804+0000","last_became_peered":"2024-07-27T03:11:20.113804+0000","last_unstale":"2024-07-27T03:11:21.112111+0000","last_undegraded":"2024-07-27T03:11:21.112111+0000","last_fullsized":"2024-07-27T03:11:21.112111+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:00:02.863737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349706+0000","last_change":"2024-07-27T03:11:19.099608+0000","last_active":"2024-07-27T03:11:21.349706+0000","last_peered":"2024-07-27T03:11:21.349706+0000","last_clean":"2024-07-27T03:11:21.349706+0000","last_became_active":"2024-07-27T03:11:19.099300+0000","last_became_peered":"2024-07-27T03:11:19.099300+0000","last_unstale":"2024-07-27T03:11:21.349706+0000","last_undegraded":"2024-07-27T03:11:21.349706+0000","last_fullsized":"2024-07-27T03:11:21.349706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:24:27.537598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105710+0000","last_change":"2024-07-27T03:11:20.106781+0000","last_active":"2024-07-27T03:11:21.105710+0000","last_peered":"2024-07-27T03:11:21.105710+0000","last_clean":"2024-07-27T03:11:21.105710+0000","last_became_active":"2024-07-27T03:11:20.106449+0000","last_became_peered":"2024-07-27T03:11:20.106449+0000","last_unstale":"2024-07-27T03:11:21.105710+0000","last_undegraded":"2024-07-27T03:11:21.105710+0000","last_fullsized":"2024-07-27T03:11:21.105710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:26:47.403266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589789+0000","last_change":"2024-07-27T03:11:19.100472+0000","last_active":"2024-07-27T03:11:21.589789+0000","last_peered":"2024-07-27T03:11:21.589789+0000","last_clean":"2024-07-27T03:11:21.589789+0000","last_became_active":"2024-07-27T03:11:19.100183+0000","last_became_peered":"2024-07-27T03:11:19.100183+0000","last_unstale":"2024-07-27T03:11:21.589789+0000","last_undegraded":"2024-07-27T03:11:21.589789+0000","last_fullsized":"2024-07-27T03:11:21.589789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:59:57.258777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105503+0000","last_change":"2024-07-27T03:11:20.099279+0000","last_active":"2024-07-27T03:11:21.105503+0000","last_peered":"2024-07-27T03:11:21.105503+0000","last_clean":"2024-07-27T03:11:21.105503+0000","last_became_active":"2024-07-27T03:11:20.098975+0000","last_became_peered":"2024-07-27T03:11:20.098975+0000","last_unstale":"2024-07-27T03:11:21.105503+0000","last_undegraded":"2024-07-27T03:11:21.105503+0000","last_fullsized":"2024-07-27T03:11:21.105503+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:45:21.326718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111627+0000","last_change":"2024-07-27T03:11:19.090066+0000","last_active":"2024-07-27T03:11:21.111627+0000","last_peered":"2024-07-27T03:11:21.111627+0000","last_clean":"2024-07-27T03:11:21.111627+0000","last_became_active":"2024-07-27T03:11:19.089703+0000","last_became_peered":"2024-07-27T03:11:19.089703+0000","last_unstale":"2024-07-27T03:11:21.111627+0000","last_undegraded":"2024-07-27T03:11:21.111627+0000","last_fullsized":"2024-07-27T03:11:21.111627+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:10:00.717705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112018+0000","last_change":"2024-07-27T03:11:20.108097+0000","last_active":"2024-07-27T03:11:21.112018+0000","last_peered":"2024-07-27T03:11:21.112018+0000","last_clean":"2024-07-27T03:11:21.112018+0000","last_became_active":"2024-07-27T03:11:20.107785+0000","last_became_peered":"2024-07-27T03:11:20.107785+0000","last_unstale":"2024-07-27T03:11:21.112018+0000","last_undegraded":"2024-07-27T03:11:21.112018+0000","last_fullsized":"2024-07-27T03:11:21.112018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:06:37.153792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590226+0000","last_change":"2024-07-27T03:11:19.101210+0000","last_active":"2024-07-27T03:11:21.590226+0000","last_peered":"2024-07-27T03:11:21.590226+0000","last_clean":"2024-07-27T03:11:21.590226+0000","last_became_active":"2024-07-27T03:11:19.100926+0000","last_became_peered":"2024-07-27T03:11:19.100926+0000","last_unstale":"2024-07-27T03:11:21.590226+0000","last_undegraded":"2024-07-27T03:11:21.590226+0000","last_fullsized":"2024-07-27T03:11:21.590226+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:18:44.458256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112316+0000","last_change":"2024-07-27T03:11:20.113271+0000","last_active":"2024-07-27T03:11:21.112316+0000","last_peered":"2024-07-27T03:11:21.112316+0000","last_clean":"2024-07-27T03:11:21.112316+0000","last_became_active":"2024-07-27T03:11:20.112668+0000","last_became_peered":"2024-07-27T03:11:20.112668+0000","last_unstale":"2024-07-27T03:11:21.112316+0000","last_undegraded":"2024-07-27T03:11:21.112316+0000","last_fullsized":"2024-07-27T03:11:21.112316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:24:57.993657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106014+0000","last_change":"2024-07-27T03:11:19.100643+0000","last_active":"2024-07-27T03:11:21.106014+0000","last_peered":"2024-07-27T03:11:21.106014+0000","last_clean":"2024-07-27T03:11:21.106014+0000","last_became_active":"2024-07-27T03:11:19.098024+0000","last_became_peered":"2024-07-27T03:11:19.098024+0000","last_unstale":"2024-07-27T03:11:21.106014+0000","last_undegraded":"2024-07-27T03:11:21.106014+0000","last_fullsized":"2024-07-27T03:11:21.106014+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:23:39.476947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589788+0000","last_change":"2024-07-27T03:11:20.106083+0000","last_active":"2024-07-27T03:11:21.589788+0000","last_peered":"2024-07-27T03:11:21.589788+0000","last_clean":"2024-07-27T03:11:21.589788+0000","last_became_active":"2024-07-27T03:11:20.105800+0000","last_became_peered":"2024-07-27T03:11:20.105800+0000","last_unstale":"2024-07-27T03:11:21.589788+0000","last_undegraded":"2024-07-27T03:11:21.589788+0000","last_fullsized":"2024-07-27T03:11:21.589788+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:17:58.586661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297919+0000","last_change":"2024-07-27T03:11:19.092933+0000","last_active":"2024-07-27T03:11:21.297919+0000","last_peered":"2024-07-27T03:11:21.297919+0000","last_clean":"2024-07-27T03:11:21.297919+0000","last_became_active":"2024-07-27T03:11:19.092598+0000","last_became_peered":"2024-07-27T03:11:19.092598+0000","last_unstale":"2024-07-27T03:11:21.297919+0000","last_undegraded":"2024-07-27T03:11:21.297919+0000","last_fullsized":"2024-07-27T03:11:21.297919+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:11:35.450924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106119+0000","last_change":"2024-07-27T03:11:20.108104+0000","last_active":"2024-07-27T03:11:21.106119+0000","last_peered":"2024-07-27T03:11:21.106119+0000","last_clean":"2024-07-27T03:11:21.106119+0000","last_became_active":"2024-07-27T03:11:20.107809+0000","last_became_peered":"2024-07-27T03:11:20.107809+0000","last_unstale":"2024-07-27T03:11:21.106119+0000","last_undegraded":"2024-07-27T03:11:21.106119+0000","last_fullsized":"2024-07-27T03:11:21.106119+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:52:57.758643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112439+0000","last_change":"2024-07-27T03:11:19.093549+0000","last_active":"2024-07-27T03:11:21.112439+0000","last_peered":"2024-07-27T03:11:21.112439+0000","last_clean":"2024-07-27T03:11:21.112439+0000","last_became_active":"2024-07-27T03:11:19.093252+0000","last_became_peered":"2024-07-27T03:11:19.093252+0000","last_unstale":"2024-07-27T03:11:21.112439+0000","last_undegraded":"2024-07-27T03:11:21.112439+0000","last_fullsized":"2024-07-27T03:11:21.112439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:23:39.476947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349538+0000","last_change":"2024-07-27T03:11:20.114563+0000","last_active":"2024-07-27T03:11:21.349538+0000","last_peered":"2024-07-27T03:11:21.349538+0000","last_clean":"2024-07-27T03:11:21.349538+0000","last_became_active":"2024-07-27T03:11:20.114266+0000","last_became_peered":"2024-07-27T03:11:20.114266+0000","last_unstale":"2024-07-27T03:11:21.349538+0000","last_undegraded":"2024-07-27T03:11:21.349538+0000","last_fullsized":"2024-07-27T03:11:21.349538+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:47.637990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589579+0000","last_change":"2024-07-27T03:11:19.092283+0000","last_active":"2024-07-27T03:11:21.589579+0000","last_peered":"2024-07-27T03:11:21.589579+0000","last_clean":"2024-07-27T03:11:21.589579+0000","last_became_active":"2024-07-27T03:11:19.091998+0000","last_became_peered":"2024-07-27T03:11:19.091998+0000","last_unstale":"2024-07-27T03:11:21.589579+0000","last_undegraded":"2024-07-27T03:11:21.589579+0000","last_fullsized":"2024-07-27T03:11:21.589579+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:10:21.905319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590635+0000","last_change":"2024-07-27T03:11:20.098366+0000","last_active":"2024-07-27T03:11:21.590635+0000","last_peered":"2024-07-27T03:11:21.590635+0000","last_clean":"2024-07-27T03:11:21.590635+0000","last_became_active":"2024-07-27T03:11:20.097872+0000","last_became_peered":"2024-07-27T03:11:20.097872+0000","last_unstale":"2024-07-27T03:11:21.590635+0000","last_undegraded":"2024-07-27T03:11:21.590635+0000","last_fullsized":"2024-07-27T03:11:21.590635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:25:24.629300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110740+0000","last_change":"2024-07-27T03:11:19.099204+0000","last_active":"2024-07-27T03:11:21.110740+0000","last_peered":"2024-07-27T03:11:21.110740+0000","last_clean":"2024-07-27T03:11:21.110740+0000","last_became_active":"2024-07-27T03:11:19.098765+0000","last_became_peered":"2024-07-27T03:11:19.098765+0000","last_unstale":"2024-07-27T03:11:21.110740+0000","last_undegraded":"2024-07-27T03:11:21.110740+0000","last_fullsized":"2024-07-27T03:11:21.110740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:17:57.583871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589841+0000","last_change":"2024-07-27T03:11:20.113643+0000","last_active":"2024-07-27T03:11:21.589841+0000","last_peered":"2024-07-27T03:11:21.589841+0000","last_clean":"2024-07-27T03:11:21.589841+0000","last_became_active":"2024-07-27T03:11:20.113344+0000","last_became_peered":"2024-07-27T03:11:20.113344+0000","last_unstale":"2024-07-27T03:11:21.589841+0000","last_undegraded":"2024-07-27T03:11:21.589841+0000","last_fullsized":"2024-07-27T03:11:21.589841+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:37:06.355797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589828+0000","last_change":"2024-07-27T03:11:19.103760+0000","last_active":"2024-07-27T03:11:21.589828+0000","last_peered":"2024-07-27T03:11:21.589828+0000","last_clean":"2024-07-27T03:11:21.589828+0000","last_became_active":"2024-07-27T03:11:19.103439+0000","last_became_peered":"2024-07-27T03:11:19.103439+0000","last_unstale":"2024-07-27T03:11:21.589828+0000","last_undegraded":"2024-07-27T03:11:21.589828+0000","last_fullsized":"2024-07-27T03:11:21.589828+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:11:35.450924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349783+0000","last_change":"2024-07-27T03:11:20.102983+0000","last_active":"2024-07-27T03:11:21.349783+0000","last_peered":"2024-07-27T03:11:21.349783+0000","last_clean":"2024-07-27T03:11:21.349783+0000","last_became_active":"2024-07-27T03:11:20.102477+0000","last_became_peered":"2024-07-27T03:11:20.102477+0000","last_unstale":"2024-07-27T03:11:21.349783+0000","last_undegraded":"2024-07-27T03:11:21.349783+0000","last_fullsized":"2024-07-27T03:11:21.349783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:09:18.167299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349488+0000","last_change":"2024-07-27T03:11:19.092804+0000","last_active":"2024-07-27T03:11:21.349488+0000","last_peered":"2024-07-27T03:11:21.349488+0000","last_clean":"2024-07-27T03:11:21.349488+0000","last_became_active":"2024-07-27T03:11:19.092496+0000","last_became_peered":"2024-07-27T03:11:19.092496+0000","last_unstale":"2024-07-27T03:11:21.349488+0000","last_undegraded":"2024-07-27T03:11:21.349488+0000","last_fullsized":"2024-07-27T03:11:21.349488+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:57:46.638801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349501+0000","last_change":"2024-07-27T03:11:20.100748+0000","last_active":"2024-07-27T03:11:21.349501+0000","last_peered":"2024-07-27T03:11:21.349501+0000","last_clean":"2024-07-27T03:11:21.349501+0000","last_became_active":"2024-07-27T03:11:20.100089+0000","last_became_peered":"2024-07-27T03:11:20.100089+0000","last_unstale":"2024-07-27T03:11:21.349501+0000","last_undegraded":"2024-07-27T03:11:21.349501+0000","last_fullsized":"2024-07-27T03:11:21.349501+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:04:22.697118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297706+0000","last_change":"2024-07-27T03:11:19.093235+0000","last_active":"2024-07-27T03:11:21.297706+0000","last_peered":"2024-07-27T03:11:21.297706+0000","last_clean":"2024-07-27T03:11:21.297706+0000","last_became_active":"2024-07-27T03:11:19.092865+0000","last_became_peered":"2024-07-27T03:11:19.092865+0000","last_unstale":"2024-07-27T03:11:21.297706+0000","last_undegraded":"2024-07-27T03:11:21.297706+0000","last_fullsized":"2024-07-27T03:11:21.297706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:59:57.258777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":174,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590131+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:11:21.590131+0000","last_peered":"2024-07-27T03:11:21.590131+0000","last_clean":"2024-07-27T03:11:21.590131+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:11:21.590131+0000","last_undegraded":"2024-07-27T03:11:21.590131+0000","last_fullsized":"2024-07-27T03:11:21.590131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":871548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":281672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36016,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335824,"statfs":{"total":96636764160,"available":96599883776,"internally_reserved":0,"allocated":684032,"data_stored":281076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":281076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36604,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335236,"statfs":{"total":96636764160,"available":96599281664,"internally_reserved":0,"allocated":1286144,"data_stored":873582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":675840,"data_stored":281020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":688128,"data_stored":282632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":679936,"data_stored":281110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:11:24.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-07-27T03:11:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.022+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1825451732 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d415ec10 msgr2=0x7ff7d415f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.022+0000 7ff7dc18f640 1 --2- 172.21.15.120:0/1825451732 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d415ec10 0x7ff7d415f020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc005fd0 tx=0x7ff7cc02a820 comp rx=0 tx=0).stop 2024-07-27T03:11:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.022+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1825451732 shutdown_connections 2024-07-27T03:11:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.022+0000 7ff7dc18f640 1 --2- 172.21.15.120:0/1825451732 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d415ec10 0x7ff7d415f020 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.022+0000 7ff7dc18f640 1 --2- 172.21.15.120:0/1825451732 >> v2:172.21.15.121:3300/0 conn(0x7ff7d406e270 0x7ff7d4073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.022+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1825451732 >> 172.21.15.120:0/1825451732 conn(0x7ff7d40b1a10 msgr2=0x7ff7d40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.022+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1825451732 shutdown_connections 2024-07-27T03:11:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.022+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1825451732 wait complete. 2024-07-27T03:11:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.024+0000 7ff7dc18f640 1 Processor -- start 2024-07-27T03:11:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.024+0000 7ff7dc18f640 1 -- start start 2024-07-27T03:11:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.025+0000 7ff7dc18f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d406e270 0x7ff7d41421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.025+0000 7ff7dc18f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7d41522e0 0x7ff7d41f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.025+0000 7ff7dc18f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7d415ec10 0x7ff7d406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.025+0000 7ff7dc18f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d415f8f0 con 0x7ff7d41522e0 2024-07-27T03:11:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.025+0000 7ff7dc18f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d415f770 con 0x7ff7d415ec10 2024-07-27T03:11:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.025+0000 7ff7dc18f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d415fa70 con 0x7ff7d406e270 2024-07-27T03:11:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.025+0000 7ff7d972a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7d41522e0 0x7ff7d41f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.025+0000 7ff7d972a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7d41522e0 0x7ff7d41f6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51090/0 (socket says 172.21.15.120:51090) 2024-07-27T03:11:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.025+0000 7ff7d972a640 1 -- 172.21.15.120:0/1284476130 learned_addr learned my addr 172.21.15.120:0/1284476130 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.025+0000 7ff7d9f2b640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d406e270 0x7ff7d41421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7da72c640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7d415ec10 0x7ff7d406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7d972a640 1 -- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d406e270 msgr2=0x7ff7d41421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7d972a640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d406e270 0x7ff7d41421e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7d972a640 1 -- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7d415ec10 msgr2=0x7ff7d406eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7d972a640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7d415ec10 0x7ff7d406eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7d972a640 1 -- 172.21.15.120:0/1284476130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d4145a60 con 0x7ff7d41522e0 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7d972a640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7d41522e0 0x7ff7d41f6980 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400e9f0 tx=0x7ff7c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7ca7fc640 1 -- 172.21.15.120:0/1284476130 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400cd80 con 0x7ff7d41522e0 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1284476130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d4144ca0 con 0x7ff7d41522e0 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7ca7fc640 1 -- 172.21.15.120:0/1284476130 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7c4004020 con 0x7ff7d41522e0 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7ca7fc640 1 -- 172.21.15.120:0/1284476130 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4004470 con 0x7ff7d41522e0 2024-07-27T03:11:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.026+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1284476130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d4145260 con 0x7ff7d41522e0 2024-07-27T03:11:25.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.027+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1284476130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d41f7460 con 0x7ff7d41522e0 2024-07-27T03:11:25.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.028+0000 7ff7ca7fc640 1 -- 172.21.15.120:0/1284476130 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff7c40035f0 con 0x7ff7d41522e0 2024-07-27T03:11:25.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.028+0000 7ff7ca7fc640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7b8077010 0x7ff7b8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:25.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.029+0000 7ff7ca7fc640 1 -- 172.21.15.120:0/1284476130 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7ff7c40991e0 con 0x7ff7d41522e0 2024-07-27T03:11:25.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.029+0000 7ff7d9f2b640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7b8077010 0x7ff7b8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:25.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.029+0000 7ff7d9f2b640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7b8077010 0x7ff7b8079520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0001610 tx=0x7ff7d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:25.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.033+0000 7ff7ca7fc640 1 -- 172.21.15.120:0/1284476130 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff7c40623f0 con 0x7ff7d41522e0 2024-07-27T03:11:25.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.291+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1284476130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff7d415f020 con 0x7ff7d41522e0 2024-07-27T03:11:25.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.292+0000 7ff7ca7fc640 1 -- 172.21.15.120:0/1284476130 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1055 (secure 0 0 0) 0x7ff7c4061cf0 con 0x7ff7d41522e0 2024-07-27T03:11:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:25.296 INFO:teuthology.orchestra.run.smithi120.stdout:{"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":189,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1722049707,"num_in_osds":8,"osd_in_since":1722049699,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":274898944,"bytes_avail":772819214336,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":50,"btime":"2024-07-27T03:11:23:110568+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5733}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-07-27T03:11:08.571799+0000","services":{}},"progress_events":{}} 2024-07-27T03:11:25.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7b8077010 msgr2=0x7ff7b8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:25.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7b8077010 0x7ff7b8079520 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0001610 tx=0x7ff7d0009040 comp rx=0 tx=0).stop 2024-07-27T03:11:25.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1284476130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7d41522e0 msgr2=0x7ff7d41f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:25.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7d41522e0 0x7ff7d41f6980 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400e9f0 tx=0x7ff7c400eeb0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1284476130 shutdown_connections 2024-07-27T03:11:25.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7b8077010 0x7ff7b8079520 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7d41522e0 0x7ff7d41f6980 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7d415ec10 0x7ff7d406eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 --2- 172.21.15.120:0/1284476130 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d406e270 0x7ff7d41421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1284476130 >> 172.21.15.120:0/1284476130 conn(0x7ff7d40b1a10 msgr2=0x7ff7d40cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:25.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1284476130 shutdown_connections 2024-07-27T03:11:25.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.294+0000 7ff7dc18f640 1 -- 172.21.15.120:0/1284476130 wait complete. 2024-07-27T03:11:25.309 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-07-27T03:11:25.309 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:11:25.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.419+0000 7f55e584a640 1 -- 172.21.15.120:0/3297219093 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55e00d10d0 msgr2=0x7f55e00d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:25.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.419+0000 7f55e584a640 1 --2- 172.21.15.120:0/3297219093 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55e00d10d0 0x7f55e00d2bf0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f55e00b3b30 tx=0x7f55d802aa30 comp rx=0 tx=0).stop 2024-07-27T03:11:25.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.419+0000 7f55e584a640 1 -- 172.21.15.120:0/3297219093 shutdown_connections 2024-07-27T03:11:25.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.419+0000 7f55e584a640 1 --2- 172.21.15.120:0/3297219093 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55e00d10d0 0x7f55e00d2bf0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.419+0000 7f55e584a640 1 --2- 172.21.15.120:0/3297219093 >> v2:172.21.15.121:3300/0 conn(0x7f55e00b4740 0x7f55e00b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.419+0000 7f55e584a640 1 -- 172.21.15.120:0/3297219093 >> 172.21.15.120:0/3297219093 conn(0x7f55e008d690 msgr2=0x7f55e009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:25.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.419+0000 7f55e584a640 1 -- 172.21.15.120:0/3297219093 shutdown_connections 2024-07-27T03:11:25.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.419+0000 7f55e584a640 1 -- 172.21.15.120:0/3297219093 wait complete. 2024-07-27T03:11:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.420+0000 7f55e584a640 1 Processor -- start 2024-07-27T03:11:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.421+0000 7f55e584a640 1 -- start start 2024-07-27T03:11:25.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55e584a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55e00b4740 0x7f55e01f9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:25.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55e584a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e00d27e0 0x7f55e00a1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:25.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55e584a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55e015c350 0x7f55e00cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55e584a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f55e00cef70 con 0x7f55e015c350 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55e584a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55e00cedf0 con 0x7f55e00d27e0 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55e584a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f55e00cf0f0 con 0x7f55e00b4740 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55df7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55e015c350 0x7f55e00cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55df7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55e015c350 0x7f55e00cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51114/0 (socket says 172.21.15.120:51114) 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55df7fe640 1 -- 172.21.15.120:0/124834015 learned_addr learned my addr 172.21.15.120:0/124834015 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55de7fc640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e00d27e0 0x7f55e00a1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55deffd640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55e00b4740 0x7f55e01f9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55df7fe640 1 -- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55e00b4740 msgr2=0x7f55e01f9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55df7fe640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55e00b4740 0x7f55e01f9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55df7fe640 1 -- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e00d27e0 msgr2=0x7f55e00a1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55df7fe640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e00d27e0 0x7f55e00a1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.422+0000 7f55df7fe640 1 -- 172.21.15.120:0/124834015 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e01f9b70 con 0x7f55e015c350 2024-07-27T03:11:25.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.423+0000 7f55df7fe640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55e015c350 0x7f55e00cced0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f55d802b020 tx=0x7f55d8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:25.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.423+0000 7f55c7fff640 1 -- 172.21.15.120:0/124834015 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8033050 con 0x7f55e015c350 2024-07-27T03:11:25.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.423+0000 7f55c7fff640 1 -- 172.21.15.120:0/124834015 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55d8004550 con 0x7f55e015c350 2024-07-27T03:11:25.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.423+0000 7f55e584a640 1 -- 172.21.15.120:0/124834015 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e00cb3d0 con 0x7f55e015c350 2024-07-27T03:11:25.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.423+0000 7f55c7fff640 1 -- 172.21.15.120:0/124834015 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8038450 con 0x7f55e015c350 2024-07-27T03:11:25.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.423+0000 7f55e584a640 1 -- 172.21.15.120:0/124834015 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e01f8e30 con 0x7f55e015c350 2024-07-27T03:11:25.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.424+0000 7f55e584a640 1 -- 172.21.15.120:0/124834015 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e00cb140 con 0x7f55e015c350 2024-07-27T03:11:25.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.425+0000 7f55c7fff640 1 -- 172.21.15.120:0/124834015 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f55d8036070 con 0x7f55e015c350 2024-07-27T03:11:25.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.425+0000 7f55c7fff640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 0x7f55cc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:25.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.425+0000 7f55c7fff640 1 -- 172.21.15.120:0/124834015 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f55d80b9c60 con 0x7f55e015c350 2024-07-27T03:11:25.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.426+0000 7f55deffd640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 0x7f55cc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:25.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.426+0000 7f55deffd640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 0x7f55cc079520 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f55d00058c0 tx=0x7f55d0005f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:25.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.430+0000 7f55c7fff640 1 -- 172.21.15.120:0/124834015 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f55d80828a0 con 0x7f55e015c350 2024-07-27T03:11:25.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.608+0000 7f55e584a640 1 -- 172.21.15.120:0/124834015 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55e00d2bf0 con 0x7f55cc077010 2024-07-27T03:11:25.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.613+0000 7f55c7fff640 1 -- 172.21.15.120:0/124834015 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f55e00d2bf0 con 0x7f55cc077010 2024-07-27T03:11:25.619 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:25.620 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:11:25.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 -- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 msgr2=0x7f55cc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:25.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 0x7f55cc079520 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f55d00058c0 tx=0x7f55d0005f60 comp rx=0 tx=0).stop 2024-07-27T03:11:25.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 -- 172.21.15.120:0/124834015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55e015c350 msgr2=0x7f55e00cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:25.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55e015c350 0x7f55e00cced0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f55d802b020 tx=0x7f55d8003f10 comp rx=0 tx=0).stop 2024-07-27T03:11:25.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 -- 172.21.15.120:0/124834015 shutdown_connections 2024-07-27T03:11:25.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 0x7f55cc079520 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55e015c350 0x7f55e00cced0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e00d27e0 0x7f55e00a1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 --2- 172.21.15.120:0/124834015 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55e00b4740 0x7f55e01f9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:25.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 -- 172.21.15.120:0/124834015 >> 172.21.15.120:0/124834015 conn(0x7f55e008d690 msgr2=0x7f55e00d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:25.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 -- 172.21.15.120:0/124834015 shutdown_connections 2024-07-27T03:11:25.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:25.616+0000 7f55e584a640 1 -- 172.21.15.120:0/124834015 wait complete. 2024-07-27T03:11:25.631 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-07-27T03:11:24.575361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":268456,"kb_used_data":6504,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":754706264,"statfs":{"total":773094113280,"available":772819214336,"internally_reserved":0,"allocated":6660096,"data_stored":3433716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":268095024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001541"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589815+0000","last_change":"2024-07-27T03:11:20.101120+0000","last_active":"2024-07-27T03:11:21.589815+0000","last_peered":"2024-07-27T03:11:21.589815+0000","last_clean":"2024-07-27T03:11:21.589815+0000","last_became_active":"2024-07-27T03:11:20.100402+0000","last_became_peered":"2024-07-27T03:11:20.100402+0000","last_unstale":"2024-07-27T03:11:21.589815+0000","last_undegraded":"2024-07-27T03:11:21.589815+0000","last_fullsized":"2024-07-27T03:11:21.589815+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:27:44.887939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349600+0000","last_change":"2024-07-27T03:11:20.112523+0000","last_active":"2024-07-27T03:11:21.349600+0000","last_peered":"2024-07-27T03:11:21.349600+0000","last_clean":"2024-07-27T03:11:21.349600+0000","last_became_active":"2024-07-27T03:11:20.112152+0000","last_became_peered":"2024-07-27T03:11:20.112152+0000","last_unstale":"2024-07-27T03:11:21.349600+0000","last_undegraded":"2024-07-27T03:11:21.349600+0000","last_fullsized":"2024-07-27T03:11:21.349600+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:43:13.334213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590635+0000","last_change":"2024-07-27T03:11:20.101310+0000","last_active":"2024-07-27T03:11:21.590635+0000","last_peered":"2024-07-27T03:11:21.590635+0000","last_clean":"2024-07-27T03:11:21.590635+0000","last_became_active":"2024-07-27T03:11:20.101014+0000","last_became_peered":"2024-07-27T03:11:20.101014+0000","last_unstale":"2024-07-27T03:11:21.590635+0000","last_undegraded":"2024-07-27T03:11:21.590635+0000","last_fullsized":"2024-07-27T03:11:21.590635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:26:47.403266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112350+0000","last_change":"2024-07-27T03:11:20.108371+0000","last_active":"2024-07-27T03:11:21.112350+0000","last_peered":"2024-07-27T03:11:21.112350+0000","last_clean":"2024-07-27T03:11:21.112350+0000","last_became_active":"2024-07-27T03:11:20.107937+0000","last_became_peered":"2024-07-27T03:11:20.107937+0000","last_unstale":"2024-07-27T03:11:21.112350+0000","last_undegraded":"2024-07-27T03:11:21.112350+0000","last_fullsized":"2024-07-27T03:11:21.112350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:45:21.326718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590195+0000","last_change":"2024-07-27T03:11:20.104726+0000","last_active":"2024-07-27T03:11:21.590195+0000","last_peered":"2024-07-27T03:11:21.590195+0000","last_clean":"2024-07-27T03:11:21.590195+0000","last_became_active":"2024-07-27T03:11:20.104367+0000","last_became_peered":"2024-07-27T03:11:20.104367+0000","last_unstale":"2024-07-27T03:11:21.590195+0000","last_undegraded":"2024-07-27T03:11:21.590195+0000","last_fullsized":"2024-07-27T03:11:21.590195+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:26:04.005879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105457+0000","last_change":"2024-07-27T03:11:20.106461+0000","last_active":"2024-07-27T03:11:21.105457+0000","last_peered":"2024-07-27T03:11:21.105457+0000","last_clean":"2024-07-27T03:11:21.105457+0000","last_became_active":"2024-07-27T03:11:20.106158+0000","last_became_peered":"2024-07-27T03:11:20.106158+0000","last_unstale":"2024-07-27T03:11:21.105457+0000","last_undegraded":"2024-07-27T03:11:21.105457+0000","last_fullsized":"2024-07-27T03:11:21.105457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:04:54.827444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110401+0000","last_change":"2024-07-27T03:11:20.110733+0000","last_active":"2024-07-27T03:11:21.110401+0000","last_peered":"2024-07-27T03:11:21.110401+0000","last_clean":"2024-07-27T03:11:21.110401+0000","last_became_active":"2024-07-27T03:11:20.109313+0000","last_became_peered":"2024-07-27T03:11:20.109313+0000","last_unstale":"2024-07-27T03:11:21.110401+0000","last_undegraded":"2024-07-27T03:11:21.110401+0000","last_fullsized":"2024-07-27T03:11:21.110401+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:38:37.104222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349338+0000","last_change":"2024-07-27T03:11:20.093990+0000","last_active":"2024-07-27T03:11:21.349338+0000","last_peered":"2024-07-27T03:11:21.349338+0000","last_clean":"2024-07-27T03:11:21.349338+0000","last_became_active":"2024-07-27T03:11:20.093667+0000","last_became_peered":"2024-07-27T03:11:20.093667+0000","last_unstale":"2024-07-27T03:11:21.349338+0000","last_undegraded":"2024-07-27T03:11:21.349338+0000","last_fullsized":"2024-07-27T03:11:21.349338+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:48:29.608996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110722+0000","last_change":"2024-07-27T03:11:20.111742+0000","last_active":"2024-07-27T03:11:21.110722+0000","last_peered":"2024-07-27T03:11:21.110722+0000","last_clean":"2024-07-27T03:11:21.110722+0000","last_became_active":"2024-07-27T03:11:20.111348+0000","last_became_peered":"2024-07-27T03:11:20.111348+0000","last_unstale":"2024-07-27T03:11:21.110722+0000","last_undegraded":"2024-07-27T03:11:21.110722+0000","last_fullsized":"2024-07-27T03:11:21.110722+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:27:49.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590278+0000","last_change":"2024-07-27T03:11:20.103525+0000","last_active":"2024-07-27T03:11:21.590278+0000","last_peered":"2024-07-27T03:11:21.590278+0000","last_clean":"2024-07-27T03:11:21.590278+0000","last_became_active":"2024-07-27T03:11:20.103196+0000","last_became_peered":"2024-07-27T03:11:20.103196+0000","last_unstale":"2024-07-27T03:11:21.590278+0000","last_undegraded":"2024-07-27T03:11:21.590278+0000","last_fullsized":"2024-07-27T03:11:21.590278+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:13:07.975210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589975+0000","last_change":"2024-07-27T03:11:20.115324+0000","last_active":"2024-07-27T03:11:21.589975+0000","last_peered":"2024-07-27T03:11:21.589975+0000","last_clean":"2024-07-27T03:11:21.589975+0000","last_became_active":"2024-07-27T03:11:20.115044+0000","last_became_peered":"2024-07-27T03:11:20.115044+0000","last_unstale":"2024-07-27T03:11:21.589975+0000","last_undegraded":"2024-07-27T03:11:21.589975+0000","last_fullsized":"2024-07-27T03:11:21.589975+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:21:49.401456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112363+0000","last_change":"2024-07-27T03:11:20.112333+0000","last_active":"2024-07-27T03:11:21.112363+0000","last_peered":"2024-07-27T03:11:21.112363+0000","last_clean":"2024-07-27T03:11:21.112363+0000","last_became_active":"2024-07-27T03:11:20.111922+0000","last_became_peered":"2024-07-27T03:11:20.111922+0000","last_unstale":"2024-07-27T03:11:21.112363+0000","last_undegraded":"2024-07-27T03:11:21.112363+0000","last_fullsized":"2024-07-27T03:11:21.112363+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:26:22.157427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297947+0000","last_change":"2024-07-27T03:11:20.108166+0000","last_active":"2024-07-27T03:11:21.297947+0000","last_peered":"2024-07-27T03:11:21.297947+0000","last_clean":"2024-07-27T03:11:21.297947+0000","last_became_active":"2024-07-27T03:11:20.107370+0000","last_became_peered":"2024-07-27T03:11:20.107370+0000","last_unstale":"2024-07-27T03:11:21.297947+0000","last_undegraded":"2024-07-27T03:11:21.297947+0000","last_fullsized":"2024-07-27T03:11:21.297947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:04:07.807790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110594+0000","last_change":"2024-07-27T03:11:20.110362+0000","last_active":"2024-07-27T03:11:21.110594+0000","last_peered":"2024-07-27T03:11:21.110594+0000","last_clean":"2024-07-27T03:11:21.110594+0000","last_became_active":"2024-07-27T03:11:20.106686+0000","last_became_peered":"2024-07-27T03:11:20.106686+0000","last_unstale":"2024-07-27T03:11:21.110594+0000","last_undegraded":"2024-07-27T03:11:21.110594+0000","last_fullsized":"2024-07-27T03:11:21.110594+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:50:09.712343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111060+0000","last_change":"2024-07-27T03:11:20.115470+0000","last_active":"2024-07-27T03:11:21.111060+0000","last_peered":"2024-07-27T03:11:21.111060+0000","last_clean":"2024-07-27T03:11:21.111060+0000","last_became_active":"2024-07-27T03:11:20.115128+0000","last_became_peered":"2024-07-27T03:11:20.115128+0000","last_unstale":"2024-07-27T03:11:21.111060+0000","last_undegraded":"2024-07-27T03:11:21.111060+0000","last_fullsized":"2024-07-27T03:11:21.111060+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:17:06.113066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105371+0000","last_change":"2024-07-27T03:11:20.109153+0000","last_active":"2024-07-27T03:11:21.105371+0000","last_peered":"2024-07-27T03:11:21.105371+0000","last_clean":"2024-07-27T03:11:21.105371+0000","last_became_active":"2024-07-27T03:11:20.108478+0000","last_became_peered":"2024-07-27T03:11:20.108478+0000","last_unstale":"2024-07-27T03:11:21.105371+0000","last_undegraded":"2024-07-27T03:11:21.105371+0000","last_fullsized":"2024-07-27T03:11:21.105371+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:00:02.863737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349620+0000","last_change":"2024-07-27T03:11:20.102545+0000","last_active":"2024-07-27T03:11:21.349620+0000","last_peered":"2024-07-27T03:11:21.349620+0000","last_clean":"2024-07-27T03:11:21.349620+0000","last_became_active":"2024-07-27T03:11:20.102270+0000","last_became_peered":"2024-07-27T03:11:20.102270+0000","last_unstale":"2024-07-27T03:11:21.349620+0000","last_undegraded":"2024-07-27T03:11:21.349620+0000","last_fullsized":"2024-07-27T03:11:21.349620+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:32:17.691215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590728+0000","last_change":"2024-07-27T03:11:20.109350+0000","last_active":"2024-07-27T03:11:21.590728+0000","last_peered":"2024-07-27T03:11:21.590728+0000","last_clean":"2024-07-27T03:11:21.590728+0000","last_became_active":"2024-07-27T03:11:20.109004+0000","last_became_peered":"2024-07-27T03:11:20.109004+0000","last_unstale":"2024-07-27T03:11:21.590728+0000","last_undegraded":"2024-07-27T03:11:21.590728+0000","last_fullsized":"2024-07-27T03:11:21.590728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:30:18.070376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589919+0000","last_change":"2024-07-27T03:11:20.100723+0000","last_active":"2024-07-27T03:11:21.589919+0000","last_peered":"2024-07-27T03:11:21.589919+0000","last_clean":"2024-07-27T03:11:21.589919+0000","last_became_active":"2024-07-27T03:11:20.100418+0000","last_became_peered":"2024-07-27T03:11:20.100418+0000","last_unstale":"2024-07-27T03:11:21.589919+0000","last_undegraded":"2024-07-27T03:11:21.589919+0000","last_fullsized":"2024-07-27T03:11:21.589919+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:41:44.860333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349702+0000","last_change":"2024-07-27T03:11:20.110047+0000","last_active":"2024-07-27T03:11:21.349702+0000","last_peered":"2024-07-27T03:11:21.349702+0000","last_clean":"2024-07-27T03:11:21.349702+0000","last_became_active":"2024-07-27T03:11:20.109581+0000","last_became_peered":"2024-07-27T03:11:20.109581+0000","last_unstale":"2024-07-27T03:11:21.349702+0000","last_undegraded":"2024-07-27T03:11:21.349702+0000","last_fullsized":"2024-07-27T03:11:21.349702+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:49:00.372071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590417+0000","last_change":"2024-07-27T03:11:20.106433+0000","last_active":"2024-07-27T03:11:21.590417+0000","last_peered":"2024-07-27T03:11:21.590417+0000","last_clean":"2024-07-27T03:11:21.590417+0000","last_became_active":"2024-07-27T03:11:20.106127+0000","last_became_peered":"2024-07-27T03:11:20.106127+0000","last_unstale":"2024-07-27T03:11:21.590417+0000","last_undegraded":"2024-07-27T03:11:21.590417+0000","last_fullsized":"2024-07-27T03:11:21.590417+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:24:57.993657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349315+0000","last_change":"2024-07-27T03:11:20.104597+0000","last_active":"2024-07-27T03:11:21.349315+0000","last_peered":"2024-07-27T03:11:21.349315+0000","last_clean":"2024-07-27T03:11:21.349315+0000","last_became_active":"2024-07-27T03:11:20.104290+0000","last_became_peered":"2024-07-27T03:11:20.104290+0000","last_unstale":"2024-07-27T03:11:21.349315+0000","last_undegraded":"2024-07-27T03:11:21.349315+0000","last_fullsized":"2024-07-27T03:11:21.349315+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:12:03.777855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590611+0000","last_change":"2024-07-27T03:11:20.098631+0000","last_active":"2024-07-27T03:11:21.590611+0000","last_peered":"2024-07-27T03:11:21.590611+0000","last_clean":"2024-07-27T03:11:21.590611+0000","last_became_active":"2024-07-27T03:11:20.097947+0000","last_became_peered":"2024-07-27T03:11:20.097947+0000","last_unstale":"2024-07-27T03:11:21.590611+0000","last_undegraded":"2024-07-27T03:11:21.590611+0000","last_fullsized":"2024-07-27T03:11:21.590611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:26:22.157427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297964+0000","last_change":"2024-07-27T03:11:20.110392+0000","last_active":"2024-07-27T03:11:21.297964+0000","last_peered":"2024-07-27T03:11:21.297964+0000","last_clean":"2024-07-27T03:11:21.297964+0000","last_became_active":"2024-07-27T03:11:20.110054+0000","last_became_peered":"2024-07-27T03:11:20.110054+0000","last_unstale":"2024-07-27T03:11:21.297964+0000","last_undegraded":"2024-07-27T03:11:21.297964+0000","last_fullsized":"2024-07-27T03:11:21.297964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:23:48.246374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590009+0000","last_change":"2024-07-27T03:11:20.118175+0000","last_active":"2024-07-27T03:11:21.590009+0000","last_peered":"2024-07-27T03:11:21.590009+0000","last_clean":"2024-07-27T03:11:21.590009+0000","last_became_active":"2024-07-27T03:11:20.117513+0000","last_became_peered":"2024-07-27T03:11:20.117513+0000","last_unstale":"2024-07-27T03:11:21.590009+0000","last_undegraded":"2024-07-27T03:11:21.590009+0000","last_fullsized":"2024-07-27T03:11:21.590009+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:33:10.009836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111918+0000","last_change":"2024-07-27T03:11:20.105616+0000","last_active":"2024-07-27T03:11:21.111918+0000","last_peered":"2024-07-27T03:11:21.111918+0000","last_clean":"2024-07-27T03:11:21.111918+0000","last_became_active":"2024-07-27T03:11:20.102991+0000","last_became_peered":"2024-07-27T03:11:20.102991+0000","last_unstale":"2024-07-27T03:11:21.111918+0000","last_undegraded":"2024-07-27T03:11:21.111918+0000","last_fullsized":"2024-07-27T03:11:21.111918+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:28:43.066840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105657+0000","last_change":"2024-07-27T03:11:20.107423+0000","last_active":"2024-07-27T03:11:21.105657+0000","last_peered":"2024-07-27T03:11:21.105657+0000","last_clean":"2024-07-27T03:11:21.105657+0000","last_became_active":"2024-07-27T03:11:20.107081+0000","last_became_peered":"2024-07-27T03:11:20.107081+0000","last_unstale":"2024-07-27T03:11:21.105657+0000","last_undegraded":"2024-07-27T03:11:21.105657+0000","last_fullsized":"2024-07-27T03:11:21.105657+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:26:22.157427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589985+0000","last_change":"2024-07-27T03:11:20.105880+0000","last_active":"2024-07-27T03:11:21.589985+0000","last_peered":"2024-07-27T03:11:21.589985+0000","last_clean":"2024-07-27T03:11:21.589985+0000","last_became_active":"2024-07-27T03:11:20.105585+0000","last_became_peered":"2024-07-27T03:11:20.105585+0000","last_unstale":"2024-07-27T03:11:21.589985+0000","last_undegraded":"2024-07-27T03:11:21.589985+0000","last_fullsized":"2024-07-27T03:11:21.589985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:34:06.075388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349743+0000","last_change":"2024-07-27T03:11:20.112205+0000","last_active":"2024-07-27T03:11:21.349743+0000","last_peered":"2024-07-27T03:11:21.349743+0000","last_clean":"2024-07-27T03:11:21.349743+0000","last_became_active":"2024-07-27T03:11:20.111888+0000","last_became_peered":"2024-07-27T03:11:20.111888+0000","last_unstale":"2024-07-27T03:11:21.349743+0000","last_undegraded":"2024-07-27T03:11:21.349743+0000","last_fullsized":"2024-07-27T03:11:21.349743+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:00:54.320660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590228+0000","last_change":"2024-07-27T03:11:20.093636+0000","last_active":"2024-07-27T03:11:21.590228+0000","last_peered":"2024-07-27T03:11:21.590228+0000","last_clean":"2024-07-27T03:11:21.590228+0000","last_became_active":"2024-07-27T03:11:20.093298+0000","last_became_peered":"2024-07-27T03:11:20.093298+0000","last_unstale":"2024-07-27T03:11:21.590228+0000","last_undegraded":"2024-07-27T03:11:21.590228+0000","last_fullsized":"2024-07-27T03:11:21.590228+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:00:02.863737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589768+0000","last_change":"2024-07-27T03:11:20.117879+0000","last_active":"2024-07-27T03:11:21.589768+0000","last_peered":"2024-07-27T03:11:21.589768+0000","last_clean":"2024-07-27T03:11:21.589768+0000","last_became_active":"2024-07-27T03:11:20.117566+0000","last_became_peered":"2024-07-27T03:11:20.117566+0000","last_unstale":"2024-07-27T03:11:21.589768+0000","last_undegraded":"2024-07-27T03:11:21.589768+0000","last_fullsized":"2024-07-27T03:11:21.589768+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:43:44.053246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105458+0000","last_change":"2024-07-27T03:11:20.109422+0000","last_active":"2024-07-27T03:11:21.105458+0000","last_peered":"2024-07-27T03:11:21.105458+0000","last_clean":"2024-07-27T03:11:21.105458+0000","last_became_active":"2024-07-27T03:11:20.108816+0000","last_became_peered":"2024-07-27T03:11:20.108816+0000","last_unstale":"2024-07-27T03:11:21.105458+0000","last_undegraded":"2024-07-27T03:11:21.105458+0000","last_fullsized":"2024-07-27T03:11:21.105458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:24:57.993657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106010+0000","last_change":"2024-07-27T03:11:20.107884+0000","last_active":"2024-07-27T03:11:21.106010+0000","last_peered":"2024-07-27T03:11:21.106010+0000","last_clean":"2024-07-27T03:11:21.106010+0000","last_became_active":"2024-07-27T03:11:20.107509+0000","last_became_peered":"2024-07-27T03:11:20.107509+0000","last_unstale":"2024-07-27T03:11:21.106010+0000","last_undegraded":"2024-07-27T03:11:21.106010+0000","last_fullsized":"2024-07-27T03:11:21.106010+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:19:25.908150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106004+0000","last_change":"2024-07-27T03:11:19.101102+0000","last_active":"2024-07-27T03:11:21.106004+0000","last_peered":"2024-07-27T03:11:21.106004+0000","last_clean":"2024-07-27T03:11:21.106004+0000","last_became_active":"2024-07-27T03:11:19.100787+0000","last_became_peered":"2024-07-27T03:11:19.100787+0000","last_unstale":"2024-07-27T03:11:21.106004+0000","last_undegraded":"2024-07-27T03:11:21.106004+0000","last_fullsized":"2024-07-27T03:11:21.106004+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:39.555321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590149+0000","last_change":"2024-07-27T03:11:20.114371+0000","last_active":"2024-07-27T03:11:21.590149+0000","last_peered":"2024-07-27T03:11:21.590149+0000","last_clean":"2024-07-27T03:11:21.590149+0000","last_became_active":"2024-07-27T03:11:20.112824+0000","last_became_peered":"2024-07-27T03:11:20.112824+0000","last_unstale":"2024-07-27T03:11:21.590149+0000","last_undegraded":"2024-07-27T03:11:21.590149+0000","last_fullsized":"2024-07-27T03:11:21.590149+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:57:37.434152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349493+0000","last_change":"2024-07-27T03:11:19.101555+0000","last_active":"2024-07-27T03:11:21.349493+0000","last_peered":"2024-07-27T03:11:21.349493+0000","last_clean":"2024-07-27T03:11:21.349493+0000","last_became_active":"2024-07-27T03:11:19.101157+0000","last_became_peered":"2024-07-27T03:11:19.101157+0000","last_unstale":"2024-07-27T03:11:21.349493+0000","last_undegraded":"2024-07-27T03:11:21.349493+0000","last_fullsized":"2024-07-27T03:11:21.349493+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:38:58.534784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106012+0000","last_change":"2024-07-27T03:11:20.116157+0000","last_active":"2024-07-27T03:11:21.106012+0000","last_peered":"2024-07-27T03:11:21.106012+0000","last_clean":"2024-07-27T03:11:21.106012+0000","last_became_active":"2024-07-27T03:11:20.115836+0000","last_became_peered":"2024-07-27T03:11:20.115836+0000","last_unstale":"2024-07-27T03:11:21.106012+0000","last_undegraded":"2024-07-27T03:11:21.106012+0000","last_fullsized":"2024-07-27T03:11:21.106012+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:30:18.070376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106123+0000","last_change":"2024-07-27T03:11:19.098946+0000","last_active":"2024-07-27T03:11:21.106123+0000","last_peered":"2024-07-27T03:11:21.106123+0000","last_clean":"2024-07-27T03:11:21.106123+0000","last_became_active":"2024-07-27T03:11:19.098638+0000","last_became_peered":"2024-07-27T03:11:19.098638+0000","last_unstale":"2024-07-27T03:11:21.106123+0000","last_undegraded":"2024-07-27T03:11:21.106123+0000","last_fullsized":"2024-07-27T03:11:21.106123+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:17:07.949100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105860+0000","last_change":"2024-07-27T03:11:20.108339+0000","last_active":"2024-07-27T03:11:21.105860+0000","last_peered":"2024-07-27T03:11:21.105860+0000","last_clean":"2024-07-27T03:11:21.105860+0000","last_became_active":"2024-07-27T03:11:20.107924+0000","last_became_peered":"2024-07-27T03:11:20.107924+0000","last_unstale":"2024-07-27T03:11:21.105860+0000","last_undegraded":"2024-07-27T03:11:21.105860+0000","last_fullsized":"2024-07-27T03:11:21.105860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:25:24.629300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112422+0000","last_change":"2024-07-27T03:11:19.099329+0000","last_active":"2024-07-27T03:11:21.112422+0000","last_peered":"2024-07-27T03:11:21.112422+0000","last_clean":"2024-07-27T03:11:21.112422+0000","last_became_active":"2024-07-27T03:11:19.098986+0000","last_became_peered":"2024-07-27T03:11:19.098986+0000","last_unstale":"2024-07-27T03:11:21.112422+0000","last_undegraded":"2024-07-27T03:11:21.112422+0000","last_fullsized":"2024-07-27T03:11:21.112422+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:39.555321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349335+0000","last_change":"2024-07-27T03:11:20.103941+0000","last_active":"2024-07-27T03:11:21.349335+0000","last_peered":"2024-07-27T03:11:21.349335+0000","last_clean":"2024-07-27T03:11:21.349335+0000","last_became_active":"2024-07-27T03:11:20.103624+0000","last_became_peered":"2024-07-27T03:11:20.103624+0000","last_unstale":"2024-07-27T03:11:21.349335+0000","last_undegraded":"2024-07-27T03:11:21.349335+0000","last_fullsized":"2024-07-27T03:11:21.349335+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:55:46.633797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110491+0000","last_change":"2024-07-27T03:11:19.098581+0000","last_active":"2024-07-27T03:11:21.110491+0000","last_peered":"2024-07-27T03:11:21.110491+0000","last_clean":"2024-07-27T03:11:21.110491+0000","last_became_active":"2024-07-27T03:11:19.098202+0000","last_became_peered":"2024-07-27T03:11:19.098202+0000","last_unstale":"2024-07-27T03:11:21.110491+0000","last_undegraded":"2024-07-27T03:11:21.110491+0000","last_fullsized":"2024-07-27T03:11:21.110491+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:37:05.353006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349562+0000","last_change":"2024-07-27T03:11:20.111246+0000","last_active":"2024-07-27T03:11:21.349562+0000","last_peered":"2024-07-27T03:11:21.349562+0000","last_clean":"2024-07-27T03:11:21.349562+0000","last_became_active":"2024-07-27T03:11:20.110640+0000","last_became_peered":"2024-07-27T03:11:20.110640+0000","last_unstale":"2024-07-27T03:11:21.349562+0000","last_undegraded":"2024-07-27T03:11:21.349562+0000","last_fullsized":"2024-07-27T03:11:21.349562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:49:37.998416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105367+0000","last_change":"2024-07-27T03:11:19.094008+0000","last_active":"2024-07-27T03:11:21.105367+0000","last_peered":"2024-07-27T03:11:21.105367+0000","last_clean":"2024-07-27T03:11:21.105367+0000","last_became_active":"2024-07-27T03:11:19.093688+0000","last_became_peered":"2024-07-27T03:11:19.093688+0000","last_unstale":"2024-07-27T03:11:21.105367+0000","last_undegraded":"2024-07-27T03:11:21.105367+0000","last_fullsized":"2024-07-27T03:11:21.105367+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:10:00.717705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297867+0000","last_change":"2024-07-27T03:11:20.105810+0000","last_active":"2024-07-27T03:11:21.297867+0000","last_peered":"2024-07-27T03:11:21.297867+0000","last_clean":"2024-07-27T03:11:21.297867+0000","last_became_active":"2024-07-27T03:11:20.105302+0000","last_became_peered":"2024-07-27T03:11:20.105302+0000","last_unstale":"2024-07-27T03:11:21.297867+0000","last_undegraded":"2024-07-27T03:11:21.297867+0000","last_fullsized":"2024-07-27T03:11:21.297867+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:18:24.478934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111733+0000","last_change":"2024-07-27T03:11:19.094528+0000","last_active":"2024-07-27T03:11:21.111733+0000","last_peered":"2024-07-27T03:11:21.111733+0000","last_clean":"2024-07-27T03:11:21.111733+0000","last_became_active":"2024-07-27T03:11:19.094100+0000","last_became_peered":"2024-07-27T03:11:19.094100+0000","last_unstale":"2024-07-27T03:11:21.111733+0000","last_undegraded":"2024-07-27T03:11:21.111733+0000","last_fullsized":"2024-07-27T03:11:21.111733+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:17:07.949100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349410+0000","last_change":"2024-07-27T03:11:20.103192+0000","last_active":"2024-07-27T03:11:21.349410+0000","last_peered":"2024-07-27T03:11:21.349410+0000","last_clean":"2024-07-27T03:11:21.349410+0000","last_became_active":"2024-07-27T03:11:20.102896+0000","last_became_peered":"2024-07-27T03:11:20.102896+0000","last_unstale":"2024-07-27T03:11:21.349410+0000","last_undegraded":"2024-07-27T03:11:21.349410+0000","last_fullsized":"2024-07-27T03:11:21.349410+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:36:46.720760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110426+0000","last_change":"2024-07-27T03:11:19.100553+0000","last_active":"2024-07-27T03:11:21.110426+0000","last_peered":"2024-07-27T03:11:21.110426+0000","last_clean":"2024-07-27T03:11:21.110426+0000","last_became_active":"2024-07-27T03:11:19.100172+0000","last_became_peered":"2024-07-27T03:11:19.100172+0000","last_unstale":"2024-07-27T03:11:21.110426+0000","last_undegraded":"2024-07-27T03:11:21.110426+0000","last_fullsized":"2024-07-27T03:11:21.110426+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:21:48.398665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110787+0000","last_change":"2024-07-27T03:11:20.097619+0000","last_active":"2024-07-27T03:11:21.110787+0000","last_peered":"2024-07-27T03:11:21.110787+0000","last_clean":"2024-07-27T03:11:21.110787+0000","last_became_active":"2024-07-27T03:11:20.097119+0000","last_became_peered":"2024-07-27T03:11:20.097119+0000","last_unstale":"2024-07-27T03:11:21.110787+0000","last_undegraded":"2024-07-27T03:11:21.110787+0000","last_fullsized":"2024-07-27T03:11:21.110787+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:28.965309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590607+0000","last_change":"2024-07-27T03:11:19.105512+0000","last_active":"2024-07-27T03:11:21.590607+0000","last_peered":"2024-07-27T03:11:21.590607+0000","last_clean":"2024-07-27T03:11:21.590607+0000","last_became_active":"2024-07-27T03:11:19.105229+0000","last_became_peered":"2024-07-27T03:11:19.105229+0000","last_unstale":"2024-07-27T03:11:21.590607+0000","last_undegraded":"2024-07-27T03:11:21.590607+0000","last_fullsized":"2024-07-27T03:11:21.590607+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:23:39.476947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590721+0000","last_change":"2024-07-27T03:11:20.115477+0000","last_active":"2024-07-27T03:11:21.590721+0000","last_peered":"2024-07-27T03:11:21.590721+0000","last_clean":"2024-07-27T03:11:21.590721+0000","last_became_active":"2024-07-27T03:11:20.115128+0000","last_became_peered":"2024-07-27T03:11:20.115128+0000","last_unstale":"2024-07-27T03:11:21.590721+0000","last_undegraded":"2024-07-27T03:11:21.590721+0000","last_fullsized":"2024-07-27T03:11:21.590721+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:19:25.908150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349663+0000","last_change":"2024-07-27T03:11:19.100490+0000","last_active":"2024-07-27T03:11:21.349663+0000","last_peered":"2024-07-27T03:11:21.349663+0000","last_clean":"2024-07-27T03:11:21.349663+0000","last_became_active":"2024-07-27T03:11:19.100209+0000","last_became_peered":"2024-07-27T03:11:19.100209+0000","last_unstale":"2024-07-27T03:11:21.349663+0000","last_undegraded":"2024-07-27T03:11:21.349663+0000","last_fullsized":"2024-07-27T03:11:21.349663+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:05:13.024640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589711+0000","last_change":"2024-07-27T03:11:20.107840+0000","last_active":"2024-07-27T03:11:21.589711+0000","last_peered":"2024-07-27T03:11:21.589711+0000","last_clean":"2024-07-27T03:11:21.589711+0000","last_became_active":"2024-07-27T03:11:20.107509+0000","last_became_peered":"2024-07-27T03:11:20.107509+0000","last_unstale":"2024-07-27T03:11:21.589711+0000","last_undegraded":"2024-07-27T03:11:21.589711+0000","last_fullsized":"2024-07-27T03:11:21.589711+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:23:48.246374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590854+0000","last_change":"2024-07-27T03:11:19.104498+0000","last_active":"2024-07-27T03:11:21.590854+0000","last_peered":"2024-07-27T03:11:21.590854+0000","last_clean":"2024-07-27T03:11:21.590854+0000","last_became_active":"2024-07-27T03:11:19.104259+0000","last_became_peered":"2024-07-27T03:11:19.104259+0000","last_unstale":"2024-07-27T03:11:21.590854+0000","last_undegraded":"2024-07-27T03:11:21.590854+0000","last_fullsized":"2024-07-27T03:11:21.590854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:39.555321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590798+0000","last_change":"2024-07-27T03:11:20.115284+0000","last_active":"2024-07-27T03:11:21.590798+0000","last_peered":"2024-07-27T03:11:21.590798+0000","last_clean":"2024-07-27T03:11:21.590798+0000","last_became_active":"2024-07-27T03:11:20.114952+0000","last_became_peered":"2024-07-27T03:11:20.114952+0000","last_unstale":"2024-07-27T03:11:21.590798+0000","last_undegraded":"2024-07-27T03:11:21.590798+0000","last_fullsized":"2024-07-27T03:11:21.590798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:52:57.758643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110960+0000","last_change":"2024-07-27T03:11:19.099210+0000","last_active":"2024-07-27T03:11:21.110960+0000","last_peered":"2024-07-27T03:11:21.110960+0000","last_clean":"2024-07-27T03:11:21.110960+0000","last_became_active":"2024-07-27T03:11:19.098810+0000","last_became_peered":"2024-07-27T03:11:19.098810+0000","last_unstale":"2024-07-27T03:11:21.110960+0000","last_undegraded":"2024-07-27T03:11:21.110960+0000","last_fullsized":"2024-07-27T03:11:21.110960+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:57:36.431361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112193+0000","last_change":"2024-07-27T03:11:20.117668+0000","last_active":"2024-07-27T03:11:21.112193+0000","last_peered":"2024-07-27T03:11:21.112193+0000","last_clean":"2024-07-27T03:11:21.112193+0000","last_became_active":"2024-07-27T03:11:20.117382+0000","last_became_peered":"2024-07-27T03:11:20.117382+0000","last_unstale":"2024-07-27T03:11:21.112193+0000","last_undegraded":"2024-07-27T03:11:21.112193+0000","last_fullsized":"2024-07-27T03:11:21.112193+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:04:54.827444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349497+0000","last_change":"2024-07-27T03:11:19.099784+0000","last_active":"2024-07-27T03:11:21.349497+0000","last_peered":"2024-07-27T03:11:21.349497+0000","last_clean":"2024-07-27T03:11:21.349497+0000","last_became_active":"2024-07-27T03:11:19.099406+0000","last_became_peered":"2024-07-27T03:11:19.099406+0000","last_unstale":"2024-07-27T03:11:21.349497+0000","last_undegraded":"2024-07-27T03:11:21.349497+0000","last_fullsized":"2024-07-27T03:11:21.349497+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:39:54.701882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590305+0000","last_change":"2024-07-27T03:11:20.102789+0000","last_active":"2024-07-27T03:11:21.590305+0000","last_peered":"2024-07-27T03:11:21.590305+0000","last_clean":"2024-07-27T03:11:21.590305+0000","last_became_active":"2024-07-27T03:11:20.102457+0000","last_became_peered":"2024-07-27T03:11:20.102457+0000","last_unstale":"2024-07-27T03:11:21.590305+0000","last_undegraded":"2024-07-27T03:11:21.590305+0000","last_fullsized":"2024-07-27T03:11:21.590305+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:04:54.827444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297790+0000","last_change":"2024-07-27T03:11:19.094598+0000","last_active":"2024-07-27T03:11:21.297790+0000","last_peered":"2024-07-27T03:11:21.297790+0000","last_clean":"2024-07-27T03:11:21.297790+0000","last_became_active":"2024-07-27T03:11:19.094256+0000","last_became_peered":"2024-07-27T03:11:19.094256+0000","last_unstale":"2024-07-27T03:11:21.297790+0000","last_undegraded":"2024-07-27T03:11:21.297790+0000","last_fullsized":"2024-07-27T03:11:21.297790+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:18:44.458256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110499+0000","last_change":"2024-07-27T03:11:20.109587+0000","last_active":"2024-07-27T03:11:21.110499+0000","last_peered":"2024-07-27T03:11:21.110499+0000","last_clean":"2024-07-27T03:11:21.110499+0000","last_became_active":"2024-07-27T03:11:20.104567+0000","last_became_peered":"2024-07-27T03:11:20.104567+0000","last_unstale":"2024-07-27T03:11:21.110499+0000","last_undegraded":"2024-07-27T03:11:21.110499+0000","last_fullsized":"2024-07-27T03:11:21.110499+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:24:10.352884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111763+0000","last_change":"2024-07-27T03:11:19.100330+0000","last_active":"2024-07-27T03:11:21.111763+0000","last_peered":"2024-07-27T03:11:21.111763+0000","last_clean":"2024-07-27T03:11:21.111763+0000","last_became_active":"2024-07-27T03:11:19.099682+0000","last_became_peered":"2024-07-27T03:11:19.099682+0000","last_unstale":"2024-07-27T03:11:21.111763+0000","last_undegraded":"2024-07-27T03:11:21.111763+0000","last_fullsized":"2024-07-27T03:11:21.111763+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:27.739312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590552+0000","last_change":"2024-07-27T03:11:20.098909+0000","last_active":"2024-07-27T03:11:21.590552+0000","last_peered":"2024-07-27T03:11:21.590552+0000","last_clean":"2024-07-27T03:11:21.590552+0000","last_became_active":"2024-07-27T03:11:20.098349+0000","last_became_peered":"2024-07-27T03:11:20.098349+0000","last_unstale":"2024-07-27T03:11:21.590552+0000","last_undegraded":"2024-07-27T03:11:21.590552+0000","last_fullsized":"2024-07-27T03:11:21.590552+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:45:21.326718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590084+0000","last_change":"2024-07-27T03:11:19.101259+0000","last_active":"2024-07-27T03:11:21.590084+0000","last_peered":"2024-07-27T03:11:21.590084+0000","last_clean":"2024-07-27T03:11:21.590084+0000","last_became_active":"2024-07-27T03:11:19.100946+0000","last_became_peered":"2024-07-27T03:11:19.100946+0000","last_unstale":"2024-07-27T03:11:21.590084+0000","last_undegraded":"2024-07-27T03:11:21.590084+0000","last_fullsized":"2024-07-27T03:11:21.590084+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:27.739312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590852+0000","last_change":"2024-07-27T03:11:20.103583+0000","last_active":"2024-07-27T03:11:21.590852+0000","last_peered":"2024-07-27T03:11:21.590852+0000","last_clean":"2024-07-27T03:11:21.590852+0000","last_became_active":"2024-07-27T03:11:20.101980+0000","last_became_peered":"2024-07-27T03:11:20.101980+0000","last_unstale":"2024-07-27T03:11:21.590852+0000","last_undegraded":"2024-07-27T03:11:21.590852+0000","last_fullsized":"2024-07-27T03:11:21.590852+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:06:13.715505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349669+0000","last_change":"2024-07-27T03:11:19.099721+0000","last_active":"2024-07-27T03:11:21.349669+0000","last_peered":"2024-07-27T03:11:21.349669+0000","last_clean":"2024-07-27T03:11:21.349669+0000","last_became_active":"2024-07-27T03:11:19.099380+0000","last_became_peered":"2024-07-27T03:11:19.099380+0000","last_unstale":"2024-07-27T03:11:21.349669+0000","last_undegraded":"2024-07-27T03:11:21.349669+0000","last_fullsized":"2024-07-27T03:11:21.349669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:35:48.351278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111997+0000","last_change":"2024-07-27T03:11:20.117677+0000","last_active":"2024-07-27T03:11:21.111997+0000","last_peered":"2024-07-27T03:11:21.111997+0000","last_clean":"2024-07-27T03:11:21.111997+0000","last_became_active":"2024-07-27T03:11:20.117376+0000","last_became_peered":"2024-07-27T03:11:20.117376+0000","last_unstale":"2024-07-27T03:11:21.111997+0000","last_undegraded":"2024-07-27T03:11:21.111997+0000","last_fullsized":"2024-07-27T03:11:21.111997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:58:12.147091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105888+0000","last_change":"2024-07-27T03:11:19.101480+0000","last_active":"2024-07-27T03:11:21.105888+0000","last_peered":"2024-07-27T03:11:21.105888+0000","last_clean":"2024-07-27T03:11:21.105888+0000","last_became_active":"2024-07-27T03:11:19.101190+0000","last_became_peered":"2024-07-27T03:11:19.101190+0000","last_unstale":"2024-07-27T03:11:21.105888+0000","last_undegraded":"2024-07-27T03:11:21.105888+0000","last_fullsized":"2024-07-27T03:11:21.105888+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:27.739312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349672+0000","last_change":"2024-07-27T03:11:20.094999+0000","last_active":"2024-07-27T03:11:21.349672+0000","last_peered":"2024-07-27T03:11:21.349672+0000","last_clean":"2024-07-27T03:11:21.349672+0000","last_became_active":"2024-07-27T03:11:20.093245+0000","last_became_peered":"2024-07-27T03:11:20.093245+0000","last_unstale":"2024-07-27T03:11:21.349672+0000","last_undegraded":"2024-07-27T03:11:21.349672+0000","last_fullsized":"2024-07-27T03:11:21.349672+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:44:47.888478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112151+0000","last_change":"2024-07-27T03:11:19.099786+0000","last_active":"2024-07-27T03:11:21.112151+0000","last_peered":"2024-07-27T03:11:21.112151+0000","last_clean":"2024-07-27T03:11:21.112151+0000","last_became_active":"2024-07-27T03:11:19.099425+0000","last_became_peered":"2024-07-27T03:11:19.099425+0000","last_unstale":"2024-07-27T03:11:21.112151+0000","last_undegraded":"2024-07-27T03:11:21.112151+0000","last_fullsized":"2024-07-27T03:11:21.112151+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:34:09.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590833+0000","last_change":"2024-07-27T03:11:20.116005+0000","last_active":"2024-07-27T03:11:21.590833+0000","last_peered":"2024-07-27T03:11:21.590833+0000","last_clean":"2024-07-27T03:11:21.590833+0000","last_became_active":"2024-07-27T03:11:20.115439+0000","last_became_peered":"2024-07-27T03:11:20.115439+0000","last_unstale":"2024-07-27T03:11:21.590833+0000","last_undegraded":"2024-07-27T03:11:21.590833+0000","last_fullsized":"2024-07-27T03:11:21.590833+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:11:24.859249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105891+0000","last_change":"2024-07-27T03:11:19.102076+0000","last_active":"2024-07-27T03:11:21.105891+0000","last_peered":"2024-07-27T03:11:21.105891+0000","last_clean":"2024-07-27T03:11:21.105891+0000","last_became_active":"2024-07-27T03:11:19.101792+0000","last_became_peered":"2024-07-27T03:11:19.101792+0000","last_unstale":"2024-07-27T03:11:21.105891+0000","last_undegraded":"2024-07-27T03:11:21.105891+0000","last_fullsized":"2024-07-27T03:11:21.105891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:34:09.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112111+0000","last_change":"2024-07-27T03:11:20.114114+0000","last_active":"2024-07-27T03:11:21.112111+0000","last_peered":"2024-07-27T03:11:21.112111+0000","last_clean":"2024-07-27T03:11:21.112111+0000","last_became_active":"2024-07-27T03:11:20.113804+0000","last_became_peered":"2024-07-27T03:11:20.113804+0000","last_unstale":"2024-07-27T03:11:21.112111+0000","last_undegraded":"2024-07-27T03:11:21.112111+0000","last_fullsized":"2024-07-27T03:11:21.112111+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:00:02.863737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349706+0000","last_change":"2024-07-27T03:11:19.099608+0000","last_active":"2024-07-27T03:11:21.349706+0000","last_peered":"2024-07-27T03:11:21.349706+0000","last_clean":"2024-07-27T03:11:21.349706+0000","last_became_active":"2024-07-27T03:11:19.099300+0000","last_became_peered":"2024-07-27T03:11:19.099300+0000","last_unstale":"2024-07-27T03:11:21.349706+0000","last_undegraded":"2024-07-27T03:11:21.349706+0000","last_fullsized":"2024-07-27T03:11:21.349706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:24:27.537598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105710+0000","last_change":"2024-07-27T03:11:20.106781+0000","last_active":"2024-07-27T03:11:21.105710+0000","last_peered":"2024-07-27T03:11:21.105710+0000","last_clean":"2024-07-27T03:11:21.105710+0000","last_became_active":"2024-07-27T03:11:20.106449+0000","last_became_peered":"2024-07-27T03:11:20.106449+0000","last_unstale":"2024-07-27T03:11:21.105710+0000","last_undegraded":"2024-07-27T03:11:21.105710+0000","last_fullsized":"2024-07-27T03:11:21.105710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:26:47.403266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589789+0000","last_change":"2024-07-27T03:11:19.100472+0000","last_active":"2024-07-27T03:11:21.589789+0000","last_peered":"2024-07-27T03:11:21.589789+0000","last_clean":"2024-07-27T03:11:21.589789+0000","last_became_active":"2024-07-27T03:11:19.100183+0000","last_became_peered":"2024-07-27T03:11:19.100183+0000","last_unstale":"2024-07-27T03:11:21.589789+0000","last_undegraded":"2024-07-27T03:11:21.589789+0000","last_fullsized":"2024-07-27T03:11:21.589789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:59:57.258777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105503+0000","last_change":"2024-07-27T03:11:20.099279+0000","last_active":"2024-07-27T03:11:21.105503+0000","last_peered":"2024-07-27T03:11:21.105503+0000","last_clean":"2024-07-27T03:11:21.105503+0000","last_became_active":"2024-07-27T03:11:20.098975+0000","last_became_peered":"2024-07-27T03:11:20.098975+0000","last_unstale":"2024-07-27T03:11:21.105503+0000","last_undegraded":"2024-07-27T03:11:21.105503+0000","last_fullsized":"2024-07-27T03:11:21.105503+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:45:21.326718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111627+0000","last_change":"2024-07-27T03:11:19.090066+0000","last_active":"2024-07-27T03:11:21.111627+0000","last_peered":"2024-07-27T03:11:21.111627+0000","last_clean":"2024-07-27T03:11:21.111627+0000","last_became_active":"2024-07-27T03:11:19.089703+0000","last_became_peered":"2024-07-27T03:11:19.089703+0000","last_unstale":"2024-07-27T03:11:21.111627+0000","last_undegraded":"2024-07-27T03:11:21.111627+0000","last_fullsized":"2024-07-27T03:11:21.111627+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:10:00.717705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112018+0000","last_change":"2024-07-27T03:11:20.108097+0000","last_active":"2024-07-27T03:11:21.112018+0000","last_peered":"2024-07-27T03:11:21.112018+0000","last_clean":"2024-07-27T03:11:21.112018+0000","last_became_active":"2024-07-27T03:11:20.107785+0000","last_became_peered":"2024-07-27T03:11:20.107785+0000","last_unstale":"2024-07-27T03:11:21.112018+0000","last_undegraded":"2024-07-27T03:11:21.112018+0000","last_fullsized":"2024-07-27T03:11:21.112018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:06:37.153792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590226+0000","last_change":"2024-07-27T03:11:19.101210+0000","last_active":"2024-07-27T03:11:21.590226+0000","last_peered":"2024-07-27T03:11:21.590226+0000","last_clean":"2024-07-27T03:11:21.590226+0000","last_became_active":"2024-07-27T03:11:19.100926+0000","last_became_peered":"2024-07-27T03:11:19.100926+0000","last_unstale":"2024-07-27T03:11:21.590226+0000","last_undegraded":"2024-07-27T03:11:21.590226+0000","last_fullsized":"2024-07-27T03:11:21.590226+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:18:44.458256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112316+0000","last_change":"2024-07-27T03:11:20.113271+0000","last_active":"2024-07-27T03:11:21.112316+0000","last_peered":"2024-07-27T03:11:21.112316+0000","last_clean":"2024-07-27T03:11:21.112316+0000","last_became_active":"2024-07-27T03:11:20.112668+0000","last_became_peered":"2024-07-27T03:11:20.112668+0000","last_unstale":"2024-07-27T03:11:21.112316+0000","last_undegraded":"2024-07-27T03:11:21.112316+0000","last_fullsized":"2024-07-27T03:11:21.112316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:24:57.993657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106014+0000","last_change":"2024-07-27T03:11:19.100643+0000","last_active":"2024-07-27T03:11:21.106014+0000","last_peered":"2024-07-27T03:11:21.106014+0000","last_clean":"2024-07-27T03:11:21.106014+0000","last_became_active":"2024-07-27T03:11:19.098024+0000","last_became_peered":"2024-07-27T03:11:19.098024+0000","last_unstale":"2024-07-27T03:11:21.106014+0000","last_undegraded":"2024-07-27T03:11:21.106014+0000","last_fullsized":"2024-07-27T03:11:21.106014+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:23:39.476947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589788+0000","last_change":"2024-07-27T03:11:20.106083+0000","last_active":"2024-07-27T03:11:21.589788+0000","last_peered":"2024-07-27T03:11:21.589788+0000","last_clean":"2024-07-27T03:11:21.589788+0000","last_became_active":"2024-07-27T03:11:20.105800+0000","last_became_peered":"2024-07-27T03:11:20.105800+0000","last_unstale":"2024-07-27T03:11:21.589788+0000","last_undegraded":"2024-07-27T03:11:21.589788+0000","last_fullsized":"2024-07-27T03:11:21.589788+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:17:58.586661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297919+0000","last_change":"2024-07-27T03:11:19.092933+0000","last_active":"2024-07-27T03:11:21.297919+0000","last_peered":"2024-07-27T03:11:21.297919+0000","last_clean":"2024-07-27T03:11:21.297919+0000","last_became_active":"2024-07-27T03:11:19.092598+0000","last_became_peered":"2024-07-27T03:11:19.092598+0000","last_unstale":"2024-07-27T03:11:21.297919+0000","last_undegraded":"2024-07-27T03:11:21.297919+0000","last_fullsized":"2024-07-27T03:11:21.297919+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:11:35.450924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106119+0000","last_change":"2024-07-27T03:11:20.108104+0000","last_active":"2024-07-27T03:11:21.106119+0000","last_peered":"2024-07-27T03:11:21.106119+0000","last_clean":"2024-07-27T03:11:21.106119+0000","last_became_active":"2024-07-27T03:11:20.107809+0000","last_became_peered":"2024-07-27T03:11:20.107809+0000","last_unstale":"2024-07-27T03:11:21.106119+0000","last_undegraded":"2024-07-27T03:11:21.106119+0000","last_fullsized":"2024-07-27T03:11:21.106119+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:52:57.758643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112439+0000","last_change":"2024-07-27T03:11:19.093549+0000","last_active":"2024-07-27T03:11:21.112439+0000","last_peered":"2024-07-27T03:11:21.112439+0000","last_clean":"2024-07-27T03:11:21.112439+0000","last_became_active":"2024-07-27T03:11:19.093252+0000","last_became_peered":"2024-07-27T03:11:19.093252+0000","last_unstale":"2024-07-27T03:11:21.112439+0000","last_undegraded":"2024-07-27T03:11:21.112439+0000","last_fullsized":"2024-07-27T03:11:21.112439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:23:39.476947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349538+0000","last_change":"2024-07-27T03:11:20.114563+0000","last_active":"2024-07-27T03:11:21.349538+0000","last_peered":"2024-07-27T03:11:21.349538+0000","last_clean":"2024-07-27T03:11:21.349538+0000","last_became_active":"2024-07-27T03:11:20.114266+0000","last_became_peered":"2024-07-27T03:11:20.114266+0000","last_unstale":"2024-07-27T03:11:21.349538+0000","last_undegraded":"2024-07-27T03:11:21.349538+0000","last_fullsized":"2024-07-27T03:11:21.349538+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:47.637990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589579+0000","last_change":"2024-07-27T03:11:19.092283+0000","last_active":"2024-07-27T03:11:21.589579+0000","last_peered":"2024-07-27T03:11:21.589579+0000","last_clean":"2024-07-27T03:11:21.589579+0000","last_became_active":"2024-07-27T03:11:19.091998+0000","last_became_peered":"2024-07-27T03:11:19.091998+0000","last_unstale":"2024-07-27T03:11:21.589579+0000","last_undegraded":"2024-07-27T03:11:21.589579+0000","last_fullsized":"2024-07-27T03:11:21.589579+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:10:21.905319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590635+0000","last_change":"2024-07-27T03:11:20.098366+0000","last_active":"2024-07-27T03:11:21.590635+0000","last_peered":"2024-07-27T03:11:21.590635+0000","last_clean":"2024-07-27T03:11:21.590635+0000","last_became_active":"2024-07-27T03:11:20.097872+0000","last_became_peered":"2024-07-27T03:11:20.097872+0000","last_unstale":"2024-07-27T03:11:21.590635+0000","last_undegraded":"2024-07-27T03:11:21.590635+0000","last_fullsized":"2024-07-27T03:11:21.590635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:25:24.629300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110740+0000","last_change":"2024-07-27T03:11:19.099204+0000","last_active":"2024-07-27T03:11:21.110740+0000","last_peered":"2024-07-27T03:11:21.110740+0000","last_clean":"2024-07-27T03:11:21.110740+0000","last_became_active":"2024-07-27T03:11:19.098765+0000","last_became_peered":"2024-07-27T03:11:19.098765+0000","last_unstale":"2024-07-27T03:11:21.110740+0000","last_undegraded":"2024-07-27T03:11:21.110740+0000","last_fullsized":"2024-07-27T03:11:21.110740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:17:57.583871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589841+0000","last_change":"2024-07-27T03:11:20.113643+0000","last_active":"2024-07-27T03:11:21.589841+0000","last_peered":"2024-07-27T03:11:21.589841+0000","last_clean":"2024-07-27T03:11:21.589841+0000","last_became_active":"2024-07-27T03:11:20.113344+0000","last_became_peered":"2024-07-27T03:11:20.113344+0000","last_unstale":"2024-07-27T03:11:21.589841+0000","last_undegraded":"2024-07-27T03:11:21.589841+0000","last_fullsized":"2024-07-27T03:11:21.589841+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:37:06.355797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589828+0000","last_change":"2024-07-27T03:11:19.103760+0000","last_active":"2024-07-27T03:11:21.589828+0000","last_peered":"2024-07-27T03:11:21.589828+0000","last_clean":"2024-07-27T03:11:21.589828+0000","last_became_active":"2024-07-27T03:11:19.103439+0000","last_became_peered":"2024-07-27T03:11:19.103439+0000","last_unstale":"2024-07-27T03:11:21.589828+0000","last_undegraded":"2024-07-27T03:11:21.589828+0000","last_fullsized":"2024-07-27T03:11:21.589828+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:11:35.450924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349783+0000","last_change":"2024-07-27T03:11:20.102983+0000","last_active":"2024-07-27T03:11:21.349783+0000","last_peered":"2024-07-27T03:11:21.349783+0000","last_clean":"2024-07-27T03:11:21.349783+0000","last_became_active":"2024-07-27T03:11:20.102477+0000","last_became_peered":"2024-07-27T03:11:20.102477+0000","last_unstale":"2024-07-27T03:11:21.349783+0000","last_undegraded":"2024-07-27T03:11:21.349783+0000","last_fullsized":"2024-07-27T03:11:21.349783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:09:18.167299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349488+0000","last_change":"2024-07-27T03:11:19.092804+0000","last_active":"2024-07-27T03:11:21.349488+0000","last_peered":"2024-07-27T03:11:21.349488+0000","last_clean":"2024-07-27T03:11:21.349488+0000","last_became_active":"2024-07-27T03:11:19.092496+0000","last_became_peered":"2024-07-27T03:11:19.092496+0000","last_unstale":"2024-07-27T03:11:21.349488+0000","last_undegraded":"2024-07-27T03:11:21.349488+0000","last_fullsized":"2024-07-27T03:11:21.349488+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:57:46.638801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349501+0000","last_change":"2024-07-27T03:11:20.100748+0000","last_active":"2024-07-27T03:11:21.349501+0000","last_peered":"2024-07-27T03:11:21.349501+0000","last_clean":"2024-07-27T03:11:21.349501+0000","last_became_active":"2024-07-27T03:11:20.100089+0000","last_became_peered":"2024-07-27T03:11:20.100089+0000","last_unstale":"2024-07-27T03:11:21.349501+0000","last_undegraded":"2024-07-27T03:11:21.349501+0000","last_fullsized":"2024-07-27T03:11:21.349501+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:04:22.697118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297706+0000","last_change":"2024-07-27T03:11:19.093235+0000","last_active":"2024-07-27T03:11:21.297706+0000","last_peered":"2024-07-27T03:11:21.297706+0000","last_clean":"2024-07-27T03:11:21.297706+0000","last_became_active":"2024-07-27T03:11:19.092865+0000","last_became_peered":"2024-07-27T03:11:19.092865+0000","last_unstale":"2024-07-27T03:11:21.297706+0000","last_undegraded":"2024-07-27T03:11:21.297706+0000","last_fullsized":"2024-07-27T03:11:21.297706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:59:57.258777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":174,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590131+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:11:21.590131+0000","last_peered":"2024-07-27T03:11:21.590131+0000","last_clean":"2024-07-27T03:11:21.590131+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:11:21.590131+0000","last_undegraded":"2024-07-27T03:11:21.590131+0000","last_fullsized":"2024-07-27T03:11:21.590131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":871548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":281672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36016,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335824,"statfs":{"total":96636764160,"available":96599883776,"internally_reserved":0,"allocated":684032,"data_stored":281076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":281076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36604,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335236,"statfs":{"total":96636764160,"available":96599281664,"internally_reserved":0,"allocated":1286144,"data_stored":873582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542183,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":675840,"data_stored":281020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542183,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":688128,"data_stored":282632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":679936,"data_stored":281110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:11:28.636 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:11:28.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.761+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/1815817882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4b8003a30 msgr2=0x7fe4b8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:28.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.761+0000 7fe4d5d0e640 1 --2- 172.21.15.120:0/1815817882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4b8003a30 0x7fe4b8003ea0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000baf0 tx=0x7fe4b8005830 comp rx=0 tx=0).stop 2024-07-27T03:11:28.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.761+0000 7fe4cffff640 1 -- 172.21.15.120:0/1815817882 reap_dead start 2024-07-27T03:11:28.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.761+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/1815817882 shutdown_connections 2024-07-27T03:11:28.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.761+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/1815817882 >> 172.21.15.120:0/1815817882 conn(0x7fe4d006cba0 msgr2=0x7fe4d006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:28.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.761+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/1815817882 shutdown_connections 2024-07-27T03:11:28.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.761+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/1815817882 wait complete. 2024-07-27T03:11:28.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.763+0000 7fe4d5d0e640 1 Processor -- start 2024-07-27T03:11:28.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.763+0000 7fe4d5d0e640 1 -- start start 2024-07-27T03:11:28.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4d5d0e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4b8003a30 0x7fe4d014dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:28.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4d5d0e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4d0148f00 0x7fe4d0149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:28.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4d5d0e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4d0149850 0x7fe4d01f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:28.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4d5d0e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d00cd920 con 0x7fe4b8003a30 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4d5d0e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d00cd7a0 con 0x7fe4d0149850 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4d5d0e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d00cdaa0 con 0x7fe4d0148f00 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4cf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4b8003a30 0x7fe4d014dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4cf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4b8003a30 0x7fe4d014dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51128/0 (socket says 172.21.15.120:51128) 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4cf7fe640 1 -- 172.21.15.120:0/949258624 learned_addr learned my addr 172.21.15.120:0/949258624 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4cffff640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4d0149850 0x7fe4d01f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4ceffd640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4d0148f00 0x7fe4d0149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4cf7fe640 1 -- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4d0148f00 msgr2=0x7fe4d0149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4cf7fe640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4d0148f00 0x7fe4d0149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4cf7fe640 1 -- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4d0149850 msgr2=0x7fe4d01f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4cf7fe640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4d0149850 0x7fe4d01f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:28.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4cf7fe640 1 -- 172.21.15.120:0/949258624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d014b9a0 con 0x7fe4b8003a30 2024-07-27T03:11:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.764+0000 7fe4cffff640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4d0149850 0x7fe4d01f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.765+0000 7fe4cf7fe640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4b8003a30 0x7fe4d014dbd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000bc10 tx=0x7fe4c0005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.765+0000 7fe4b7fff640 1 -- 172.21.15.120:0/949258624 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0040070 con 0x7fe4b8003a30 2024-07-27T03:11:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.765+0000 7fe4b7fff640 1 -- 172.21.15.120:0/949258624 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4c0005310 con 0x7fe4b8003a30 2024-07-27T03:11:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.765+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/949258624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d014bc80 con 0x7fe4b8003a30 2024-07-27T03:11:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.765+0000 7fe4b7fff640 1 -- 172.21.15.120:0/949258624 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0035040 con 0x7fe4b8003a30 2024-07-27T03:11:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.765+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/949258624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d014c240 con 0x7fe4b8003a30 2024-07-27T03:11:28.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.766+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/949258624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d00cf1b0 con 0x7fe4b8003a30 2024-07-27T03:11:28.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.767+0000 7fe4b7fff640 1 -- 172.21.15.120:0/949258624 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe4c0038020 con 0x7fe4b8003a30 2024-07-27T03:11:28.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.767+0000 7fe4b7fff640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe4bc077040 0x7fe4bc079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:28.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.768+0000 7fe4b7fff640 1 -- 172.21.15.120:0/949258624 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe4c00b9680 con 0x7fe4b8003a30 2024-07-27T03:11:28.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.768+0000 7fe4ceffd640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe4bc077040 0x7fe4bc079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:28.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.768+0000 7fe4ceffd640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe4bc077040 0x7fe4bc079550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4001860 tx=0x7fe4c4001ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:28.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.772+0000 7fe4b7fff640 1 -- 172.21.15.120:0/949258624 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fe4c004a060 con 0x7fe4b8003a30 2024-07-27T03:11:28.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.952+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/949258624 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4d0069c10 con 0x7fe4bc077040 2024-07-27T03:11:28.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.956+0000 7fe4b7fff640 1 -- 172.21.15.120:0/949258624 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251907 (secure 0 0 0) 0x7fe4c400f8a0 con 0x7fe4bc077040 2024-07-27T03:11:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:28.964 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:11:28.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe4bc077040 msgr2=0x7fe4bc079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:28.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe4bc077040 0x7fe4bc079550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4001860 tx=0x7fe4c4001ce0 comp rx=0 tx=0).stop 2024-07-27T03:11:28.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/949258624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4b8003a30 msgr2=0x7fe4d014dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:28.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4b8003a30 0x7fe4d014dbd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000bc10 tx=0x7fe4c0005890 comp rx=0 tx=0).stop 2024-07-27T03:11:28.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/949258624 shutdown_connections 2024-07-27T03:11:28.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe4bc077040 0x7fe4bc079550 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:28.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4d0149850 0x7fe4d01f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:28.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4d0148f00 0x7fe4d0149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:28.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 --2- 172.21.15.120:0/949258624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe4b8003a30 0x7fe4d014dbd0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:28.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/949258624 >> 172.21.15.120:0/949258624 conn(0x7fe4d006cba0 msgr2=0x7fe4d015d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:28.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/949258624 shutdown_connections 2024-07-27T03:11:28.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:28.960+0000 7fe4d5d0e640 1 -- 172.21.15.120:0/949258624 wait complete. 2024-07-27T03:11:28.975 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-07-27T03:11:28.576509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":268456,"kb_used_data":6504,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":754706264,"statfs":{"total":773094113280,"available":772819214336,"internally_reserved":0,"allocated":6660096,"data_stored":3433716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":268095024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.490203"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589815+0000","last_change":"2024-07-27T03:11:20.101120+0000","last_active":"2024-07-27T03:11:21.589815+0000","last_peered":"2024-07-27T03:11:21.589815+0000","last_clean":"2024-07-27T03:11:21.589815+0000","last_became_active":"2024-07-27T03:11:20.100402+0000","last_became_peered":"2024-07-27T03:11:20.100402+0000","last_unstale":"2024-07-27T03:11:21.589815+0000","last_undegraded":"2024-07-27T03:11:21.589815+0000","last_fullsized":"2024-07-27T03:11:21.589815+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:27:44.887939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349600+0000","last_change":"2024-07-27T03:11:20.112523+0000","last_active":"2024-07-27T03:11:21.349600+0000","last_peered":"2024-07-27T03:11:21.349600+0000","last_clean":"2024-07-27T03:11:21.349600+0000","last_became_active":"2024-07-27T03:11:20.112152+0000","last_became_peered":"2024-07-27T03:11:20.112152+0000","last_unstale":"2024-07-27T03:11:21.349600+0000","last_undegraded":"2024-07-27T03:11:21.349600+0000","last_fullsized":"2024-07-27T03:11:21.349600+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:43:13.334213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590635+0000","last_change":"2024-07-27T03:11:20.101310+0000","last_active":"2024-07-27T03:11:21.590635+0000","last_peered":"2024-07-27T03:11:21.590635+0000","last_clean":"2024-07-27T03:11:21.590635+0000","last_became_active":"2024-07-27T03:11:20.101014+0000","last_became_peered":"2024-07-27T03:11:20.101014+0000","last_unstale":"2024-07-27T03:11:21.590635+0000","last_undegraded":"2024-07-27T03:11:21.590635+0000","last_fullsized":"2024-07-27T03:11:21.590635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:26:47.403266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112350+0000","last_change":"2024-07-27T03:11:20.108371+0000","last_active":"2024-07-27T03:11:21.112350+0000","last_peered":"2024-07-27T03:11:21.112350+0000","last_clean":"2024-07-27T03:11:21.112350+0000","last_became_active":"2024-07-27T03:11:20.107937+0000","last_became_peered":"2024-07-27T03:11:20.107937+0000","last_unstale":"2024-07-27T03:11:21.112350+0000","last_undegraded":"2024-07-27T03:11:21.112350+0000","last_fullsized":"2024-07-27T03:11:21.112350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:45:21.326718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590195+0000","last_change":"2024-07-27T03:11:20.104726+0000","last_active":"2024-07-27T03:11:21.590195+0000","last_peered":"2024-07-27T03:11:21.590195+0000","last_clean":"2024-07-27T03:11:21.590195+0000","last_became_active":"2024-07-27T03:11:20.104367+0000","last_became_peered":"2024-07-27T03:11:20.104367+0000","last_unstale":"2024-07-27T03:11:21.590195+0000","last_undegraded":"2024-07-27T03:11:21.590195+0000","last_fullsized":"2024-07-27T03:11:21.590195+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:26:04.005879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105457+0000","last_change":"2024-07-27T03:11:20.106461+0000","last_active":"2024-07-27T03:11:21.105457+0000","last_peered":"2024-07-27T03:11:21.105457+0000","last_clean":"2024-07-27T03:11:21.105457+0000","last_became_active":"2024-07-27T03:11:20.106158+0000","last_became_peered":"2024-07-27T03:11:20.106158+0000","last_unstale":"2024-07-27T03:11:21.105457+0000","last_undegraded":"2024-07-27T03:11:21.105457+0000","last_fullsized":"2024-07-27T03:11:21.105457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:04:54.827444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110401+0000","last_change":"2024-07-27T03:11:20.110733+0000","last_active":"2024-07-27T03:11:21.110401+0000","last_peered":"2024-07-27T03:11:21.110401+0000","last_clean":"2024-07-27T03:11:21.110401+0000","last_became_active":"2024-07-27T03:11:20.109313+0000","last_became_peered":"2024-07-27T03:11:20.109313+0000","last_unstale":"2024-07-27T03:11:21.110401+0000","last_undegraded":"2024-07-27T03:11:21.110401+0000","last_fullsized":"2024-07-27T03:11:21.110401+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:38:37.104222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349338+0000","last_change":"2024-07-27T03:11:20.093990+0000","last_active":"2024-07-27T03:11:21.349338+0000","last_peered":"2024-07-27T03:11:21.349338+0000","last_clean":"2024-07-27T03:11:21.349338+0000","last_became_active":"2024-07-27T03:11:20.093667+0000","last_became_peered":"2024-07-27T03:11:20.093667+0000","last_unstale":"2024-07-27T03:11:21.349338+0000","last_undegraded":"2024-07-27T03:11:21.349338+0000","last_fullsized":"2024-07-27T03:11:21.349338+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:48:29.608996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110722+0000","last_change":"2024-07-27T03:11:20.111742+0000","last_active":"2024-07-27T03:11:21.110722+0000","last_peered":"2024-07-27T03:11:21.110722+0000","last_clean":"2024-07-27T03:11:21.110722+0000","last_became_active":"2024-07-27T03:11:20.111348+0000","last_became_peered":"2024-07-27T03:11:20.111348+0000","last_unstale":"2024-07-27T03:11:21.110722+0000","last_undegraded":"2024-07-27T03:11:21.110722+0000","last_fullsized":"2024-07-27T03:11:21.110722+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:27:49.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590278+0000","last_change":"2024-07-27T03:11:20.103525+0000","last_active":"2024-07-27T03:11:21.590278+0000","last_peered":"2024-07-27T03:11:21.590278+0000","last_clean":"2024-07-27T03:11:21.590278+0000","last_became_active":"2024-07-27T03:11:20.103196+0000","last_became_peered":"2024-07-27T03:11:20.103196+0000","last_unstale":"2024-07-27T03:11:21.590278+0000","last_undegraded":"2024-07-27T03:11:21.590278+0000","last_fullsized":"2024-07-27T03:11:21.590278+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:13:07.975210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589975+0000","last_change":"2024-07-27T03:11:20.115324+0000","last_active":"2024-07-27T03:11:21.589975+0000","last_peered":"2024-07-27T03:11:21.589975+0000","last_clean":"2024-07-27T03:11:21.589975+0000","last_became_active":"2024-07-27T03:11:20.115044+0000","last_became_peered":"2024-07-27T03:11:20.115044+0000","last_unstale":"2024-07-27T03:11:21.589975+0000","last_undegraded":"2024-07-27T03:11:21.589975+0000","last_fullsized":"2024-07-27T03:11:21.589975+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:21:49.401456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112363+0000","last_change":"2024-07-27T03:11:20.112333+0000","last_active":"2024-07-27T03:11:21.112363+0000","last_peered":"2024-07-27T03:11:21.112363+0000","last_clean":"2024-07-27T03:11:21.112363+0000","last_became_active":"2024-07-27T03:11:20.111922+0000","last_became_peered":"2024-07-27T03:11:20.111922+0000","last_unstale":"2024-07-27T03:11:21.112363+0000","last_undegraded":"2024-07-27T03:11:21.112363+0000","last_fullsized":"2024-07-27T03:11:21.112363+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:26:22.157427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297947+0000","last_change":"2024-07-27T03:11:20.108166+0000","last_active":"2024-07-27T03:11:21.297947+0000","last_peered":"2024-07-27T03:11:21.297947+0000","last_clean":"2024-07-27T03:11:21.297947+0000","last_became_active":"2024-07-27T03:11:20.107370+0000","last_became_peered":"2024-07-27T03:11:20.107370+0000","last_unstale":"2024-07-27T03:11:21.297947+0000","last_undegraded":"2024-07-27T03:11:21.297947+0000","last_fullsized":"2024-07-27T03:11:21.297947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:04:07.807790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110594+0000","last_change":"2024-07-27T03:11:20.110362+0000","last_active":"2024-07-27T03:11:21.110594+0000","last_peered":"2024-07-27T03:11:21.110594+0000","last_clean":"2024-07-27T03:11:21.110594+0000","last_became_active":"2024-07-27T03:11:20.106686+0000","last_became_peered":"2024-07-27T03:11:20.106686+0000","last_unstale":"2024-07-27T03:11:21.110594+0000","last_undegraded":"2024-07-27T03:11:21.110594+0000","last_fullsized":"2024-07-27T03:11:21.110594+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:50:09.712343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111060+0000","last_change":"2024-07-27T03:11:20.115470+0000","last_active":"2024-07-27T03:11:21.111060+0000","last_peered":"2024-07-27T03:11:21.111060+0000","last_clean":"2024-07-27T03:11:21.111060+0000","last_became_active":"2024-07-27T03:11:20.115128+0000","last_became_peered":"2024-07-27T03:11:20.115128+0000","last_unstale":"2024-07-27T03:11:21.111060+0000","last_undegraded":"2024-07-27T03:11:21.111060+0000","last_fullsized":"2024-07-27T03:11:21.111060+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:17:06.113066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105371+0000","last_change":"2024-07-27T03:11:20.109153+0000","last_active":"2024-07-27T03:11:21.105371+0000","last_peered":"2024-07-27T03:11:21.105371+0000","last_clean":"2024-07-27T03:11:21.105371+0000","last_became_active":"2024-07-27T03:11:20.108478+0000","last_became_peered":"2024-07-27T03:11:20.108478+0000","last_unstale":"2024-07-27T03:11:21.105371+0000","last_undegraded":"2024-07-27T03:11:21.105371+0000","last_fullsized":"2024-07-27T03:11:21.105371+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:00:02.863737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349620+0000","last_change":"2024-07-27T03:11:20.102545+0000","last_active":"2024-07-27T03:11:21.349620+0000","last_peered":"2024-07-27T03:11:21.349620+0000","last_clean":"2024-07-27T03:11:21.349620+0000","last_became_active":"2024-07-27T03:11:20.102270+0000","last_became_peered":"2024-07-27T03:11:20.102270+0000","last_unstale":"2024-07-27T03:11:21.349620+0000","last_undegraded":"2024-07-27T03:11:21.349620+0000","last_fullsized":"2024-07-27T03:11:21.349620+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:32:17.691215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590728+0000","last_change":"2024-07-27T03:11:20.109350+0000","last_active":"2024-07-27T03:11:21.590728+0000","last_peered":"2024-07-27T03:11:21.590728+0000","last_clean":"2024-07-27T03:11:21.590728+0000","last_became_active":"2024-07-27T03:11:20.109004+0000","last_became_peered":"2024-07-27T03:11:20.109004+0000","last_unstale":"2024-07-27T03:11:21.590728+0000","last_undegraded":"2024-07-27T03:11:21.590728+0000","last_fullsized":"2024-07-27T03:11:21.590728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:30:18.070376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589919+0000","last_change":"2024-07-27T03:11:20.100723+0000","last_active":"2024-07-27T03:11:21.589919+0000","last_peered":"2024-07-27T03:11:21.589919+0000","last_clean":"2024-07-27T03:11:21.589919+0000","last_became_active":"2024-07-27T03:11:20.100418+0000","last_became_peered":"2024-07-27T03:11:20.100418+0000","last_unstale":"2024-07-27T03:11:21.589919+0000","last_undegraded":"2024-07-27T03:11:21.589919+0000","last_fullsized":"2024-07-27T03:11:21.589919+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:41:44.860333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349702+0000","last_change":"2024-07-27T03:11:20.110047+0000","last_active":"2024-07-27T03:11:21.349702+0000","last_peered":"2024-07-27T03:11:21.349702+0000","last_clean":"2024-07-27T03:11:21.349702+0000","last_became_active":"2024-07-27T03:11:20.109581+0000","last_became_peered":"2024-07-27T03:11:20.109581+0000","last_unstale":"2024-07-27T03:11:21.349702+0000","last_undegraded":"2024-07-27T03:11:21.349702+0000","last_fullsized":"2024-07-27T03:11:21.349702+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:49:00.372071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590417+0000","last_change":"2024-07-27T03:11:20.106433+0000","last_active":"2024-07-27T03:11:21.590417+0000","last_peered":"2024-07-27T03:11:21.590417+0000","last_clean":"2024-07-27T03:11:21.590417+0000","last_became_active":"2024-07-27T03:11:20.106127+0000","last_became_peered":"2024-07-27T03:11:20.106127+0000","last_unstale":"2024-07-27T03:11:21.590417+0000","last_undegraded":"2024-07-27T03:11:21.590417+0000","last_fullsized":"2024-07-27T03:11:21.590417+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:24:57.993657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349315+0000","last_change":"2024-07-27T03:11:20.104597+0000","last_active":"2024-07-27T03:11:21.349315+0000","last_peered":"2024-07-27T03:11:21.349315+0000","last_clean":"2024-07-27T03:11:21.349315+0000","last_became_active":"2024-07-27T03:11:20.104290+0000","last_became_peered":"2024-07-27T03:11:20.104290+0000","last_unstale":"2024-07-27T03:11:21.349315+0000","last_undegraded":"2024-07-27T03:11:21.349315+0000","last_fullsized":"2024-07-27T03:11:21.349315+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:12:03.777855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590611+0000","last_change":"2024-07-27T03:11:20.098631+0000","last_active":"2024-07-27T03:11:21.590611+0000","last_peered":"2024-07-27T03:11:21.590611+0000","last_clean":"2024-07-27T03:11:21.590611+0000","last_became_active":"2024-07-27T03:11:20.097947+0000","last_became_peered":"2024-07-27T03:11:20.097947+0000","last_unstale":"2024-07-27T03:11:21.590611+0000","last_undegraded":"2024-07-27T03:11:21.590611+0000","last_fullsized":"2024-07-27T03:11:21.590611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:26:22.157427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297964+0000","last_change":"2024-07-27T03:11:20.110392+0000","last_active":"2024-07-27T03:11:21.297964+0000","last_peered":"2024-07-27T03:11:21.297964+0000","last_clean":"2024-07-27T03:11:21.297964+0000","last_became_active":"2024-07-27T03:11:20.110054+0000","last_became_peered":"2024-07-27T03:11:20.110054+0000","last_unstale":"2024-07-27T03:11:21.297964+0000","last_undegraded":"2024-07-27T03:11:21.297964+0000","last_fullsized":"2024-07-27T03:11:21.297964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:23:48.246374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590009+0000","last_change":"2024-07-27T03:11:20.118175+0000","last_active":"2024-07-27T03:11:21.590009+0000","last_peered":"2024-07-27T03:11:21.590009+0000","last_clean":"2024-07-27T03:11:21.590009+0000","last_became_active":"2024-07-27T03:11:20.117513+0000","last_became_peered":"2024-07-27T03:11:20.117513+0000","last_unstale":"2024-07-27T03:11:21.590009+0000","last_undegraded":"2024-07-27T03:11:21.590009+0000","last_fullsized":"2024-07-27T03:11:21.590009+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:33:10.009836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111918+0000","last_change":"2024-07-27T03:11:20.105616+0000","last_active":"2024-07-27T03:11:21.111918+0000","last_peered":"2024-07-27T03:11:21.111918+0000","last_clean":"2024-07-27T03:11:21.111918+0000","last_became_active":"2024-07-27T03:11:20.102991+0000","last_became_peered":"2024-07-27T03:11:20.102991+0000","last_unstale":"2024-07-27T03:11:21.111918+0000","last_undegraded":"2024-07-27T03:11:21.111918+0000","last_fullsized":"2024-07-27T03:11:21.111918+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:28:43.066840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105657+0000","last_change":"2024-07-27T03:11:20.107423+0000","last_active":"2024-07-27T03:11:21.105657+0000","last_peered":"2024-07-27T03:11:21.105657+0000","last_clean":"2024-07-27T03:11:21.105657+0000","last_became_active":"2024-07-27T03:11:20.107081+0000","last_became_peered":"2024-07-27T03:11:20.107081+0000","last_unstale":"2024-07-27T03:11:21.105657+0000","last_undegraded":"2024-07-27T03:11:21.105657+0000","last_fullsized":"2024-07-27T03:11:21.105657+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:26:22.157427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589985+0000","last_change":"2024-07-27T03:11:20.105880+0000","last_active":"2024-07-27T03:11:21.589985+0000","last_peered":"2024-07-27T03:11:21.589985+0000","last_clean":"2024-07-27T03:11:21.589985+0000","last_became_active":"2024-07-27T03:11:20.105585+0000","last_became_peered":"2024-07-27T03:11:20.105585+0000","last_unstale":"2024-07-27T03:11:21.589985+0000","last_undegraded":"2024-07-27T03:11:21.589985+0000","last_fullsized":"2024-07-27T03:11:21.589985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:34:06.075388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349743+0000","last_change":"2024-07-27T03:11:20.112205+0000","last_active":"2024-07-27T03:11:21.349743+0000","last_peered":"2024-07-27T03:11:21.349743+0000","last_clean":"2024-07-27T03:11:21.349743+0000","last_became_active":"2024-07-27T03:11:20.111888+0000","last_became_peered":"2024-07-27T03:11:20.111888+0000","last_unstale":"2024-07-27T03:11:21.349743+0000","last_undegraded":"2024-07-27T03:11:21.349743+0000","last_fullsized":"2024-07-27T03:11:21.349743+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:00:54.320660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590228+0000","last_change":"2024-07-27T03:11:20.093636+0000","last_active":"2024-07-27T03:11:21.590228+0000","last_peered":"2024-07-27T03:11:21.590228+0000","last_clean":"2024-07-27T03:11:21.590228+0000","last_became_active":"2024-07-27T03:11:20.093298+0000","last_became_peered":"2024-07-27T03:11:20.093298+0000","last_unstale":"2024-07-27T03:11:21.590228+0000","last_undegraded":"2024-07-27T03:11:21.590228+0000","last_fullsized":"2024-07-27T03:11:21.590228+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:00:02.863737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589768+0000","last_change":"2024-07-27T03:11:20.117879+0000","last_active":"2024-07-27T03:11:21.589768+0000","last_peered":"2024-07-27T03:11:21.589768+0000","last_clean":"2024-07-27T03:11:21.589768+0000","last_became_active":"2024-07-27T03:11:20.117566+0000","last_became_peered":"2024-07-27T03:11:20.117566+0000","last_unstale":"2024-07-27T03:11:21.589768+0000","last_undegraded":"2024-07-27T03:11:21.589768+0000","last_fullsized":"2024-07-27T03:11:21.589768+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:43:44.053246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105458+0000","last_change":"2024-07-27T03:11:20.109422+0000","last_active":"2024-07-27T03:11:21.105458+0000","last_peered":"2024-07-27T03:11:21.105458+0000","last_clean":"2024-07-27T03:11:21.105458+0000","last_became_active":"2024-07-27T03:11:20.108816+0000","last_became_peered":"2024-07-27T03:11:20.108816+0000","last_unstale":"2024-07-27T03:11:21.105458+0000","last_undegraded":"2024-07-27T03:11:21.105458+0000","last_fullsized":"2024-07-27T03:11:21.105458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:24:57.993657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106010+0000","last_change":"2024-07-27T03:11:20.107884+0000","last_active":"2024-07-27T03:11:21.106010+0000","last_peered":"2024-07-27T03:11:21.106010+0000","last_clean":"2024-07-27T03:11:21.106010+0000","last_became_active":"2024-07-27T03:11:20.107509+0000","last_became_peered":"2024-07-27T03:11:20.107509+0000","last_unstale":"2024-07-27T03:11:21.106010+0000","last_undegraded":"2024-07-27T03:11:21.106010+0000","last_fullsized":"2024-07-27T03:11:21.106010+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:19:25.908150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106004+0000","last_change":"2024-07-27T03:11:19.101102+0000","last_active":"2024-07-27T03:11:21.106004+0000","last_peered":"2024-07-27T03:11:21.106004+0000","last_clean":"2024-07-27T03:11:21.106004+0000","last_became_active":"2024-07-27T03:11:19.100787+0000","last_became_peered":"2024-07-27T03:11:19.100787+0000","last_unstale":"2024-07-27T03:11:21.106004+0000","last_undegraded":"2024-07-27T03:11:21.106004+0000","last_fullsized":"2024-07-27T03:11:21.106004+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:39.555321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590149+0000","last_change":"2024-07-27T03:11:20.114371+0000","last_active":"2024-07-27T03:11:21.590149+0000","last_peered":"2024-07-27T03:11:21.590149+0000","last_clean":"2024-07-27T03:11:21.590149+0000","last_became_active":"2024-07-27T03:11:20.112824+0000","last_became_peered":"2024-07-27T03:11:20.112824+0000","last_unstale":"2024-07-27T03:11:21.590149+0000","last_undegraded":"2024-07-27T03:11:21.590149+0000","last_fullsized":"2024-07-27T03:11:21.590149+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:57:37.434152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349493+0000","last_change":"2024-07-27T03:11:19.101555+0000","last_active":"2024-07-27T03:11:21.349493+0000","last_peered":"2024-07-27T03:11:21.349493+0000","last_clean":"2024-07-27T03:11:21.349493+0000","last_became_active":"2024-07-27T03:11:19.101157+0000","last_became_peered":"2024-07-27T03:11:19.101157+0000","last_unstale":"2024-07-27T03:11:21.349493+0000","last_undegraded":"2024-07-27T03:11:21.349493+0000","last_fullsized":"2024-07-27T03:11:21.349493+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:38:58.534784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106012+0000","last_change":"2024-07-27T03:11:20.116157+0000","last_active":"2024-07-27T03:11:21.106012+0000","last_peered":"2024-07-27T03:11:21.106012+0000","last_clean":"2024-07-27T03:11:21.106012+0000","last_became_active":"2024-07-27T03:11:20.115836+0000","last_became_peered":"2024-07-27T03:11:20.115836+0000","last_unstale":"2024-07-27T03:11:21.106012+0000","last_undegraded":"2024-07-27T03:11:21.106012+0000","last_fullsized":"2024-07-27T03:11:21.106012+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:30:18.070376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106123+0000","last_change":"2024-07-27T03:11:19.098946+0000","last_active":"2024-07-27T03:11:21.106123+0000","last_peered":"2024-07-27T03:11:21.106123+0000","last_clean":"2024-07-27T03:11:21.106123+0000","last_became_active":"2024-07-27T03:11:19.098638+0000","last_became_peered":"2024-07-27T03:11:19.098638+0000","last_unstale":"2024-07-27T03:11:21.106123+0000","last_undegraded":"2024-07-27T03:11:21.106123+0000","last_fullsized":"2024-07-27T03:11:21.106123+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:17:07.949100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105860+0000","last_change":"2024-07-27T03:11:20.108339+0000","last_active":"2024-07-27T03:11:21.105860+0000","last_peered":"2024-07-27T03:11:21.105860+0000","last_clean":"2024-07-27T03:11:21.105860+0000","last_became_active":"2024-07-27T03:11:20.107924+0000","last_became_peered":"2024-07-27T03:11:20.107924+0000","last_unstale":"2024-07-27T03:11:21.105860+0000","last_undegraded":"2024-07-27T03:11:21.105860+0000","last_fullsized":"2024-07-27T03:11:21.105860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:25:24.629300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112422+0000","last_change":"2024-07-27T03:11:19.099329+0000","last_active":"2024-07-27T03:11:21.112422+0000","last_peered":"2024-07-27T03:11:21.112422+0000","last_clean":"2024-07-27T03:11:21.112422+0000","last_became_active":"2024-07-27T03:11:19.098986+0000","last_became_peered":"2024-07-27T03:11:19.098986+0000","last_unstale":"2024-07-27T03:11:21.112422+0000","last_undegraded":"2024-07-27T03:11:21.112422+0000","last_fullsized":"2024-07-27T03:11:21.112422+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:39.555321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349335+0000","last_change":"2024-07-27T03:11:20.103941+0000","last_active":"2024-07-27T03:11:21.349335+0000","last_peered":"2024-07-27T03:11:21.349335+0000","last_clean":"2024-07-27T03:11:21.349335+0000","last_became_active":"2024-07-27T03:11:20.103624+0000","last_became_peered":"2024-07-27T03:11:20.103624+0000","last_unstale":"2024-07-27T03:11:21.349335+0000","last_undegraded":"2024-07-27T03:11:21.349335+0000","last_fullsized":"2024-07-27T03:11:21.349335+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:55:46.633797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110491+0000","last_change":"2024-07-27T03:11:19.098581+0000","last_active":"2024-07-27T03:11:21.110491+0000","last_peered":"2024-07-27T03:11:21.110491+0000","last_clean":"2024-07-27T03:11:21.110491+0000","last_became_active":"2024-07-27T03:11:19.098202+0000","last_became_peered":"2024-07-27T03:11:19.098202+0000","last_unstale":"2024-07-27T03:11:21.110491+0000","last_undegraded":"2024-07-27T03:11:21.110491+0000","last_fullsized":"2024-07-27T03:11:21.110491+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:37:05.353006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349562+0000","last_change":"2024-07-27T03:11:20.111246+0000","last_active":"2024-07-27T03:11:21.349562+0000","last_peered":"2024-07-27T03:11:21.349562+0000","last_clean":"2024-07-27T03:11:21.349562+0000","last_became_active":"2024-07-27T03:11:20.110640+0000","last_became_peered":"2024-07-27T03:11:20.110640+0000","last_unstale":"2024-07-27T03:11:21.349562+0000","last_undegraded":"2024-07-27T03:11:21.349562+0000","last_fullsized":"2024-07-27T03:11:21.349562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:49:37.998416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105367+0000","last_change":"2024-07-27T03:11:19.094008+0000","last_active":"2024-07-27T03:11:21.105367+0000","last_peered":"2024-07-27T03:11:21.105367+0000","last_clean":"2024-07-27T03:11:21.105367+0000","last_became_active":"2024-07-27T03:11:19.093688+0000","last_became_peered":"2024-07-27T03:11:19.093688+0000","last_unstale":"2024-07-27T03:11:21.105367+0000","last_undegraded":"2024-07-27T03:11:21.105367+0000","last_fullsized":"2024-07-27T03:11:21.105367+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:10:00.717705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297867+0000","last_change":"2024-07-27T03:11:20.105810+0000","last_active":"2024-07-27T03:11:21.297867+0000","last_peered":"2024-07-27T03:11:21.297867+0000","last_clean":"2024-07-27T03:11:21.297867+0000","last_became_active":"2024-07-27T03:11:20.105302+0000","last_became_peered":"2024-07-27T03:11:20.105302+0000","last_unstale":"2024-07-27T03:11:21.297867+0000","last_undegraded":"2024-07-27T03:11:21.297867+0000","last_fullsized":"2024-07-27T03:11:21.297867+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:18:24.478934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111733+0000","last_change":"2024-07-27T03:11:19.094528+0000","last_active":"2024-07-27T03:11:21.111733+0000","last_peered":"2024-07-27T03:11:21.111733+0000","last_clean":"2024-07-27T03:11:21.111733+0000","last_became_active":"2024-07-27T03:11:19.094100+0000","last_became_peered":"2024-07-27T03:11:19.094100+0000","last_unstale":"2024-07-27T03:11:21.111733+0000","last_undegraded":"2024-07-27T03:11:21.111733+0000","last_fullsized":"2024-07-27T03:11:21.111733+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:17:07.949100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349410+0000","last_change":"2024-07-27T03:11:20.103192+0000","last_active":"2024-07-27T03:11:21.349410+0000","last_peered":"2024-07-27T03:11:21.349410+0000","last_clean":"2024-07-27T03:11:21.349410+0000","last_became_active":"2024-07-27T03:11:20.102896+0000","last_became_peered":"2024-07-27T03:11:20.102896+0000","last_unstale":"2024-07-27T03:11:21.349410+0000","last_undegraded":"2024-07-27T03:11:21.349410+0000","last_fullsized":"2024-07-27T03:11:21.349410+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:36:46.720760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110426+0000","last_change":"2024-07-27T03:11:19.100553+0000","last_active":"2024-07-27T03:11:21.110426+0000","last_peered":"2024-07-27T03:11:21.110426+0000","last_clean":"2024-07-27T03:11:21.110426+0000","last_became_active":"2024-07-27T03:11:19.100172+0000","last_became_peered":"2024-07-27T03:11:19.100172+0000","last_unstale":"2024-07-27T03:11:21.110426+0000","last_undegraded":"2024-07-27T03:11:21.110426+0000","last_fullsized":"2024-07-27T03:11:21.110426+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:21:48.398665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110787+0000","last_change":"2024-07-27T03:11:20.097619+0000","last_active":"2024-07-27T03:11:21.110787+0000","last_peered":"2024-07-27T03:11:21.110787+0000","last_clean":"2024-07-27T03:11:21.110787+0000","last_became_active":"2024-07-27T03:11:20.097119+0000","last_became_peered":"2024-07-27T03:11:20.097119+0000","last_unstale":"2024-07-27T03:11:21.110787+0000","last_undegraded":"2024-07-27T03:11:21.110787+0000","last_fullsized":"2024-07-27T03:11:21.110787+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:06:28.965309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590607+0000","last_change":"2024-07-27T03:11:19.105512+0000","last_active":"2024-07-27T03:11:21.590607+0000","last_peered":"2024-07-27T03:11:21.590607+0000","last_clean":"2024-07-27T03:11:21.590607+0000","last_became_active":"2024-07-27T03:11:19.105229+0000","last_became_peered":"2024-07-27T03:11:19.105229+0000","last_unstale":"2024-07-27T03:11:21.590607+0000","last_undegraded":"2024-07-27T03:11:21.590607+0000","last_fullsized":"2024-07-27T03:11:21.590607+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:23:39.476947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590721+0000","last_change":"2024-07-27T03:11:20.115477+0000","last_active":"2024-07-27T03:11:21.590721+0000","last_peered":"2024-07-27T03:11:21.590721+0000","last_clean":"2024-07-27T03:11:21.590721+0000","last_became_active":"2024-07-27T03:11:20.115128+0000","last_became_peered":"2024-07-27T03:11:20.115128+0000","last_unstale":"2024-07-27T03:11:21.590721+0000","last_undegraded":"2024-07-27T03:11:21.590721+0000","last_fullsized":"2024-07-27T03:11:21.590721+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:19:25.908150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349663+0000","last_change":"2024-07-27T03:11:19.100490+0000","last_active":"2024-07-27T03:11:21.349663+0000","last_peered":"2024-07-27T03:11:21.349663+0000","last_clean":"2024-07-27T03:11:21.349663+0000","last_became_active":"2024-07-27T03:11:19.100209+0000","last_became_peered":"2024-07-27T03:11:19.100209+0000","last_unstale":"2024-07-27T03:11:21.349663+0000","last_undegraded":"2024-07-27T03:11:21.349663+0000","last_fullsized":"2024-07-27T03:11:21.349663+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:05:13.024640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589711+0000","last_change":"2024-07-27T03:11:20.107840+0000","last_active":"2024-07-27T03:11:21.589711+0000","last_peered":"2024-07-27T03:11:21.589711+0000","last_clean":"2024-07-27T03:11:21.589711+0000","last_became_active":"2024-07-27T03:11:20.107509+0000","last_became_peered":"2024-07-27T03:11:20.107509+0000","last_unstale":"2024-07-27T03:11:21.589711+0000","last_undegraded":"2024-07-27T03:11:21.589711+0000","last_fullsized":"2024-07-27T03:11:21.589711+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:23:48.246374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590854+0000","last_change":"2024-07-27T03:11:19.104498+0000","last_active":"2024-07-27T03:11:21.590854+0000","last_peered":"2024-07-27T03:11:21.590854+0000","last_clean":"2024-07-27T03:11:21.590854+0000","last_became_active":"2024-07-27T03:11:19.104259+0000","last_became_peered":"2024-07-27T03:11:19.104259+0000","last_unstale":"2024-07-27T03:11:21.590854+0000","last_undegraded":"2024-07-27T03:11:21.590854+0000","last_fullsized":"2024-07-27T03:11:21.590854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:39.555321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590798+0000","last_change":"2024-07-27T03:11:20.115284+0000","last_active":"2024-07-27T03:11:21.590798+0000","last_peered":"2024-07-27T03:11:21.590798+0000","last_clean":"2024-07-27T03:11:21.590798+0000","last_became_active":"2024-07-27T03:11:20.114952+0000","last_became_peered":"2024-07-27T03:11:20.114952+0000","last_unstale":"2024-07-27T03:11:21.590798+0000","last_undegraded":"2024-07-27T03:11:21.590798+0000","last_fullsized":"2024-07-27T03:11:21.590798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:52:57.758643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110960+0000","last_change":"2024-07-27T03:11:19.099210+0000","last_active":"2024-07-27T03:11:21.110960+0000","last_peered":"2024-07-27T03:11:21.110960+0000","last_clean":"2024-07-27T03:11:21.110960+0000","last_became_active":"2024-07-27T03:11:19.098810+0000","last_became_peered":"2024-07-27T03:11:19.098810+0000","last_unstale":"2024-07-27T03:11:21.110960+0000","last_undegraded":"2024-07-27T03:11:21.110960+0000","last_fullsized":"2024-07-27T03:11:21.110960+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:57:36.431361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112193+0000","last_change":"2024-07-27T03:11:20.117668+0000","last_active":"2024-07-27T03:11:21.112193+0000","last_peered":"2024-07-27T03:11:21.112193+0000","last_clean":"2024-07-27T03:11:21.112193+0000","last_became_active":"2024-07-27T03:11:20.117382+0000","last_became_peered":"2024-07-27T03:11:20.117382+0000","last_unstale":"2024-07-27T03:11:21.112193+0000","last_undegraded":"2024-07-27T03:11:21.112193+0000","last_fullsized":"2024-07-27T03:11:21.112193+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:04:54.827444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349497+0000","last_change":"2024-07-27T03:11:19.099784+0000","last_active":"2024-07-27T03:11:21.349497+0000","last_peered":"2024-07-27T03:11:21.349497+0000","last_clean":"2024-07-27T03:11:21.349497+0000","last_became_active":"2024-07-27T03:11:19.099406+0000","last_became_peered":"2024-07-27T03:11:19.099406+0000","last_unstale":"2024-07-27T03:11:21.349497+0000","last_undegraded":"2024-07-27T03:11:21.349497+0000","last_fullsized":"2024-07-27T03:11:21.349497+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:39:54.701882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590305+0000","last_change":"2024-07-27T03:11:20.102789+0000","last_active":"2024-07-27T03:11:21.590305+0000","last_peered":"2024-07-27T03:11:21.590305+0000","last_clean":"2024-07-27T03:11:21.590305+0000","last_became_active":"2024-07-27T03:11:20.102457+0000","last_became_peered":"2024-07-27T03:11:20.102457+0000","last_unstale":"2024-07-27T03:11:21.590305+0000","last_undegraded":"2024-07-27T03:11:21.590305+0000","last_fullsized":"2024-07-27T03:11:21.590305+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:04:54.827444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297790+0000","last_change":"2024-07-27T03:11:19.094598+0000","last_active":"2024-07-27T03:11:21.297790+0000","last_peered":"2024-07-27T03:11:21.297790+0000","last_clean":"2024-07-27T03:11:21.297790+0000","last_became_active":"2024-07-27T03:11:19.094256+0000","last_became_peered":"2024-07-27T03:11:19.094256+0000","last_unstale":"2024-07-27T03:11:21.297790+0000","last_undegraded":"2024-07-27T03:11:21.297790+0000","last_fullsized":"2024-07-27T03:11:21.297790+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:18:44.458256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110499+0000","last_change":"2024-07-27T03:11:20.109587+0000","last_active":"2024-07-27T03:11:21.110499+0000","last_peered":"2024-07-27T03:11:21.110499+0000","last_clean":"2024-07-27T03:11:21.110499+0000","last_became_active":"2024-07-27T03:11:20.104567+0000","last_became_peered":"2024-07-27T03:11:20.104567+0000","last_unstale":"2024-07-27T03:11:21.110499+0000","last_undegraded":"2024-07-27T03:11:21.110499+0000","last_fullsized":"2024-07-27T03:11:21.110499+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:24:10.352884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111763+0000","last_change":"2024-07-27T03:11:19.100330+0000","last_active":"2024-07-27T03:11:21.111763+0000","last_peered":"2024-07-27T03:11:21.111763+0000","last_clean":"2024-07-27T03:11:21.111763+0000","last_became_active":"2024-07-27T03:11:19.099682+0000","last_became_peered":"2024-07-27T03:11:19.099682+0000","last_unstale":"2024-07-27T03:11:21.111763+0000","last_undegraded":"2024-07-27T03:11:21.111763+0000","last_fullsized":"2024-07-27T03:11:21.111763+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:27.739312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590552+0000","last_change":"2024-07-27T03:11:20.098909+0000","last_active":"2024-07-27T03:11:21.590552+0000","last_peered":"2024-07-27T03:11:21.590552+0000","last_clean":"2024-07-27T03:11:21.590552+0000","last_became_active":"2024-07-27T03:11:20.098349+0000","last_became_peered":"2024-07-27T03:11:20.098349+0000","last_unstale":"2024-07-27T03:11:21.590552+0000","last_undegraded":"2024-07-27T03:11:21.590552+0000","last_fullsized":"2024-07-27T03:11:21.590552+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:45:21.326718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590084+0000","last_change":"2024-07-27T03:11:19.101259+0000","last_active":"2024-07-27T03:11:21.590084+0000","last_peered":"2024-07-27T03:11:21.590084+0000","last_clean":"2024-07-27T03:11:21.590084+0000","last_became_active":"2024-07-27T03:11:19.100946+0000","last_became_peered":"2024-07-27T03:11:19.100946+0000","last_unstale":"2024-07-27T03:11:21.590084+0000","last_undegraded":"2024-07-27T03:11:21.590084+0000","last_fullsized":"2024-07-27T03:11:21.590084+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:27.739312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590852+0000","last_change":"2024-07-27T03:11:20.103583+0000","last_active":"2024-07-27T03:11:21.590852+0000","last_peered":"2024-07-27T03:11:21.590852+0000","last_clean":"2024-07-27T03:11:21.590852+0000","last_became_active":"2024-07-27T03:11:20.101980+0000","last_became_peered":"2024-07-27T03:11:20.101980+0000","last_unstale":"2024-07-27T03:11:21.590852+0000","last_undegraded":"2024-07-27T03:11:21.590852+0000","last_fullsized":"2024-07-27T03:11:21.590852+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:06:13.715505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349669+0000","last_change":"2024-07-27T03:11:19.099721+0000","last_active":"2024-07-27T03:11:21.349669+0000","last_peered":"2024-07-27T03:11:21.349669+0000","last_clean":"2024-07-27T03:11:21.349669+0000","last_became_active":"2024-07-27T03:11:19.099380+0000","last_became_peered":"2024-07-27T03:11:19.099380+0000","last_unstale":"2024-07-27T03:11:21.349669+0000","last_undegraded":"2024-07-27T03:11:21.349669+0000","last_fullsized":"2024-07-27T03:11:21.349669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:35:48.351278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111997+0000","last_change":"2024-07-27T03:11:20.117677+0000","last_active":"2024-07-27T03:11:21.111997+0000","last_peered":"2024-07-27T03:11:21.111997+0000","last_clean":"2024-07-27T03:11:21.111997+0000","last_became_active":"2024-07-27T03:11:20.117376+0000","last_became_peered":"2024-07-27T03:11:20.117376+0000","last_unstale":"2024-07-27T03:11:21.111997+0000","last_undegraded":"2024-07-27T03:11:21.111997+0000","last_fullsized":"2024-07-27T03:11:21.111997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:58:12.147091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105888+0000","last_change":"2024-07-27T03:11:19.101480+0000","last_active":"2024-07-27T03:11:21.105888+0000","last_peered":"2024-07-27T03:11:21.105888+0000","last_clean":"2024-07-27T03:11:21.105888+0000","last_became_active":"2024-07-27T03:11:19.101190+0000","last_became_peered":"2024-07-27T03:11:19.101190+0000","last_unstale":"2024-07-27T03:11:21.105888+0000","last_undegraded":"2024-07-27T03:11:21.105888+0000","last_fullsized":"2024-07-27T03:11:21.105888+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:27.739312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349672+0000","last_change":"2024-07-27T03:11:20.094999+0000","last_active":"2024-07-27T03:11:21.349672+0000","last_peered":"2024-07-27T03:11:21.349672+0000","last_clean":"2024-07-27T03:11:21.349672+0000","last_became_active":"2024-07-27T03:11:20.093245+0000","last_became_peered":"2024-07-27T03:11:20.093245+0000","last_unstale":"2024-07-27T03:11:21.349672+0000","last_undegraded":"2024-07-27T03:11:21.349672+0000","last_fullsized":"2024-07-27T03:11:21.349672+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:44:47.888478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112151+0000","last_change":"2024-07-27T03:11:19.099786+0000","last_active":"2024-07-27T03:11:21.112151+0000","last_peered":"2024-07-27T03:11:21.112151+0000","last_clean":"2024-07-27T03:11:21.112151+0000","last_became_active":"2024-07-27T03:11:19.099425+0000","last_became_peered":"2024-07-27T03:11:19.099425+0000","last_unstale":"2024-07-27T03:11:21.112151+0000","last_undegraded":"2024-07-27T03:11:21.112151+0000","last_fullsized":"2024-07-27T03:11:21.112151+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:34:09.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590833+0000","last_change":"2024-07-27T03:11:20.116005+0000","last_active":"2024-07-27T03:11:21.590833+0000","last_peered":"2024-07-27T03:11:21.590833+0000","last_clean":"2024-07-27T03:11:21.590833+0000","last_became_active":"2024-07-27T03:11:20.115439+0000","last_became_peered":"2024-07-27T03:11:20.115439+0000","last_unstale":"2024-07-27T03:11:21.590833+0000","last_undegraded":"2024-07-27T03:11:21.590833+0000","last_fullsized":"2024-07-27T03:11:21.590833+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:11:24.859249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105891+0000","last_change":"2024-07-27T03:11:19.102076+0000","last_active":"2024-07-27T03:11:21.105891+0000","last_peered":"2024-07-27T03:11:21.105891+0000","last_clean":"2024-07-27T03:11:21.105891+0000","last_became_active":"2024-07-27T03:11:19.101792+0000","last_became_peered":"2024-07-27T03:11:19.101792+0000","last_unstale":"2024-07-27T03:11:21.105891+0000","last_undegraded":"2024-07-27T03:11:21.105891+0000","last_fullsized":"2024-07-27T03:11:21.105891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:34:09.661808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112111+0000","last_change":"2024-07-27T03:11:20.114114+0000","last_active":"2024-07-27T03:11:21.112111+0000","last_peered":"2024-07-27T03:11:21.112111+0000","last_clean":"2024-07-27T03:11:21.112111+0000","last_became_active":"2024-07-27T03:11:20.113804+0000","last_became_peered":"2024-07-27T03:11:20.113804+0000","last_unstale":"2024-07-27T03:11:21.112111+0000","last_undegraded":"2024-07-27T03:11:21.112111+0000","last_fullsized":"2024-07-27T03:11:21.112111+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:00:02.863737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349706+0000","last_change":"2024-07-27T03:11:19.099608+0000","last_active":"2024-07-27T03:11:21.349706+0000","last_peered":"2024-07-27T03:11:21.349706+0000","last_clean":"2024-07-27T03:11:21.349706+0000","last_became_active":"2024-07-27T03:11:19.099300+0000","last_became_peered":"2024-07-27T03:11:19.099300+0000","last_unstale":"2024-07-27T03:11:21.349706+0000","last_undegraded":"2024-07-27T03:11:21.349706+0000","last_fullsized":"2024-07-27T03:11:21.349706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:24:27.537598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105710+0000","last_change":"2024-07-27T03:11:20.106781+0000","last_active":"2024-07-27T03:11:21.105710+0000","last_peered":"2024-07-27T03:11:21.105710+0000","last_clean":"2024-07-27T03:11:21.105710+0000","last_became_active":"2024-07-27T03:11:20.106449+0000","last_became_peered":"2024-07-27T03:11:20.106449+0000","last_unstale":"2024-07-27T03:11:21.105710+0000","last_undegraded":"2024-07-27T03:11:21.105710+0000","last_fullsized":"2024-07-27T03:11:21.105710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:26:47.403266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589789+0000","last_change":"2024-07-27T03:11:19.100472+0000","last_active":"2024-07-27T03:11:21.589789+0000","last_peered":"2024-07-27T03:11:21.589789+0000","last_clean":"2024-07-27T03:11:21.589789+0000","last_became_active":"2024-07-27T03:11:19.100183+0000","last_became_peered":"2024-07-27T03:11:19.100183+0000","last_unstale":"2024-07-27T03:11:21.589789+0000","last_undegraded":"2024-07-27T03:11:21.589789+0000","last_fullsized":"2024-07-27T03:11:21.589789+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:59:57.258777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.105503+0000","last_change":"2024-07-27T03:11:20.099279+0000","last_active":"2024-07-27T03:11:21.105503+0000","last_peered":"2024-07-27T03:11:21.105503+0000","last_clean":"2024-07-27T03:11:21.105503+0000","last_became_active":"2024-07-27T03:11:20.098975+0000","last_became_peered":"2024-07-27T03:11:20.098975+0000","last_unstale":"2024-07-27T03:11:21.105503+0000","last_undegraded":"2024-07-27T03:11:21.105503+0000","last_fullsized":"2024-07-27T03:11:21.105503+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:45:21.326718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.111627+0000","last_change":"2024-07-27T03:11:19.090066+0000","last_active":"2024-07-27T03:11:21.111627+0000","last_peered":"2024-07-27T03:11:21.111627+0000","last_clean":"2024-07-27T03:11:21.111627+0000","last_became_active":"2024-07-27T03:11:19.089703+0000","last_became_peered":"2024-07-27T03:11:19.089703+0000","last_unstale":"2024-07-27T03:11:21.111627+0000","last_undegraded":"2024-07-27T03:11:21.111627+0000","last_fullsized":"2024-07-27T03:11:21.111627+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:10:00.717705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112018+0000","last_change":"2024-07-27T03:11:20.108097+0000","last_active":"2024-07-27T03:11:21.112018+0000","last_peered":"2024-07-27T03:11:21.112018+0000","last_clean":"2024-07-27T03:11:21.112018+0000","last_became_active":"2024-07-27T03:11:20.107785+0000","last_became_peered":"2024-07-27T03:11:20.107785+0000","last_unstale":"2024-07-27T03:11:21.112018+0000","last_undegraded":"2024-07-27T03:11:21.112018+0000","last_fullsized":"2024-07-27T03:11:21.112018+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:06:37.153792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590226+0000","last_change":"2024-07-27T03:11:19.101210+0000","last_active":"2024-07-27T03:11:21.590226+0000","last_peered":"2024-07-27T03:11:21.590226+0000","last_clean":"2024-07-27T03:11:21.590226+0000","last_became_active":"2024-07-27T03:11:19.100926+0000","last_became_peered":"2024-07-27T03:11:19.100926+0000","last_unstale":"2024-07-27T03:11:21.590226+0000","last_undegraded":"2024-07-27T03:11:21.590226+0000","last_fullsized":"2024-07-27T03:11:21.590226+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:18:44.458256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112316+0000","last_change":"2024-07-27T03:11:20.113271+0000","last_active":"2024-07-27T03:11:21.112316+0000","last_peered":"2024-07-27T03:11:21.112316+0000","last_clean":"2024-07-27T03:11:21.112316+0000","last_became_active":"2024-07-27T03:11:20.112668+0000","last_became_peered":"2024-07-27T03:11:20.112668+0000","last_unstale":"2024-07-27T03:11:21.112316+0000","last_undegraded":"2024-07-27T03:11:21.112316+0000","last_fullsized":"2024-07-27T03:11:21.112316+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:24:57.993657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106014+0000","last_change":"2024-07-27T03:11:19.100643+0000","last_active":"2024-07-27T03:11:21.106014+0000","last_peered":"2024-07-27T03:11:21.106014+0000","last_clean":"2024-07-27T03:11:21.106014+0000","last_became_active":"2024-07-27T03:11:19.098024+0000","last_became_peered":"2024-07-27T03:11:19.098024+0000","last_unstale":"2024-07-27T03:11:21.106014+0000","last_undegraded":"2024-07-27T03:11:21.106014+0000","last_fullsized":"2024-07-27T03:11:21.106014+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:23:39.476947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589788+0000","last_change":"2024-07-27T03:11:20.106083+0000","last_active":"2024-07-27T03:11:21.589788+0000","last_peered":"2024-07-27T03:11:21.589788+0000","last_clean":"2024-07-27T03:11:21.589788+0000","last_became_active":"2024-07-27T03:11:20.105800+0000","last_became_peered":"2024-07-27T03:11:20.105800+0000","last_unstale":"2024-07-27T03:11:21.589788+0000","last_undegraded":"2024-07-27T03:11:21.589788+0000","last_fullsized":"2024-07-27T03:11:21.589788+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:17:58.586661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297919+0000","last_change":"2024-07-27T03:11:19.092933+0000","last_active":"2024-07-27T03:11:21.297919+0000","last_peered":"2024-07-27T03:11:21.297919+0000","last_clean":"2024-07-27T03:11:21.297919+0000","last_became_active":"2024-07-27T03:11:19.092598+0000","last_became_peered":"2024-07-27T03:11:19.092598+0000","last_unstale":"2024-07-27T03:11:21.297919+0000","last_undegraded":"2024-07-27T03:11:21.297919+0000","last_fullsized":"2024-07-27T03:11:21.297919+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:11:35.450924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.106119+0000","last_change":"2024-07-27T03:11:20.108104+0000","last_active":"2024-07-27T03:11:21.106119+0000","last_peered":"2024-07-27T03:11:21.106119+0000","last_clean":"2024-07-27T03:11:21.106119+0000","last_became_active":"2024-07-27T03:11:20.107809+0000","last_became_peered":"2024-07-27T03:11:20.107809+0000","last_unstale":"2024-07-27T03:11:21.106119+0000","last_undegraded":"2024-07-27T03:11:21.106119+0000","last_fullsized":"2024-07-27T03:11:21.106119+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:52:57.758643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.112439+0000","last_change":"2024-07-27T03:11:19.093549+0000","last_active":"2024-07-27T03:11:21.112439+0000","last_peered":"2024-07-27T03:11:21.112439+0000","last_clean":"2024-07-27T03:11:21.112439+0000","last_became_active":"2024-07-27T03:11:19.093252+0000","last_became_peered":"2024-07-27T03:11:19.093252+0000","last_unstale":"2024-07-27T03:11:21.112439+0000","last_undegraded":"2024-07-27T03:11:21.112439+0000","last_fullsized":"2024-07-27T03:11:21.112439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:23:39.476947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349538+0000","last_change":"2024-07-27T03:11:20.114563+0000","last_active":"2024-07-27T03:11:21.349538+0000","last_peered":"2024-07-27T03:11:21.349538+0000","last_clean":"2024-07-27T03:11:21.349538+0000","last_became_active":"2024-07-27T03:11:20.114266+0000","last_became_peered":"2024-07-27T03:11:20.114266+0000","last_unstale":"2024-07-27T03:11:21.349538+0000","last_undegraded":"2024-07-27T03:11:21.349538+0000","last_fullsized":"2024-07-27T03:11:21.349538+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:15:47.637990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589579+0000","last_change":"2024-07-27T03:11:19.092283+0000","last_active":"2024-07-27T03:11:21.589579+0000","last_peered":"2024-07-27T03:11:21.589579+0000","last_clean":"2024-07-27T03:11:21.589579+0000","last_became_active":"2024-07-27T03:11:19.091998+0000","last_became_peered":"2024-07-27T03:11:19.091998+0000","last_unstale":"2024-07-27T03:11:21.589579+0000","last_undegraded":"2024-07-27T03:11:21.589579+0000","last_fullsized":"2024-07-27T03:11:21.589579+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:10:21.905319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590635+0000","last_change":"2024-07-27T03:11:20.098366+0000","last_active":"2024-07-27T03:11:21.590635+0000","last_peered":"2024-07-27T03:11:21.590635+0000","last_clean":"2024-07-27T03:11:21.590635+0000","last_became_active":"2024-07-27T03:11:20.097872+0000","last_became_peered":"2024-07-27T03:11:20.097872+0000","last_unstale":"2024-07-27T03:11:21.590635+0000","last_undegraded":"2024-07-27T03:11:21.590635+0000","last_fullsized":"2024-07-27T03:11:21.590635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:25:24.629300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.110740+0000","last_change":"2024-07-27T03:11:19.099204+0000","last_active":"2024-07-27T03:11:21.110740+0000","last_peered":"2024-07-27T03:11:21.110740+0000","last_clean":"2024-07-27T03:11:21.110740+0000","last_became_active":"2024-07-27T03:11:19.098765+0000","last_became_peered":"2024-07-27T03:11:19.098765+0000","last_unstale":"2024-07-27T03:11:21.110740+0000","last_undegraded":"2024-07-27T03:11:21.110740+0000","last_fullsized":"2024-07-27T03:11:21.110740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:17:57.583871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589841+0000","last_change":"2024-07-27T03:11:20.113643+0000","last_active":"2024-07-27T03:11:21.589841+0000","last_peered":"2024-07-27T03:11:21.589841+0000","last_clean":"2024-07-27T03:11:21.589841+0000","last_became_active":"2024-07-27T03:11:20.113344+0000","last_became_peered":"2024-07-27T03:11:20.113344+0000","last_unstale":"2024-07-27T03:11:21.589841+0000","last_undegraded":"2024-07-27T03:11:21.589841+0000","last_fullsized":"2024-07-27T03:11:21.589841+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:37:06.355797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.589828+0000","last_change":"2024-07-27T03:11:19.103760+0000","last_active":"2024-07-27T03:11:21.589828+0000","last_peered":"2024-07-27T03:11:21.589828+0000","last_clean":"2024-07-27T03:11:21.589828+0000","last_became_active":"2024-07-27T03:11:19.103439+0000","last_became_peered":"2024-07-27T03:11:19.103439+0000","last_unstale":"2024-07-27T03:11:21.589828+0000","last_undegraded":"2024-07-27T03:11:21.589828+0000","last_fullsized":"2024-07-27T03:11:21.589828+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:11:35.450924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349783+0000","last_change":"2024-07-27T03:11:20.102983+0000","last_active":"2024-07-27T03:11:21.349783+0000","last_peered":"2024-07-27T03:11:21.349783+0000","last_clean":"2024-07-27T03:11:21.349783+0000","last_became_active":"2024-07-27T03:11:20.102477+0000","last_became_peered":"2024-07-27T03:11:20.102477+0000","last_unstale":"2024-07-27T03:11:21.349783+0000","last_undegraded":"2024-07-27T03:11:21.349783+0000","last_fullsized":"2024-07-27T03:11:21.349783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:09:18.167299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349488+0000","last_change":"2024-07-27T03:11:19.092804+0000","last_active":"2024-07-27T03:11:21.349488+0000","last_peered":"2024-07-27T03:11:21.349488+0000","last_clean":"2024-07-27T03:11:21.349488+0000","last_became_active":"2024-07-27T03:11:19.092496+0000","last_became_peered":"2024-07-27T03:11:19.092496+0000","last_unstale":"2024-07-27T03:11:21.349488+0000","last_undegraded":"2024-07-27T03:11:21.349488+0000","last_fullsized":"2024-07-27T03:11:21.349488+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:57:46.638801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.349501+0000","last_change":"2024-07-27T03:11:20.100748+0000","last_active":"2024-07-27T03:11:21.349501+0000","last_peered":"2024-07-27T03:11:21.349501+0000","last_clean":"2024-07-27T03:11:21.349501+0000","last_became_active":"2024-07-27T03:11:20.100089+0000","last_became_peered":"2024-07-27T03:11:20.100089+0000","last_unstale":"2024-07-27T03:11:21.349501+0000","last_undegraded":"2024-07-27T03:11:21.349501+0000","last_fullsized":"2024-07-27T03:11:21.349501+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:19.075228+0000","last_clean_scrub_stamp":"2024-07-27T03:11:19.075228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:04:22.697118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.297706+0000","last_change":"2024-07-27T03:11:19.093235+0000","last_active":"2024-07-27T03:11:21.297706+0000","last_peered":"2024-07-27T03:11:21.297706+0000","last_clean":"2024-07-27T03:11:21.297706+0000","last_became_active":"2024-07-27T03:11:19.092865+0000","last_became_peered":"2024-07-27T03:11:19.092865+0000","last_unstale":"2024-07-27T03:11:21.297706+0000","last_undegraded":"2024-07-27T03:11:21.297706+0000","last_fullsized":"2024-07-27T03:11:21.297706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:11:18.072437+0000","last_clean_scrub_stamp":"2024-07-27T03:11:18.072437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:59:57.258777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":174,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-07-27T03:11:21.590131+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:11:21.590131+0000","last_peered":"2024-07-27T03:11:21.590131+0000","last_clean":"2024-07-27T03:11:21.590131+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:11:21.590131+0000","last_undegraded":"2024-07-27T03:11:21.590131+0000","last_fullsized":"2024-07-27T03:11:21.590131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":871548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":281672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36016,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335824,"statfs":{"total":96636764160,"available":96599883776,"internally_reserved":0,"allocated":684032,"data_stored":281076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":281076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36604,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335236,"statfs":{"total":96636764160,"available":96599281664,"internally_reserved":0,"allocated":1286144,"data_stored":873582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":675840,"data_stored":281020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":688128,"data_stored":282632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":679936,"data_stored":281110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:11:28.979 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-27T03:11:28.979 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-07-27T03:11:29.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.135+0000 7f99450d2640 1 -- 172.21.15.120:0/3522571694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99400b4740 msgr2=0x7f99400b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:29.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.135+0000 7f99450d2640 1 --2- 172.21.15.120:0/3522571694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99400b4740 0x7f99400b2c40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9930005fd0 tx=0x7f993002a5c0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.135+0000 7f99450d2640 1 -- 172.21.15.120:0/3522571694 shutdown_connections 2024-07-27T03:11:29.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.135+0000 7f99450d2640 1 --2- 172.21.15.120:0/3522571694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99400d10d0 0x7f99400d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.135+0000 7f99450d2640 1 --2- 172.21.15.120:0/3522571694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99400b4740 0x7f99400b2c40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.135+0000 7f99450d2640 1 -- 172.21.15.120:0/3522571694 >> 172.21.15.120:0/3522571694 conn(0x7f994008d690 msgr2=0x7f994009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:29.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.135+0000 7f99450d2640 1 -- 172.21.15.120:0/3522571694 shutdown_connections 2024-07-27T03:11:29.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.135+0000 7f99450d2640 1 -- 172.21.15.120:0/3522571694 wait complete. 2024-07-27T03:11:29.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.137+0000 7f99450d2640 1 Processor -- start 2024-07-27T03:11:29.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.137+0000 7f99450d2640 1 -- start start 2024-07-27T03:11:29.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.138+0000 7f99450d2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99400b4740 0x7f99400caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:29.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.138+0000 7f99450d2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99400d27e0 0x7f99401523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:29.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.138+0000 7f99450d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99400b83d0 0x7f99400b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:29.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.138+0000 7f99450d2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f99400cefb0 con 0x7f99400b4740 2024-07-27T03:11:29.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.138+0000 7f99450d2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f99400cee30 con 0x7f99400b83d0 2024-07-27T03:11:29.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.138+0000 7f99450d2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f99400cf130 con 0x7f99400d27e0 2024-07-27T03:11:29.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.138+0000 7f993ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99400b4740 0x7f99400caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:29.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.138+0000 7f993ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99400b4740 0x7f99400caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51138/0 (socket says 172.21.15.120:51138) 2024-07-27T03:11:29.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.138+0000 7f993ed9d640 1 -- 172.21.15.120:0/3244282456 learned_addr learned my addr 172.21.15.120:0/3244282456 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:29.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.138+0000 7f9937fff640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99400d27e0 0x7f99401523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:29.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.138+0000 7f993f59e640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99400b83d0 0x7f99400b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:29.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.139+0000 7f993ed9d640 1 -- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99400d27e0 msgr2=0x7f99401523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:29.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.139+0000 7f993ed9d640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99400d27e0 0x7f99401523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.139+0000 7f993ed9d640 1 -- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99400b83d0 msgr2=0x7f99400b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:29.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.139+0000 7f993ed9d640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99400b83d0 0x7f99400b87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.139+0000 7f993ed9d640 1 -- 172.21.15.120:0/3244282456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99400b8d20 con 0x7f99400b4740 2024-07-27T03:11:29.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.139+0000 7f993ed9d640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99400b4740 0x7f99400caff0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9930034040 tx=0x7f99300038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:29.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.139+0000 7f99377fe640 1 -- 172.21.15.120:0/3244282456 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993003e030 con 0x7f99400b4740 2024-07-27T03:11:29.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.139+0000 7f99377fe640 1 -- 172.21.15.120:0/3244282456 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9930003db0 con 0x7f99400b4740 2024-07-27T03:11:29.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.139+0000 7f99377fe640 1 -- 172.21.15.120:0/3244282456 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9930035040 con 0x7f99400b4740 2024-07-27T03:11:29.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.139+0000 7f99450d2640 1 -- 172.21.15.120:0/3244282456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99400cb530 con 0x7f99400b4740 2024-07-27T03:11:29.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.139+0000 7f99450d2640 1 -- 172.21.15.120:0/3244282456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99401f8e10 con 0x7f99400b4740 2024-07-27T03:11:29.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.140+0000 7f99450d2640 1 -- 172.21.15.120:0/3244282456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99400d2bf0 con 0x7f99400b4740 2024-07-27T03:11:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.141+0000 7f99377fe640 1 -- 172.21.15.120:0/3244282456 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9930041030 con 0x7f99400b4740 2024-07-27T03:11:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.141+0000 7f99377fe640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9920077010 0x7f9920079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.141+0000 7f99377fe640 1 -- 172.21.15.120:0/3244282456 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f99300b8ed0 con 0x7f99400b4740 2024-07-27T03:11:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.141+0000 7f9937fff640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9920077010 0x7f9920079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.142+0000 7f9937fff640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9920077010 0x7f9920079520 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f99401f8960 tx=0x7f9928009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:29.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.146+0000 7f99377fe640 1 -- 172.21.15.120:0/3244282456 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f99400b8d20 con 0x7f99400b4740 2024-07-27T03:11:29.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.397+0000 7f99450d2640 1 -- 172.21.15.120:0/3244282456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f99401f97d0 con 0x7f99400b4740 2024-07-27T03:11:29.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.399+0000 7f99377fe640 1 -- 172.21.15.120:0/3244282456 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f9930081a80 con 0x7f99400b4740 2024-07-27T03:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-07-27T03:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmI8baMRAArCIL9NNNVlevij0JAWwGwg== 2024-07-27T03:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: caps mds = "allow" 2024-07-27T03:11:29.403 INFO:teuthology.orchestra.run.smithi120.stdout: caps mon = "allow r" 2024-07-27T03:11:29.404 INFO:teuthology.orchestra.run.smithi120.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-07-27T03:11:29.404 INFO:teuthology.orchestra.run.smithi120.stderr:updated caps for client.0 2024-07-27T03:11:29.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 -- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9920077010 msgr2=0x7f9920079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:29.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9920077010 0x7f9920079520 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f99401f8960 tx=0x7f9928009040 comp rx=0 tx=0).stop 2024-07-27T03:11:29.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 -- 172.21.15.120:0/3244282456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99400b4740 msgr2=0x7f99400caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:29.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99400b4740 0x7f99400caff0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9930034040 tx=0x7f99300038a0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 -- 172.21.15.120:0/3244282456 shutdown_connections 2024-07-27T03:11:29.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9920077010 0x7f9920079520 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99400b83d0 0x7f99400b87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99400d27e0 0x7f99401523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 --2- 172.21.15.120:0/3244282456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99400b4740 0x7f99400caff0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 -- 172.21.15.120:0/3244282456 >> 172.21.15.120:0/3244282456 conn(0x7f994008d690 msgr2=0x7f99400b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:29.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 -- 172.21.15.120:0/3244282456 shutdown_connections 2024-07-27T03:11:29.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.402+0000 7f99450d2640 1 -- 172.21.15.120:0/3244282456 wait complete. 2024-07-27T03:11:29.417 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:11:29.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.527+0000 7ff000691640 1 -- 172.21.15.120:0/861630653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feff80b5cd0 msgr2=0x7feff80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:29.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.527+0000 7ff000691640 1 --2- 172.21.15.120:0/861630653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feff80b5cd0 0x7feff80b60e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009830 tx=0x7fefe802a510 comp rx=0 tx=0).stop 2024-07-27T03:11:29.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.527+0000 7ff000691640 1 -- 172.21.15.120:0/861630653 shutdown_connections 2024-07-27T03:11:29.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.527+0000 7ff000691640 1 --2- 172.21.15.120:0/861630653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feff80b5cd0 0x7feff80b60e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.527+0000 7ff000691640 1 --2- 172.21.15.120:0/861630653 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feff815c220 0x7feff8152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.527+0000 7ff000691640 1 -- 172.21.15.120:0/861630653 >> 172.21.15.120:0/861630653 conn(0x7feff806cba0 msgr2=0x7feff806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:29.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.527+0000 7ff000691640 1 -- 172.21.15.120:0/861630653 shutdown_connections 2024-07-27T03:11:29.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.527+0000 7ff000691640 1 -- 172.21.15.120:0/861630653 wait complete. 2024-07-27T03:11:29.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.528+0000 7ff000691640 1 Processor -- start 2024-07-27T03:11:29.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.529+0000 7ff000691640 1 -- start start 2024-07-27T03:11:29.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7ff000691640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feff80b5cd0 0x7feff8072d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:29.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7ff000691640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff815c220 0x7feff8073240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:29.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7ff000691640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feff815ec20 0x7feff8148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:29.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7ff000691640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7feff80cdb40 con 0x7feff80b5cd0 2024-07-27T03:11:29.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7ff000691640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feff80cd9c0 con 0x7feff815c220 2024-07-27T03:11:29.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7ff000691640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7feff80cdcc0 con 0x7feff815ec20 2024-07-27T03:11:29.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffe42d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feff80b5cd0 0x7feff8072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:29.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffe42d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feff80b5cd0 0x7feff8072d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51160/0 (socket says 172.21.15.120:51160) 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffe42d640 1 -- 172.21.15.120:0/1277124342 learned_addr learned my addr 172.21.15.120:0/1277124342 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffdc2c640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff815c220 0x7feff8073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffec2e640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feff815ec20 0x7feff8148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffe42d640 1 -- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feff815ec20 msgr2=0x7feff8148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffe42d640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feff815ec20 0x7feff8148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffe42d640 1 -- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff815c220 msgr2=0x7feff8073240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffe42d640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff815c220 0x7feff8073240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffe42d640 1 -- 172.21.15.120:0/1277124342 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff814d4e0 con 0x7feff80b5cd0 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffec2e640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feff815ec20 0x7feff8148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffdc2c640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff815c220 0x7feff8073240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.530+0000 7feffe42d640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feff80b5cd0 0x7feff8072d00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7feff400d6d0 tx=0x7feff400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.531+0000 7fefeeffd640 1 -- 172.21.15.120:0/1277124342 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4017070 con 0x7feff80b5cd0 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.531+0000 7fefeeffd640 1 -- 172.21.15.120:0/1277124342 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feff4004310 con 0x7feff80b5cd0 2024-07-27T03:11:29.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.531+0000 7ff000691640 1 -- 172.21.15.120:0/1277124342 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff814d7c0 con 0x7feff80b5cd0 2024-07-27T03:11:29.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.531+0000 7fefeeffd640 1 -- 172.21.15.120:0/1277124342 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4009a80 con 0x7feff80b5cd0 2024-07-27T03:11:29.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.531+0000 7ff000691640 1 -- 172.21.15.120:0/1277124342 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff814dd80 con 0x7feff80b5cd0 2024-07-27T03:11:29.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.532+0000 7ff000691640 1 -- 172.21.15.120:0/1277124342 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff80ce1e0 con 0x7feff80b5cd0 2024-07-27T03:11:29.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.532+0000 7fefeeffd640 1 -- 172.21.15.120:0/1277124342 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7feff40035f0 con 0x7feff80b5cd0 2024-07-27T03:11:29.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.533+0000 7fefeeffd640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fefdc077010 0x7fefdc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:29.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.533+0000 7fefeeffd640 1 -- 172.21.15.120:0/1277124342 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7feff4098b40 con 0x7feff80b5cd0 2024-07-27T03:11:29.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.533+0000 7feffdc2c640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fefdc077010 0x7fefdc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:29.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.534+0000 7feffdc2c640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fefdc077010 0x7fefdc079520 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fefe8034000 tx=0x7fefe8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:29.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.537+0000 7fefeeffd640 1 -- 172.21.15.120:0/1277124342 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7feff4061de0 con 0x7feff80b5cd0 2024-07-27T03:11:29.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.754+0000 7ff000691640 1 -- 172.21.15.120:0/1277124342 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feff80ccf70 con 0x7feff80b5cd0 2024-07-27T03:11:29.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.755+0000 7fefeeffd640 1 -- 172.21.15.120:0/1277124342 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5235 (secure 0 0 0) 0x7feff40616e0 con 0x7feff80b5cd0 2024-07-27T03:11:29.759 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:29.759 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":50,"btime":"2024-07-27T03:11:23:110568+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/3598257167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3598257167},{"type":"v1","addr":"172.21.15.121:6836","nonce":3598257167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5458,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/2987877930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2987877930},{"type":"v1","addr":"172.21.15.120:6834","nonce":2987877930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1057652547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1057652547},{"type":"v1","addr":"172.21.15.121:6837","nonce":1057652547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:11:19.459319+0000","modified":"2024-07-27T03:11:22.479244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/3550669358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":3550669358},{"type":"v1","addr":"172.21.15.120:6835","nonce":3550669358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5733,"qdb_cluster":[5733]},"id":4}]} 2024-07-27T03:11:29.759 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 50 2024-07-27T03:11:29.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 -- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fefdc077010 msgr2=0x7fefdc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:29.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fefdc077010 0x7fefdc079520 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fefe8034000 tx=0x7fefe8004730 comp rx=0 tx=0).stop 2024-07-27T03:11:29.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 -- 172.21.15.120:0/1277124342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feff80b5cd0 msgr2=0x7feff8072d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:29.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feff80b5cd0 0x7feff8072d00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7feff400d6d0 tx=0x7feff400db90 comp rx=0 tx=0).stop 2024-07-27T03:11:29.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 -- 172.21.15.120:0/1277124342 shutdown_connections 2024-07-27T03:11:29.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fefdc077010 0x7fefdc079520 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feff815ec20 0x7feff8148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff815c220 0x7feff8073240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 --2- 172.21.15.120:0/1277124342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feff80b5cd0 0x7feff8072d00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:29.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 -- 172.21.15.120:0/1277124342 >> 172.21.15.120:0/1277124342 conn(0x7feff806cba0 msgr2=0x7feff815cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:29.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 -- 172.21.15.120:0/1277124342 shutdown_connections 2024-07-27T03:11:29.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:29.757+0000 7ff000691640 1 -- 172.21.15.120:0/1277124342 wait complete. 2024-07-27T03:11:30.174 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:11:19.459319+0000', 'modified': '2024-07-27T03:11:22.479244+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5733}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5733': {'gid': 5733, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6835/3550669358', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6833', 'nonce': 3550669358}, {'type': 'v1', 'addr': '172.21.15.120:6835', 'nonce': 3550669358}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5733, 'qdb_cluster': [5733]} 2024-07-27T03:11:30.174 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-27T03:11:30.175 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-07-27T03:11:30.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.287+0000 7f7f4e538640 1 -- 172.21.15.120:0/1407530582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f480d2460 msgr2=0x7f7f480cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.287+0000 7f7f4e538640 1 --2- 172.21.15.120:0/1407530582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f480d2460 0x7f7f480cf990 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7f40005fd0 tx=0x7f7f4002a8b0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.287+0000 7f7f4e538640 1 -- 172.21.15.120:0/1407530582 shutdown_connections 2024-07-27T03:11:30.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.287+0000 7f7f4e538640 1 --2- 172.21.15.120:0/1407530582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f480d2460 0x7f7f480cf990 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.287+0000 7f7f4e538640 1 --2- 172.21.15.120:0/1407530582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f480b71d0 0x7f7f480cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.287+0000 7f7f4e538640 1 -- 172.21.15.120:0/1407530582 >> 172.21.15.120:0/1407530582 conn(0x7f7f4809aa30 msgr2=0x7f7f4809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.287+0000 7f7f4e538640 1 -- 172.21.15.120:0/1407530582 shutdown_connections 2024-07-27T03:11:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.287+0000 7f7f4e538640 1 -- 172.21.15.120:0/1407530582 wait complete. 2024-07-27T03:11:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.289+0000 7f7f4e538640 1 Processor -- start 2024-07-27T03:11:30.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.289+0000 7f7f4e538640 1 -- start start 2024-07-27T03:11:30.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.290+0000 7f7f4e538640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f480b1130 0x7f7f4815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.290+0000 7f7f4e538640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f480b71d0 0x7f7f4815d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.290+0000 7f7f4e538640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f48144cd0 0x7f7f481450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.290+0000 7f7f4e538640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7f480d0260 con 0x7f7f48144cd0 2024-07-27T03:11:30.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.290+0000 7f7f4e538640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f480d00e0 con 0x7f7f480b1130 2024-07-27T03:11:30.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.290+0000 7f7f4e538640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7f480d03e0 con 0x7f7f480b71d0 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.290+0000 7f7f4cad5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f48144cd0 0x7f7f481450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f4cad5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f48144cd0 0x7f7f481450e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51188/0 (socket says 172.21.15.120:51188) 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f4cad5640 1 -- 172.21.15.120:0/1336240310 learned_addr learned my addr 172.21.15.120:0/1336240310 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f47fff640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f480b1130 0x7f7f4815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f477fe640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f480b71d0 0x7f7f4815d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f4cad5640 1 -- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f480b71d0 msgr2=0x7f7f4815d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f480b71d0 0x7f7f4815d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f4cad5640 1 -- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f480b1130 msgr2=0x7f7f4815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f480b1130 0x7f7f4815b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f4cad5640 1 -- 172.21.15.120:0/1336240310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f480b0210 con 0x7f7f48144cd0 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f47fff640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f480b1130 0x7f7f4815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f48144cd0 0x7f7f481450e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7f40006010 tx=0x7f7f40003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f44ff9640 1 -- 172.21.15.120:0/1336240310 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f40031990 con 0x7f7f48144cd0 2024-07-27T03:11:30.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f44ff9640 1 -- 172.21.15.120:0/1336240310 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f40031c20 con 0x7f7f48144cd0 2024-07-27T03:11:30.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f4e538640 1 -- 172.21.15.120:0/1336240310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f480b04f0 con 0x7f7f48144cd0 2024-07-27T03:11:30.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f44ff9640 1 -- 172.21.15.120:0/1336240310 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400330d0 con 0x7f7f48144cd0 2024-07-27T03:11:30.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.291+0000 7f7f4e538640 1 -- 172.21.15.120:0/1336240310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f48159ba0 con 0x7f7f48144cd0 2024-07-27T03:11:30.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.293+0000 7f7f44ff9640 1 -- 172.21.15.120:0/1336240310 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f7f40033270 con 0x7f7f48144cd0 2024-07-27T03:11:30.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.293+0000 7f7f44ff9640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f34077030 0x7f7f34079540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.294+0000 7f7f44ff9640 1 -- 172.21.15.120:0/1336240310 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f7f400b9e00 con 0x7f7f48144cd0 2024-07-27T03:11:30.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.294+0000 7f7f47fff640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f34077030 0x7f7f34079540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.294+0000 7f7f47fff640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f34077030 0x7f7f34079540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7f38005fd0 tx=0x7f7f3800f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:30.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.295+0000 7f7f55455740 1 Processor -- start 2024-07-27T03:11:30.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.295+0000 7f7f55455740 1 -- start start 2024-07-27T03:11:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f55455740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8f5270 0x55f65ace2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f55455740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8cc3b0 0x55f65acc4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f55455740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f55455740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f65ac0d360 con 0x55f65a8d4590 2024-07-27T03:11:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f55455740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f65abfc860 con 0x55f65a8f5270 2024-07-27T03:11:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f55455740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55f65ac008a0 con 0x55f65a8cc3b0 2024-07-27T03:11:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f4cad5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f4cad5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51198/0 (socket says 172.21.15.120:51198) 2024-07-27T03:11:30.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f4cad5640 1 -- 172.21.15.120:0/913135886 learned_addr learned my addr 172.21.15.120:0/913135886 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f47fff640 1 --2- 172.21.15.120:0/913135886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8f5270 0x55f65ace2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f477fe640 1 --2- 172.21.15.120:0/913135886 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8cc3b0 0x55f65acc4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f4cad5640 1 -- 172.21.15.120:0/913135886 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8cc3b0 msgr2=0x55f65acc4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/913135886 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8cc3b0 0x55f65acc4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f4cad5640 1 -- 172.21.15.120:0/913135886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8f5270 msgr2=0x55f65ace2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/913135886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8f5270 0x55f65ace2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f4cad5640 1 -- 172.21.15.120:0/913135886 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65ab8c360 con 0x55f65a8d4590 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.296+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/913135886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc5380 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7f400b8360 tx=0x7f7f40082190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8479822e78bfc05f server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f2dffb640 1 -- 172.21.15.120:0/913135886 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400b6070 con 0x55f65a8d4590 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f2dffb640 1 -- 172.21.15.120:0/913135886 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f40083120 con 0x55f65a8d4590 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f2dffb640 1 -- 172.21.15.120:0/913135886 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4009b030 con 0x55f65a8d4590 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f55455740 1 -- 172.21.15.120:0/913135886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 msgr2=0x55f65acc5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f55455740 1 --2- 172.21.15.120:0/913135886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc5380 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7f400b8360 tx=0x7f7f40082190 comp rx=0 tx=0).stop 2024-07-27T03:11:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f55455740 1 -- 172.21.15.120:0/913135886 shutdown_connections 2024-07-27T03:11:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f55455740 1 --2- 172.21.15.120:0/913135886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc5380 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f55455740 1 --2- 172.21.15.120:0/913135886 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8cc3b0 0x55f65acc4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f55455740 1 --2- 172.21.15.120:0/913135886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8f5270 0x55f65ace2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f55455740 1 -- 172.21.15.120:0/913135886 >> 172.21.15.120:0/913135886 conn(0x55f65a8e93c0 msgr2=0x55f65ac9b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f55455740 1 -- 172.21.15.120:0/913135886 shutdown_connections 2024-07-27T03:11:30.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.297+0000 7f7f55455740 1 -- 172.21.15.120:0/913135886 wait complete. 2024-07-27T03:11:30.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.298+0000 7f7f55455740 1 -- start start 2024-07-27T03:11:30.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.298+0000 7f7f55455740 1 Processor -- start 2024-07-27T03:11:30.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f55455740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8cc3b0 0x55f65acb27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f55455740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65ace2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f55455740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8f5270 0x55f65ace2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f55455740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f65a96f620 con 0x55f65a8d4590 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f55455740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f65ab98140 con 0x55f65a8cc3b0 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f55455740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55f65ac0d360 con 0x55f65a8f5270 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f55455740 10 client.0 _ll_register_callbacks cb 0x55f65abf5c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f477fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65ace2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f477fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65ace2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51210/0 (socket says 172.21.15.120:51210) 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f477fe640 1 -- 172.21.15.120:0/3325226463 learned_addr learned my addr 172.21.15.120:0/3325226463 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f47fff640 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8cc3b0 0x55f65acb27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8f5270 0x55f65ace2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f477fe640 1 -- 172.21.15.120:0/3325226463 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8f5270 msgr2=0x55f65ace2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f477fe640 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8f5270 0x55f65ace2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f477fe640 1 -- 172.21.15.120:0/3325226463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8cc3b0 msgr2=0x55f65acb27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f477fe640 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8cc3b0 0x55f65acb27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f477fe640 1 -- 172.21.15.120:0/3325226463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f65a960850 con 0x55f65a8d4590 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f477fe640 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65ace2860 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7f480744d0 tx=0x7f7f3c011620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28e744702b0b5de server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.300+0000 7f7f26ffd640 1 -- 172.21.15.120:0/3325226463 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c0050d0 con 0x55f65a8d4590 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f26ffd640 1 -- 172.21.15.120:0/3325226463 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f7f3c005270 con 0x55f65a8d4590 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f55455740 1 -- 172.21.15.120:0/3325226463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f40083120 con 0x55f65a8d4590 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f26ffd640 1 -- 172.21.15.120:0/3325226463 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7f3c022050 con 0x55f65a8d4590 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f55455740 10 client.5889 fetch_fsmap learned FSMap version 50 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f55455740 1 -- 172.21.15.120:0/3325226463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55f65a9d76b0 con 0x55f65a8d4590 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f26ffd640 1 -- 172.21.15.120:0/3325226463 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f40083120 con 0x55f65a8d4590 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f26ffd640 1 -- 172.21.15.120:0/3325226463 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 50) ==== 3502+0+0 (secure 0 0 0) 0x7f7f3c025020 con 0x55f65a8d4590 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f55455740 10 client.5889 fetch_fsmap finished waiting for FSMap version 50 2024-07-27T03:11:30.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f55455740 10 client.5889 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f55455740 20 client.5889 populate_metadata read hostname 'smithi120' 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f55455740 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55f65a8b3e40 0x55f65acda210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f55455740 4 client.5889 mds_command: new command op to 5733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f55455740 1 -- 172.21.15.120:0/3325226463 --> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f65ac0f2b0 con 0x55f65a8b3e40 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f47fff640 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55f65a8b3e40 0x55f65acda210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.301+0000 7f7f26ffd640 10 client.5889 ms_handle_connect on v2:172.21.15.120:6833/3550669358 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.302+0000 7f7f47fff640 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55f65a8b3e40 0x55f65acda210 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8ef6f235b18ca2f server_cookie=74314601cd130202 in_seq=0 out_seq=0 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.302+0000 7f7f26ffd640 1 -- 172.21.15.120:0/3325226463 <== mds.0 v2:172.21.15.120:6833/3550669358 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f65ac0f2b0 con 0x55f65a8b3e40 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.302+0000 7f7f26ffd640 10 client.5889 handle_command_reply: tid=0 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.302+0000 7f7f55455740 1 client.5889 shutdown 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.302+0000 7f7f55455740 1 -- 172.21.15.120:0/3325226463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 msgr2=0x55f65ace2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.302+0000 7f7f55455740 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65ace2860 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7f480744d0 tx=0x7f7f3c011620 comp rx=0 tx=0).stop 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.303+0000 7f7f55455740 1 -- 172.21.15.120:0/3325226463 shutdown_connections 2024-07-27T03:11:30.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.303+0000 7f7f55455740 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55f65a8b3e40 0x55f65acda210 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.303+0000 7f7f55455740 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65ace2860 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.303+0000 7f7f55455740 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8f5270 0x55f65ace2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.303+0000 7f7f55455740 1 --2- 172.21.15.120:0/3325226463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8cc3b0 0x55f65acb27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.303+0000 7f7f26ffd640 0 client.5889 ms_handle_reset on v2:172.21.15.120:6833/3550669358 2024-07-27T03:11:30.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.303+0000 7f7f55455740 1 -- 172.21.15.120:0/3325226463 >> 172.21.15.120:0/3325226463 conn(0x55f65a8e93c0 msgr2=0x55f65ac9afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:30.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.303+0000 7f7f55455740 1 -- 172.21.15.120:0/3325226463 shutdown_connections 2024-07-27T03:11:30.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.303+0000 7f7f55455740 1 -- 172.21.15.120:0/3325226463 wait complete. 2024-07-27T03:11:30.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.303+0000 7f7f55455740 20 client.5889 trim_cache size 0 max 16384 2024-07-27T03:11:30.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.321+0000 7f7f55455740 1 Processor -- start 2024-07-27T03:11:30.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.322+0000 7f7f55455740 1 -- start start 2024-07-27T03:11:30.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f55455740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8cc3b0 0x55f65ad53ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f55455740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f55455740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8f5270 0x55f65acc1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f55455740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7f48158d90 con 0x55f65a8d4590 2024-07-27T03:11:30.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f55455740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481f6fd0 con 0x55f65a8cc3b0 2024-07-27T03:11:30.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f55455740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7f481f28f0 con 0x55f65a8f5270 2024-07-27T03:11:30.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f477fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f477fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51222/0 (socket says 172.21.15.120:51222) 2024-07-27T03:11:30.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f477fe640 1 -- 172.21.15.120:0/3510936462 learned_addr learned my addr 172.21.15.120:0/3510936462 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f47fff640 1 --2- 172.21.15.120:0/3510936462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8cc3b0 0x55f65ad53ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/3510936462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8f5270 0x55f65acc1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f477fe640 1 -- 172.21.15.120:0/3510936462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8f5270 msgr2=0x55f65acc1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f477fe640 1 --2- 172.21.15.120:0/3510936462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8f5270 0x55f65acc1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f477fe640 1 -- 172.21.15.120:0/3510936462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8cc3b0 msgr2=0x55f65ad53ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f477fe640 1 --2- 172.21.15.120:0/3510936462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8cc3b0 0x55f65ad53ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f477fe640 1 -- 172.21.15.120:0/3510936462 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65ac9bdb0 con 0x55f65a8d4590 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f47fff640 1 --2- 172.21.15.120:0/3510936462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8cc3b0 0x55f65ad53ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/3510936462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8f5270 0x55f65acc1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f477fe640 1 --2- 172.21.15.120:0/3510936462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc1830 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c003830 tx=0x7f7f3c011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632d71e4ec6c8786 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.323+0000 7f7f2d7fa640 1 -- 172.21.15.120:0/3510936462 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c02a020 con 0x55f65a8d4590 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.324+0000 7f7f2d7fa640 1 -- 172.21.15.120:0/3510936462 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f3c01a070 con 0x55f65a8d4590 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.324+0000 7f7f2d7fa640 1 -- 172.21.15.120:0/3510936462 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c0038b0 con 0x55f65a8d4590 2024-07-27T03:11:30.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.324+0000 7f7f55455740 1 -- 172.21.15.120:0/3510936462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 msgr2=0x55f65acc1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.324+0000 7f7f55455740 1 --2- 172.21.15.120:0/3510936462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc1830 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c003830 tx=0x7f7f3c011bc0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.324+0000 7f7f55455740 1 -- 172.21.15.120:0/3510936462 shutdown_connections 2024-07-27T03:11:30.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.324+0000 7f7f55455740 1 --2- 172.21.15.120:0/3510936462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8d4590 0x55f65acc1830 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.324+0000 7f7f55455740 1 --2- 172.21.15.120:0/3510936462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8f5270 0x55f65acc1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.324+0000 7f7f55455740 1 --2- 172.21.15.120:0/3510936462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8cc3b0 0x55f65ad53ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.324+0000 7f7f55455740 1 -- 172.21.15.120:0/3510936462 >> 172.21.15.120:0/3510936462 conn(0x55f65a8e93c0 msgr2=0x55f65acdfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:30.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.324+0000 7f7f55455740 1 -- 172.21.15.120:0/3510936462 shutdown_connections 2024-07-27T03:11:30.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.324+0000 7f7f55455740 1 -- 172.21.15.120:0/3510936462 wait complete. 2024-07-27T03:11:30.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.325+0000 7f7f55455740 1 -- start start 2024-07-27T03:11:30.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.325+0000 7f7f55455740 1 Processor -- start 2024-07-27T03:11:30.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f55455740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8cc3b0 0x55f65aceee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f55455740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8d4590 0x55f65acb4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f55455740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8f5270 0x55f65ac957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f55455740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f65acb34b0 con 0x55f65a8f5270 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f55455740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f65acdc3b0 con 0x55f65a8d4590 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f55455740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55f65acde400 con 0x55f65a8cc3b0 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f55455740 10 client.0 _ll_register_callbacks cb 0x7f7f3c001a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f4cad5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8f5270 0x55f65ac957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f4cad5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8f5270 0x55f65ac957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51234/0 (socket says 172.21.15.120:51234) 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f4cad5640 1 -- 172.21.15.120:0/2762872540 learned_addr learned my addr 172.21.15.120:0/2762872540 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f477fe640 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8d4590 0x55f65acb4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f47fff640 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8cc3b0 0x55f65aceee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f4cad5640 1 -- 172.21.15.120:0/2762872540 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8cc3b0 msgr2=0x55f65aceee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8cc3b0 0x55f65aceee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f4cad5640 1 -- 172.21.15.120:0/2762872540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8d4590 msgr2=0x55f65acb4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8d4590 0x55f65acb4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f4cad5640 1 -- 172.21.15.120:0/2762872540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f65ad60e60 con 0x55f65a8f5270 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f47fff640 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8cc3b0 0x55f65aceee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f4cad5640 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8f5270 0x55f65ac957f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7f4009c040 tx=0x7f7f400b8290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f9f7a66bfe331d server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f26ffd640 1 -- 172.21.15.120:0/2762872540 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400b6070 con 0x55f65a8f5270 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f26ffd640 1 -- 172.21.15.120:0/2762872540 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f7f400a4220 con 0x55f65a8f5270 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.327+0000 7f7f55455740 1 -- 172.21.15.120:0/2762872540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f3c01a070 con 0x55f65a8f5270 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f26ffd640 1 -- 172.21.15.120:0/2762872540 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7f400317b0 con 0x55f65a8f5270 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f55455740 10 client.5895 fetch_fsmap learned FSMap version 50 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f55455740 1 -- 172.21.15.120:0/2762872540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55f65acef3f0 con 0x55f65a8f5270 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f26ffd640 1 -- 172.21.15.120:0/2762872540 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f3c01a070 con 0x55f65a8f5270 2024-07-27T03:11:30.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f26ffd640 1 -- 172.21.15.120:0/2762872540 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 50) ==== 3502+0+0 (secure 0 0 0) 0x7f7f4004b030 con 0x55f65a8f5270 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f55455740 10 client.5895 fetch_fsmap finished waiting for FSMap version 50 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f55455740 10 client.5895 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f55455740 20 client.5895 populate_metadata read hostname 'smithi120' 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f55455740 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55f65ad5dc80 0x55f65ad5e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f55455740 4 client.5895 mds_command: new command op to 5733 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f55455740 1 -- 172.21.15.120:0/2762872540 --> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] -- command(tid 0: {"prefix": "status"}) -- 0x55f65ac0ad50 con 0x55f65ad5dc80 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f47fff640 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55f65ad5dc80 0x55f65ad5e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f26ffd640 10 client.5895 ms_handle_connect on v2:172.21.15.120:6833/3550669358 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.328+0000 7f7f47fff640 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55f65ad5dc80 0x55f65ad5e090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a799c38ca1862538 server_cookie=edd28fa67e637fb6 in_seq=0 out_seq=0 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f26ffd640 1 -- 172.21.15.120:0/2762872540 <== mds.0 v2:172.21.15.120:6833/3550669358 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55f65ac0ad50 con 0x55f65ad5dc80 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f26ffd640 10 client.5895 handle_command_reply: tid=0 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 1 client.5895 shutdown 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 1 -- 172.21.15.120:0/2762872540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8f5270 msgr2=0x55f65ac957f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8f5270 0x55f65ac957f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7f4009c040 tx=0x7f7f400b8290 comp rx=0 tx=0).stop 2024-07-27T03:11:30.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 1 -- 172.21.15.120:0/2762872540 shutdown_connections 2024-07-27T03:11:30.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55f65ad5dc80 0x55f65ad5e090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f65a8f5270 0x55f65ac957f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f26ffd640 0 client.5895 ms_handle_reset on v2:172.21.15.120:6833/3550669358 2024-07-27T03:11:30.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f65a8d4590 0x55f65acb4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 1 --2- 172.21.15.120:0/2762872540 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f65a8cc3b0 0x55f65aceee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 1 -- 172.21.15.120:0/2762872540 >> 172.21.15.120:0/2762872540 conn(0x55f65a8e93c0 msgr2=0x55f65ac9b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:30.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 1 -- 172.21.15.120:0/2762872540 shutdown_connections 2024-07-27T03:11:30.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 1 -- 172.21.15.120:0/2762872540 wait complete. 2024-07-27T03:11:30.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f55455740 20 client.5895 trim_cache size 0 max 16384 2024-07-27T03:11:30.344 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5733, 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 10.24727086, 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 50, 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 57, 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 57, 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 14.924183776 2024-07-27T03:11:30.345 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:11:30.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f4e538640 1 -- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f34077030 msgr2=0x7f7f34079540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f4e538640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f34077030 0x7f7f34079540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7f38005fd0 tx=0x7f7f3800f360 comp rx=0 tx=0).stop 2024-07-27T03:11:30.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f4e538640 1 -- 172.21.15.120:0/1336240310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f48144cd0 msgr2=0x7f7f481450e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.329+0000 7f7f4e538640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f48144cd0 0x7f7f481450e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7f40006010 tx=0x7f7f40003970 comp rx=0 tx=0).stop 2024-07-27T03:11:30.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.330+0000 7f7f4e538640 1 -- 172.21.15.120:0/1336240310 shutdown_connections 2024-07-27T03:11:30.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.330+0000 7f7f4e538640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7f34077030 0x7f7f34079540 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.330+0000 7f7f4e538640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f48144cd0 0x7f7f481450e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.330+0000 7f7f4e538640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f480b71d0 0x7f7f4815d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.330+0000 7f7f4e538640 1 --2- 172.21.15.120:0/1336240310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f480b1130 0x7f7f4815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.330+0000 7f7f4e538640 1 -- 172.21.15.120:0/1336240310 >> 172.21.15.120:0/1336240310 conn(0x7f7f4809aa30 msgr2=0x7f7f48158300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:30.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.330+0000 7f7f4e538640 1 -- 172.21.15.120:0/1336240310 shutdown_connections 2024-07-27T03:11:30.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.330+0000 7f7f4e538640 1 -- 172.21.15.120:0/1336240310 wait complete. 2024-07-27T03:11:30.348 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-27T03:11:30.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.458+0000 7f16a03d9640 1 -- 172.21.15.120:0/689544376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16980b63e0 msgr2=0x7f1698152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.458+0000 7f16a03d9640 1 --2- 172.21.15.120:0/689544376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16980b63e0 0x7f1698152160 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1698155c70 tx=0x7f168c02a560 comp rx=0 tx=0).stop 2024-07-27T03:11:30.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.458+0000 7f16a03d9640 1 -- 172.21.15.120:0/689544376 shutdown_connections 2024-07-27T03:11:30.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.458+0000 7f16a03d9640 1 --2- 172.21.15.120:0/689544376 >> v2:172.21.15.121:3300/0 conn(0x7f169815ec20 0x7f169815f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.458+0000 7f16a03d9640 1 --2- 172.21.15.120:0/689544376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16980b63e0 0x7f1698152160 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.458+0000 7f16a03d9640 1 -- 172.21.15.120:0/689544376 >> 172.21.15.120:0/689544376 conn(0x7f169806cba0 msgr2=0x7f169806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:30.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.458+0000 7f16a03d9640 1 -- 172.21.15.120:0/689544376 shutdown_connections 2024-07-27T03:11:30.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.458+0000 7f16a03d9640 1 -- 172.21.15.120:0/689544376 wait complete. 2024-07-27T03:11:30.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.460+0000 7f16a03d9640 1 Processor -- start 2024-07-27T03:11:30.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.460+0000 7f16a03d9640 1 -- start start 2024-07-27T03:11:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.461+0000 7f16a03d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169815c220 0x7f1698146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.461+0000 7f16a03d9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f169815ec20 0x7f1698154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.461+0000 7f16a03d9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1698146c30 0x7f1698154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.461+0000 7f16a03d9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f16980cdb10 con 0x7f169815c220 2024-07-27T03:11:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.461+0000 7f16a03d9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f16980cd990 con 0x7f1698146c30 2024-07-27T03:11:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.461+0000 7f16a03d9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f16980cdc90 con 0x7f169815ec20 2024-07-27T03:11:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.461+0000 7f169e175640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169815c220 0x7f1698146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.461+0000 7f169e175640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169815c220 0x7f1698146330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51252/0 (socket says 172.21.15.120:51252) 2024-07-27T03:11:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.461+0000 7f169e175640 1 -- 172.21.15.120:0/1875081140 learned_addr learned my addr 172.21.15.120:0/1875081140 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f169e976640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1698146c30 0x7f1698154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f169e175640 1 -- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f169815ec20 msgr2=0x7f1698154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f169e175640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f169815ec20 0x7f1698154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f169e175640 1 -- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1698146c30 msgr2=0x7f1698154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f169e175640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1698146c30 0x7f1698154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f169e175640 1 -- 172.21.15.120:0/1875081140 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169814ae30 con 0x7f169815c220 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f169e175640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169815c220 0x7f1698146330 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f168800c740 tx=0x7f168800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f1696ffd640 1 -- 172.21.15.120:0/1875081140 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688017070 con 0x7f169815c220 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f1696ffd640 1 -- 172.21.15.120:0/1875081140 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f168800ce50 con 0x7f169815c220 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f1696ffd640 1 -- 172.21.15.120:0/1875081140 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16880052d0 con 0x7f169815c220 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f16a03d9640 1 -- 172.21.15.120:0/1875081140 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169814b0d0 con 0x7f169815c220 2024-07-27T03:11:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.462+0000 7f16a03d9640 1 -- 172.21.15.120:0/1875081140 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16980b55b0 con 0x7f169815c220 2024-07-27T03:11:30.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.463+0000 7f16a03d9640 1 -- 172.21.15.120:0/1875081140 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16980ce1b0 con 0x7f169815c220 2024-07-27T03:11:30.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.464+0000 7f1696ffd640 1 -- 172.21.15.120:0/1875081140 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f168801a070 con 0x7f169815c220 2024-07-27T03:11:30.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.464+0000 7f1696ffd640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1684077010 0x7f1684079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:30.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.464+0000 7f1696ffd640 1 -- 172.21.15.120:0/1875081140 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f1688097fa0 con 0x7f169815c220 2024-07-27T03:11:30.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.464+0000 7f169d974640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1684077010 0x7f1684079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:30.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.465+0000 7f169d974640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1684077010 0x7f1684079520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f168c033000 tx=0x7f168c0046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.469+0000 7f1696ffd640 1 -- 172.21.15.120:0/1875081140 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f1688061230 con 0x7f169815c220 2024-07-27T03:11:30.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.688+0000 7f16a03d9640 1 -- 172.21.15.120:0/1875081140 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f169815e340 con 0x7f169815c220 2024-07-27T03:11:30.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.688+0000 7f1696ffd640 1 -- 172.21.15.120:0/1875081140 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) ==== 53+0+73 (secure 0 0 0) 0x7f1688060b30 con 0x7f169815c220 2024-07-27T03:11:30.692 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-27T03:11:30.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 -- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1684077010 msgr2=0x7f1684079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1684077010 0x7f1684079520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f168c033000 tx=0x7f168c0046c0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 -- 172.21.15.120:0/1875081140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169815c220 msgr2=0x7f1698146330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169815c220 0x7f1698146330 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f168800c740 tx=0x7f168800cc00 comp rx=0 tx=0).stop 2024-07-27T03:11:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 -- 172.21.15.120:0/1875081140 shutdown_connections 2024-07-27T03:11:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1684077010 0x7f1684079520 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1698146c30 0x7f1698154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f169815ec20 0x7f1698154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 --2- 172.21.15.120:0/1875081140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f169815c220 0x7f1698146330 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 -- 172.21.15.120:0/1875081140 >> 172.21.15.120:0/1875081140 conn(0x7f169806cba0 msgr2=0x7f16980cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 -- 172.21.15.120:0/1875081140 shutdown_connections 2024-07-27T03:11:30.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30.691+0000 7f16a03d9640 1 -- 172.21.15.120:0/1875081140 wait complete. 2024-07-27T03:11:30.705 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-07-27T03:11:30.705 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-27T03:11:30.706 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-07-27T03:11:30.706 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-07-27T03:11:30.706 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-27T03:11:30.706 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-07-27T03:11:30.706 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-07-27T03:11:30.706 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-27T03:11:30.706 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:11:30.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:11:30.706 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-07-27T03:11:30.722 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:11:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:11:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-27T03:11:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42586sec preferred_lft 42586sec 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 1a:04:15:6c:cf:e1 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::d44a:78ff:feef:fe4e/64 scope link 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether d2:ac:2a:c4:e4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-27T03:11:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::d0ac:2aff:fec4:e45e/64 scope link 2024-07-27T03:11:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:11:30.725 INFO:teuthology.orchestra.run.smithi120.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-27T03:11:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 1a:04:15:6c:cf:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-07-27T03:11:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::1804:15ff:fe6c:cfe1/64 scope link 2024-07-27T03:11:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:11:30.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:11:30.725 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-27T03:11:30.786 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-07-27T03:11:30.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:11:30.788 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-07-27T03:11:30.844 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-07-27T03:11:30.845 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-27T03:11:30.845 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-27T03:11:30.845 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-27T03:11:30.845 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-27T03:11:30.845 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:11:30.845 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:11:30.845 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-27T03:11:30.845 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-27T03:11:30.845 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-27T03:11:30.845 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:11:30.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:11:30.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:30.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:11:30.971 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-07-27T03:11:30.987 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-07-27T03:11:30.987 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-27T03:11:30.987 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:11:30.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:11:30.987 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-07-27T03:11:31.053 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:11:31.053 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-07-27T03:11:31.109 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:11:31.109 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:11:31.109 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-07-27T03:11:31.165 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-07-27T03:11:31.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:11:31.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:11:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:11:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:11:31.267 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:11:31.267 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:11:31.267 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-07-27T03:11:31.267 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: trying mount with new device syntax: 0@81c6fc84-d59a-4d77-bf87-f698cf0d6963.cephfs=/ 2024-07-27T03:11:31.267 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.120:3300/172.21.15.121:3300/172.21.15.121:3301" will pass to kernel 2024-07-27T03:11:31.268 INFO:teuthology.orchestra.run.smithi120.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-07-27T03:11:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: You just mounted a file system that supports labels which does not 2024-07-27T03:11:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-27T03:11:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: applications will generate AVC messages and not be allowed access to 2024-07-27T03:11:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-27T03:11:31.269 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-27T03:11:31.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:11:31.270 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-07-27T03:11:31.294 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:11:31.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:11:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:31.397 INFO:teuthology.orchestra.run.smithi120.stdout:client5907 2024-07-27T03:11:31.398 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:31.398 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:31.414 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-07-27T03:11:31.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.568+0000 7f5c26e43640 1 -- 172.21.15.120:0/2213888597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c2015c220 msgr2=0x7f5c20152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:31.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.568+0000 7f5c26e43640 1 --2- 172.21.15.120:0/2213888597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c2015c220 0x7f5c20152160 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5c2015b630 tx=0x7f5c1c02a560 comp rx=0 tx=0).stop 2024-07-27T03:11:31.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.568+0000 7f5c26e43640 1 -- 172.21.15.120:0/2213888597 shutdown_connections 2024-07-27T03:11:31.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.568+0000 7f5c26e43640 1 --2- 172.21.15.120:0/2213888597 >> v2:172.21.15.121:3300/0 conn(0x7f5c2015ec20 0x7f5c2015f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:31.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.568+0000 7f5c26e43640 1 --2- 172.21.15.120:0/2213888597 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c200b5cd0 0x7f5c200b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:31.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.568+0000 7f5c26e43640 1 --2- 172.21.15.120:0/2213888597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c2015c220 0x7f5c20152160 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:31.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.569+0000 7f5c26e43640 1 -- 172.21.15.120:0/2213888597 >> 172.21.15.120:0/2213888597 conn(0x7f5c2006cba0 msgr2=0x7f5c2006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:31.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.569+0000 7f5c26e43640 1 -- 172.21.15.120:0/2213888597 shutdown_connections 2024-07-27T03:11:31.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.569+0000 7f5c26e43640 1 -- 172.21.15.120:0/2213888597 wait complete. 2024-07-27T03:11:31.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.570+0000 7f5c26e43640 1 Processor -- start 2024-07-27T03:11:31.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.570+0000 7f5c26e43640 1 -- start start 2024-07-27T03:11:31.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c26e43640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c200b5cd0 0x7f5c200cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:31.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c26e43640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c2015c220 0x7f5c2015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:31.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c26e43640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c2015ec20 0x7f5c201f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:31.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c26e43640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5c200cd920 con 0x7f5c200b5cd0 2024-07-27T03:11:31.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c26e43640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5c200cd7a0 con 0x7f5c2015ec20 2024-07-27T03:11:31.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c26e43640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5c200cdaa0 con 0x7f5c2015c220 2024-07-27T03:11:31.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c24bdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c200b5cd0 0x7f5c200cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:31.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c24bdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c200b5cd0 0x7f5c200cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51268/0 (socket says 172.21.15.120:51268) 2024-07-27T03:11:31.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c24bdf640 1 -- 172.21.15.120:0/2804646375 learned_addr learned my addr 172.21.15.120:0/2804646375 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:31.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c253e0640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c2015ec20 0x7f5c201f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:31.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c24bdf640 1 -- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c2015c220 msgr2=0x7f5c2015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:31.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c17fff640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c2015c220 0x7f5c2015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:31.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c24bdf640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c2015c220 0x7f5c2015a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:31.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c24bdf640 1 -- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c2015ec20 msgr2=0x7f5c201f6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:31.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c24bdf640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c2015ec20 0x7f5c201f6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:31.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c24bdf640 1 -- 172.21.15.120:0/2804646375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c200cc140 con 0x7f5c200b5cd0 2024-07-27T03:11:31.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c253e0640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c2015ec20 0x7f5c201f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:31.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c24bdf640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c200b5cd0 0x7f5c200cbc00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c034040 tx=0x7f5c1c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:31.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.572+0000 7f5c157fa640 1 -- 172.21.15.120:0/2804646375 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c03e030 con 0x7f5c200b5cd0 2024-07-27T03:11:31.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.573+0000 7f5c157fa640 1 -- 172.21.15.120:0/2804646375 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c1c0047a0 con 0x7f5c200b5cd0 2024-07-27T03:11:31.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.573+0000 7f5c26e43640 1 -- 172.21.15.120:0/2804646375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2015b100 con 0x7f5c200b5cd0 2024-07-27T03:11:31.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.573+0000 7f5c157fa640 1 -- 172.21.15.120:0/2804646375 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c035040 con 0x7f5c200b5cd0 2024-07-27T03:11:31.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.573+0000 7f5c26e43640 1 -- 172.21.15.120:0/2804646375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c200c68f0 con 0x7f5c200b5cd0 2024-07-27T03:11:31.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.573+0000 7f5c26e43640 1 -- 172.21.15.120:0/2804646375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c200cdfe0 con 0x7f5c200b5cd0 2024-07-27T03:11:31.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.574+0000 7f5c157fa640 1 -- 172.21.15.120:0/2804646375 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5c1c041030 con 0x7f5c200b5cd0 2024-07-27T03:11:31.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.575+0000 7f5c157fa640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c0c077010 0x7f5c0c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:31.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.575+0000 7f5c157fa640 1 -- 172.21.15.120:0/2804646375 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f5c1c0b90d0 con 0x7f5c200b5cd0 2024-07-27T03:11:31.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.575+0000 7f5c17fff640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c0c077010 0x7f5c0c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:31.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.576+0000 7f5c17fff640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c0c077010 0x7f5c0c079520 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5c200cc550 tx=0x7f5c10005c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:31.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.580+0000 7f5c157fa640 1 -- 172.21.15.120:0/2804646375 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5c200b6620 con 0x7f5c200b5cd0 2024-07-27T03:11:31.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:31.802+0000 7f5c26e43640 1 -- 172.21.15.120:0/2804646375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f5c200b60e0 con 0x7f5c200b5cd0 2024-07-27T03:11:32.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.137+0000 7f5c157fa640 1 -- 172.21.15.120:0/2804646375 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v51) ==== 105+0+0 (secure 0 0 0) 0x7f5c1c0822e0 con 0x7f5c200b5cd0 2024-07-27T03:11:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 -- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c0c077010 msgr2=0x7f5c0c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c0c077010 0x7f5c0c079520 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5c200cc550 tx=0x7f5c10005c90 comp rx=0 tx=0).stop 2024-07-27T03:11:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 -- 172.21.15.120:0/2804646375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c200b5cd0 msgr2=0x7f5c200cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c200b5cd0 0x7f5c200cbc00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c034040 tx=0x7f5c1c0039e0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 -- 172.21.15.120:0/2804646375 shutdown_connections 2024-07-27T03:11:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c0c077010 0x7f5c0c079520 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c2015ec20 0x7f5c201f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c2015c220 0x7f5c2015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 --2- 172.21.15.120:0/2804646375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c200b5cd0 0x7f5c200cbc00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 -- 172.21.15.120:0/2804646375 >> 172.21.15.120:0/2804646375 conn(0x7f5c2006cba0 msgr2=0x7f5c201510f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 -- 172.21.15.120:0/2804646375 shutdown_connections 2024-07-27T03:11:32.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.140+0000 7f5c26e43640 1 -- 172.21.15.120:0/2804646375 wait complete. 2024-07-27T03:11:32.157 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:11:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.269+0000 7f8a0580c640 1 -- 172.21.15.120:0/381091803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89e8003a50 msgr2=0x7f89e8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:32.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.269+0000 7f8a0580c640 1 --2- 172.21.15.120:0/381091803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89e8003a50 0x7f89e8003ec0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009ed0 tx=0x7f89e8005830 comp rx=0 tx=0).stop 2024-07-27T03:11:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.269+0000 7f8a0580c640 1 -- 172.21.15.120:0/381091803 shutdown_connections 2024-07-27T03:11:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.269+0000 7f8a0580c640 1 --2- 172.21.15.120:0/381091803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f89e8003a50 0x7f89e8003ec0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.269+0000 7f8a0580c640 1 -- 172.21.15.120:0/381091803 >> 172.21.15.120:0/381091803 conn(0x7f8a000d1dd0 msgr2=0x7f8a000d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.269+0000 7f8a0580c640 1 -- 172.21.15.120:0/381091803 shutdown_connections 2024-07-27T03:11:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.269+0000 7f8a0580c640 1 -- 172.21.15.120:0/381091803 wait complete. 2024-07-27T03:11:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.271+0000 7f8a0580c640 1 Processor -- start 2024-07-27T03:11:32.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.271+0000 7f8a0580c640 1 -- start start 2024-07-27T03:11:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f8a0580c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89e8003a50 0x7f8a001f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f8a0580c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a001f2aa0 0x7f8a001f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:32.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f8a0580c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a000c9a00 0x7f8a000c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f8a0580c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8a000d0910 con 0x7f8a001f2aa0 2024-07-27T03:11:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f8a0580c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8a000d0790 con 0x7f8a000c9a00 2024-07-27T03:11:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f8a0580c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8a000d0a90 con 0x7f89e8003a50 2024-07-27T03:11:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f89fe7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a001f2aa0 0x7f8a001f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f89fe7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a001f2aa0 0x7f8a001f2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41832/0 (socket says 172.21.15.120:41832) 2024-07-27T03:11:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f89fe7fc640 1 -- 172.21.15.120:0/2320335655 learned_addr learned my addr 172.21.15.120:0/2320335655 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f89ff7fe640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a000c9a00 0x7f8a000c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f89feffd640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89e8003a50 0x7f8a001f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f89fe7fc640 1 -- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89e8003a50 msgr2=0x7f8a001f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f89fe7fc640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89e8003a50 0x7f8a001f2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f89fe7fc640 1 -- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a000c9a00 msgr2=0x7f8a000c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f89fe7fc640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a000c9a00 0x7f8a000c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.272+0000 7f89fe7fc640 1 -- 172.21.15.120:0/2320335655 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a000cbb40 con 0x7f8a001f2aa0 2024-07-27T03:11:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.273+0000 7f89fe7fc640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a001f2aa0 0x7f8a001f2eb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f89f4001e90 tx=0x7f89f4001860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.273+0000 7f89e7fff640 1 -- 172.21.15.120:0/2320335655 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4015070 con 0x7f8a001f2aa0 2024-07-27T03:11:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.273+0000 7f89e7fff640 1 -- 172.21.15.120:0/2320335655 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89f4011900 con 0x7f8a001f2aa0 2024-07-27T03:11:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.273+0000 7f8a0580c640 1 -- 172.21.15.120:0/2320335655 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a000cbe20 con 0x7f8a001f2aa0 2024-07-27T03:11:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.273+0000 7f89e7fff640 1 -- 172.21.15.120:0/2320335655 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4011d50 con 0x7f8a001f2aa0 2024-07-27T03:11:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.273+0000 7f8a0580c640 1 -- 172.21.15.120:0/2320335655 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a000c9200 con 0x7f8a001f2aa0 2024-07-27T03:11:32.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.274+0000 7f8a0580c640 1 -- 172.21.15.120:0/2320335655 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a000cb8b0 con 0x7f8a001f2aa0 2024-07-27T03:11:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.275+0000 7f89e7fff640 1 -- 172.21.15.120:0/2320335655 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f89f4018070 con 0x7f8a001f2aa0 2024-07-27T03:11:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.275+0000 7f89e7fff640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f89ec077010 0x7f89ec079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.275+0000 7f89e7fff640 1 -- 172.21.15.120:0/2320335655 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f89f4099830 con 0x7f8a001f2aa0 2024-07-27T03:11:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.275+0000 7f89feffd640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f89ec077010 0x7f89ec079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:32.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.276+0000 7f89feffd640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f89ec077010 0x7f89ec079520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f89f0035000 tx=0x7f89f0004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:32.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.279+0000 7f89e7fff640 1 -- 172.21.15.120:0/2320335655 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f89f4062450 con 0x7f8a001f2aa0 2024-07-27T03:11:32.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.495+0000 7f8a0580c640 1 -- 172.21.15.120:0/2320335655 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a000b1ca0 con 0x7f8a001f2aa0 2024-07-27T03:11:32.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.496+0000 7f89e7fff640 1 -- 172.21.15.120:0/2320335655 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5251 (secure 0 0 0) 0x7f89f40669a0 con 0x7f8a001f2aa0 2024-07-27T03:11:32.500 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:32.500 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":52,"btime":"2024-07-27T03:11:32:142329+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/3598257167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3598257167},{"type":"v1","addr":"172.21.15.121:6836","nonce":3598257167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5458,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6834/2987877930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2987877930},{"type":"v1","addr":"172.21.15.120:6834","nonce":2987877930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:11:19.459319+0000","modified":"2024-07-27T03:11:32.142309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":5733,"mds_1":5473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5473":{"gid":5473,"name":"b","rank":1,"incarnation":52,"state":"up:creating","state_seq":1,"addr":"172.21.15.121:6837/1057652547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1057652547},{"type":"v1","addr":"172.21.15.121:6837","nonce":1057652547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/3550669358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":3550669358},{"type":"v1","addr":"172.21.15.120:6835","nonce":3550669358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5733,"qdb_cluster":[5733]},"id":4}]} 2024-07-27T03:11:32.500 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 52 2024-07-27T03:11:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 -- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f89ec077010 msgr2=0x7f89ec079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f89ec077010 0x7f89ec079520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f89f0035000 tx=0x7f89f0004a40 comp rx=0 tx=0).stop 2024-07-27T03:11:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 -- 172.21.15.120:0/2320335655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a001f2aa0 msgr2=0x7f8a001f2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a001f2aa0 0x7f8a001f2eb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f89f4001e90 tx=0x7f89f4001860 comp rx=0 tx=0).stop 2024-07-27T03:11:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 -- 172.21.15.120:0/2320335655 shutdown_connections 2024-07-27T03:11:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f89ec077010 0x7f89ec079520 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a001f2aa0 0x7f8a001f2eb0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a000c9a00 0x7f8a000c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 --2- 172.21.15.120:0/2320335655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f89e8003a50 0x7f8a001f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:32.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 -- 172.21.15.120:0/2320335655 >> 172.21.15.120:0/2320335655 conn(0x7f8a000d1dd0 msgr2=0x7f8a000b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:32.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 -- 172.21.15.120:0/2320335655 shutdown_connections 2024-07-27T03:11:32.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:32.498+0000 7f8a0580c640 1 -- 172.21.15.120:0/2320335655 wait complete. 2024-07-27T03:11:32.916 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:11:19.459319+0000', 'modified': '2024-07-27T03:11:32.142309+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 5733, 'mds_1': 5473}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5473': {'gid': 5473, 'name': 'b', 'rank': 1, 'incarnation': 52, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.121:6837/1057652547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 1057652547}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 1057652547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5733': {'gid': 5733, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6835/3550669358', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6833', 'nonce': 3550669358}, {'type': 'v1', 'addr': '172.21.15.120:6835', 'nonce': 3550669358}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5733, 'qdb_cluster': [5733]} 2024-07-27T03:11:32.917 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5473:up:creating 2024-07-27T03:11:33.918 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:11:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.043+0000 7f2f76b88640 1 -- 172.21.15.120:0/3635910596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f58003a50 msgr2=0x7f2f58003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.043+0000 7f2f76b88640 1 --2- 172.21.15.120:0/3635910596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f58003a50 0x7f2f58003ec0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c006fa0 tx=0x7f2f58005830 comp rx=0 tx=0).stop 2024-07-27T03:11:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.043+0000 7f2f76b88640 1 -- 172.21.15.120:0/3635910596 shutdown_connections 2024-07-27T03:11:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.043+0000 7f2f76b88640 1 --2- 172.21.15.120:0/3635910596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f58003a50 0x7f2f58003ec0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.043+0000 7f2f76b88640 1 -- 172.21.15.120:0/3635910596 >> 172.21.15.120:0/3635910596 conn(0x7f2f700b1a10 msgr2=0x7f2f700b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.043+0000 7f2f76b88640 1 -- 172.21.15.120:0/3635910596 shutdown_connections 2024-07-27T03:11:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.043+0000 7f2f76b88640 1 -- 172.21.15.120:0/3635910596 wait complete. 2024-07-27T03:11:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.045+0000 7f2f76b88640 1 Processor -- start 2024-07-27T03:11:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.045+0000 7f2f76b88640 1 -- start start 2024-07-27T03:11:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f76b88640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f58003a50 0x7f2f70148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f76b88640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7009d2a0 0x7f2f7009d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f76b88640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f701e7290 0x7f2f701e76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f76b88640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7006eb00 con 0x7f2f701e7290 2024-07-27T03:11:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f76b88640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7015e990 con 0x7f2f7009d2a0 2024-07-27T03:11:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f76b88640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7006ec80 con 0x7f2f58003a50 2024-07-27T03:11:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f75125640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f701e7290 0x7f2f701e76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f75125640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f701e7290 0x7f2f701e76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41854/0 (socket says 172.21.15.120:41854) 2024-07-27T03:11:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f75125640 1 -- 172.21.15.120:0/2353855386 learned_addr learned my addr 172.21.15.120:0/2353855386 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f74924640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f58003a50 0x7f2f70148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f67fff640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7009d2a0 0x7f2f7009d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f75125640 1 -- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f58003a50 msgr2=0x7f2f70148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f75125640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f58003a50 0x7f2f70148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f75125640 1 -- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7009d2a0 msgr2=0x7f2f7009d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f75125640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7009d2a0 0x7f2f7009d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f75125640 1 -- 172.21.15.120:0/2353855386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f701e7be0 con 0x7f2f701e7290 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f75125640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f701e7290 0x7f2f701e76a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2f700af7d0 tx=0x7f2f6800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f657fa640 1 -- 172.21.15.120:0/2353855386 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68003d80 con 0x7f2f701e7290 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f657fa640 1 -- 172.21.15.120:0/2353855386 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f68015070 con 0x7f2f701e7290 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f657fa640 1 -- 172.21.15.120:0/2353855386 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f680062d0 con 0x7f2f701e7290 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.047+0000 7f2f76b88640 1 -- 172.21.15.120:0/2353855386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7009dfd0 con 0x7f2f701e7290 2024-07-27T03:11:34.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.048+0000 7f2f76b88640 1 -- 172.21.15.120:0/2353855386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f701f6460 con 0x7f2f701e7290 2024-07-27T03:11:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.049+0000 7f2f76b88640 1 -- 172.21.15.120:0/2353855386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f7009dd40 con 0x7f2f701e7290 2024-07-27T03:11:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.049+0000 7f2f657fa640 1 -- 172.21.15.120:0/2353855386 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2f68006470 con 0x7f2f701e7290 2024-07-27T03:11:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.050+0000 7f2f657fa640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f5c077010 0x7f2f5c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.050+0000 7f2f657fa640 1 -- 172.21.15.120:0/2353855386 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2f680988c0 con 0x7f2f701e7290 2024-07-27T03:11:34.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.050+0000 7f2f74924640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f5c077010 0x7f2f5c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.051+0000 7f2f74924640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f5c077010 0x7f2f5c079520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c033000 tx=0x7f2f7015b7f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:34.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.054+0000 7f2f657fa640 1 -- 172.21.15.120:0/2353855386 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f2f701e7be0 con 0x7f2f701e7290 2024-07-27T03:11:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.277+0000 7f2f76b88640 1 -- 172.21.15.120:0/2353855386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f7006f1e0 con 0x7f2f701e7290 2024-07-27T03:11:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.277+0000 7f2f657fa640 1 -- 172.21.15.120:0/2353855386 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5273 (secure 0 0 0) 0x7f2f68061ac0 con 0x7f2f701e7290 2024-07-27T03:11:34.280 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:34.280 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":55,"btime":"2024-07-27T03:11:34:157246+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/3598257167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3598257167},{"type":"v1","addr":"172.21.15.121:6836","nonce":3598257167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:11:19.459319+0000","modified":"2024-07-27T03:11:34.157239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5733,"mds_1":5473,"mds_2":5458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5458":{"gid":5458,"name":"a","rank":2,"incarnation":54,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/2987877930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2987877930},{"type":"v1","addr":"172.21.15.120:6834","nonce":2987877930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5473":{"gid":5473,"name":"b","rank":1,"incarnation":52,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6837/1057652547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1057652547},{"type":"v1","addr":"172.21.15.121:6837","nonce":1057652547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/3550669358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":3550669358},{"type":"v1","addr":"172.21.15.120:6835","nonce":3550669358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5733,"qdb_cluster":[5458,5473,5733]},"id":4}]} 2024-07-27T03:11:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 55 2024-07-27T03:11:34.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 -- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f5c077010 msgr2=0x7f2f5c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f5c077010 0x7f2f5c079520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c033000 tx=0x7f2f7015b7f0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 -- 172.21.15.120:0/2353855386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f701e7290 msgr2=0x7f2f701e76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f701e7290 0x7f2f701e76a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2f700af7d0 tx=0x7f2f6800da90 comp rx=0 tx=0).stop 2024-07-27T03:11:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 -- 172.21.15.120:0/2353855386 shutdown_connections 2024-07-27T03:11:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f5c077010 0x7f2f5c079520 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f701e7290 0x7f2f701e76a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f7009d2a0 0x7f2f7009d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 --2- 172.21.15.120:0/2353855386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f58003a50 0x7f2f70148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 -- 172.21.15.120:0/2353855386 >> 172.21.15.120:0/2353855386 conn(0x7f2f700b1a10 msgr2=0x7f2f700b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 -- 172.21.15.120:0/2353855386 shutdown_connections 2024-07-27T03:11:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.280+0000 7f2f76b88640 1 -- 172.21.15.120:0/2353855386 wait complete. 2024-07-27T03:11:34.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:11:19.459319+0000', 'modified': '2024-07-27T03:11:34.157239+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 5733, 'mds_1': 5473, 'mds_2': 5458}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5458': {'gid': 5458, 'name': 'a', 'rank': 2, 'incarnation': 54, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.120:6834/2987877930', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6832', 'nonce': 2987877930}, {'type': 'v1', 'addr': '172.21.15.120:6834', 'nonce': 2987877930}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5473': {'gid': 5473, 'name': 'b', 'rank': 1, 'incarnation': 52, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.121:6837/1057652547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 1057652547}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 1057652547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5733': {'gid': 5733, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6835/3550669358', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6833', 'nonce': 3550669358}, {'type': 'v1', 'addr': '172.21.15.120:6835', 'nonce': 3550669358}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5733, 'qdb_cluster': [5458, 5473, 5733]} 2024-07-27T03:11:34.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-07-27T03:11:34.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-07-27T03:11:34.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.814+0000 7f4b91ffa640 1 -- 172.21.15.120:0/89530681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b74005250 msgr2=0x7f4b7400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.814+0000 7f4b91ffa640 1 --2- 172.21.15.120:0/89530681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b74005250 0x7f4b7400b9c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4b84005fd0 tx=0x7f4b74005830 comp rx=0 tx=0).stop 2024-07-27T03:11:34.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.814+0000 7f4b91ffa640 1 -- 172.21.15.120:0/89530681 shutdown_connections 2024-07-27T03:11:34.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.814+0000 7f4b91ffa640 1 --2- 172.21.15.120:0/89530681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b74005250 0x7f4b7400b9c0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.814+0000 7f4b91ffa640 1 -- 172.21.15.120:0/89530681 >> 172.21.15.120:0/89530681 conn(0x7f4b8c08d690 msgr2=0x7f4b8c09d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:34.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.814+0000 7f4b91ffa640 1 -- 172.21.15.120:0/89530681 shutdown_connections 2024-07-27T03:11:34.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.814+0000 7f4b91ffa640 1 -- 172.21.15.120:0/89530681 wait complete. 2024-07-27T03:11:34.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.816+0000 7f4b91ffa640 1 Processor -- start 2024-07-27T03:11:34.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.816+0000 7f4b91ffa640 1 -- start start 2024-07-27T03:11:34.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b91ffa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b74005250 0x7f4b8c1f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b91ffa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b8c0ca4b0 0x7f4b8c15c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b91ffa640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b8c1f5c00 0x7f4b8c15f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b91ffa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c0d2b70 con 0x7f4b74005250 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b91ffa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c0d29f0 con 0x7f4b8c0ca4b0 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b91ffa640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4b8c0d2cf0 con 0x7f4b8c1f5c00 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b8b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b74005250 0x7f4b8c1f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b8b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b74005250 0x7f4b8c1f91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41866/0 (socket says 172.21.15.120:41866) 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/1041253049 learned_addr learned my addr 172.21.15.120:0/1041253049 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b8affd640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b8c0ca4b0 0x7f4b8c15c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b8bfff640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b8c1f5c00 0x7f4b8c15f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b8c1f5c00 msgr2=0x7f4b8c15f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b8c1f5c00 0x7f4b8c15f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.817+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b8c0ca4b0 msgr2=0x7f4b8c15c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.818+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b8c0ca4b0 0x7f4b8c15c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.818+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/1041253049 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8c1e8800 con 0x7f4b74005250 2024-07-27T03:11:34.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.818+0000 7f4b8affd640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b8c0ca4b0 0x7f4b8c15c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:34.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.818+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b74005250 0x7f4b8c1f91b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c004ed0 tx=0x7f4b7c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:34.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.818+0000 7f4b73fff640 1 -- 172.21.15.120:0/1041253049 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c015020 con 0x7f4b74005250 2024-07-27T03:11:34.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.818+0000 7f4b73fff640 1 -- 172.21.15.120:0/1041253049 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b7c011960 con 0x7f4b74005250 2024-07-27T03:11:34.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.818+0000 7f4b91ffa640 1 -- 172.21.15.120:0/1041253049 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8c1e8ae0 con 0x7f4b74005250 2024-07-27T03:11:34.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.818+0000 7f4b73fff640 1 -- 172.21.15.120:0/1041253049 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c011d90 con 0x7f4b74005250 2024-07-27T03:11:34.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.818+0000 7f4b91ffa640 1 -- 172.21.15.120:0/1041253049 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8c1f56e0 con 0x7f4b74005250 2024-07-27T03:11:34.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.820+0000 7f4b73fff640 1 -- 172.21.15.120:0/1041253049 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4b7c018020 con 0x7f4b74005250 2024-07-27T03:11:34.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.820+0000 7f4b73fff640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4b78077010 0x7f4b78079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.821+0000 7f4b73fff640 1 -- 172.21.15.120:0/1041253049 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4b7c0992f0 con 0x7f4b74005250 2024-07-27T03:11:34.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.821+0000 7f4b8affd640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4b78077010 0x7f4b78079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.821+0000 7f4b8affd640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4b78077010 0x7f4b78079520 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4b80001860 tx=0x7f4b80001110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:34.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.821+0000 7f4b98feb740 1 Processor -- start 2024-07-27T03:11:34.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.821+0000 7f4b98feb740 1 -- start start 2024-07-27T03:11:34.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f5777f9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5777dbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f5773eb590 0x55f5777dc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b98feb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f577724360 con 0x55f57740c270 2024-07-27T03:11:34.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b98feb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f577713860 con 0x55f5773e33b0 2024-07-27T03:11:34.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b98feb740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55f5777178a0 con 0x55f5773eb590 2024-07-27T03:11:34.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f5777f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f5777f9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41874/0 (socket says 172.21.15.120:41874) 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/3433301291 learned_addr learned my addr 172.21.15.120:0/3433301291 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8bfff640 1 --2- 172.21.15.120:0/3433301291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f5773eb590 0x55f5777dc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8affd640 1 --2- 172.21.15.120:0/3433301291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5777dbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/3433301291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f5773eb590 msgr2=0x55f5777dc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/3433301291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f5773eb590 0x55f5777dc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/3433301291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 msgr2=0x55f5777dbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/3433301291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5777dbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/3433301291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5776a3360 con 0x55f57740c270 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8affd640 1 --2- 172.21.15.120:0/3433301291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5777dbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.823+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/3433301291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f5777f9170 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c05e470 tx=0x7f4b7c05de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208bcdf472ce0936 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.824+0000 7f4b717fa640 1 -- 172.21.15.120:0/3433301291 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c061e80 con 0x55f57740c270 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.824+0000 7f4b717fa640 1 -- 172.21.15.120:0/3433301291 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b7c06aea0 con 0x55f57740c270 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.824+0000 7f4b717fa640 1 -- 172.21.15.120:0/3433301291 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0610e0 con 0x55f57740c270 2024-07-27T03:11:34.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.824+0000 7f4b98feb740 1 -- 172.21.15.120:0/3433301291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 msgr2=0x55f5777f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.824+0000 7f4b98feb740 1 --2- 172.21.15.120:0/3433301291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f5777f9170 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c05e470 tx=0x7f4b7c05de70 comp rx=0 tx=0).stop 2024-07-27T03:11:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.825+0000 7f4b98feb740 1 -- 172.21.15.120:0/3433301291 shutdown_connections 2024-07-27T03:11:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.825+0000 7f4b98feb740 1 --2- 172.21.15.120:0/3433301291 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f5773eb590 0x55f5777dc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.825+0000 7f4b98feb740 1 --2- 172.21.15.120:0/3433301291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5777dbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.825+0000 7f4b98feb740 1 --2- 172.21.15.120:0/3433301291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f5777f9170 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.825+0000 7f4b98feb740 1 -- 172.21.15.120:0/3433301291 >> 172.21.15.120:0/3433301291 conn(0x55f5774003c0 msgr2=0x55f5777b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.825+0000 7f4b98feb740 1 -- 172.21.15.120:0/3433301291 shutdown_connections 2024-07-27T03:11:34.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.825+0000 7f4b98feb740 1 -- 172.21.15.120:0/3433301291 wait complete. 2024-07-27T03:11:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.825+0000 7f4b98feb740 1 -- start start 2024-07-27T03:11:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.826+0000 7f4b98feb740 1 Processor -- start 2024-07-27T03:11:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773e33b0 0x55f5778085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773eb590 0x55f577808b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f57740c270 0x55f5777c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b98feb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f577486620 con 0x55f5773e33b0 2024-07-27T03:11:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b98feb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f5776af140 con 0x55f5773eb590 2024-07-27T03:11:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b98feb740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55f577806da0 con 0x55f57740c270 2024-07-27T03:11:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b98feb740 10 client.0 _ll_register_callbacks cb 0x55f57770cc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:11:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b8b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773e33b0 0x55f5778085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b8b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773e33b0 0x55f5778085d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41878/0 (socket says 172.21.15.120:41878) 2024-07-27T03:11:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/1433376380 learned_addr learned my addr 172.21.15.120:0/1433376380 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:34.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/1433376380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f57740c270 msgr2=0x55f5777c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/1433376380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f57740c270 0x55f5777c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/1433376380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773eb590 msgr2=0x55f577808b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/1433376380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773eb590 0x55f577808b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b8b7fe640 1 -- 172.21.15.120:0/1433376380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f577477850 con 0x55f5773e33b0 2024-07-27T03:11:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/1433376380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773e33b0 0x55f5778085d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c097790 tx=0x7f4b7c099260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2179dca30921d5c1 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:11:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.827+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/1433376380 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c080060 con 0x55f5773e33b0 2024-07-27T03:11:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/1433376380 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4b7c0972d0 con 0x55f5773e33b0 2024-07-27T03:11:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b98feb740 1 -- 172.21.15.120:0/1433376380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b7c06aea0 con 0x55f5773e33b0 2024-07-27T03:11:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/1433376380 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f4b7c061e80 con 0x55f5773e33b0 2024-07-27T03:11:34.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b98feb740 10 client.5937 fetch_fsmap learned FSMap version 55 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b98feb740 1 -- 172.21.15.120:0/1433376380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55f5774ee6b0 con 0x55f5773e33b0 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/1433376380 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b7c06aea0 con 0x55f5773e33b0 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/1433376380 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 55) ==== 3542+0+0 (secure 0 0 0) 0x7f4b7c0610e0 con 0x55f5773e33b0 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b98feb740 10 client.5937 fetch_fsmap finished waiting for FSMap version 55 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b98feb740 10 client.5937 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b98feb740 20 client.5937 populate_metadata read hostname 'smithi120' 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b98feb740 1 --2- 172.21.15.120:0/1433376380 >> [v2:172.21.15.120:6832/2987877930,v1:172.21.15.120:6834/2987877930] conn(0x55f5773cae40 0x55f5778093c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b98feb740 4 client.5937 mds_command: new command op to 5458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b98feb740 1 -- 172.21.15.120:0/1433376380 --> [v2:172.21.15.120:6832/2987877930,v1:172.21.15.120:6834/2987877930] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5777262b0 con 0x55f5773cae40 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b8affd640 1 --2- 172.21.15.120:0/1433376380 >> [v2:172.21.15.120:6832/2987877930,v1:172.21.15.120:6834/2987877930] conn(0x55f5773cae40 0x55f5778093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.828+0000 7f4b6a7fc640 10 client.5937 ms_handle_connect on v2:172.21.15.120:6832/2987877930 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b8affd640 1 --2- 172.21.15.120:0/1433376380 >> [v2:172.21.15.120:6832/2987877930,v1:172.21.15.120:6834/2987877930] conn(0x55f5773cae40 0x55f5778093c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f17863ffe7fcb1d3 server_cookie=a651bb33666ded88 in_seq=0 out_seq=0 2024-07-27T03:11:34.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/1433376380 <== mds.2 v2:172.21.15.120:6832/2987877930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5777262b0 con 0x55f5773cae40 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b6a7fc640 10 client.5937 handle_command_reply: tid=0 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b98feb740 1 client.5937 shutdown 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b98feb740 1 -- 172.21.15.120:0/1433376380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773e33b0 msgr2=0x55f5778085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b98feb740 1 --2- 172.21.15.120:0/1433376380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773e33b0 0x55f5778085d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c097790 tx=0x7f4b7c099260 comp rx=0 tx=0).stop 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b98feb740 1 -- 172.21.15.120:0/1433376380 shutdown_connections 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b98feb740 1 --2- 172.21.15.120:0/1433376380 >> [v2:172.21.15.120:6832/2987877930,v1:172.21.15.120:6834/2987877930] conn(0x55f5773cae40 0x55f5778093c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b98feb740 1 --2- 172.21.15.120:0/1433376380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f57740c270 0x55f5777c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b98feb740 1 --2- 172.21.15.120:0/1433376380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773eb590 0x55f577808b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b6a7fc640 0 client.5937 ms_handle_reset on v2:172.21.15.120:6832/2987877930 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b98feb740 1 --2- 172.21.15.120:0/1433376380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773e33b0 0x55f5778085d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.829+0000 7f4b98feb740 1 -- 172.21.15.120:0/1433376380 >> 172.21.15.120:0/1433376380 conn(0x55f5774003c0 msgr2=0x55f5777f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.830+0000 7f4b98feb740 1 -- 172.21.15.120:0/1433376380 shutdown_connections 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.830+0000 7f4b98feb740 1 -- 172.21.15.120:0/1433376380 wait complete. 2024-07-27T03:11:34.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.830+0000 7f4b98feb740 20 client.5937 trim_cache size 0 max 16384 2024-07-27T03:11:34.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.848+0000 7f4b98feb740 1 Processor -- start 2024-07-27T03:11:34.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.848+0000 7f4b98feb740 1 -- start start 2024-07-27T03:11:34.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5777ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773eb590 0x55f5777abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f57740c270 0x55f5777d3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b98feb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c201100 con 0x55f5773eb590 2024-07-27T03:11:34.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b98feb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c2017d0 con 0x55f5773e33b0 2024-07-27T03:11:34.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b98feb740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4b8c0b5cd0 con 0x55f57740c270 2024-07-27T03:11:34.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b8affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773eb590 0x55f5777abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b8affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773eb590 0x55f5777abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41886/0 (socket says 172.21.15.120:41886) 2024-07-27T03:11:34.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b8affd640 1 -- 172.21.15.120:0/3179606166 learned_addr learned my addr 172.21.15.120:0/3179606166 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:34.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/3179606166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5777ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b8bfff640 1 --2- 172.21.15.120:0/3179606166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f57740c270 0x55f5777d3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b8affd640 1 -- 172.21.15.120:0/3179606166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f57740c270 msgr2=0x55f5777d3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:34.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b8affd640 1 --2- 172.21.15.120:0/3179606166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f57740c270 0x55f5777d3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b8affd640 1 -- 172.21.15.120:0/3179606166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 msgr2=0x55f5777ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:34.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b8affd640 1 --2- 172.21.15.120:0/3179606166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5777ab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b8affd640 1 -- 172.21.15.120:0/3179606166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5777ae230 con 0x55f5773eb590 2024-07-27T03:11:34.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b8affd640 1 --2- 172.21.15.120:0/3179606166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773eb590 0x55f5777abed0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4b80001240 tx=0x7f4b80012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123b178c0221c6d2 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:34.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b70ff9640 1 -- 172.21.15.120:0/3179606166 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000fe30 con 0x55f5773eb590 2024-07-27T03:11:34.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b70ff9640 1 -- 172.21.15.120:0/3179606166 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b800035f0 con 0x55f5773eb590 2024-07-27T03:11:34.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.850+0000 7f4b70ff9640 1 -- 172.21.15.120:0/3179606166 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80003a20 con 0x55f5773eb590 2024-07-27T03:11:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.851+0000 7f4b98feb740 1 -- 172.21.15.120:0/3179606166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773eb590 msgr2=0x55f5777abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.851+0000 7f4b98feb740 1 --2- 172.21.15.120:0/3179606166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773eb590 0x55f5777abed0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4b80001240 tx=0x7f4b80012000 comp rx=0 tx=0).stop 2024-07-27T03:11:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.851+0000 7f4b98feb740 1 -- 172.21.15.120:0/3179606166 shutdown_connections 2024-07-27T03:11:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.851+0000 7f4b98feb740 1 --2- 172.21.15.120:0/3179606166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f5773eb590 0x55f5777abed0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.851+0000 7f4b98feb740 1 --2- 172.21.15.120:0/3179606166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f57740c270 0x55f5777d3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.851+0000 7f4b98feb740 1 --2- 172.21.15.120:0/3179606166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5777ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.851+0000 7f4b98feb740 1 -- 172.21.15.120:0/3179606166 >> 172.21.15.120:0/3179606166 conn(0x55f5774003c0 msgr2=0x55f5777f6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.851+0000 7f4b98feb740 1 -- 172.21.15.120:0/3179606166 shutdown_connections 2024-07-27T03:11:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.851+0000 7f4b98feb740 1 -- 172.21.15.120:0/3179606166 wait complete. 2024-07-27T03:11:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.852+0000 7f4b98feb740 1 -- start start 2024-07-27T03:11:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.852+0000 7f4b98feb740 1 Processor -- start 2024-07-27T03:11:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5778734a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f5773eb590 0x55f5777abc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b98feb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f577816c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b98feb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f5777ca670 con 0x55f57740c270 2024-07-27T03:11:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b98feb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f577486620 con 0x55f5773e33b0 2024-07-27T03:11:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b98feb740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55f5777cace0 con 0x55f5773eb590 2024-07-27T03:11:34.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b98feb740 10 client.0 _ll_register_callbacks cb 0x7f4b7c07a040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:11:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b8bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f577816c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b8b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5778734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b8bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f577816c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41902/0 (socket says 172.21.15.120:41902) 2024-07-27T03:11:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b8bfff640 1 -- 172.21.15.120:0/2104775294 learned_addr learned my addr 172.21.15.120:0/2104775294 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:34.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b8affd640 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f5773eb590 0x55f5777abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b8bfff640 1 -- 172.21.15.120:0/2104775294 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f5773eb590 msgr2=0x55f5777abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b8bfff640 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f5773eb590 0x55f5777abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b8bfff640 1 -- 172.21.15.120:0/2104775294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 msgr2=0x55f5778734a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b8bfff640 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5778734a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b8bfff640 1 -- 172.21.15.120:0/2104775294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f57781a360 con 0x55f57740c270 2024-07-27T03:11:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b8bfff640 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f577816c50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4b8402aec0 tx=0x7f4b84003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ca38106528779a server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:11:34.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/2104775294 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84009ad0 con 0x55f57740c270 2024-07-27T03:11:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/2104775294 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4b84004250 con 0x55f57740c270 2024-07-27T03:11:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.854+0000 7f4b98feb740 1 -- 172.21.15.120:0/2104775294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b800035f0 con 0x55f57740c270 2024-07-27T03:11:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/2104775294 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f4b8404b050 con 0x55f57740c270 2024-07-27T03:11:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b98feb740 10 client.5943 fetch_fsmap learned FSMap version 55 2024-07-27T03:11:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b98feb740 1 -- 172.21.15.120:0/2104775294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55f5778739e0 con 0x55f57740c270 2024-07-27T03:11:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/2104775294 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b800035f0 con 0x55f57740c270 2024-07-27T03:11:34.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/2104775294 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 55) ==== 3542+0+0 (secure 0 0 0) 0x7f4b8404e020 con 0x55f57740c270 2024-07-27T03:11:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b98feb740 10 client.5943 fetch_fsmap finished waiting for FSMap version 55 2024-07-27T03:11:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b98feb740 10 client.5943 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-27T03:11:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b98feb740 20 client.5943 populate_metadata read hostname 'smithi120' 2024-07-27T03:11:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b98feb740 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.120:6832/2987877930,v1:172.21.15.120:6834/2987877930] conn(0x55f5777d8340 0x55f577805be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b98feb740 4 client.5943 mds_command: new command op to 5458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:11:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b98feb740 1 -- 172.21.15.120:0/2104775294 --> [v2:172.21.15.120:6832/2987877930,v1:172.21.15.120:6834/2987877930] -- command(tid 0: {"prefix": "status"}) -- 0x55f5777f2b10 con 0x55f5777d8340 2024-07-27T03:11:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.120:6832/2987877930,v1:172.21.15.120:6834/2987877930] conn(0x55f5777d8340 0x55f577805be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b6a7fc640 10 client.5943 ms_handle_connect on v2:172.21.15.120:6832/2987877930 2024-07-27T03:11:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.855+0000 7f4b8b7fe640 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.120:6832/2987877930,v1:172.21.15.120:6834/2987877930] conn(0x55f5777d8340 0x55f577805be0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2d741db60ec56a88 server_cookie=970d9b76207eb898 in_seq=0 out_seq=0 2024-07-27T03:11:34.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b6a7fc640 1 -- 172.21.15.120:0/2104775294 <== mds.2 v2:172.21.15.120:6832/2987877930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f5777f2b10 con 0x55f5777d8340 2024-07-27T03:11:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b6a7fc640 10 client.5943 handle_command_reply: tid=0 2024-07-27T03:11:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 1 client.5943 shutdown 2024-07-27T03:11:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 1 -- 172.21.15.120:0/2104775294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 msgr2=0x55f577816c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f577816c50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4b8402aec0 tx=0x7f4b84003de0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 1 -- 172.21.15.120:0/2104775294 shutdown_connections 2024-07-27T03:11:34.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.120:6832/2987877930,v1:172.21.15.120:6834/2987877930] conn(0x55f5777d8340 0x55f577805be0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f57740c270 0x55f577816c50 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55f5773eb590 0x55f5777abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b6a7fc640 0 client.5943 ms_handle_reset on v2:172.21.15.120:6832/2987877930 2024-07-27T03:11:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 1 --2- 172.21.15.120:0/2104775294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f5773e33b0 0x55f5778734a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 1 -- 172.21.15.120:0/2104775294 >> 172.21.15.120:0/2104775294 conn(0x55f5774003c0 msgr2=0x55f5777d54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 1 -- 172.21.15.120:0/2104775294 shutdown_connections 2024-07-27T03:11:34.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 1 -- 172.21.15.120:0/2104775294 wait complete. 2024-07-27T03:11:34.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b98feb740 20 client.5943 trim_cache size 0 max 16384 2024-07-27T03:11:34.873 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:11:34.873 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:11:34.874 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 2, 2024-07-27T03:11:34.874 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5458, 2024-07-27T03:11:34.874 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:11:34.874 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:11:34.875 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:11:34.875 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 1.6987552969999999, 2024-07-27T03:11:34.875 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 55, 2024-07-27T03:11:34.875 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 57, 2024-07-27T03:11:34.876 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 57, 2024-07-27T03:11:34.876 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 19.450255334000001 2024-07-27T03:11:34.876 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:11:34.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b91ffa640 1 -- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4b78077010 msgr2=0x7f4b78079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b91ffa640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4b78077010 0x7f4b78079520 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4b80001860 tx=0x7f4b80001110 comp rx=0 tx=0).stop 2024-07-27T03:11:34.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b91ffa640 1 -- 172.21.15.120:0/1041253049 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b74005250 msgr2=0x7f4b8c1f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.856+0000 7f4b91ffa640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b74005250 0x7f4b8c1f91b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c004ed0 tx=0x7f4b7c001630 comp rx=0 tx=0).stop 2024-07-27T03:11:34.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.857+0000 7f4b91ffa640 1 -- 172.21.15.120:0/1041253049 shutdown_connections 2024-07-27T03:11:34.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.857+0000 7f4b91ffa640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4b78077010 0x7f4b78079520 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.857+0000 7f4b91ffa640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4b8c1f5c00 0x7f4b8c15f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.857+0000 7f4b91ffa640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b8c0ca4b0 0x7f4b8c15c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.857+0000 7f4b91ffa640 1 --2- 172.21.15.120:0/1041253049 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b74005250 0x7f4b8c1f91b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.857+0000 7f4b91ffa640 1 -- 172.21.15.120:0/1041253049 >> 172.21.15.120:0/1041253049 conn(0x7f4b8c08d690 msgr2=0x7f4b8c0b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:34.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.857+0000 7f4b91ffa640 1 -- 172.21.15.120:0/1041253049 shutdown_connections 2024-07-27T03:11:34.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.857+0000 7f4b91ffa640 1 -- 172.21.15.120:0/1041253049 wait complete. 2024-07-27T03:11:34.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-07-27T03:11:34.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.991+0000 7f59917c3640 1 -- 172.21.15.120:0/3810050189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f598c09b640 msgr2=0x7f598c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.991+0000 7f59917c3640 1 --2- 172.21.15.120:0/3810050189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f598c09b640 0x7f598c0b7110 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f598c0b8120 tx=0x7f597c02a540 comp rx=0 tx=0).stop 2024-07-27T03:11:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.991+0000 7f59917c3640 1 -- 172.21.15.120:0/3810050189 shutdown_connections 2024-07-27T03:11:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.991+0000 7f59917c3640 1 --2- 172.21.15.120:0/3810050189 >> v2:172.21.15.121:3300/0 conn(0x7f598c0cf4e0 0x7f598c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.991+0000 7f59917c3640 1 --2- 172.21.15.120:0/3810050189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f598c09b640 0x7f598c0b7110 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.991+0000 7f59917c3640 1 -- 172.21.15.120:0/3810050189 >> 172.21.15.120:0/3810050189 conn(0x7f598c0d20a0 msgr2=0x7f598c0d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.991+0000 7f59917c3640 1 -- 172.21.15.120:0/3810050189 shutdown_connections 2024-07-27T03:11:34.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.991+0000 7f59917c3640 1 -- 172.21.15.120:0/3810050189 wait complete. 2024-07-27T03:11:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.993+0000 7f59917c3640 1 Processor -- start 2024-07-27T03:11:34.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.993+0000 7f59917c3640 1 -- start start 2024-07-27T03:11:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f59917c3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f598c09af70 0x7f598c1f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f59917c3640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f598c09b640 0x7f598c0aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f59917c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f598c0cf4e0 0x7f598c1f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f59917c3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f598c160620 con 0x7f598c09af70 2024-07-27T03:11:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f59917c3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f598c0b61c0 con 0x7f598c0cf4e0 2024-07-27T03:11:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f59917c3640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f598c1607a0 con 0x7f598c09b640 2024-07-27T03:11:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f598c09af70 0x7f598c1f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f598c09af70 0x7f598c1f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41922/0 (socket says 172.21.15.120:41922) 2024-07-27T03:11:34.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598affd640 1 -- 172.21.15.120:0/2849568427 learned_addr learned my addr 172.21.15.120:0/2849568427 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598b7fe640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f598c0cf4e0 0x7f598c1f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598a7fc640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f598c09b640 0x7f598c0aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598affd640 1 -- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f598c09b640 msgr2=0x7f598c0aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598affd640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f598c09b640 0x7f598c0aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598affd640 1 -- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f598c0cf4e0 msgr2=0x7f598c1f6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598affd640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f598c0cf4e0 0x7f598c1f6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598affd640 1 -- 172.21.15.120:0/2849568427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598c0afc80 con 0x7f598c09af70 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598a7fc640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f598c09b640 0x7f598c0aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.994+0000 7f598affd640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f598c09af70 0x7f598c1f6510 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f597c0099d0 tx=0x7f597c0052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.995+0000 7f59737fe640 1 -- 172.21.15.120:0/2849568427 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c005cf0 con 0x7f598c09af70 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.995+0000 7f59737fe640 1 -- 172.21.15.120:0/2849568427 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f597c031c40 con 0x7f598c09af70 2024-07-27T03:11:34.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.995+0000 7f59917c3640 1 -- 172.21.15.120:0/2849568427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f598c0aff60 con 0x7f598c09af70 2024-07-27T03:11:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.995+0000 7f59737fe640 1 -- 172.21.15.120:0/2849568427 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c033330 con 0x7f598c09af70 2024-07-27T03:11:35.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.995+0000 7f59917c3640 1 -- 172.21.15.120:0/2849568427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f598c0b0520 con 0x7f598c09af70 2024-07-27T03:11:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.996+0000 7f59737fe640 1 -- 172.21.15.120:0/2849568427 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f597c0334d0 con 0x7f598c09af70 2024-07-27T03:11:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.997+0000 7f59737fe640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5978077040 0x7f5978079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.997+0000 7f59737fe640 1 -- 172.21.15.120:0/2849568427 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f597c0b9b60 con 0x7f598c09af70 2024-07-27T03:11:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.997+0000 7f598a7fc640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5978077040 0x7f5978079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.998+0000 7f598a7fc640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5978077040 0x7f5978079550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f598c09cc30 tx=0x7f5980005f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.998+0000 7f59987b3740 1 Processor -- start 2024-07-27T03:11:35.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.998+0000 7f59987b3740 1 -- start start 2024-07-27T03:11:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.999+0000 7f59987b3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285d5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.999+0000 7f59987b3740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.999+0000 7f59987b3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281c3590 0x55ff285b8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.999+0000 7f59987b3740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff284fc360 con 0x55ff281e4270 2024-07-27T03:11:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.999+0000 7f59987b3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ff284eb860 con 0x55ff281c3590 2024-07-27T03:11:35.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.999+0000 7f59987b3740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55ff284ef8a0 con 0x55ff281bb3b0 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.999+0000 7f598affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285d5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.999+0000 7f598affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285d5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41930/0 (socket says 172.21.15.120:41930) 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.999+0000 7f598affd640 1 -- 172.21.15.120:0/3699473282 learned_addr learned my addr 172.21.15.120:0/3699473282 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.999+0000 7f598a7fc640 1 --2- 172.21.15.120:0/3699473282 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:34.999+0000 7f598b7fe640 1 --2- 172.21.15.120:0/3699473282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281c3590 0x55ff285b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.000+0000 7f598affd640 1 -- 172.21.15.120:0/3699473282 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 msgr2=0x55ff285b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.000+0000 7f598affd640 1 --2- 172.21.15.120:0/3699473282 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.000+0000 7f598affd640 1 -- 172.21.15.120:0/3699473282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281c3590 msgr2=0x55ff285b8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.000+0000 7f598affd640 1 --2- 172.21.15.120:0/3699473282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281c3590 0x55ff285b8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.000+0000 7f598affd640 1 -- 172.21.15.120:0/3699473282 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff2847b360 con 0x55ff281e4270 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.000+0000 7f598affd640 1 --2- 172.21.15.120:0/3699473282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285d5580 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f597c07ecc0 tx=0x7f597c081e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40b168217bcc3a1 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.000+0000 7f5970ff9640 1 -- 172.21.15.120:0/3699473282 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c087e60 con 0x55ff281e4270 2024-07-27T03:11:35.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.000+0000 7f5970ff9640 1 -- 172.21.15.120:0/3699473282 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f597c082dd0 con 0x55ff281e4270 2024-07-27T03:11:35.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.000+0000 7f5970ff9640 1 -- 172.21.15.120:0/3699473282 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c031770 con 0x55ff281e4270 2024-07-27T03:11:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.001+0000 7f59987b3740 1 -- 172.21.15.120:0/3699473282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 msgr2=0x55ff285d5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.001+0000 7f59987b3740 1 --2- 172.21.15.120:0/3699473282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285d5580 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f597c07ecc0 tx=0x7f597c081e40 comp rx=0 tx=0).stop 2024-07-27T03:11:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.001+0000 7f59987b3740 1 -- 172.21.15.120:0/3699473282 shutdown_connections 2024-07-27T03:11:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.001+0000 7f59987b3740 1 --2- 172.21.15.120:0/3699473282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281c3590 0x55ff285b8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.001+0000 7f59987b3740 1 --2- 172.21.15.120:0/3699473282 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.001+0000 7f59987b3740 1 --2- 172.21.15.120:0/3699473282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285d5580 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.001+0000 7f59987b3740 1 -- 172.21.15.120:0/3699473282 >> 172.21.15.120:0/3699473282 conn(0x55ff281d83c0 msgr2=0x55ff2858e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.001+0000 7f59987b3740 1 -- 172.21.15.120:0/3699473282 shutdown_connections 2024-07-27T03:11:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.001+0000 7f59987b3740 1 -- 172.21.15.120:0/3699473282 wait complete. 2024-07-27T03:11:35.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.002+0000 7f59987b3740 1 -- start start 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.002+0000 7f59987b3740 1 Processor -- start 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f59987b3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281bb3b0 0x55ff285d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f59987b3740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281c3590 0x55ff285e6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f59987b3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285a6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f59987b3740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff2825e620 con 0x55ff281e4270 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f59987b3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ff28487140 con 0x55ff281bb3b0 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f59987b3740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55ff284fc360 con 0x55ff281c3590 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f59987b3740 10 client.0 _ll_register_callbacks cb 0x55ff284e4c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f598b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f598b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285a6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41938/0 (socket says 172.21.15.120:41938) 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f598b7fe640 1 -- 172.21.15.120:0/231588637 learned_addr learned my addr 172.21.15.120:0/231588637 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f598affd640 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281bb3b0 0x55ff285d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.003+0000 7f598a7fc640 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281c3590 0x55ff285e6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f598b7fe640 1 -- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281c3590 msgr2=0x55ff285e6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f598b7fe640 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281c3590 0x55ff285e6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f598b7fe640 1 -- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281bb3b0 msgr2=0x55ff285d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f598b7fe640 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281bb3b0 0x55ff285d2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f598b7fe640 1 -- 172.21.15.120:0/231588637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff2824f850 con 0x55ff281e4270 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f598b7fe640 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285a6620 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f598c0c5ba0 tx=0x7f598400af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2493e45840d5b40 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f5969ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f5969ffb640 1 -- 172.21.15.120:0/231588637 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5984007e80 con 0x55ff281e4270 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f5969ffb640 1 -- 172.21.15.120:0/231588637 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f5984016410 con 0x55ff281e4270 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f59987b3740 1 -- 172.21.15.120:0/231588637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f597c082dd0 con 0x55ff281e4270 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f5969ffb640 1 -- 172.21.15.120:0/231588637 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f5984016610 con 0x55ff281e4270 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f59987b3740 10 client.5955 fetch_fsmap learned FSMap version 55 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f59987b3740 1 -- 172.21.15.120:0/231588637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55ff282c66b0 con 0x55ff281e4270 2024-07-27T03:11:35.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f5969ffb640 1 -- 172.21.15.120:0/231588637 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f597c082dd0 con 0x55ff281e4270 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f5969ffb640 1 -- 172.21.15.120:0/231588637 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 55) ==== 3542+0+0 (secure 0 0 0) 0x7f5984026080 con 0x55ff281e4270 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f59987b3740 10 client.5955 fetch_fsmap finished waiting for FSMap version 55 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f59987b3740 10 client.5955 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f59987b3740 20 client.5955 populate_metadata read hostname 'smithi120' 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f59987b3740 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:6834/1057652547,v1:172.21.15.121:6837/1057652547] conn(0x55ff281a2e40 0x55ff285b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f59987b3740 4 client.5955 mds_command: new command op to 5473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.004+0000 7f59987b3740 1 -- 172.21.15.120:0/231588637 --> [v2:172.21.15.121:6834/1057652547,v1:172.21.15.121:6837/1057652547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff284fe2b0 con 0x55ff281a2e40 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.005+0000 7f598affd640 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:6834/1057652547,v1:172.21.15.121:6837/1057652547] conn(0x55ff281a2e40 0x55ff285b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.005+0000 7f598affd640 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:6834/1057652547,v1:172.21.15.121:6837/1057652547] conn(0x55ff281a2e40 0x55ff285b2e70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24f4a0155ca1ae46 server_cookie=fb7848d6be0ee73b in_seq=0 out_seq=0 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.005+0000 7f5969ffb640 10 client.5955 ms_handle_connect on v2:172.21.15.121:6834/1057652547 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f5969ffb640 1 -- 172.21.15.120:0/231588637 <== mds.1 v2:172.21.15.121:6834/1057652547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff284fe2b0 con 0x55ff281a2e40 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f5969ffb640 10 client.5955 handle_command_reply: tid=0 2024-07-27T03:11:35.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 1 client.5955 shutdown 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 1 -- 172.21.15.120:0/231588637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 msgr2=0x55ff285a6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285a6620 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f598c0c5ba0 tx=0x7f598400af70 comp rx=0 tx=0).stop 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 1 -- 172.21.15.120:0/231588637 shutdown_connections 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:6834/1057652547,v1:172.21.15.121:6837/1057652547] conn(0x55ff281a2e40 0x55ff285b2e70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285a6620 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281c3590 0x55ff285e6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f5969ffb640 0 client.5955 ms_handle_reset on v2:172.21.15.121:6834/1057652547 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 1 --2- 172.21.15.120:0/231588637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281bb3b0 0x55ff285d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 1 -- 172.21.15.120:0/231588637 >> 172.21.15.120:0/231588637 conn(0x55ff281d83c0 msgr2=0x55ff285d3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 1 -- 172.21.15.120:0/231588637 shutdown_connections 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 1 -- 172.21.15.120:0/231588637 wait complete. 2024-07-27T03:11:35.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.006+0000 7f59987b3740 20 client.5955 trim_cache size 0 max 16384 2024-07-27T03:11:35.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.025+0000 7f59987b3740 1 Processor -- start 2024-07-27T03:11:35.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.025+0000 7f59987b3740 1 -- start start 2024-07-27T03:11:35.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.026+0000 7f59987b3740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.026+0000 7f59987b3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281c3590 0x55ff2858e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.026+0000 7f59987b3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.026+0000 7f59987b3740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f598c06d890 con 0x55ff281e4270 2024-07-27T03:11:35.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.026+0000 7f59987b3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f598c06df60 con 0x55ff281c3590 2024-07-27T03:11:35.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.026+0000 7f59987b3740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f598c1f37b0 con 0x55ff281bb3b0 2024-07-27T03:11:35.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.026+0000 7f598b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f598b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41944/0 (socket says 172.21.15.120:41944) 2024-07-27T03:11:35.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f598b7fe640 1 -- 172.21.15.120:0/356230933 learned_addr learned my addr 172.21.15.120:0/356230933 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:35.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f598a7fc640 1 --2- 172.21.15.120:0/356230933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281c3590 0x55ff2858e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f598affd640 1 --2- 172.21.15.120:0/356230933 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f598b7fe640 1 -- 172.21.15.120:0/356230933 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 msgr2=0x55ff285b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f598b7fe640 1 --2- 172.21.15.120:0/356230933 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f598b7fe640 1 -- 172.21.15.120:0/356230933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281c3590 msgr2=0x55ff2858e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f598b7fe640 1 --2- 172.21.15.120:0/356230933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281c3590 0x55ff2858e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f598b7fe640 1 -- 172.21.15.120:0/356230933 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff285b29c0 con 0x55ff281e4270 2024-07-27T03:11:35.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f598a7fc640 1 --2- 172.21.15.120:0/356230933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281c3590 0x55ff2858e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:35.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f598b7fe640 1 --2- 172.21.15.120:0/356230933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285b4340 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5984009c00 tx=0x7f5984009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476e3136890a6d1f server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f596bfff640 1 -- 172.21.15.120:0/356230933 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59840169e0 con 0x55ff281e4270 2024-07-27T03:11:35.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f596bfff640 1 -- 172.21.15.120:0/356230933 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f598401b070 con 0x55ff281e4270 2024-07-27T03:11:35.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.027+0000 7f596bfff640 1 -- 172.21.15.120:0/356230933 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598402d410 con 0x55ff281e4270 2024-07-27T03:11:35.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.028+0000 7f59987b3740 1 -- 172.21.15.120:0/356230933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 msgr2=0x55ff285b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.028+0000 7f59987b3740 1 --2- 172.21.15.120:0/356230933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285b4340 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5984009c00 tx=0x7f5984009c30 comp rx=0 tx=0).stop 2024-07-27T03:11:35.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.028+0000 7f59987b3740 1 -- 172.21.15.120:0/356230933 shutdown_connections 2024-07-27T03:11:35.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.028+0000 7f59987b3740 1 --2- 172.21.15.120:0/356230933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281e4270 0x55ff285b4340 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.028+0000 7f59987b3740 1 --2- 172.21.15.120:0/356230933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281c3590 0x55ff2858e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.028+0000 7f59987b3740 1 --2- 172.21.15.120:0/356230933 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.028+0000 7f59987b3740 1 -- 172.21.15.120:0/356230933 >> 172.21.15.120:0/356230933 conn(0x55ff281d83c0 msgr2=0x55ff285d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.028+0000 7f59987b3740 1 -- 172.21.15.120:0/356230933 shutdown_connections 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.028+0000 7f59987b3740 1 -- 172.21.15.120:0/356230933 wait complete. 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.029+0000 7f59987b3740 1 -- start start 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.029+0000 7f59987b3740 1 Processor -- start 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f59987b3740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f59987b3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281c3590 0x55ff286387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f59987b3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281e4270 0x55ff28654050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f59987b3740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff285b75d0 con 0x55ff281c3590 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f59987b3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ff285b3f50 con 0x55ff281e4270 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f59987b3740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55ff285b07f0 con 0x55ff281bb3b0 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f59987b3740 10 client.0 _ll_register_callbacks cb 0x7f5984009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f598a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281c3590 0x55ff286387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f598a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281c3590 0x55ff286387f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41956/0 (socket says 172.21.15.120:41956) 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f598a7fc640 1 -- 172.21.15.120:0/277445141 learned_addr learned my addr 172.21.15.120:0/277445141 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f598b7fe640 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281e4270 0x55ff28654050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f598affd640 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f598a7fc640 1 -- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 msgr2=0x55ff285b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f598a7fc640 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f598a7fc640 1 -- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281e4270 msgr2=0x55ff28654050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f598a7fc640 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281e4270 0x55ff28654050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.030+0000 7f598a7fc640 1 -- 172.21.15.120:0/277445141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff286538a0 con 0x55ff281c3590 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f598a7fc640 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281c3590 0x55ff286387f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f598c15d520 tx=0x7f5980004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bc1ecc5824970b server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f5969ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f5969ffb640 1 -- 172.21.15.120:0/277445141 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5980005020 con 0x55ff281c3590 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f5969ffb640 1 -- 172.21.15.120:0/277445141 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f59800051c0 con 0x55ff281c3590 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f59987b3740 1 -- 172.21.15.120:0/277445141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f598401b070 con 0x55ff281c3590 2024-07-27T03:11:35.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f5969ffb640 1 -- 172.21.15.120:0/277445141 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f5980033050 con 0x55ff281c3590 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f59987b3740 10 client.5961 fetch_fsmap learned FSMap version 55 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f59987b3740 1 -- 172.21.15.120:0/277445141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55ff28638d30 con 0x55ff281c3590 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f5969ffb640 1 -- 172.21.15.120:0/277445141 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f598401b070 con 0x55ff281c3590 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f5969ffb640 1 -- 172.21.15.120:0/277445141 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 55) ==== 3542+0+0 (secure 0 0 0) 0x7f5980036020 con 0x55ff281c3590 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f59987b3740 10 client.5961 fetch_fsmap finished waiting for FSMap version 55 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f59987b3740 10 client.5961 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f59987b3740 20 client.5961 populate_metadata read hostname 'smithi120' 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f59987b3740 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:6834/1057652547,v1:172.21.15.121:6837/1057652547] conn(0x55ff285b2ca0 0x55ff285a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f59987b3740 4 client.5961 mds_command: new command op to 5473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f59987b3740 1 -- 172.21.15.120:0/277445141 --> [v2:172.21.15.121:6834/1057652547,v1:172.21.15.121:6837/1057652547] -- command(tid 0: {"prefix": "status"}) -- 0x55ff284f9d50 con 0x55ff285b2ca0 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.031+0000 7f598affd640 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:6834/1057652547,v1:172.21.15.121:6837/1057652547] conn(0x55ff285b2ca0 0x55ff285a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f5969ffb640 10 client.5961 ms_handle_connect on v2:172.21.15.121:6834/1057652547 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f598affd640 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:6834/1057652547,v1:172.21.15.121:6837/1057652547] conn(0x55ff285b2ca0 0x55ff285a7760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa90fa531e04e9cb server_cookie=7d8c7917ac9411f7 in_seq=0 out_seq=0 2024-07-27T03:11:35.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f5969ffb640 1 -- 172.21.15.120:0/277445141 <== mds.1 v2:172.21.15.121:6834/1057652547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55ff284f9d50 con 0x55ff285b2ca0 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f5969ffb640 10 client.5961 handle_command_reply: tid=0 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 1 client.5961 shutdown 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 1 -- 172.21.15.120:0/277445141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281c3590 msgr2=0x55ff286387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281c3590 0x55ff286387f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f598c15d520 tx=0x7f5980004730 comp rx=0 tx=0).stop 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 1 -- 172.21.15.120:0/277445141 shutdown_connections 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:6834/1057652547,v1:172.21.15.121:6837/1057652547] conn(0x55ff285b2ca0 0x55ff285a7760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff281c3590 0x55ff286387f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f5969ffb640 0 client.5961 ms_handle_reset on v2:172.21.15.121:6834/1057652547 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ff281e4270 0x55ff28654050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 1 --2- 172.21.15.120:0/277445141 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ff281bb3b0 0x55ff285b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 1 -- 172.21.15.120:0/277445141 >> 172.21.15.120:0/277445141 conn(0x55ff281d83c0 msgr2=0x55ff2858f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 1 -- 172.21.15.120:0/277445141 shutdown_connections 2024-07-27T03:11:35.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 1 -- 172.21.15.120:0/277445141 wait complete. 2024-07-27T03:11:35.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.032+0000 7f59987b3740 20 client.5961 trim_cache size 0 max 16384 2024-07-27T03:11:35.043 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:11:35.043 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:11:35.043 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 1, 2024-07-27T03:11:35.043 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5473, 2024-07-27T03:11:35.043 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:11:35.043 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:11:35.043 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:11:35.043 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 2.885910564, 2024-07-27T03:11:35.043 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 55, 2024-07-27T03:11:35.043 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 57, 2024-07-27T03:11:35.044 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 57, 2024-07-27T03:11:35.044 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 19.614600412000001 2024-07-27T03:11:35.044 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 -- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5978077040 msgr2=0x7f5978079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5978077040 0x7f5978079550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f598c09cc30 tx=0x7f5980005f10 comp rx=0 tx=0).stop 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 -- 172.21.15.120:0/2849568427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f598c09af70 msgr2=0x7f598c1f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f598c09af70 0x7f598c1f6510 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f597c0099d0 tx=0x7f597c0052f0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 -- 172.21.15.120:0/2849568427 shutdown_connections 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5978077040 0x7f5978079550 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f598c0cf4e0 0x7f598c1f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f598c09b640 0x7f598c0aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 --2- 172.21.15.120:0/2849568427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f598c09af70 0x7f598c1f6510 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 -- 172.21.15.120:0/2849568427 >> 172.21.15.120:0/2849568427 conn(0x7f598c0d20a0 msgr2=0x7f598c1595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 -- 172.21.15.120:0/2849568427 shutdown_connections 2024-07-27T03:11:35.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.033+0000 7f59917c3640 1 -- 172.21.15.120:0/2849568427 wait complete. 2024-07-27T03:11:35.047 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-07-27T03:11:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.160+0000 7fcc67243640 1 -- 172.21.15.120:0/4087293353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc600d0c10 msgr2=0x7fcc600b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.160+0000 7fcc67243640 1 --2- 172.21.15.120:0/4087293353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc600d0c10 0x7fcc600b2520 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcc50005fd0 tx=0x7fcc5002a840 comp rx=0 tx=0).stop 2024-07-27T03:11:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.160+0000 7fcc67243640 1 -- 172.21.15.120:0/4087293353 shutdown_connections 2024-07-27T03:11:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.160+0000 7fcc67243640 1 --2- 172.21.15.120:0/4087293353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc600d0c10 0x7fcc600b2520 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.160+0000 7fcc67243640 1 -- 172.21.15.120:0/4087293353 >> 172.21.15.120:0/4087293353 conn(0x7fcc600b3920 msgr2=0x7fcc600b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.160+0000 7fcc67243640 1 -- 172.21.15.120:0/4087293353 shutdown_connections 2024-07-27T03:11:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.160+0000 7fcc67243640 1 -- 172.21.15.120:0/4087293353 wait complete. 2024-07-27T03:11:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.162+0000 7fcc67243640 1 Processor -- start 2024-07-27T03:11:35.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.162+0000 7fcc67243640 1 -- start start 2024-07-27T03:11:35.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc67243640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc600b2110 0x7fcc60151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc67243640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc600b5fe0 0x7fcc60157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc67243640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc601e6ac0 0x7fcc601e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc67243640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6015f730 con 0x7fcc600b5fe0 2024-07-27T03:11:35.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc67243640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6015f5b0 con 0x7fcc600b2110 2024-07-27T03:11:35.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc67243640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6015f8b0 con 0x7fcc601e6ac0 2024-07-27T03:11:35.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc600b5fe0 0x7fcc60157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc600b5fe0 0x7fcc60157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41968/0 (socket says 172.21.15.120:41968) 2024-07-27T03:11:35.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc5ffff640 1 -- 172.21.15.120:0/3885866344 learned_addr learned my addr 172.21.15.120:0/3885866344 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:35.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc600b2110 0x7fcc60151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc657e0640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc601e6ac0 0x7fcc601e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc5ffff640 1 -- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc601e6ac0 msgr2=0x7fcc601e6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc5ffff640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc601e6ac0 0x7fcc601e6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc5ffff640 1 -- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc600b2110 msgr2=0x7fcc60151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc5ffff640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc600b2110 0x7fcc60151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc5ffff640 1 -- 172.21.15.120:0/3885866344 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc601520e0 con 0x7fcc600b5fe0 2024-07-27T03:11:35.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.164+0000 7fcc5ffff640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc600b5fe0 0x7fcc60157930 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcc50034040 tx=0x7fcc50032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.169+0000 7fcc5d7fa640 1 -- 172.21.15.120:0/3885866344 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50040070 con 0x7fcc600b5fe0 2024-07-27T03:11:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.169+0000 7fcc5d7fa640 1 -- 172.21.15.120:0/3885866344 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc50004560 con 0x7fcc600b5fe0 2024-07-27T03:11:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.169+0000 7fcc67243640 1 -- 172.21.15.120:0/3885866344 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc601e7410 con 0x7fcc600b5fe0 2024-07-27T03:11:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.169+0000 7fcc5d7fa640 1 -- 172.21.15.120:0/3885866344 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5003c420 con 0x7fcc600b5fe0 2024-07-27T03:11:35.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.169+0000 7fcc67243640 1 -- 172.21.15.120:0/3885866344 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc601583f0 con 0x7fcc600b5fe0 2024-07-27T03:11:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.170+0000 7fcc5d7fa640 1 -- 172.21.15.120:0/3885866344 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fcc50043070 con 0x7fcc600b5fe0 2024-07-27T03:11:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.171+0000 7fcc5d7fa640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcc40077010 0x7fcc40079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.171+0000 7fcc5d7fa640 1 -- 172.21.15.120:0/3885866344 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fcc500b9c00 con 0x7fcc600b5fe0 2024-07-27T03:11:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.171+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcc40077010 0x7fcc40079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.172+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcc40077010 0x7fcc40079520 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcc58001860 tx=0x7fcc58001690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.172+0000 7fcc6ddfd740 1 Processor -- start 2024-07-27T03:11:35.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.172+0000 7fcc6ddfd740 1 -- start start 2024-07-27T03:11:35.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.173+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c325192170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.173+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d7c3b0 0x55c325174e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.173+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d84590 0x55c325175380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.173+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c3250bd360 con 0x55c324da5270 2024-07-27T03:11:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.173+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c3250ac860 con 0x55c324d84590 2024-07-27T03:11:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.173+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55c3250b08a0 con 0x55c324d7c3b0 2024-07-27T03:11:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.173+0000 7fcc64fdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c325192170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.173+0000 7fcc64fdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c325192170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41970/0 (socket says 172.21.15.120:41970) 2024-07-27T03:11:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.173+0000 7fcc64fdf640 1 -- 172.21.15.120:0/940902947 learned_addr learned my addr 172.21.15.120:0/940902947 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc657e0640 1 --2- 172.21.15.120:0/940902947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d84590 0x55c325175380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc64fdf640 1 -- 172.21.15.120:0/940902947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d7c3b0 msgr2=0x55c325174e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc5ffff640 1 --2- 172.21.15.120:0/940902947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d7c3b0 0x55c325174e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/940902947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d7c3b0 0x55c325174e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc64fdf640 1 -- 172.21.15.120:0/940902947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d84590 msgr2=0x55c325175380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/940902947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d84590 0x55c325175380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc64fdf640 1 -- 172.21.15.120:0/940902947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c32503c360 con 0x55c324da5270 2024-07-27T03:11:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc657e0640 1 --2- 172.21.15.120:0/940902947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d84590 0x55c325175380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc5ffff640 1 --2- 172.21.15.120:0/940902947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d7c3b0 0x55c325174e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/940902947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c325192170 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800fbb0 tx=0x7fcc58012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9aaf9b2c935e472 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc567fc640 1 -- 172.21.15.120:0/940902947 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5801b050 con 0x55c324da5270 2024-07-27T03:11:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc567fc640 1 -- 172.21.15.120:0/940902947 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc58025070 con 0x55c324da5270 2024-07-27T03:11:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.174+0000 7fcc567fc640 1 -- 172.21.15.120:0/940902947 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc58020660 con 0x55c324da5270 2024-07-27T03:11:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.175+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/940902947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 msgr2=0x55c325192170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.175+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/940902947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c325192170 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800fbb0 tx=0x7fcc58012000 comp rx=0 tx=0).stop 2024-07-27T03:11:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.175+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/940902947 shutdown_connections 2024-07-27T03:11:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.175+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/940902947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d84590 0x55c325175380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.175+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/940902947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d7c3b0 0x55c325174e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.175+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/940902947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c325192170 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.175+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/940902947 >> 172.21.15.120:0/940902947 conn(0x55c324d993c0 msgr2=0x55c32514b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.175+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/940902947 shutdown_connections 2024-07-27T03:11:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.175+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/940902947 wait complete. 2024-07-27T03:11:35.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.176+0000 7fcc6ddfd740 1 -- start start 2024-07-27T03:11:35.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.176+0000 7fcc6ddfd740 1 Processor -- start 2024-07-27T03:11:35.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.177+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d7c3b0 0x55c32518f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.177+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d84590 0x55c32518b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.177+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32518c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.177+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c324e1f620 con 0x55c324da5270 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.177+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c325048140 con 0x55c324d7c3b0 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.177+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55c32518a210 con 0x55c324d84590 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.177+0000 7fcc6ddfd740 10 client.0 _ll_register_callbacks cb 0x55c3250a5c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.177+0000 7fcc657e0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32518c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.177+0000 7fcc657e0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32518c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41972/0 (socket says 172.21.15.120:41972) 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.177+0000 7fcc657e0640 1 -- 172.21.15.120:0/1431482429 learned_addr learned my addr 172.21.15.120:0/1431482429 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d7c3b0 0x55c32518f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc5ffff640 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d84590 0x55c32518b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc657e0640 1 -- 172.21.15.120:0/1431482429 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d84590 msgr2=0x55c32518b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc657e0640 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d84590 0x55c32518b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc657e0640 1 -- 172.21.15.120:0/1431482429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d7c3b0 msgr2=0x55c32518f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc657e0640 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d7c3b0 0x55c32518f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc657e0640 1 -- 172.21.15.120:0/1431482429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c324e10850 con 0x55c324da5270 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc657e0640 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32518c460 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcc48003ac0 tx=0x7fcc48003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380e0b9be400ebe4 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/1431482429 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4801a060 con 0x55c324da5270 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/1431482429 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fcc48001b70 con 0x55c324da5270 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1431482429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc58025070 con 0x55c324da5270 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/1431482429 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fcc48020050 con 0x55c324da5270 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc6ddfd740 10 client.5973 fetch_fsmap learned FSMap version 55 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1431482429 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55c324e876b0 con 0x55c324da5270 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/1431482429 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc58025070 con 0x55c324da5270 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/1431482429 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 55) ==== 3542+0+0 (secure 0 0 0) 0x7fcc48023020 con 0x55c324da5270 2024-07-27T03:11:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.178+0000 7fcc6ddfd740 10 client.5973 fetch_fsmap finished waiting for FSMap version 55 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.179+0000 7fcc6ddfd740 10 client.5973 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.179+0000 7fcc6ddfd740 20 client.5973 populate_metadata read hostname 'smithi120' 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.179+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55c324d63e40 0x55c32519ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.179+0000 7fcc6ddfd740 4 client.5973 mds_command: new command op to 5733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.179+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1431482429 --> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3250bf2b0 con 0x55c324d63e40 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.179+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55c324d63e40 0x55c32519ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.179+0000 7fcc3f7fe640 10 client.5973 ms_handle_connect on v2:172.21.15.120:6833/3550669358 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.179+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55c324d63e40 0x55c32519ea60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7eae8daef0f74bc6 server_cookie=3df252d4e870ba1 in_seq=0 out_seq=0 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/1431482429 <== mds.0 v2:172.21.15.120:6833/3550669358 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3250bf2b0 con 0x55c324d63e40 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc3f7fe640 10 client.5973 handle_command_reply: tid=0 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 1 client.5973 shutdown 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1431482429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 msgr2=0x55c32518c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32518c460 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcc48003ac0 tx=0x7fcc48003f80 comp rx=0 tx=0).stop 2024-07-27T03:11:35.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1431482429 shutdown_connections 2024-07-27T03:11:35.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55c324d63e40 0x55c32519ea60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32518c460 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d84590 0x55c32518b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc3f7fe640 0 client.5973 ms_handle_reset on v2:172.21.15.120:6833/3550669358 2024-07-27T03:11:35.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/1431482429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d7c3b0 0x55c32518f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1431482429 >> 172.21.15.120:0/1431482429 conn(0x55c324d993c0 msgr2=0x55c325164600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1431482429 shutdown_connections 2024-07-27T03:11:35.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1431482429 wait complete. 2024-07-27T03:11:35.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.180+0000 7fcc6ddfd740 20 client.5973 trim_cache size 0 max 16384 2024-07-27T03:11:35.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.199+0000 7fcc6ddfd740 1 Processor -- start 2024-07-27T03:11:35.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.199+0000 7fcc6ddfd740 1 -- start start 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.200+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d7c3b0 0x55c325144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.200+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324d84590 0x55c325148f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.200+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324da5270 0x55c3251494d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.200+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcc601feba0 con 0x55c324d84590 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.200+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc601ff270 con 0x55c324d7c3b0 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.200+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fcc600c6a60 con 0x55c324da5270 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324d84590 0x55c325148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324d84590 0x55c325148f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41986/0 (socket says 172.21.15.120:41986) 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc5ffff640 1 -- 172.21.15.120:0/1009023401 learned_addr learned my addr 172.21.15.120:0/1009023401 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/1009023401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d7c3b0 0x55c325144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc5ffff640 1 -- 172.21.15.120:0/1009023401 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324da5270 msgr2=0x55c3251494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc657e0640 1 --2- 172.21.15.120:0/1009023401 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324da5270 0x55c3251494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc5ffff640 1 --2- 172.21.15.120:0/1009023401 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324da5270 0x55c3251494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc5ffff640 1 -- 172.21.15.120:0/1009023401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d7c3b0 msgr2=0x55c325144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc5ffff640 1 --2- 172.21.15.120:0/1009023401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d7c3b0 0x55c325144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc5ffff640 1 -- 172.21.15.120:0/1009023401 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c325147e50 con 0x55c324d84590 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/1009023401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d7c3b0 0x55c325144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc5ffff640 1 --2- 172.21.15.120:0/1009023401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324d84590 0x55c325148f90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcc500827d0 tx=0x7fcc50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c713ea50bcbdfb4 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc55ffb640 1 -- 172.21.15.120:0/1009023401 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5004a070 con 0x55c324d84590 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc55ffb640 1 -- 172.21.15.120:0/1009023401 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc5009b070 con 0x55c324d84590 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.201+0000 7fcc55ffb640 1 -- 172.21.15.120:0/1009023401 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5008b180 con 0x55c324d84590 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.202+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1009023401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324d84590 msgr2=0x55c325148f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.202+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/1009023401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324d84590 0x55c325148f90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcc500827d0 tx=0x7fcc50009840 comp rx=0 tx=0).stop 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.202+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1009023401 shutdown_connections 2024-07-27T03:11:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.202+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/1009023401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324d84590 0x55c325148f90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.202+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/1009023401 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324da5270 0x55c3251494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.202+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/1009023401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d7c3b0 0x55c325144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.202+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1009023401 >> 172.21.15.120:0/1009023401 conn(0x55c324d993c0 msgr2=0x55c3251901f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.202+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1009023401 shutdown_connections 2024-07-27T03:11:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.202+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/1009023401 wait complete. 2024-07-27T03:11:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.203+0000 7fcc6ddfd740 1 -- start start 2024-07-27T03:11:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.203+0000 7fcc6ddfd740 1 Processor -- start 2024-07-27T03:11:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.204+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d7c3b0 0x55c3251f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.204+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d84590 0x55c3251a6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.204+0000 7fcc6ddfd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32520d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.204+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c32518c0d0 con 0x55c324da5270 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.204+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c32518e690 con 0x55c324d84590 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.204+0000 7fcc6ddfd740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55c32518d7c0 con 0x55c324d7c3b0 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc6ddfd740 10 client.0 _ll_register_callbacks cb 0x7fcc48005070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc657e0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32520d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc657e0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32520d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41998/0 (socket says 172.21.15.120:41998) 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc657e0640 1 -- 172.21.15.120:0/985437277 learned_addr learned my addr 172.21.15.120:0/985437277 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d7c3b0 0x55c3251f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc5ffff640 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d84590 0x55c3251a6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc657e0640 1 -- 172.21.15.120:0/985437277 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d7c3b0 msgr2=0x55c3251f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc657e0640 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d7c3b0 0x55c3251f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc657e0640 1 -- 172.21.15.120:0/985437277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d84590 msgr2=0x55c3251a6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc657e0640 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d84590 0x55c3251a6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc657e0640 1 -- 172.21.15.120:0/985437277 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c325165100 con 0x55c324da5270 2024-07-27T03:11:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc657e0640 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32520d210 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcc48014880 tx=0x7fcc48007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed0d7a886ba9596 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/985437277 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48028070 con 0x55c324da5270 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/985437277 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fcc48001b70 con 0x55c324da5270 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/985437277 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc5009b070 con 0x55c324da5270 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/985437277 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fcc48033050 con 0x55c324da5270 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc6ddfd740 10 client.5979 fetch_fsmap learned FSMap version 55 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.205+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/985437277 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55c32516be40 con 0x55c324da5270 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/985437277 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc5009b070 con 0x55c324da5270 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/985437277 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 55) ==== 3542+0+0 (secure 0 0 0) 0x7fcc48023040 con 0x55c324da5270 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc6ddfd740 10 client.5979 fetch_fsmap finished waiting for FSMap version 55 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc6ddfd740 10 client.5979 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc6ddfd740 20 client.5979 populate_metadata read hostname 'smithi120' 2024-07-27T03:11:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55c32514c200 0x55c325210800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc6ddfd740 4 client.5979 mds_command: new command op to 5733 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/985437277 --> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] -- command(tid 0: {"prefix": "status"}) -- 0x55c3250bad50 con 0x55c32514c200 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55c32514c200 0x55c325210800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc3f7fe640 10 client.5979 ms_handle_connect on v2:172.21.15.120:6833/3550669358 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc64fdf640 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55c32514c200 0x55c325210800 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4edd15b7ee31dba server_cookie=9b947fb07646a5a6 in_seq=0 out_seq=0 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc3f7fe640 1 -- 172.21.15.120:0/985437277 <== mds.0 v2:172.21.15.120:6833/3550669358 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55c3250bad50 con 0x55c32514c200 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc3f7fe640 10 client.5979 handle_command_reply: tid=0 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.206+0000 7fcc6ddfd740 1 client.5979 shutdown 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/985437277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 msgr2=0x55c32520d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32520d210 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcc48014880 tx=0x7fcc48007de0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/985437277 shutdown_connections 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.120:6833/3550669358,v1:172.21.15.120:6835/3550669358] conn(0x55c32514c200 0x55c325210800 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c324da5270 0x55c32520d210 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c324d84590 0x55c3251a6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc3f7fe640 0 client.5979 ms_handle_reset on v2:172.21.15.120:6833/3550669358 2024-07-27T03:11:35.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc6ddfd740 1 --2- 172.21.15.120:0/985437277 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c324d7c3b0 0x55c3251f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/985437277 >> 172.21.15.120:0/985437277 conn(0x55c324d993c0 msgr2=0x55c32518b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/985437277 shutdown_connections 2024-07-27T03:11:35.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc6ddfd740 1 -- 172.21.15.120:0/985437277 wait complete. 2024-07-27T03:11:35.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc6ddfd740 20 client.5979 trim_cache size 0 max 16384 2024-07-27T03:11:35.215 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:11:35.215 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:11:35.215 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-07-27T03:11:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5733, 2024-07-27T03:11:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:11:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:11:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:11:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 15.124128716, 2024-07-27T03:11:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 55, 2024-07-27T03:11:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 57, 2024-07-27T03:11:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 57, 2024-07-27T03:11:35.216 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 19.801041807000001 2024-07-27T03:11:35.216 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:11:35.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc67243640 1 -- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcc40077010 msgr2=0x7fcc40079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc67243640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcc40077010 0x7fcc40079520 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcc58001860 tx=0x7fcc58001690 comp rx=0 tx=0).stop 2024-07-27T03:11:35.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc67243640 1 -- 172.21.15.120:0/3885866344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc600b5fe0 msgr2=0x7fcc60157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc67243640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc600b5fe0 0x7fcc60157930 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcc50034040 tx=0x7fcc50032cf0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc67243640 1 -- 172.21.15.120:0/3885866344 shutdown_connections 2024-07-27T03:11:35.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc67243640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcc40077010 0x7fcc40079520 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc67243640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc600b5fe0 0x7fcc60157930 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc67243640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc601e6ac0 0x7fcc601e6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.207+0000 7fcc67243640 1 --2- 172.21.15.120:0/3885866344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc600b2110 0x7fcc60151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.208+0000 7fcc67243640 1 -- 172.21.15.120:0/3885866344 >> 172.21.15.120:0/3885866344 conn(0x7fcc600b3920 msgr2=0x7fcc6015cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.208+0000 7fcc67243640 1 -- 172.21.15.120:0/3885866344 shutdown_connections 2024-07-27T03:11:35.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.208+0000 7fcc67243640 1 -- 172.21.15.120:0/3885866344 wait complete. 2024-07-27T03:11:35.221 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:11:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.332+0000 7f8c4eb00640 1 -- 172.21.15.120:0/1545203360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c480b2c40 msgr2=0x7f8c480d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.332+0000 7f8c4eb00640 1 --2- 172.21.15.120:0/1545203360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c480b2c40 0x7f8c480d09c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8c480d24d0 tx=0x7f8c3802a530 comp rx=0 tx=0).stop 2024-07-27T03:11:35.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.333+0000 7f8c4eb00640 1 -- 172.21.15.120:0/1545203360 shutdown_connections 2024-07-27T03:11:35.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.333+0000 7f8c4eb00640 1 --2- 172.21.15.120:0/1545203360 >> v2:172.21.15.121:3300/0 conn(0x7f8c480d0f00 0x7f8c480cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.333+0000 7f8c4eb00640 1 --2- 172.21.15.120:0/1545203360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c480b2c40 0x7f8c480d09c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.333+0000 7f8c4eb00640 1 -- 172.21.15.120:0/1545203360 >> 172.21.15.120:0/1545203360 conn(0x7f8c4808d690 msgr2=0x7f8c4809d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.333+0000 7f8c4eb00640 1 -- 172.21.15.120:0/1545203360 shutdown_connections 2024-07-27T03:11:35.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.333+0000 7f8c4eb00640 1 -- 172.21.15.120:0/1545203360 wait complete. 2024-07-27T03:11:35.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.334+0000 7f8c4eb00640 1 Processor -- start 2024-07-27T03:11:35.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.334+0000 7f8c4eb00640 1 -- start start 2024-07-27T03:11:35.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4eb00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c480b2c40 0x7f8c480caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4eb00640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c480b4740 0x7f8c48152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4eb00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c480d0f00 0x7f8c480b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4eb00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480b33c0 con 0x7f8c480b2c40 2024-07-27T03:11:35.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4eb00640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480d3100 con 0x7f8c480d0f00 2024-07-27T03:11:35.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4eb00640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8c480cf120 con 0x7f8c480b4740 2024-07-27T03:11:35.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4c89c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c480b2c40 0x7f8c480caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4c89c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c480b2c40 0x7f8c480caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42008/0 (socket says 172.21.15.120:42008) 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4c89c640 1 -- 172.21.15.120:0/335041786 learned_addr learned my addr 172.21.15.120:0/335041786 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c3ffff640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c480b4740 0x7f8c48152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4d09d640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c480d0f00 0x7f8c480b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4c89c640 1 -- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c480b4740 msgr2=0x7f8c48152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4c89c640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c480b4740 0x7f8c48152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4c89c640 1 -- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c480d0f00 msgr2=0x7f8c480b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4c89c640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c480d0f00 0x7f8c480b83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4c89c640 1 -- 172.21.15.120:0/335041786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c481f5610 con 0x7f8c480b2c40 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c4c89c640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c480b2c40 0x7f8c480caff0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c3c0 tx=0x7f8c4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.336+0000 7f8c3d7fa640 1 -- 172.21.15.120:0/335041786 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44017070 con 0x7f8c480b2c40 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.337+0000 7f8c3d7fa640 1 -- 172.21.15.120:0/335041786 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c440035f0 con 0x7f8c480b2c40 2024-07-27T03:11:35.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.337+0000 7f8c4eb00640 1 -- 172.21.15.120:0/335041786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c481f58f0 con 0x7f8c480b2c40 2024-07-27T03:11:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.337+0000 7f8c3d7fa640 1 -- 172.21.15.120:0/335041786 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44003a40 con 0x7f8c480b2c40 2024-07-27T03:11:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.337+0000 7f8c4eb00640 1 -- 172.21.15.120:0/335041786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c481f5eb0 con 0x7f8c480b2c40 2024-07-27T03:11:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.337+0000 7f8c4eb00640 1 -- 172.21.15.120:0/335041786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c480d09c0 con 0x7f8c480b2c40 2024-07-27T03:11:35.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.338+0000 7f8c3d7fa640 1 -- 172.21.15.120:0/335041786 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8c4401a070 con 0x7f8c480b2c40 2024-07-27T03:11:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.339+0000 7f8c3d7fa640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c34077010 0x7f8c34079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.339+0000 7f8c3d7fa640 1 -- 172.21.15.120:0/335041786 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f8c44097be0 con 0x7f8c480b2c40 2024-07-27T03:11:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.339+0000 7f8c3ffff640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c34077010 0x7f8c34079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.340+0000 7f8c3ffff640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c34077010 0x7f8c34079520 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8c38034000 tx=0x7f8c38004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.343+0000 7f8c3d7fa640 1 -- 172.21.15.120:0/335041786 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f8c480d1310 con 0x7f8c480b2c40 2024-07-27T03:11:35.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.562+0000 7f8c4eb00640 1 -- 172.21.15.120:0/335041786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c4806df70 con 0x7f8c480b2c40 2024-07-27T03:11:35.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.563+0000 7f8c3d7fa640 1 -- 172.21.15.120:0/335041786 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5273 (secure 0 0 0) 0x7f8c44060e70 con 0x7f8c480b2c40 2024-07-27T03:11:35.565 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:11:35.566 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":55,"btime":"2024-07-27T03:11:34:157246+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/3598257167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3598257167},{"type":"v1","addr":"172.21.15.121:6836","nonce":3598257167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:11:19.459319+0000","modified":"2024-07-27T03:11:34.157239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5733,"mds_1":5473,"mds_2":5458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5458":{"gid":5458,"name":"a","rank":2,"incarnation":54,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/2987877930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2987877930},{"type":"v1","addr":"172.21.15.120:6834","nonce":2987877930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5473":{"gid":5473,"name":"b","rank":1,"incarnation":52,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6837/1057652547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1057652547},{"type":"v1","addr":"172.21.15.121:6837","nonce":1057652547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/3550669358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":3550669358},{"type":"v1","addr":"172.21.15.120:6835","nonce":3550669358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5733,"qdb_cluster":[5458,5473,5733]},"id":4}]} 2024-07-27T03:11:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 55 2024-07-27T03:11:35.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 -- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c34077010 msgr2=0x7f8c34079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c34077010 0x7f8c34079520 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8c38034000 tx=0x7f8c38004730 comp rx=0 tx=0).stop 2024-07-27T03:11:35.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 -- 172.21.15.120:0/335041786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c480b2c40 msgr2=0x7f8c480caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c480b2c40 0x7f8c480caff0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c3c0 tx=0x7f8c4400c880 comp rx=0 tx=0).stop 2024-07-27T03:11:35.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 -- 172.21.15.120:0/335041786 shutdown_connections 2024-07-27T03:11:35.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8c34077010 0x7f8c34079520 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c480d0f00 0x7f8c480b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c480b4740 0x7f8c48152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 --2- 172.21.15.120:0/335041786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c480b2c40 0x7f8c480caff0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 -- 172.21.15.120:0/335041786 >> 172.21.15.120:0/335041786 conn(0x7f8c4808d690 msgr2=0x7f8c480cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 -- 172.21.15.120:0/335041786 shutdown_connections 2024-07-27T03:11:35.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.565+0000 7f8c4eb00640 1 -- 172.21.15.120:0/335041786 wait complete. 2024-07-27T03:11:35.579 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs balance_automate true 2024-07-27T03:11:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.693+0000 7f546696b640 1 -- 172.21.15.120:0/489278992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5460156070 msgr2=0x7f5460156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.693+0000 7f546696b640 1 --2- 172.21.15.120:0/489278992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5460156070 0x7f5460156480 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f54600d1de0 tx=0x7f545802a820 comp rx=0 tx=0).stop 2024-07-27T03:11:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.693+0000 7f546696b640 1 -- 172.21.15.120:0/489278992 shutdown_connections 2024-07-27T03:11:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.693+0000 7f546696b640 1 --2- 172.21.15.120:0/489278992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5460156070 0x7f5460156480 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.693+0000 7f546696b640 1 --2- 172.21.15.120:0/489278992 >> v2:172.21.15.121:3300/0 conn(0x7f54600718b0 0x7f546015d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.693+0000 7f546696b640 1 -- 172.21.15.120:0/489278992 >> 172.21.15.120:0/489278992 conn(0x7f54600d0df0 msgr2=0x7f54600d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.693+0000 7f546696b640 1 -- 172.21.15.120:0/489278992 shutdown_connections 2024-07-27T03:11:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.693+0000 7f546696b640 1 -- 172.21.15.120:0/489278992 wait complete. 2024-07-27T03:11:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.695+0000 7f546696b640 1 Processor -- start 2024-07-27T03:11:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.695+0000 7f546696b640 1 -- start start 2024-07-27T03:11:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.696+0000 7f546696b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f546006c780 0x7f5460153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.696+0000 7f546696b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54600718b0 0x7f54600af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.696+0000 7f546696b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5460156070 0x7f54600afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.696+0000 7f546696b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f54600cee10 con 0x7f54600718b0 2024-07-27T03:11:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.696+0000 7f546696b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f54600cec90 con 0x7f546006c780 2024-07-27T03:11:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.696+0000 7f546696b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f54601569c0 con 0x7f5460156070 2024-07-27T03:11:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54600718b0 0x7f54600af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54600718b0 0x7f54600af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42032/0 (socket says 172.21.15.120:42032) 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545f7fe640 1 -- 172.21.15.120:0/1894532509 learned_addr learned my addr 172.21.15.120:0/1894532509 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f5464f08640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5460156070 0x7f54600afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545ffff640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f546006c780 0x7f5460153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545f7fe640 1 -- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5460156070 msgr2=0x7f54600afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545f7fe640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5460156070 0x7f54600afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545f7fe640 1 -- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f546006c780 msgr2=0x7f5460153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545f7fe640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f546006c780 0x7f5460153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545f7fe640 1 -- 172.21.15.120:0/1894532509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54601f6d00 con 0x7f54600718b0 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545f7fe640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54600718b0 0x7f54600af500 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f545400c3f0 tx=0x7f5454001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545cff9640 1 -- 172.21.15.120:0/1894532509 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454017070 con 0x7f54600718b0 2024-07-27T03:11:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545cff9640 1 -- 172.21.15.120:0/1894532509 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54540035f0 con 0x7f54600718b0 2024-07-27T03:11:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f546696b640 1 -- 172.21.15.120:0/1894532509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54601f6fe0 con 0x7f54600718b0 2024-07-27T03:11:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f545cff9640 1 -- 172.21.15.120:0/1894532509 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454003a80 con 0x7f54600718b0 2024-07-27T03:11:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.697+0000 7f546696b640 1 -- 172.21.15.120:0/1894532509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54600c8180 con 0x7f54600718b0 2024-07-27T03:11:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.698+0000 7f546696b640 1 -- 172.21.15.120:0/1894532509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546015d2a0 con 0x7f54600718b0 2024-07-27T03:11:35.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.699+0000 7f545cff9640 1 -- 172.21.15.120:0/1894532509 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f545401a070 con 0x7f54600718b0 2024-07-27T03:11:35.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.700+0000 7f545cff9640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f544c077010 0x7f544c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:35.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.700+0000 7f545cff9640 1 -- 172.21.15.120:0/1894532509 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f5454097bf0 con 0x7f54600718b0 2024-07-27T03:11:35.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.700+0000 7f545ffff640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f544c077010 0x7f544c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:35.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.700+0000 7f545ffff640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f544c077010 0x7f544c079520 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f545000bb50 tx=0x7f545000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:35.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.704+0000 7f545cff9640 1 -- 172.21.15.120:0/1894532509 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f54540607b0 con 0x7f54600718b0 2024-07-27T03:11:35.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:35.922+0000 7f546696b640 1 -- 172.21.15.120:0/1894532509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f5460153e50 con 0x7f54600718b0 2024-07-27T03:11:36.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.170+0000 7f545cff9640 1 -- 172.21.15.120:0/1894532509 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v56) ==== 117+0+0 (secure 0 0 0) 0x7f5454069040 con 0x7f54600718b0 2024-07-27T03:11:36.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 -- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f544c077010 msgr2=0x7f544c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f544c077010 0x7f544c079520 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f545000bb50 tx=0x7f545000b2e0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 -- 172.21.15.120:0/1894532509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54600718b0 msgr2=0x7f54600af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54600718b0 0x7f54600af500 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f545400c3f0 tx=0x7f5454001e70 comp rx=0 tx=0).stop 2024-07-27T03:11:36.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 -- 172.21.15.120:0/1894532509 shutdown_connections 2024-07-27T03:11:36.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f544c077010 0x7f544c079520 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f54600718b0 0x7f54600af500 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5460156070 0x7f54600afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 --2- 172.21.15.120:0/1894532509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f546006c780 0x7f5460153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 -- 172.21.15.120:0/1894532509 >> 172.21.15.120:0/1894532509 conn(0x7f54600d0df0 msgr2=0x7f54600cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:36.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 -- 172.21.15.120:0/1894532509 shutdown_connections 2024-07-27T03:11:36.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.173+0000 7f546696b640 1 -- 172.21.15.120:0/1894532509 wait complete. 2024-07-27T03:11:36.187 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/a') 2024-07-27T03:11:36.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:11:36.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:36.249 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_export_ephemeral_random True 2024-07-27T03:11:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.363+0000 7f4c50718640 1 -- 172.21.15.120:0/1335235240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c34004d20 msgr2=0x7f4c34005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.363+0000 7f4c50718640 1 --2- 172.21.15.120:0/1335235240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c34004d20 0x7f4c34005170 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4c44001800 tx=0x7f4c34006940 comp rx=0 tx=0).stop 2024-07-27T03:11:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.363+0000 7f4c4ecb5640 1 -- 172.21.15.120:0/1335235240 reap_dead start 2024-07-27T03:11:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.364+0000 7f4c50718640 1 -- 172.21.15.120:0/1335235240 shutdown_connections 2024-07-27T03:11:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.364+0000 7f4c50718640 1 -- 172.21.15.120:0/1335235240 >> 172.21.15.120:0/1335235240 conn(0x7f4c480b1a10 msgr2=0x7f4c480b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.364+0000 7f4c50718640 1 -- 172.21.15.120:0/1335235240 shutdown_connections 2024-07-27T03:11:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.364+0000 7f4c50718640 1 -- 172.21.15.120:0/1335235240 wait complete. 2024-07-27T03:11:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.365+0000 7f4c50718640 1 Processor -- start 2024-07-27T03:11:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.365+0000 7f4c50718640 1 -- start start 2024-07-27T03:11:36.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c50718640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c34004d20 0x7f4c481f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:36.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c50718640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c481ea5a0 0x7f4c480b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c50718640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c480b4b00 0x7f4c481e4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c50718640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4806e600 con 0x7f4c34004d20 2024-07-27T03:11:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c50718640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4806e480 con 0x7f4c481ea5a0 2024-07-27T03:11:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c50718640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4806e780 con 0x7f4c480b4b00 2024-07-27T03:11:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4e4b4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c34004d20 0x7f4c481f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4e4b4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c34004d20 0x7f4c481f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42048/0 (socket says 172.21.15.120:42048) 2024-07-27T03:11:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4e4b4640 1 -- 172.21.15.120:0/2609518779 learned_addr learned my addr 172.21.15.120:0/2609518779 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4dcb3640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c481ea5a0 0x7f4c480b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4ecb5640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c480b4b00 0x7f4c481e4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4e4b4640 1 -- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c480b4b00 msgr2=0x7f4c481e4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4e4b4640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c480b4b00 0x7f4c481e4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4e4b4640 1 -- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c481ea5a0 msgr2=0x7f4c480b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4e4b4640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c481ea5a0 0x7f4c480b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4e4b4640 1 -- 172.21.15.120:0/2609518779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c480b4f10 con 0x7f4c34004d20 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4ecb5640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c480b4b00 0x7f4c481e4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c4e4b4640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c34004d20 0x7f4c481f46b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4c4402aa40 tx=0x7f4c440060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c3effd640 1 -- 172.21.15.120:0/2609518779 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44003a00 con 0x7f4c34004d20 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c3effd640 1 -- 172.21.15.120:0/2609518779 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c44003c90 con 0x7f4c34004d20 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c3effd640 1 -- 172.21.15.120:0/2609518779 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c440336e0 con 0x7f4c34004d20 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c50718640 1 -- 172.21.15.120:0/2609518779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c481f0a70 con 0x7f4c34004d20 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.367+0000 7f4c50718640 1 -- 172.21.15.120:0/2609518779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c481f1030 con 0x7f4c34004d20 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.369+0000 7f4c50718640 1 -- 172.21.15.120:0/2609518779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4815e730 con 0x7f4c34004d20 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.369+0000 7f4c3effd640 1 -- 172.21.15.120:0/2609518779 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4c44045020 con 0x7f4c34004d20 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.369+0000 7f4c3effd640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c2c077010 0x7f4c2c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.370+0000 7f4c3effd640 1 -- 172.21.15.120:0/2609518779 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4c440b87c0 con 0x7f4c34004d20 2024-07-27T03:11:36.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.370+0000 7f4c4dcb3640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c2c077010 0x7f4c2c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:36.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.370+0000 7f4c4dcb3640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c2c077010 0x7f4c2c079520 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4c4815a620 tx=0x7f4c38006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:36.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.374+0000 7f4c3effd640 1 -- 172.21.15.120:0/2609518779 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f4c480b4f10 con 0x7f4c34004d20 2024-07-27T03:11:36.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.556+0000 7f4c50718640 1 -- 172.21.15.120:0/2609518779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mds_export_ephemeral_random}] v 0) -- 0x7f4c480b30d0 con 0x7f4c34004d20 2024-07-27T03:11:36.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.560+0000 7f4c3effd640 1 -- 172.21.15.120:0/2609518779 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_export_ephemeral_random}]=0 v34)=0 v34) ==== 128+0+0 (secure 0 0 0) 0x7f4c440819c0 con 0x7f4c34004d20 2024-07-27T03:11:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 -- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c2c077010 msgr2=0x7f4c2c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c2c077010 0x7f4c2c079520 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4c4815a620 tx=0x7f4c38006040 comp rx=0 tx=0).stop 2024-07-27T03:11:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 -- 172.21.15.120:0/2609518779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c34004d20 msgr2=0x7f4c481f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c34004d20 0x7f4c481f46b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4c4402aa40 tx=0x7f4c440060e0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 -- 172.21.15.120:0/2609518779 shutdown_connections 2024-07-27T03:11:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4c2c077010 0x7f4c2c079520 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c480b4b00 0x7f4c481e4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c481ea5a0 0x7f4c480b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 --2- 172.21.15.120:0/2609518779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c34004d20 0x7f4c481f46b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 -- 172.21.15.120:0/2609518779 >> 172.21.15.120:0/2609518779 conn(0x7f4c480b1a10 msgr2=0x7f4c480aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 -- 172.21.15.120:0/2609518779 shutdown_connections 2024-07-27T03:11:36.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.563+0000 7f4c50718640 1 -- 172.21.15.120:0/2609518779 wait complete. 2024-07-27T03:11:36.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_export_ephemeral_random_max 1.0 2024-07-27T03:11:36.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.692+0000 7fb519205640 1 -- 172.21.15.120:0/1506349915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb500004800 msgr2=0x7fb500004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.692+0000 7fb519205640 1 --2- 172.21.15.120:0/1506349915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb500004800 0x7fb500004c10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb5140b4b50 tx=0x7fb500005830 comp rx=0 tx=0).stop 2024-07-27T03:11:36.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.692+0000 7fb51359e640 1 -- 172.21.15.120:0/1506349915 reap_dead start 2024-07-27T03:11:36.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.692+0000 7fb519205640 1 -- 172.21.15.120:0/1506349915 shutdown_connections 2024-07-27T03:11:36.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.692+0000 7fb519205640 1 -- 172.21.15.120:0/1506349915 >> 172.21.15.120:0/1506349915 conn(0x7fb51408d690 msgr2=0x7fb51409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:36.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.692+0000 7fb519205640 1 -- 172.21.15.120:0/1506349915 shutdown_connections 2024-07-27T03:11:36.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.692+0000 7fb519205640 1 -- 172.21.15.120:0/1506349915 wait complete. 2024-07-27T03:11:36.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.694+0000 7fb519205640 1 Processor -- start 2024-07-27T03:11:36.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.694+0000 7fb519205640 1 -- start start 2024-07-27T03:11:36.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.695+0000 7fb519205640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb500004800 0x7fb514159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:36.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.695+0000 7fb519205640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb51415b850 0x7fb514159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:36.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.695+0000 7fb519205640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb5140b8af0 0x7fb5140b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.695+0000 7fb519205640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb5140b2fd0 con 0x7fb500004800 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.695+0000 7fb519205640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb5140b2e50 con 0x7fb51415b850 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.695+0000 7fb519205640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb5140cebe0 con 0x7fb5140b8af0 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.695+0000 7fb512d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb500004800 0x7fb514159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.695+0000 7fb512d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb500004800 0x7fb514159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42070/0 (socket says 172.21.15.120:42070) 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.695+0000 7fb512d9d640 1 -- 172.21.15.120:0/1181926419 learned_addr learned my addr 172.21.15.120:0/1181926419 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb50bfff640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb51415b850 0x7fb514159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb51359e640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb5140b8af0 0x7fb5140b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb512d9d640 1 -- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb5140b8af0 msgr2=0x7fb5140b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb512d9d640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb5140b8af0 0x7fb5140b7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb512d9d640 1 -- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb51415b850 msgr2=0x7fb514159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb512d9d640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb51415b850 0x7fb514159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb512d9d640 1 -- 172.21.15.120:0/1181926419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5140cbb30 con 0x7fb500004800 2024-07-27T03:11:36.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb50bfff640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb51415b850 0x7fb514159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:11:36.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb512d9d640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb500004800 0x7fb514159cc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb50400fa00 tx=0x7fb50400fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:36.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb50b7fe640 1 -- 172.21.15.120:0/1181926419 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50400bcb0 con 0x7fb500004800 2024-07-27T03:11:36.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb50b7fe640 1 -- 172.21.15.120:0/1181926419 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb504011440 con 0x7fb500004800 2024-07-27T03:11:36.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb519205640 1 -- 172.21.15.120:0/1181926419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5140cbe10 con 0x7fb500004800 2024-07-27T03:11:36.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb50b7fe640 1 -- 172.21.15.120:0/1181926419 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504011810 con 0x7fb500004800 2024-07-27T03:11:36.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.696+0000 7fb519205640 1 -- 172.21.15.120:0/1181926419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5140cc0f0 con 0x7fb500004800 2024-07-27T03:11:36.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.697+0000 7fb519205640 1 -- 172.21.15.120:0/1181926419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5140d1520 con 0x7fb500004800 2024-07-27T03:11:36.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.698+0000 7fb50b7fe640 1 -- 172.21.15.120:0/1181926419 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb504019020 con 0x7fb500004800 2024-07-27T03:11:36.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.698+0000 7fb50b7fe640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb4f4077040 0x7fb4f4079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:11:36.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.698+0000 7fb50b7fe640 1 -- 172.21.15.120:0/1181926419 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb504099440 con 0x7fb500004800 2024-07-27T03:11:36.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.698+0000 7fb50bfff640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb4f4077040 0x7fb4f4079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:11:36.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.699+0000 7fb50bfff640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb4f4077040 0x7fb4f4079550 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc035000 tx=0x7fb4fc02d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:11:36.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.703+0000 7fb50b7fe640 1 -- 172.21.15.120:0/1181926419 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb5140d1520 con 0x7fb500004800 2024-07-27T03:11:36.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.884+0000 7fb519205640 1 -- 172.21.15.120:0/1181926419 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mds_export_ephemeral_random_max}] v 0) -- 0x7fb5140d2bf0 con 0x7fb500004800 2024-07-27T03:11:36.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.888+0000 7fb50b7fe640 1 -- 172.21.15.120:0/1181926419 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_export_ephemeral_random_max}]=0 v35)=0 v35) ==== 131+0+0 (secure 0 0 0) 0x7fb504062520 con 0x7fb500004800 2024-07-27T03:11:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.890+0000 7fb519205640 1 -- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb4f4077040 msgr2=0x7fb4f4079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.890+0000 7fb519205640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb4f4077040 0x7fb4f4079550 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc035000 tx=0x7fb4fc02d040 comp rx=0 tx=0).stop 2024-07-27T03:11:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.890+0000 7fb519205640 1 -- 172.21.15.120:0/1181926419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb500004800 msgr2=0x7fb514159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:11:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.890+0000 7fb519205640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb500004800 0x7fb514159cc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb50400fa00 tx=0x7fb50400fec0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.890+0000 7fb519205640 1 -- 172.21.15.120:0/1181926419 shutdown_connections 2024-07-27T03:11:36.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.890+0000 7fb519205640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb4f4077040 0x7fb4f4079550 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.890+0000 7fb519205640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb5140b8af0 0x7fb5140b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.890+0000 7fb519205640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb51415b850 0x7fb514159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.890+0000 7fb519205640 1 --2- 172.21.15.120:0/1181926419 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb500004800 0x7fb514159cc0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:11:36.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.890+0000 7fb519205640 1 -- 172.21.15.120:0/1181926419 >> 172.21.15.120:0/1181926419 conn(0x7fb51408d690 msgr2=0x7fb5140cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:11:36.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.891+0000 7fb519205640 1 -- 172.21.15.120:0/1181926419 shutdown_connections 2024-07-27T03:11:36.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:36.891+0000 7fb519205640 1 -- 172.21.15.120:0/1181926419 wait complete. 2024-07-27T03:11:36.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:11:36.905 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.bal.mask -v 2 1) 2024-07-27T03:11:36.922 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:36.922 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:36.978 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:36.978 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:36.978 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:36.979 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:36.980 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:36.981 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:36.981 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:37.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:37.561 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:37.561 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:37.617 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:37.617 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:37.617 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:37.617 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:37.618 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:37.619 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:37.620 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:37.620 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:37.620 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:38.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:38.452 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:38.452 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:38.509 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:38.510 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:38.511 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:38.511 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:38.511 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:38.511 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:38.511 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:38.511 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:38.511 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:38.511 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:38.511 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:38.511 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:38.511 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:39.438 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:39.438 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:39.494 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:39.495 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:39.496 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:39.496 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:39.496 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:39.496 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:39.496 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:39.496 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:39.496 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:39.496 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:40.354 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:40.355 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:40.410 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:40.411 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:40.412 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:40.413 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:40.413 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:40.413 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:40.413 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:40.890 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:11:40.892 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:11:41.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:41.367 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:41.367 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:41.385 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:41.385 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:41.385 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:41.385 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:41.386 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:41.386 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:41.386 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:41.386 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:41.386 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:11:41.386 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:41.387 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:41.387 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:41.387 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:41.387 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:41.387 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:41.388 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:41.388 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:41.388 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:41.388 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:41.388 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:41.389 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:41.389 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:41.389 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:41.389 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:41.389 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:41.390 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:41.390 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:41.390 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:41.390 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:41.390 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:41.391 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:41.391 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:41.391 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:41.391 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:41.391 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:41.391 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:42.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:42.413 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:42.413 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:42.469 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:42.470 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:42.470 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:42.470 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:42.470 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:42.470 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:42.470 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:42.470 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:42.470 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:11:42.470 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:42.470 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:42.470 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:42.471 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:42.472 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:43.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:43.478 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:43.478 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:43.534 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:43.534 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:43.534 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:43.535 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:43.536 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:43.537 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:43.537 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:43.537 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:43.537 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:43.537 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:44.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:44.545 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:44.545 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:44.601 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:44.601 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:44.601 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:44.601 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:44.601 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:44.602 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:44.603 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:44.604 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:44.604 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:44.604 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:45.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:45.678 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:45.678 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:45.735 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:45.736 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:45.737 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:45.737 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:45.737 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:45.737 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:45.737 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:45.737 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:45.737 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:45.737 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:46.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:46.799 INFO:tasks.cephfs.cephfs_test_case:_wait_subtrees test=[('/1', 2)] status={ "btime": "2024-07-27T03:11:34:157246+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 4, "epoch": 55, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 4, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-07-27T03:11:19.459319+0000", "damaged": [], "data_pools": [ 9 ], "enabled": true, "epoch": 55, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2 ], "info": { "gid_5458": { "addr": "172.21.15.120:6834/2987877930", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6832", "nonce": 2987877930, "type": "v2" }, { "addr": "172.21.15.120:6834", "nonce": 2987877930, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5458, "incarnation": 54, "join_fscid": -1, "name": "a", "rank": 2, "state": "up:active", "state_seq": 6 }, "gid_5473": { "addr": "172.21.15.121:6837/1057652547", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6834", "nonce": 1057652547, "type": "v2" }, { "addr": "172.21.15.121:6837", "nonce": 1057652547, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5473, "incarnation": 52, "join_fscid": -1, "name": "b", "rank": 1, "state": "up:active", "state_seq": 6 }, "gid_5733": { "addr": "172.21.15.120:6835/3550669358", "addrs": { "addrvec": [ { "addr": "172.21.15.120:6833", "nonce": 3550669358, "type": "v2" }, { "addr": "172.21.15.120:6835", "nonce": 3550669358, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5733, "incarnation": 47, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 3, "max_xattr_size": 65536, "metadata_pool": 8, "modified": "2024-07-27T03:11:34.157239+0000", "qdb_cluster": [ 5458, 5473, 5733 ], "qdb_leader": 5733, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5733, "mds_1": 5473, "mds_2": 5458 } } } ], "standbys": [ { "addr": "172.21.15.121:6836/3598257167", "addrs": { "addrvec": [ { "addr": "172.21.15.121:6835", "nonce": 3598257167, "type": "v2" }, { "addr": "172.21.15.121:6836", "nonce": 3598257167, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 46, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5210, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } rank=2 timeout=30 sleep=2 action=None path=None 2024-07-27T03:11:46.800 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-07-27T03:11:46.964 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"3453","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"7605","version":"7605","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1,"authpin":0},"nref":4}}] 2024-07-27T03:11:46.964 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3453" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "7605", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7605" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-07-27T03:11:46.964 INFO:tasks.cephfs.cephfs_test_case:[('/1', 2)] =?= [('/1', 2)] 2024-07-27T03:11:46.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:11:46.965 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin.random -v 1.0 1) 2024-07-27T03:11:56.982 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/0') 2024-07-27T03:11:57.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:11:57.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:57.054 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:57.054 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:57.071 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:57.071 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/0/file" 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:57.072 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:57.073 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:57.074 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:57.074 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:57.074 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:57.074 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:57.074 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:57.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:57.676 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/1') 2024-07-27T03:11:57.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:11:57.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:57.774 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:57.774 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:57.790 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:57.790 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:57.790 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:57.790 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:57.790 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:57.790 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/1/file" 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:57.791 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:57.792 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:58.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:58.376 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/2') 2024-07-27T03:11:58.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:11:58.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:58.474 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:58.475 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:58.490 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:58.490 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:58.490 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/2/file" 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:58.491 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:58.492 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:58.493 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:58.493 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:59.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:59.090 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/3') 2024-07-27T03:11:59.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:11:59.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:59.189 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:59.189 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:59.205 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:59.205 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:59.205 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/3/file" 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:59.206 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:59.207 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:59.208 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:11:59.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:59.794 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/4') 2024-07-27T03:11:59.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:11:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:11:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:11:59.893 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:11:59.893 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:11:59.908 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/4/file" 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:59.909 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:11:59.910 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:59.911 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:59.911 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:11:59.911 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:11:59.911 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:11:59.911 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:11:59.911 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:11:59.911 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:11:59.911 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:11:59.911 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:00.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:00.473 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/5') 2024-07-27T03:12:00.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:12:00.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:00.570 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:00.571 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:00.586 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:00.586 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:00.586 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/5/file" 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:00.587 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:00.588 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:00.589 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:00.589 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:00.589 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:00.589 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:01.155 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/6') 2024-07-27T03:12:01.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:12:01.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:01.253 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:01.253 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:01.270 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:01.270 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:01.270 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:01.270 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:01.270 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:01.270 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:01.270 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:01.270 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:01.270 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/6/file" 2024-07-27T03:12:01.270 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:01.271 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:01.271 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:01.271 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:01.271 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:01.271 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:01.271 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:01.271 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:01.271 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:01.272 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:01.272 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:01.273 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:01.274 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:01.274 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:01.274 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:01.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:01.828 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/7') 2024-07-27T03:12:01.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:12:01.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:01.926 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:01.927 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:01.942 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/7/file" 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:01.943 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:01.944 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:01.945 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:01.945 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:01.945 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:01.945 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:01.945 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:01.945 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:01.945 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:01.945 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:02.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:02.500 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/8') 2024-07-27T03:12:02.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:12:02.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:02.599 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:02.599 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:02.615 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/8/file" 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:02.616 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:02.617 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:02.618 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:02.618 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:02.618 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:02.618 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:02.618 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:02.618 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:02.618 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:03.171 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/9') 2024-07-27T03:12:03.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:12:03.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:03.269 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:03.270 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:03.286 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/9/file" 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:03.287 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:03.288 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:03.289 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:03.289 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:03.289 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:03.289 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:03.289 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:03.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:03.846 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-07-27T03:12:04.010 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":0,"dir":{"path":"/1/4","dirfrag":"0x30000000388","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"3453","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/1","dirfrag":"0x30000000259","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/0","dirfrag":"0x30000000000","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"11636","version":"11636","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"1":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":2,"dir":{"path":"/1/2","dirfrag":"0x300000002be","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":2,"dir":{"path":"/1/3","dirfrag":"0x30000000323","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-07-27T03:12:04.011 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x30000000388", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1/4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3453" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000259", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/1", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/0", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "1": 2 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "11636", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "11636" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x300000002be", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1/2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x30000000323", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1/3", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": true } ] 2024-07-27T03:12:04.012 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 0, "dir": { "path": "/1/4", "dirfrag": "0x30000000388", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 1, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds2", "dirfrag": "0x102", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "3453", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/1", "dirfrag": "0x30000000259", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/0", "dirfrag": "0x30000000000", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "11636", "version": "11636", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 1, "1": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 2, "dir": { "path": "/1/2", "dirfrag": "0x300000002be", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 1, "authpin": 0 }, "nref": 3 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 2, "dir": { "path": "/1/3", "dirfrag": "0x30000000323", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 1, "authpin": 0 }, "nref": 3 } } ] 2024-07-27T03:12:04.012 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-07-27T03:12:04.137 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/0","dirfrag":"0x30000000000","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/1","dirfrag":"0x30000000259","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"3478","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"0","version":"9621","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}}] 2024-07-27T03:12:04.137 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/0", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000259", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/1", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3478" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "9621" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-07-27T03:12:04.138 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/0", "dirfrag": "0x30000000000", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/1", "dirfrag": "0x30000000259", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "3478", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "0", "version": "9621", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dnwaiter": 0, "child": 1, "subtree": 1 }, "nref": 2 } } ] 2024-07-27T03:12:04.138 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-07-27T03:12:04.263 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"3488","version":"3488","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1,"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3459","version":"3459","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"dnwaiter":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":0,"dir":{"path":"/1/4","dirfrag":"0x30000000388","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-07-27T03:12:04.264 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1, "2": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "3488", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3488" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "dnwaiter": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "3459", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3459" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x30000000388", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": true } ] 2024-07-27T03:12:04.264 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "3488", "version": "3488", "committing_version": "1", "committed_version": "1", "is_rep": true, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1, "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds0", "dirfrag": "0x100", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "3459", "version": "3459", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "dnwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 0, "dir": { "path": "/1/4", "dirfrag": "0x30000000388", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } } ] 2024-07-27T03:12:04.264 INFO:tasks.cephfs.cephfs_test_case:len=5 [{'is_auth': True, 'auth_first': 2, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 2, 'dir': {'path': '/1/2', 'dirfrag': '0x300000002be', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '2', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [2, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1, 'subtree': 1, 'dirty': 1, 'authpin': 0}, 'nref': 3}}, {'is_auth': True, 'auth_first': 2, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 2, 'dir': {'path': '/1/3', 'dirfrag': '0x30000000323', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '2', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [2, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1, 'subtree': 1, 'dirty': 1, 'authpin': 0}, 'nref': 3}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/0', 'dirfrag': '0x30000000000', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/1', 'dirfrag': '0x30000000259', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 0, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 0, 'dir': {'path': '/1/4', 'dirfrag': '0x30000000388', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '0', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}] 2024-07-27T03:12:09.266 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-07-27T03:12:09.404 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":0,"dir":{"path":"/1/4","dirfrag":"0x30000000388","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"3453","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/1","dirfrag":"0x30000000259","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/0","dirfrag":"0x30000000000","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"11637","version":"11637","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"1":2}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":2,"dir":{"path":"/1/2","dirfrag":"0x300000002be","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":2,"dir":{"path":"/1/3","dirfrag":"0x30000000323","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":0,"dir":{"path":"/1/5","dirfrag":"0x300000003ed","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/6","dirfrag":"0x30000000452","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/7","dirfrag":"0x300000004b7","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":2,"dir":{"path":"/1/8","dirfrag":"0x3000000051c","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/9","dirfrag":"0x30000000581","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-07-27T03:12:09.405 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x30000000388", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1/4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3453" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000259", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/1", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/0", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "1": 2 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "11637", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "11637" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x300000002be", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1/2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x30000000323", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1/3", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x300000003ed", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/5", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000452", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x300000004b7", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/7", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x3000000051c", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/1/8", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000581", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/9", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": true } ] 2024-07-27T03:12:09.406 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 0, "dir": { "path": "/1/4", "dirfrag": "0x30000000388", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 1, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds2", "dirfrag": "0x102", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "3453", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/1", "dirfrag": "0x30000000259", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/0", "dirfrag": "0x30000000000", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "11637", "version": "11637", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 1, "1": 2 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 2, "dir": { "path": "/1/2", "dirfrag": "0x300000002be", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 1, "authpin": 0 }, "nref": 3 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 2, "dir": { "path": "/1/3", "dirfrag": "0x30000000323", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 1, "authpin": 0 }, "nref": 3 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 0, "dir": { "path": "/1/5", "dirfrag": "0x300000003ed", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/6", "dirfrag": "0x30000000452", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/7", "dirfrag": "0x300000004b7", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 2, "dir": { "path": "/1/8", "dirfrag": "0x3000000051c", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 1, "authpin": 0 }, "nref": 3 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/9", "dirfrag": "0x30000000581", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 0, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 1 } } ] 2024-07-27T03:12:09.406 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-07-27T03:12:09.544 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/0","dirfrag":"0x30000000000","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/1","dirfrag":"0x30000000259","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/7","dirfrag":"0x300000004b7","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/6","dirfrag":"0x30000000452","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"3478","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"0","version":"9621","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":2},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/9","dirfrag":"0x30000000581","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-07-27T03:12:09.544 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/0", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000259", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/1", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x300000004b7", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/7", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000452", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3478" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "snapid_first": 2, "states": [], "version": "9621" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000581", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/9", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true } ] 2024-07-27T03:12:09.545 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/0", "dirfrag": "0x30000000000", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/1", "dirfrag": "0x30000000259", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/7", "dirfrag": "0x300000004b7", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/6", "dirfrag": "0x30000000452", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "3478", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "0", "version": "9621", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 2 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "dnwaiter": 0, "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/9", "dirfrag": "0x30000000581", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } } ] 2024-07-27T03:12:09.545 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-07-27T03:12:09.671 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"3490","version":"3490","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1,"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":0,"dir":{"path":"/1/5","dirfrag":"0x300000003ed","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"2","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3459","version":"3459","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"dnwaiter":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":0,"dir":{"path":"/1/4","dirfrag":"0x30000000388","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-07-27T03:12:09.672 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1, "2": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "3490", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3490" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x300000003ed", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/5", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "2", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "dnwaiter": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "3459", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3459" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x30000000388", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": true } ] 2024-07-27T03:12:09.673 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "3490", "version": "3490", "committing_version": "1", "committed_version": "1", "is_rep": true, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1, "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds0", "dirfrag": "0x100", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 0, "dir": { "path": "/1/5", "dirfrag": "0x300000003ed", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "2", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "3459", "version": "3459", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "dnwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 0, "dir": { "path": "/1/4", "dirfrag": "0x30000000388", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } } ] 2024-07-27T03:12:09.673 INFO:tasks.cephfs.cephfs_test_case:len=10 [{'is_auth': True, 'auth_first': 2, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 2, 'dir': {'path': '/1/2', 'dirfrag': '0x300000002be', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '2', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [2, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1, 'subtree': 1, 'dirty': 1, 'authpin': 0}, 'nref': 3}}, {'is_auth': True, 'auth_first': 2, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 2, 'dir': {'path': '/1/3', 'dirfrag': '0x30000000323', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '2', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [2, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1, 'subtree': 1, 'dirty': 1, 'authpin': 0}, 'nref': 3}}, {'is_auth': True, 'auth_first': 2, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 2, 'dir': {'path': '/1/8', 'dirfrag': '0x3000000051c', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '2', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {}}, 'replica_state': {'authority': [2, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1, 'subtree': 1, 'dirty': 1, 'authpin': 0}, 'nref': 3}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/0', 'dirfrag': '0x30000000000', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/1', 'dirfrag': '0x30000000259', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/7', 'dirfrag': '0x300000004b7', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/6', 'dirfrag': '0x30000000452', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/9', 'dirfrag': '0x30000000581', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 0, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 0, 'dir': {'path': '/1/5', 'dirfrag': '0x300000003ed', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '0', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 0, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 0, 'dir': {'path': '/1/4', 'dirfrag': '0x30000000388', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '0', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}] 2024-07-27T03:12:09.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:09.673 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.bal.mask -v 1 1) 2024-07-27T03:12:09.690 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:09.690 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:09.748 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:09.748 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:09.748 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:09.748 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:09.748 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:09.748 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:09.748 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:09.748 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:09.748 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:09.749 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:09.750 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:10.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:10.496 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:10.496 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:10.553 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:10.553 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:10.553 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:10.553 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:10.553 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:10.553 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:10.553 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:10.553 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:10.553 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:12:10.553 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:10.554 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:10.555 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:10.555 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:10.555 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:10.555 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:10.555 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:10.555 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:10.555 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:10.555 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:10.556 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:10.556 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:10.556 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:10.556 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:10.952 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:12:10.954 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:12:11.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:11.320 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:11.320 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:11.337 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:11.338 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:11.338 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:11.338 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:11.338 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:11.338 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:11.338 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:11.338 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:11.338 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:11.338 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:11.338 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:11.338 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:11.339 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:12.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:12.123 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:12.123 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:12.179 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:12.180 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:12.180 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:12.180 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:12.180 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:12.180 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:12.180 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:12.180 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:12.180 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:12:12.180 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:12.180 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:12.181 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:12.182 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:12.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:12.938 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:12.938 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:12.995 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:12.996 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:12.997 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:12.997 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:12.997 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:12.997 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:12.997 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:12.997 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:12.997 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:12.997 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:13.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:13.688 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:13.688 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:13.744 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:13.745 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:13.746 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:13.746 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:13.746 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:13.746 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:13.746 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:13.746 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:13.746 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:13.746 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:13.746 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:13.746 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:13.747 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:13.747 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:13.747 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:13.747 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:13.747 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:13.747 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:13.747 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:13.747 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:13.747 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:13.747 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:13.747 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:14.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:14.457 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:14.458 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:14.513 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:14.514 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:14.515 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:14.516 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:14.516 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:14.516 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:14.516 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:14.516 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:14.516 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:14.516 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:14.516 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:15.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:15.243 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:15.243 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:15.299 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:15.299 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:15.300 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:15.301 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:15.302 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:15.302 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:15.302 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:15.302 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:15.302 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:16.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:16.068 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:16.068 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:16.125 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:16.125 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:16.125 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:16.125 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:16.125 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:16.125 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:16.125 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:16.125 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:16.125 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:12:16.125 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:16.125 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:16.126 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:16.127 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:16.127 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:16.127 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:16.127 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:16.127 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:16.127 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:16.127 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:16.127 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:16.127 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:16.127 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:16.127 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:16.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:16.948 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:16.948 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:17.004 DEBUG:teuthology.orchestra.run.smithi120:> stdin-killer -- python3 -c ' 2024-07-27T03:12:17.004 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> import uuid 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> n = 100 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = False 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> if 0 > 0: 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> create_hard_links = True 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> path = "/home/ubuntu/cephtest/mnt.0/1/file" 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> dpath = os.path.dirname(path) 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> fnameprefix = os.path.basename(path) 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> os.makedirs(dpath, exist_ok=True) 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> try: 2024-07-27T03:12:17.005 DEBUG:teuthology.orchestra.run.smithi120:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> for i in range(n): 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> with open(fpath, '"'"'w'"'"') as f: 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> f.write(f"{i}") 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> if True: 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> f.flush() 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(f.fileno()) 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> os.unlink(fpath) 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> if create_hard_links: 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> for j in range(0): 2024-07-27T03:12:17.006 DEBUG:teuthology.orchestra.run.smithi120:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-07-27T03:12:17.007 DEBUG:teuthology.orchestra.run.smithi120:> if False: 2024-07-27T03:12:17.007 DEBUG:teuthology.orchestra.run.smithi120:> os.fsync(dirfd) 2024-07-27T03:12:17.007 DEBUG:teuthology.orchestra.run.smithi120:> finally: 2024-07-27T03:12:17.007 DEBUG:teuthology.orchestra.run.smithi120:> os.close(dirfd) 2024-07-27T03:12:17.007 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-07-27T03:12:17.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:17.809 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-07-27T03:12:17.972 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":0,"dir":{"path":"/1/4","dirfrag":"0x30000000388","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"exportbound":0,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"3453","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"1","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"17247","version":"17247","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":2,"dir":{"path":"/1/2","dirfrag":"0x300000002be","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"exportbound":0,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":2,"dir":{"path":"/1/3","dirfrag":"0x30000000323","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"exportbound":0,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":2,"dir":{"path":"/1/8","dirfrag":"0x3000000051c","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"exportbound":0,"replicated":1,"dirty":1,"authpin":0},"nref":4}}] 2024-07-27T03:12:17.973 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x30000000388", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1/4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "exportbound": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "401", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3453" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "1", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "17247", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "17247" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x300000002be", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "exportbound": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x30000000323", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/3", "pins": { "authpin": 0, "child": 1, "dirty": 1, "exportbound": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x3000000051c", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/8", "pins": { "authpin": 0, "child": 1, "dirty": 1, "exportbound": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": true } ] 2024-07-27T03:12:17.973 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 0, "dir": { "path": "/1/4", "dirfrag": "0x30000000388", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 1, "frozen": 0, "subtree": 1, "exportbound": 0, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds2", "dirfrag": "0x102", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "2", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "3453", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "1", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "17247", "version": "17247", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 2, "dir": { "path": "/1/2", "dirfrag": "0x300000002be", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "exportbound": 0, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 2, "dir": { "path": "/1/3", "dirfrag": "0x30000000323", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "exportbound": 0, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 2, "dir": { "path": "/1/8", "dirfrag": "0x3000000051c", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1 } }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "exportbound": 0, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } } ] 2024-07-27T03:12:17.974 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-07-27T03:12:18.098 INFO:teuthology.orchestra.run.smithi121.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/0","dirfrag":"0x30000000000","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"importbound":0,"sticky":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/1","dirfrag":"0x30000000259","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"importbound":0,"sticky":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/7","dirfrag":"0x300000004b7","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"importbound":0,"sticky":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/6","dirfrag":"0x30000000452","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"importbound":0,"sticky":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"3478","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"1","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"19639","version":"19639","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"dnwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":1,"dir":{"path":"/1/9","dirfrag":"0x30000000581","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"importbound":0,"sticky":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":2,"dir":{"path":"/1/2","dirfrag":"0x300000002be","snapid_first":2,"projected_version":"0","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1,"importbound":0,"sticky":0},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":2,"dir":{"path":"/1/3","dirfrag":"0x30000000323","snapid_first":2,"projected_version":"0","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1,"importbound":0,"sticky":0},"nref":1}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":2,"dir":{"path":"/1/8","dirfrag":"0x3000000051c","snapid_first":2,"projected_version":"0","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1,"importbound":0,"sticky":0},"nref":1}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":0,"dir":{"path":"/1/4","dirfrag":"0x30000000388","snapid_first":2,"projected_version":"0","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1,"importbound":0,"sticky":0},"nref":1}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":0,"dir":{"path":"/1/5","dirfrag":"0x300000003ed","snapid_first":2,"projected_version":"0","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"subtree":1,"importbound":0,"sticky":0},"nref":1}}] 2024-07-27T03:12:18.099 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/0", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importbound": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "sticky": 0, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000259", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/1", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importbound": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "sticky": 0, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x300000004b7", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/7", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importbound": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "sticky": 0, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000452", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importbound": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "sticky": 0, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3478" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "1", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 1, "dnwaiter": 0, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "19639", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "19639" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x30000000581", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/9", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importbound": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "sticky": 0, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x300000002be", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/2", "pins": { "importbound": 0, "sticky": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x30000000323", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/3", "pins": { "importbound": 0, "sticky": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 2, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x3000000051c", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/8", "pins": { "importbound": 0, "sticky": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x30000000388", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/4", "pins": { "importbound": 0, "sticky": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": true }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x300000003ed", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/1/5", "pins": { "importbound": 0, "sticky": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 0, "is_auth": false, "random_ephemeral_pin": true } ] 2024-07-27T03:12:18.100 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds1", "dirfrag": "0x101", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "1", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/0", "dirfrag": "0x30000000000", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "importbound": 0, "sticky": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/1", "dirfrag": "0x30000000259", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "importbound": 0, "sticky": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/7", "dirfrag": "0x300000004b7", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "importbound": 0, "sticky": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/6", "dirfrag": "0x30000000452", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "importbound": 0, "sticky": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "0", "version": "3478", "committing_version": "0", "committed_version": "0", "is_rep": true, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1 }, "nref": 2 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "1", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "19639", "version": "19639", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "dnwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 1, "dir": { "path": "/1/9", "dirfrag": "0x30000000581", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "2": 1 } }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "importbound": 0, "sticky": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 2, "dir": { "path": "/1/2", "dirfrag": "0x300000002be", "snapid_first": 2, "projected_version": "0", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1, "importbound": 0, "sticky": 0 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 2, "dir": { "path": "/1/3", "dirfrag": "0x30000000323", "snapid_first": 2, "projected_version": "0", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1, "importbound": 0, "sticky": 0 }, "nref": 1 } }, { "is_auth": false, "auth_first": 2, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 2, "dir": { "path": "/1/8", "dirfrag": "0x3000000051c", "snapid_first": 2, "projected_version": "0", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "2", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1, "importbound": 0, "sticky": 0 }, "nref": 1 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 0, "dir": { "path": "/1/4", "dirfrag": "0x30000000388", "snapid_first": 2, "projected_version": "0", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1, "importbound": 0, "sticky": 0 }, "nref": 1 } }, { "is_auth": false, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 0, "dir": { "path": "/1/5", "dirfrag": "0x300000003ed", "snapid_first": 2, "projected_version": "0", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "0", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "subtree": 1, "importbound": 0, "sticky": 0 }, "nref": 1 } } ] 2024-07-27T03:12:18.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-07-27T03:12:18.227 INFO:teuthology.orchestra.run.smithi120.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"3494","version":"3494","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1,"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"","export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":0,"dir":{"path":"/1/5","dirfrag":"0x300000003ed","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"bal_rank_mask":"1","export_pin_target":-1,"dir":{"path":"/1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3459","version":"3459","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"dnwaiter":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":true,"bal_rank_mask":"","export_pin_target":0,"dir":{"path":"/1/4","dirfrag":"0x30000000388","snapid_first":2,"projected_version":"401","version":"401","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1,"2":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-07-27T03:12:18.227 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1, "2": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "3494", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3494" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x300000003ed", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/5", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": true }, { "auth_first": 1, "auth_second": -2, "bal_rank_mask": "1", "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "dnwaiter": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "3459", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "3459" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "bal_rank_mask": "", "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x30000000388", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/1/4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "401", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "401" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": true } ] 2024-07-27T03:12:18.228 DEBUG:tasks.cephfs.cephfs_test_case:[ { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "", "dirfrag": "0x1", "snapid_first": 2, "projected_version": "3494", "version": "3494", "committing_version": "1", "committed_version": "1", "is_rep": true, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1, "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "replicated": 1, "dirty": 1, "authpin": 0 }, "nref": 4 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "", "export_pin_target": -1, "dir": { "path": "~mds0", "dirfrag": "0x100", "snapid_first": 2, "projected_version": "1", "version": "1", "committing_version": "1", "committed_version": "1", "is_rep": false, "dir_auth": "0", "states": [ "auth", "complete" ], "is_auth": true, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "child": 1, "subtree": 1, "dirty": 0, "authpin": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 0, "dir": { "path": "/1/5", "dirfrag": "0x300000003ed", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } }, { "is_auth": false, "auth_first": 1, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": false, "bal_rank_mask": "1", "export_pin_target": -1, "dir": { "path": "/1", "dirfrag": "0x10000000000", "snapid_first": 2, "projected_version": "3459", "version": "3459", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "1", "states": [], "is_auth": false, "auth_state": { "replicas": {} }, "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "request": 0, "dnwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "replicated": 0, "dirty": 0, "waiter": 0, "authpin": 0, "tempexporting": 0 }, "nref": 2 } }, { "is_auth": true, "auth_first": 0, "auth_second": -2, "export_pin": -1, "distributed_ephemeral_pin": false, "random_ephemeral_pin": true, "bal_rank_mask": "", "export_pin_target": 0, "dir": { "path": "/1/4", "dirfrag": "0x30000000388", "snapid_first": 2, "projected_version": "401", "version": "401", "committing_version": "0", "committed_version": "0", "is_rep": false, "dir_auth": "0", "states": [ "auth", "dirty", "complete" ], "is_auth": true, "auth_state": { "replicas": { "1": 1, "2": 1 } }, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "auth_pins": 0, "is_frozen": false, "is_freezing": false, "pins": { "ptrwaiter": 0, "child": 1, "frozen": 0, "subtree": 1, "importing": 0, "replicated": 1, "dirty": 1 }, "nref": 4 } } ] 2024-07-27T03:12:18.228 INFO:tasks.cephfs.cephfs_test_case:len=10 [{'is_auth': True, 'auth_first': 2, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 2, 'dir': {'path': '/1/2', 'dirfrag': '0x300000002be', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '2', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'1': 1}}, 'replica_state': {'authority': [2, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1, 'subtree': 1, 'exportbound': 0, 'replicated': 1, 'dirty': 1, 'authpin': 0}, 'nref': 4}}, {'is_auth': True, 'auth_first': 2, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 2, 'dir': {'path': '/1/3', 'dirfrag': '0x30000000323', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '2', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'1': 1}}, 'replica_state': {'authority': [2, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1, 'subtree': 1, 'exportbound': 0, 'replicated': 1, 'dirty': 1, 'authpin': 0}, 'nref': 4}}, {'is_auth': True, 'auth_first': 2, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 2, 'dir': {'path': '/1/8', 'dirfrag': '0x3000000051c', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '2', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'1': 1}}, 'replica_state': {'authority': [2, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'child': 1, 'subtree': 1, 'exportbound': 0, 'replicated': 1, 'dirty': 1, 'authpin': 0}, 'nref': 4}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/0', 'dirfrag': '0x30000000000', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'importbound': 0, 'sticky': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/1', 'dirfrag': '0x30000000259', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'importbound': 0, 'sticky': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/7', 'dirfrag': '0x300000004b7', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'importbound': 0, 'sticky': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/6', 'dirfrag': '0x30000000452', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'importbound': 0, 'sticky': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 1, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 1, 'dir': {'path': '/1/9', 'dirfrag': '0x30000000581', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '1', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'2': 1}}, 'replica_state': {'authority': [1, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'importbound': 0, 'sticky': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 0, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 0, 'dir': {'path': '/1/5', 'dirfrag': '0x300000003ed', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '0', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'1': 1}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}, {'is_auth': True, 'auth_first': 0, 'auth_second': -2, 'export_pin': -1, 'distributed_ephemeral_pin': False, 'random_ephemeral_pin': True, 'bal_rank_mask': '', 'export_pin_target': 0, 'dir': {'path': '/1/4', 'dirfrag': '0x30000000388', 'snapid_first': 2, 'projected_version': '401', 'version': '401', 'committing_version': '0', 'committed_version': '0', 'is_rep': False, 'dir_auth': '0', 'states': ['auth', 'dirty', 'complete'], 'is_auth': True, 'auth_state': {'replicas': {'1': 1, '2': 1}}, 'replica_state': {'authority': [0, -2], 'replica_nonce': 0}, 'auth_pins': 0, 'is_frozen': False, 'is_freezing': False, 'pins': {'ptrwaiter': 0, 'child': 1, 'frozen': 0, 'subtree': 1, 'importing': 0, 'replicated': 1, 'dirty': 1}, 'nref': 4}}] 2024-07-27T03:12:18.229 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-07-27T03:12:18.229 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:12:18.279 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:12:18.321 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-07-27T03:12:18.321 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:12:18.321 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:18.321 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:18.342 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:18.342 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:18.398 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-27T03:12:18.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.550+0000 7ff404398640 1 -- 172.21.15.120:0/2115582762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3fc0d10d0 msgr2=0x7ff3fc0d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:18.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.550+0000 7ff404398640 1 --2- 172.21.15.120:0/2115582762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3fc0d10d0 0x7ff3fc0d2bf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4005fd0 tx=0x7ff3f402aa90 comp rx=0 tx=0).stop 2024-07-27T03:12:18.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.550+0000 7ff404398640 1 -- 172.21.15.120:0/2115582762 shutdown_connections 2024-07-27T03:12:18.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.550+0000 7ff404398640 1 --2- 172.21.15.120:0/2115582762 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3fc0d10d0 0x7ff3fc0d2bf0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:18.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.550+0000 7ff404398640 1 --2- 172.21.15.120:0/2115582762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff3fc0b4740 0x7ff3fc0b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:18.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.550+0000 7ff404398640 1 -- 172.21.15.120:0/2115582762 >> 172.21.15.120:0/2115582762 conn(0x7ff3fc08d690 msgr2=0x7ff3fc09d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:18.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.550+0000 7ff404398640 1 -- 172.21.15.120:0/2115582762 shutdown_connections 2024-07-27T03:12:18.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.550+0000 7ff404398640 1 -- 172.21.15.120:0/2115582762 wait complete. 2024-07-27T03:12:18.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.552+0000 7ff404398640 1 Processor -- start 2024-07-27T03:12:18.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.552+0000 7ff404398640 1 -- start start 2024-07-27T03:12:18.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.553+0000 7ff404398640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3fc0b4740 0x7ff3fc15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:18.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.553+0000 7ff404398640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3fc0d27e0 0x7ff3fc0cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:18.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.553+0000 7ff404398640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff3fc15b2a0 0x7ff3fc15d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:18.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.553+0000 7ff404398640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0ceff0 con 0x7ff3fc0b4740 2024-07-27T03:12:18.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.553+0000 7ff404398640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0cee70 con 0x7ff3fc0d27e0 2024-07-27T03:12:18.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.553+0000 7ff404398640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff3fc0cf170 con 0x7ff3fc15b2a0 2024-07-27T03:12:18.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff402134640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3fc0b4740 0x7ff3fc15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:18.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff402134640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3fc0b4740 0x7ff3fc15ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60040/0 (socket says 172.21.15.120:60040) 2024-07-27T03:12:18.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff402134640 1 -- 172.21.15.120:0/2576142339 learned_addr learned my addr 172.21.15.120:0/2576142339 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:18.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff402935640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff3fc15b2a0 0x7ff3fc15d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:18.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff401933640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3fc0d27e0 0x7ff3fc0cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:18.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff402134640 1 -- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff3fc15b2a0 msgr2=0x7ff3fc15d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:18.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff402134640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff3fc15b2a0 0x7ff3fc15d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff402134640 1 -- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3fc0d27e0 msgr2=0x7ff3fc0cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff402134640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3fc0d27e0 0x7ff3fc0cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff402134640 1 -- 172.21.15.120:0/2576142339 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc15c610 con 0x7ff3fc0b4740 2024-07-27T03:12:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff402134640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3fc0b4740 0x7ff3fc15ac70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800d7a0 tx=0x7ff3f800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff3f2ffd640 1 -- 172.21.15.120:0/2576142339 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8017070 con 0x7ff3fc0b4740 2024-07-27T03:12:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff404398640 1 -- 172.21.15.120:0/2576142339 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc15c8f0 con 0x7ff3fc0b4740 2024-07-27T03:12:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff3f2ffd640 1 -- 172.21.15.120:0/2576142339 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3f8009cc0 con 0x7ff3fc0b4740 2024-07-27T03:12:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff3f2ffd640 1 -- 172.21.15.120:0/2576142339 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f80106c0 con 0x7ff3fc0b4740 2024-07-27T03:12:18.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.554+0000 7ff404398640 1 -- 172.21.15.120:0/2576142339 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc15ceb0 con 0x7ff3fc0b4740 2024-07-27T03:12:18.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.555+0000 7ff404398640 1 -- 172.21.15.120:0/2576142339 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3fc0d2bf0 con 0x7ff3fc0b4740 2024-07-27T03:12:18.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.556+0000 7ff3f2ffd640 1 -- 172.21.15.120:0/2576142339 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff3f801a070 con 0x7ff3fc0b4740 2024-07-27T03:12:18.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.556+0000 7ff3f2ffd640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff3e0077040 0x7ff3e0079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:18.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.556+0000 7ff3f2ffd640 1 -- 172.21.15.120:0/2576142339 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7ff3f80988c0 con 0x7ff3fc0b4740 2024-07-27T03:12:18.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.557+0000 7ff401933640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff3e0077040 0x7ff3e0079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:18.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.557+0000 7ff401933640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff3e0077040 0x7ff3e0079550 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc15c250 tx=0x7ff3ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:18.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.561+0000 7ff3f2ffd640 1 -- 172.21.15.120:0/2576142339 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff3f8061480 con 0x7ff3fc0b4740 2024-07-27T03:12:18.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.754+0000 7ff404398640 1 -- 172.21.15.120:0/2576142339 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff3fc0b51e0 con 0x7ff3fc0b4740 2024-07-27T03:12:18.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.755+0000 7ff3f2ffd640 1 -- 172.21.15.120:0/2576142339 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7ff3f80659d0 con 0x7ff3fc0b4740 2024-07-27T03:12:18.759 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-07-27T03:12:18.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 -- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff3e0077040 msgr2=0x7ff3e0079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:18.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff3e0077040 0x7ff3e0079550 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc15c250 tx=0x7ff3ec009040 comp rx=0 tx=0).stop 2024-07-27T03:12:18.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 -- 172.21.15.120:0/2576142339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3fc0b4740 msgr2=0x7ff3fc15ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:18.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3fc0b4740 0x7ff3fc15ac70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800d7a0 tx=0x7ff3f800dc60 comp rx=0 tx=0).stop 2024-07-27T03:12:18.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 -- 172.21.15.120:0/2576142339 shutdown_connections 2024-07-27T03:12:18.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff3e0077040 0x7ff3e0079550 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:18.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff3fc15b2a0 0x7ff3fc15d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:18.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3fc0d27e0 0x7ff3fc0cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:18.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 --2- 172.21.15.120:0/2576142339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff3fc0b4740 0x7ff3fc15ac70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:18.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 -- 172.21.15.120:0/2576142339 >> 172.21.15.120:0/2576142339 conn(0x7ff3fc08d690 msgr2=0x7ff3fc0b8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:18.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 -- 172.21.15.120:0/2576142339 shutdown_connections 2024-07-27T03:12:18.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:18.757+0000 7ff404398640 1 -- 172.21.15.120:0/2576142339 wait complete. 2024-07-27T03:12:18.776 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-07-27T03:12:18.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:18.776 DEBUG:teuthology.orchestra.run.smithi120:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-07-27T03:12:19.046 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:12:19.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:19.046 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-07-27T03:12:19.065 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:12:19.065 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:12:19.066 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:19.083 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:12:19.083 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:12:19.084 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:19.084 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:19.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:12:19.124 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:12:19.125 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:12:19.125 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:19.149 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:12:19.149 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:12:19.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.278+0000 7f110da6e640 1 -- 172.21.15.120:0/2475508201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11081522e0 msgr2=0x7f110806e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:19.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.278+0000 7f110da6e640 1 --2- 172.21.15.120:0/2475508201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11081522e0 0x7f110806e270 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f11080cfc50 tx=0x7f10f802a4d0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.278+0000 7f110da6e640 1 -- 172.21.15.120:0/2475508201 shutdown_connections 2024-07-27T03:12:19.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.278+0000 7f110da6e640 1 --2- 172.21.15.120:0/2475508201 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1108073d30 0x7f110815b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.278+0000 7f110da6e640 1 --2- 172.21.15.120:0/2475508201 >> v2:172.21.15.121:3300/0 conn(0x7f11080733e0 0x7f11080737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.278+0000 7f110da6e640 1 --2- 172.21.15.120:0/2475508201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11081522e0 0x7f110806e270 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.278+0000 7f110da6e640 1 -- 172.21.15.120:0/2475508201 >> 172.21.15.120:0/2475508201 conn(0x7f11080b1a10 msgr2=0x7f11080b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:19.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.278+0000 7f110da6e640 1 -- 172.21.15.120:0/2475508201 shutdown_connections 2024-07-27T03:12:19.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.278+0000 7f110da6e640 1 -- 172.21.15.120:0/2475508201 wait complete. 2024-07-27T03:12:19.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.279+0000 7f110da6e640 1 Processor -- start 2024-07-27T03:12:19.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.280+0000 7f110da6e640 1 -- start start 2024-07-27T03:12:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f110da6e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080733e0 0x7f1108157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f110da6e640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1108073d30 0x7f110809cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f110da6e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11081522e0 0x7f110809d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f110da6e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f110815c130 con 0x7f11080733e0 2024-07-27T03:12:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f110da6e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f110815bfb0 con 0x7f11081522e0 2024-07-27T03:12:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f110da6e640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f110815c2b0 con 0x7f1108073d30 2024-07-27T03:12:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f11077fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080733e0 0x7f1108157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f11077fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080733e0 0x7f1108157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60064/0 (socket says 172.21.15.120:60064) 2024-07-27T03:12:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f11077fe640 1 -- 172.21.15.120:0/2385261922 learned_addr learned my addr 172.21.15.120:0/2385261922 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f1106ffd640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1108073d30 0x7f110809cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f1107fff640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11081522e0 0x7f110809d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f11077fe640 1 -- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1108073d30 msgr2=0x7f110809cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f11077fe640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1108073d30 0x7f110809cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f11077fe640 1 -- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11081522e0 msgr2=0x7f110809d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f11077fe640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11081522e0 0x7f110809d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.281+0000 7f11077fe640 1 -- 172.21.15.120:0/2385261922 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1108155590 con 0x7f11080733e0 2024-07-27T03:12:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.282+0000 7f11077fe640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080733e0 0x7f1108157a70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f10f8034040 tx=0x7f10f80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.282+0000 7f10effff640 1 -- 172.21.15.120:0/2385261922 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f803e030 con 0x7f11080733e0 2024-07-27T03:12:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.282+0000 7f10effff640 1 -- 172.21.15.120:0/2385261922 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10f8003ca0 con 0x7f11080733e0 2024-07-27T03:12:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.282+0000 7f110da6e640 1 -- 172.21.15.120:0/2385261922 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1108158680 con 0x7f11080733e0 2024-07-27T03:12:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.282+0000 7f10effff640 1 -- 172.21.15.120:0/2385261922 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8035040 con 0x7f11080733e0 2024-07-27T03:12:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.282+0000 7f110da6e640 1 -- 172.21.15.120:0/2385261922 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1108153d10 con 0x7f11080733e0 2024-07-27T03:12:19.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.283+0000 7f110da6e640 1 -- 172.21.15.120:0/2385261922 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1108146070 con 0x7f11080733e0 2024-07-27T03:12:19.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.284+0000 7f10effff640 1 -- 172.21.15.120:0/2385261922 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f10f8041030 con 0x7f11080733e0 2024-07-27T03:12:19.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.284+0000 7f10effff640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f10f4077010 0x7f10f4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:19.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.284+0000 7f10effff640 1 -- 172.21.15.120:0/2385261922 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f10f80b8f40 con 0x7f11080733e0 2024-07-27T03:12:19.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.284+0000 7f1106ffd640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f10f4077010 0x7f10f4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:19.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.285+0000 7f1106ffd640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f10f4077010 0x7f10f4079520 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f11080b14c0 tx=0x7f10fc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:19.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.289+0000 7f10effff640 1 -- 172.21.15.120:0/2385261922 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f10f8081af0 con 0x7f11080733e0 2024-07-27T03:12:19.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.505+0000 7f110da6e640 1 -- 172.21.15.120:0/2385261922 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11080acd60 con 0x7f11080733e0 2024-07-27T03:12:19.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.505+0000 7f10effff640 1 -- 172.21.15.120:0/2385261922 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5277 (secure 0 0 0) 0x7f11080acd60 con 0x7f11080733e0 2024-07-27T03:12:19.508 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:19.508 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":58,"btime":"2024-07-27T03:12:00:654675+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/3598257167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3598257167},{"type":"v1","addr":"172.21.15.121:6836","nonce":3598257167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":58,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:11:19.459319+0000","modified":"2024-07-27T03:12:00.411091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5733,"mds_1":5473,"mds_2":5458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5458":{"gid":5458,"name":"a","rank":2,"incarnation":54,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/2987877930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2987877930},{"type":"v1","addr":"172.21.15.120:6834","nonce":2987877930}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5473":{"gid":5473,"name":"b","rank":1,"incarnation":52,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6837/1057652547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1057652547},{"type":"v1","addr":"172.21.15.121:6837","nonce":1057652547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/3550669358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":3550669358},{"type":"v1","addr":"172.21.15.120:6835","nonce":3550669358}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5733,"qdb_cluster":[5733,5473,5458]},"id":4}]} 2024-07-27T03:12:19.508 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 58 2024-07-27T03:12:19.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 -- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f10f4077010 msgr2=0x7f10f4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:19.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f10f4077010 0x7f10f4079520 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f11080b14c0 tx=0x7f10fc005f90 comp rx=0 tx=0).stop 2024-07-27T03:12:19.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 -- 172.21.15.120:0/2385261922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080733e0 msgr2=0x7f1108157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:19.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080733e0 0x7f1108157a70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f10f8034040 tx=0x7f10f80038a0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 -- 172.21.15.120:0/2385261922 shutdown_connections 2024-07-27T03:12:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f10f4077010 0x7f10f4079520 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11081522e0 0x7f110809d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1108073d30 0x7f110809cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 --2- 172.21.15.120:0/2385261922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11080733e0 0x7f1108157a70 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 -- 172.21.15.120:0/2385261922 >> 172.21.15.120:0/2385261922 conn(0x7f11080b1a10 msgr2=0x7f11080cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 -- 172.21.15.120:0/2385261922 shutdown_connections 2024-07-27T03:12:19.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.507+0000 7f110da6e640 1 -- 172.21.15.120:0/2385261922 wait complete. 2024-07-27T03:12:19.521 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:12:19.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.635+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1866755064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ad00b4650 msgr2=0x7f7ad00b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:19.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.635+0000 7f7ad56c7640 1 --2- 172.21.15.120:0/1866755064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ad00b4650 0x7f7ad00b4a60 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8005fd0 tx=0x7f7ab802a540 comp rx=0 tx=0).stop 2024-07-27T03:12:19.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.635+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1866755064 shutdown_connections 2024-07-27T03:12:19.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.635+0000 7f7ad56c7640 1 --2- 172.21.15.120:0/1866755064 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ad00add70 0x7f7ad00ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.635+0000 7f7ad56c7640 1 --2- 172.21.15.120:0/1866755064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ad00b4650 0x7f7ad00b4a60 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.635+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1866755064 >> 172.21.15.120:0/1866755064 conn(0x7f7ad00b2e40 msgr2=0x7f7ad00b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:19.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.635+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1866755064 shutdown_connections 2024-07-27T03:12:19.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.635+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1866755064 wait complete. 2024-07-27T03:12:19.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.637+0000 7f7ad56c7640 1 Processor -- start 2024-07-27T03:12:19.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.637+0000 7f7ad56c7640 1 -- start start 2024-07-27T03:12:19.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.638+0000 7f7ad56c7640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ad00add70 0x7f7ad013c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:19.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.638+0000 7f7ad56c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ad00b4650 0x7f7ad014eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:19.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ad56c7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ad014b420 0x7f7ad00cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:19.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ad56c7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad0073bd0 con 0x7f7ad00b4650 2024-07-27T03:12:19.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ad56c7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad0073a50 con 0x7f7ad014b420 2024-07-27T03:12:19.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ad56c7640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad0073d50 con 0x7f7ad00add70 2024-07-27T03:12:19.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ad00b4650 0x7f7ad014eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:19.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ad00b4650 0x7f7ad014eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60082/0 (socket says 172.21.15.120:60082) 2024-07-27T03:12:19.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac67fc640 1 -- 172.21.15.120:0/1662486149 learned_addr learned my addr 172.21.15.120:0/1662486149 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:19.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7aceffd640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ad00add70 0x7f7ad013c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:19.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7acf7fe640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ad014b420 0x7f7ad00cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:19.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac67fc640 1 -- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ad00add70 msgr2=0x7f7ad013c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:19.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac67fc640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ad00add70 0x7f7ad013c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac67fc640 1 -- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ad014b420 msgr2=0x7f7ad00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:19.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac67fc640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ad014b420 0x7f7ad00cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac67fc640 1 -- 172.21.15.120:0/1662486149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad00ce690 con 0x7f7ad00b4650 2024-07-27T03:12:19.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac67fc640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ad00b4650 0x7f7ad014eb90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8034040 tx=0x7f7ab80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:19.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac7fff640 1 -- 172.21.15.120:0/1662486149 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab803e030 con 0x7f7ad00b4650 2024-07-27T03:12:19.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac7fff640 1 -- 172.21.15.120:0/1662486149 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ab8003d90 con 0x7f7ad00b4650 2024-07-27T03:12:19.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ac7fff640 1 -- 172.21.15.120:0/1662486149 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8035040 con 0x7f7ad00b4650 2024-07-27T03:12:19.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1662486149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad00ce970 con 0x7f7ad00b4650 2024-07-27T03:12:19.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.639+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1662486149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad00cef30 con 0x7f7ad00b4650 2024-07-27T03:12:19.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.641+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1662486149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad00742e0 con 0x7f7ad00b4650 2024-07-27T03:12:19.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.641+0000 7f7ac7fff640 1 -- 172.21.15.120:0/1662486149 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f7ab8041030 con 0x7f7ad00b4650 2024-07-27T03:12:19.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.641+0000 7f7ac7fff640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7ab0077010 0x7f7ab0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:19.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.641+0000 7f7ac7fff640 1 -- 172.21.15.120:0/1662486149 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f7ab80b8f10 con 0x7f7ad00b4650 2024-07-27T03:12:19.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.642+0000 7f7aceffd640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7ab0077010 0x7f7ab0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:19.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.642+0000 7f7aceffd640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7ab0077010 0x7f7ab0079520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00b56d0 tx=0x7f7ac0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:19.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.646+0000 7f7ac7fff640 1 -- 172.21.15.120:0/1662486149 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f7ab80821b0 con 0x7f7ad00b4650 2024-07-27T03:12:19.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.864+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1662486149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ad015b9e0 con 0x7f7ad00b4650 2024-07-27T03:12:19.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.865+0000 7f7ac7fff640 1 -- 172.21.15.120:0/1662486149 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5277 (secure 0 0 0) 0x7f7ab80a1e20 con 0x7f7ad00b4650 2024-07-27T03:12:19.868 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:19.868 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":58,"btime":"2024-07-27T03:12:00:654675+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/3598257167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3598257167},{"type":"v1","addr":"172.21.15.121:6836","nonce":3598257167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":58,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:11:19.459319+0000","modified":"2024-07-27T03:12:00.411091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5733,"mds_1":5473,"mds_2":5458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5458":{"gid":5458,"name":"a","rank":2,"incarnation":54,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/2987877930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2987877930},{"type":"v1","addr":"172.21.15.120:6834","nonce":2987877930}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5473":{"gid":5473,"name":"b","rank":1,"incarnation":52,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6837/1057652547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1057652547},{"type":"v1","addr":"172.21.15.121:6837","nonce":1057652547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/3550669358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":3550669358},{"type":"v1","addr":"172.21.15.120:6835","nonce":3550669358}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5733,"qdb_cluster":[5733,5473,5458]},"id":4}]} 2024-07-27T03:12:19.869 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 58 2024-07-27T03:12:19.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7ab0077010 msgr2=0x7f7ab0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:19.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7ab0077010 0x7f7ab0079520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00b56d0 tx=0x7f7ac0009040 comp rx=0 tx=0).stop 2024-07-27T03:12:19.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1662486149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ad00b4650 msgr2=0x7f7ad014eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:19.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ad00b4650 0x7f7ad014eb90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8034040 tx=0x7f7ab80038a0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1662486149 shutdown_connections 2024-07-27T03:12:19.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7ab0077010 0x7f7ab0079520 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7ad00b4650 0x7f7ad014eb90 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ad014b420 0x7f7ad00cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 --2- 172.21.15.120:0/1662486149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ad00add70 0x7f7ad013c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:19.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1662486149 >> 172.21.15.120:0/1662486149 conn(0x7f7ad00b2e40 msgr2=0x7f7ad0151870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:19.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1662486149 shutdown_connections 2024-07-27T03:12:19.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.867+0000 7f7ad56c7640 1 -- 172.21.15.120:0/1662486149 wait complete. 2024-07-27T03:12:19.881 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:12:19.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.994+0000 7f1be2e8b640 1 -- 172.21.15.120:0/2582086656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bc4004af0 msgr2=0x7f1bc4004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:19.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.994+0000 7f1be2e8b640 1 --2- 172.21.15.120:0/2582086656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bc4004af0 0x7f1bc4004f20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009b20 tx=0x7f1bc4006940 comp rx=0 tx=0).stop 2024-07-27T03:12:19.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.994+0000 7f1be1428640 1 -- 172.21.15.120:0/2582086656 reap_dead start 2024-07-27T03:12:19.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.994+0000 7f1be2e8b640 1 -- 172.21.15.120:0/2582086656 shutdown_connections 2024-07-27T03:12:19.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.994+0000 7f1be2e8b640 1 -- 172.21.15.120:0/2582086656 >> 172.21.15.120:0/2582086656 conn(0x7f1bdc0b1a10 msgr2=0x7f1bdc0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:19.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.994+0000 7f1be2e8b640 1 -- 172.21.15.120:0/2582086656 shutdown_connections 2024-07-27T03:12:19.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.994+0000 7f1be2e8b640 1 -- 172.21.15.120:0/2582086656 wait complete. 2024-07-27T03:12:19.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.995+0000 7f1be2e8b640 1 Processor -- start 2024-07-27T03:12:19.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.995+0000 7f1be2e8b640 1 -- start start 2024-07-27T03:12:20.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be2e8b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bc4004af0 0x7f1bdc09ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be2e8b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bdc15b810 0x7f1bdc157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be2e8b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bdc1453a0 0x7f1bdc147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be2e8b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1bdc06e270 con 0x7f1bdc1453a0 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be2e8b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1bdc070090 con 0x7f1bdc15b810 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be2e8b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1bdc06e3f0 con 0x7f1bc4004af0 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be1428640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bdc1453a0 0x7f1bdc147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be1428640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bdc1453a0 0x7f1bdc147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60092/0 (socket says 172.21.15.120:60092) 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be1428640 1 -- 172.21.15.120:0/185376607 learned_addr learned my addr 172.21.15.120:0/185376607 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1bdbfff640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bdc15b810 0x7f1bdc157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be0c27640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bc4004af0 0x7f1bdc09ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be1428640 1 -- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bc4004af0 msgr2=0x7f1bdc09ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be1428640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bc4004af0 0x7f1bdc09ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be1428640 1 -- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bdc15b810 msgr2=0x7f1bdc157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be1428640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bdc15b810 0x7f1bdc157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.997+0000 7f1be1428640 1 -- 172.21.15.120:0/185376607 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bdc15bf60 con 0x7f1bdc1453a0 2024-07-27T03:12:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.998+0000 7f1be1428640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bdc1453a0 0x7f1bdc147e10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0b4d10 tx=0x7f1bd40064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.998+0000 7f1bd97fa640 1 -- 172.21.15.120:0/185376607 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4011900 con 0x7f1bdc1453a0 2024-07-27T03:12:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.998+0000 7f1bd97fa640 1 -- 172.21.15.120:0/185376607 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bd4017070 con 0x7f1bdc1453a0 2024-07-27T03:12:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.998+0000 7f1be2e8b640 1 -- 172.21.15.120:0/185376607 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bdc1571d0 con 0x7f1bdc1453a0 2024-07-27T03:12:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.998+0000 7f1bd97fa640 1 -- 172.21.15.120:0/185376607 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4011d40 con 0x7f1bdc1453a0 2024-07-27T03:12:20.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.998+0000 7f1be2e8b640 1 -- 172.21.15.120:0/185376607 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bdc157790 con 0x7f1bdc1453a0 2024-07-27T03:12:20.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.999+0000 7f1be2e8b640 1 -- 172.21.15.120:0/185376607 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bdc0b3db0 con 0x7f1bdc1453a0 2024-07-27T03:12:20.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:19.999+0000 7f1bd97fa640 1 -- 172.21.15.120:0/185376607 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1bd401c460 con 0x7f1bdc1453a0 2024-07-27T03:12:20.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.000+0000 7f1bd97fa640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1bc8077010 0x7f1bc8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.000+0000 7f1bd97fa640 1 -- 172.21.15.120:0/185376607 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f1bd4098d80 con 0x7f1bdc1453a0 2024-07-27T03:12:20.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.000+0000 7f1be0c27640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1bc8077010 0x7f1bc8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.001+0000 7f1be0c27640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1bc8077010 0x7f1bc8079520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc035000 tx=0x7f1bcc02d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:20.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.004+0000 7f1bd97fa640 1 -- 172.21.15.120:0/185376607 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f1bd40619c0 con 0x7f1bdc1453a0 2024-07-27T03:12:20.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.190+0000 7f1be2e8b640 1 -- 172.21.15.120:0/185376607 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bdc0cc690 con 0x7f1bdc1453a0 2024-07-27T03:12:20.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.191+0000 7f1bd97fa640 1 -- 172.21.15.120:0/185376607 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16689 (secure 0 0 0) 0x7f1bd406a250 con 0x7f1bdc1453a0 2024-07-27T03:12:20.194 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:20.194 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":57,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:11:21.094416+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:11:17.121357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-07-27T03:11:18.418999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 -- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1bc8077010 msgr2=0x7f1bc8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1bc8077010 0x7f1bc8079520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc035000 tx=0x7f1bcc02d040 comp rx=0 tx=0).stop 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 -- 172.21.15.120:0/185376607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bdc1453a0 msgr2=0x7f1bdc147e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bdc1453a0 0x7f1bdc147e10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0b4d10 tx=0x7f1bd40064f0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 -- 172.21.15.120:0/185376607 shutdown_connections 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1bc8077010 0x7f1bc8079520 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bdc1453a0 0x7f1bdc147e10 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bdc15b810 0x7f1bdc157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 --2- 172.21.15.120:0/185376607 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1bc4004af0 0x7f1bdc09ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 -- 172.21.15.120:0/185376607 >> 172.21.15.120:0/185376607 conn(0x7f1bdc0b1a10 msgr2=0x7f1bdc072ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 -- 172.21.15.120:0/185376607 shutdown_connections 2024-07-27T03:12:20.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.193+0000 7f1be2e8b640 1 -- 172.21.15.120:0/185376607 wait complete. 2024-07-27T03:12:20.207 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-07-27T03:12:20.207 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:12:20.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.320+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2455310434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdbc0b63e0 msgr2=0x7fcdbc152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.320+0000 7fcdc22d9640 1 --2- 172.21.15.120:0/2455310434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdbc0b63e0 0x7fcdbc152160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0005fd0 tx=0x7fcdb002a5c0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.320+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2455310434 shutdown_connections 2024-07-27T03:12:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.320+0000 7fcdc22d9640 1 --2- 172.21.15.120:0/2455310434 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcdbc15ec20 0x7fcdbc15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.320+0000 7fcdc22d9640 1 --2- 172.21.15.120:0/2455310434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdbc0b63e0 0x7fcdbc152160 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.320+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2455310434 >> 172.21.15.120:0/2455310434 conn(0x7fcdbc06cba0 msgr2=0x7fcdbc06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.320+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2455310434 shutdown_connections 2024-07-27T03:12:20.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.320+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2455310434 wait complete. 2024-07-27T03:12:20.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.321+0000 7fcdc22d9640 1 Processor -- start 2024-07-27T03:12:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.322+0000 7fcdc22d9640 1 -- start start 2024-07-27T03:12:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc22d9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcdbc15c220 0x7fcdbc0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc22d9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdbc15ec20 0x7fcdbc154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc22d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdbc155080 0x7fcdbc0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc22d9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc0cdbc0 con 0x7fcdbc155080 2024-07-27T03:12:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc22d9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc0cda40 con 0x7fcdbc15ec20 2024-07-27T03:12:20.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc22d9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fcdbc0cdd40 con 0x7fcdbc15c220 2024-07-27T03:12:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc0876640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdbc155080 0x7fcdbc0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc0876640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdbc155080 0x7fcdbc0b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60102/0 (socket says 172.21.15.120:60102) 2024-07-27T03:12:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc0876640 1 -- 172.21.15.120:0/2276732583 learned_addr learned my addr 172.21.15.120:0/2276732583 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdbb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdbc15ec20 0x7fcdbc154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdbbfff640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcdbc15c220 0x7fcdbc0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc0876640 1 -- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcdbc15c220 msgr2=0x7fcdbc0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc0876640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcdbc15c220 0x7fcdbc0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc0876640 1 -- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdbc15ec20 msgr2=0x7fcdbc154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc0876640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdbc15ec20 0x7fcdbc154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdc0876640 1 -- 172.21.15.120:0/2276732583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc14c7f0 con 0x7fcdbc155080 2024-07-27T03:12:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.323+0000 7fcdbb7fe640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdbc15ec20 0x7fcdbc154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:12:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.324+0000 7fcdc0876640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdbc155080 0x7fcdbc0b4a20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400ea40 tx=0x7fcdb400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:20.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.324+0000 7fcdb8ff9640 1 -- 172.21.15.120:0/2276732583 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400ce40 con 0x7fcdbc155080 2024-07-27T03:12:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.324+0000 7fcdb8ff9640 1 -- 172.21.15.120:0/2276732583 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdb4004c10 con 0x7fcdbc155080 2024-07-27T03:12:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.324+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2276732583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdbc14cad0 con 0x7fcdbc155080 2024-07-27T03:12:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.324+0000 7fcdb8ff9640 1 -- 172.21.15.120:0/2276732583 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4005020 con 0x7fcdbc155080 2024-07-27T03:12:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.324+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2276732583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdbc14d090 con 0x7fcdbc155080 2024-07-27T03:12:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.325+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2276732583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdbc0739d0 con 0x7fcdbc155080 2024-07-27T03:12:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.326+0000 7fcdb8ff9640 1 -- 172.21.15.120:0/2276732583 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fcdb40051c0 con 0x7fcdbc155080 2024-07-27T03:12:20.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.326+0000 7fcdb8ff9640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcda8077040 0x7fcda8079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.326+0000 7fcdb8ff9640 1 -- 172.21.15.120:0/2276732583 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fcdb4099530 con 0x7fcdbc155080 2024-07-27T03:12:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.326+0000 7fcdbbfff640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcda8077040 0x7fcda8079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.327+0000 7fcdbbfff640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcda8077040 0x7fcda8079550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc159220 tx=0x7fcdac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:20.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.330+0000 7fcdb8ff9640 1 -- 172.21.15.120:0/2276732583 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fcdb40620f0 con 0x7fcdbc155080 2024-07-27T03:12:20.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.553+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2276732583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcdbc0b2cf0 con 0x7fcdbc155080 2024-07-27T03:12:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.553+0000 7fcdb8ff9640 1 -- 172.21.15.120:0/2276732583 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5277 (secure 0 0 0) 0x7fcdb4066640 con 0x7fcdbc155080 2024-07-27T03:12:20.556 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:20.556 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":58,"btime":"2024-07-27T03:12:00:654675+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/3598257167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3598257167},{"type":"v1","addr":"172.21.15.121:6836","nonce":3598257167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":58,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:11:19.459319+0000","modified":"2024-07-27T03:12:00.411091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5733,"mds_1":5473,"mds_2":5458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5458":{"gid":5458,"name":"a","rank":2,"incarnation":54,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/2987877930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2987877930},{"type":"v1","addr":"172.21.15.120:6834","nonce":2987877930}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5473":{"gid":5473,"name":"b","rank":1,"incarnation":52,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6837/1057652547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1057652547},{"type":"v1","addr":"172.21.15.121:6837","nonce":1057652547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/3550669358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":3550669358},{"type":"v1","addr":"172.21.15.120:6835","nonce":3550669358}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5733,"qdb_cluster":[5733,5473,5458]},"id":4}]} 2024-07-27T03:12:20.556 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 58 2024-07-27T03:12:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.555+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcda8077040 msgr2=0x7fcda8079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.555+0000 7fcdc22d9640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcda8077040 0x7fcda8079550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc159220 tx=0x7fcdac009040 comp rx=0 tx=0).stop 2024-07-27T03:12:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.555+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2276732583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdbc155080 msgr2=0x7fcdbc0b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.555+0000 7fcdc22d9640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdbc155080 0x7fcdbc0b4a20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400ea40 tx=0x7fcdb400ef00 comp rx=0 tx=0).stop 2024-07-27T03:12:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.555+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2276732583 shutdown_connections 2024-07-27T03:12:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.555+0000 7fcdc22d9640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcda8077040 0x7fcda8079550 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.555+0000 7fcdc22d9640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdbc155080 0x7fcdbc0b4a20 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.555+0000 7fcdc22d9640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcdbc15ec20 0x7fcdbc154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.555+0000 7fcdc22d9640 1 --2- 172.21.15.120:0/2276732583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcdbc15c220 0x7fcdbc0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.555+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2276732583 >> 172.21.15.120:0/2276732583 conn(0x7fcdbc06cba0 msgr2=0x7fcdbc159250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.556+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2276732583 shutdown_connections 2024-07-27T03:12:20.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.556+0000 7fcdc22d9640 1 -- 172.21.15.120:0/2276732583 wait complete. 2024-07-27T03:12:20.569 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:12:20.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.681+0000 7f6bfd393640 1 -- 172.21.15.120:0/3426809014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80b5fe0 msgr2=0x7f6bf815e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.681+0000 7f6bfd393640 1 --2- 172.21.15.120:0/3426809014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80b5fe0 0x7f6bf815e9c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0005fd0 tx=0x7f6bf002a540 comp rx=0 tx=0).stop 2024-07-27T03:12:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.681+0000 7f6bfd393640 1 -- 172.21.15.120:0/3426809014 shutdown_connections 2024-07-27T03:12:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.681+0000 7f6bfd393640 1 --2- 172.21.15.120:0/3426809014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80b5fe0 0x7f6bf815e9c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.681+0000 7f6bfd393640 1 --2- 172.21.15.120:0/3426809014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bf80d0c10 0x7f6bf80b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.681+0000 7f6bfd393640 1 -- 172.21.15.120:0/3426809014 >> 172.21.15.120:0/3426809014 conn(0x7f6bf80b3920 msgr2=0x7f6bf80b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.681+0000 7f6bfd393640 1 -- 172.21.15.120:0/3426809014 shutdown_connections 2024-07-27T03:12:20.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.681+0000 7f6bfd393640 1 -- 172.21.15.120:0/3426809014 wait complete. 2024-07-27T03:12:20.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.683+0000 7f6bfd393640 1 Processor -- start 2024-07-27T03:12:20.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.683+0000 7f6bfd393640 1 -- start start 2024-07-27T03:12:20.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.684+0000 7f6bfd393640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80b2110 0x7f6bf81516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.684+0000 7f6bfd393640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bf80b5fe0 0x7f6bf80706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.684+0000 7f6bfd393640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bf8151dc0 0x7f6bf8070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.684+0000 7f6bfd393640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf815f590 con 0x7f6bf80b2110 2024-07-27T03:12:20.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.684+0000 7f6bfd393640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf815f410 con 0x7f6bf8151dc0 2024-07-27T03:12:20.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.684+0000 7f6bfd393640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf815f710 con 0x7f6bf80b5fe0 2024-07-27T03:12:20.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.684+0000 7f6bf6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80b2110 0x7f6bf81516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.684+0000 7f6bf6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80b2110 0x7f6bf81516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60110/0 (socket says 172.21.15.120:60110) 2024-07-27T03:12:20.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.684+0000 7f6bf6ffd640 1 -- 172.21.15.120:0/429984528 learned_addr learned my addr 172.21.15.120:0/429984528 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:20.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.684+0000 7f6bf67fc640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bf80b5fe0 0x7f6bf80706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.684+0000 7f6bf77fe640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bf8151dc0 0x7f6bf8070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.685+0000 7f6bf6ffd640 1 -- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bf80b5fe0 msgr2=0x7f6bf80706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.685+0000 7f6bf6ffd640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bf80b5fe0 0x7f6bf80706d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.685+0000 7f6bf6ffd640 1 -- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bf8151dc0 msgr2=0x7f6bf8070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.685+0000 7f6bf6ffd640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bf8151dc0 0x7f6bf8070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.685+0000 7f6bf6ffd640 1 -- 172.21.15.120:0/429984528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf8159370 con 0x7f6bf80b2110 2024-07-27T03:12:20.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.685+0000 7f6bf6ffd640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80b2110 0x7f6bf81516f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6be800c730 tx=0x7f6be800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:20.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.687+0000 7f6bdf7fe640 1 -- 172.21.15.120:0/429984528 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be8003b70 con 0x7f6bf80b2110 2024-07-27T03:12:20.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.687+0000 7f6bdf7fe640 1 -- 172.21.15.120:0/429984528 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6be8003d30 con 0x7f6bf80b2110 2024-07-27T03:12:20.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.687+0000 7f6bfd393640 1 -- 172.21.15.120:0/429984528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf81f7320 con 0x7f6bf80b2110 2024-07-27T03:12:20.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.687+0000 7f6bdf7fe640 1 -- 172.21.15.120:0/429984528 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be800aab0 con 0x7f6bf80b2110 2024-07-27T03:12:20.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.687+0000 7f6bfd393640 1 -- 172.21.15.120:0/429984528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf81f7010 con 0x7f6bf80b2110 2024-07-27T03:12:20.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.689+0000 7f6bfd393640 1 -- 172.21.15.120:0/429984528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf815fc30 con 0x7f6bf80b2110 2024-07-27T03:12:20.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.689+0000 7f6bdf7fe640 1 -- 172.21.15.120:0/429984528 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6be800ac50 con 0x7f6bf80b2110 2024-07-27T03:12:20.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.690+0000 7f6bdf7fe640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6be4077040 0x7f6be4079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:20.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.690+0000 7f6bdf7fe640 1 -- 172.21.15.120:0/429984528 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f6be8098620 con 0x7f6bf80b2110 2024-07-27T03:12:20.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.690+0000 7f6bf67fc640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6be4077040 0x7f6be4079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:20.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.690+0000 7f6bf67fc640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6be4077040 0x7f6be4079550 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80cf460 tx=0x7f6bec00f6f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:20.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.694+0000 7f6bdf7fe640 1 -- 172.21.15.120:0/429984528 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6be8061270 con 0x7f6bf80b2110 2024-07-27T03:12:20.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.910+0000 7f6bfd393640 1 -- 172.21.15.120:0/429984528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bf815dc20 con 0x7f6bf80b2110 2024-07-27T03:12:20.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.911+0000 7f6bdf7fe640 1 -- 172.21.15.120:0/429984528 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5277 (secure 0 0 0) 0x7f6be80657c0 con 0x7f6bf80b2110 2024-07-27T03:12:20.913 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:20.913 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":58,"btime":"2024-07-27T03:12:00:654675+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/3598257167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3598257167},{"type":"v1","addr":"172.21.15.121:6836","nonce":3598257167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":58,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:11:19.459319+0000","modified":"2024-07-27T03:12:00.411091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5733,"mds_1":5473,"mds_2":5458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5458":{"gid":5458,"name":"a","rank":2,"incarnation":54,"state":"up:active","state_seq":6,"addr":"172.21.15.120:6834/2987877930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":2987877930},{"type":"v1","addr":"172.21.15.120:6834","nonce":2987877930}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5473":{"gid":5473,"name":"b","rank":1,"incarnation":52,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6837/1057652547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1057652547},{"type":"v1","addr":"172.21.15.121:6837","nonce":1057652547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5733":{"gid":5733,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6835/3550669358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6833","nonce":3550669358},{"type":"v1","addr":"172.21.15.120:6835","nonce":3550669358}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5733,"qdb_cluster":[5733,5473,5458]},"id":4}]} 2024-07-27T03:12:20.914 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 58 2024-07-27T03:12:20.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 -- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6be4077040 msgr2=0x7f6be4079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6be4077040 0x7f6be4079550 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80cf460 tx=0x7f6bec00f6f0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 -- 172.21.15.120:0/429984528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80b2110 msgr2=0x7f6bf81516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:20.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80b2110 0x7f6bf81516f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6be800c730 tx=0x7f6be800cbf0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 -- 172.21.15.120:0/429984528 shutdown_connections 2024-07-27T03:12:20.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6be4077040 0x7f6be4079550 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bf8151dc0 0x7f6bf8070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bf80b5fe0 0x7f6bf80706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 --2- 172.21.15.120:0/429984528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6bf80b2110 0x7f6bf81516f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:20.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 -- 172.21.15.120:0/429984528 >> 172.21.15.120:0/429984528 conn(0x7f6bf80b3920 msgr2=0x7f6bf80cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:20.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 -- 172.21.15.120:0/429984528 shutdown_connections 2024-07-27T03:12:20.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:20.913+0000 7f6bfd393640 1 -- 172.21.15.120:0/429984528 wait complete. 2024-07-27T03:12:20.927 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:12:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.039+0000 7f431f48b640 1 -- 172.21.15.120:0/3989994452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4304004d40 msgr2=0x7f4304005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.039+0000 7f431f48b640 1 --2- 172.21.15.120:0/3989994452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4304004d40 0x7f4304005210 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f43180b5320 tx=0x7f4304005830 comp rx=0 tx=0).stop 2024-07-27T03:12:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.039+0000 7f431da28640 1 -- 172.21.15.120:0/3989994452 reap_dead start 2024-07-27T03:12:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.039+0000 7f431f48b640 1 -- 172.21.15.120:0/3989994452 shutdown_connections 2024-07-27T03:12:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.039+0000 7f431f48b640 1 -- 172.21.15.120:0/3989994452 >> 172.21.15.120:0/3989994452 conn(0x7f431808d690 msgr2=0x7f431809d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.039+0000 7f431f48b640 1 -- 172.21.15.120:0/3989994452 shutdown_connections 2024-07-27T03:12:21.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.039+0000 7f431f48b640 1 -- 172.21.15.120:0/3989994452 wait complete. 2024-07-27T03:12:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.041+0000 7f431f48b640 1 Processor -- start 2024-07-27T03:12:21.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.041+0000 7f431f48b640 1 -- start start 2024-07-27T03:12:21.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431f48b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4304004d40 0x7f43180cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431f48b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f431815c8c0 0x7f43181f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431f48b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f431815c080 0x7f431809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431f48b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f43180b3410 con 0x7f431815c8c0 2024-07-27T03:12:21.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431f48b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43180d3100 con 0x7f4304004d40 2024-07-27T03:12:21.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431f48b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f43180cf2f0 con 0x7f431815c080 2024-07-27T03:12:21.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431ca26640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f431815c8c0 0x7f43181f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431ca26640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f431815c8c0 0x7f43181f6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60134/0 (socket says 172.21.15.120:60134) 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431ca26640 1 -- 172.21.15.120:0/939381826 learned_addr learned my addr 172.21.15.120:0/939381826 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431d227640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4304004d40 0x7f43180cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431ca26640 1 -- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f431815c080 msgr2=0x7f431809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431da28640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f431815c080 0x7f431809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431ca26640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f431815c080 0x7f431809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431ca26640 1 -- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4304004d40 msgr2=0x7f43180cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431ca26640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4304004d40 0x7f43180cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.042+0000 7f431ca26640 1 -- 172.21.15.120:0/939381826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431809fe90 con 0x7f431815c8c0 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.043+0000 7f431ca26640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f431815c8c0 0x7f43181f6760 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4308011b10 tx=0x7f4308009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.043+0000 7f430dffb640 1 -- 172.21.15.120:0/939381826 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430801e070 con 0x7f431815c8c0 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.043+0000 7f430dffb640 1 -- 172.21.15.120:0/939381826 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f430800fe40 con 0x7f431815c8c0 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.043+0000 7f431f48b640 1 -- 172.21.15.120:0/939381826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43180a0170 con 0x7f431815c8c0 2024-07-27T03:12:21.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.043+0000 7f430dffb640 1 -- 172.21.15.120:0/939381826 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43080042b0 con 0x7f431815c8c0 2024-07-27T03:12:21.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.043+0000 7f431f48b640 1 -- 172.21.15.120:0/939381826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f431815c490 con 0x7f431815c8c0 2024-07-27T03:12:21.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.044+0000 7f431f48b640 1 -- 172.21.15.120:0/939381826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43180d0aa0 con 0x7f431815c8c0 2024-07-27T03:12:21.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.045+0000 7f430dffb640 1 -- 172.21.15.120:0/939381826 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4308021070 con 0x7f431815c8c0 2024-07-27T03:12:21.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.045+0000 7f430dffb640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42fc077010 0x7f42fc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.045+0000 7f430dffb640 1 -- 172.21.15.120:0/939381826 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f43080991d0 con 0x7f431815c8c0 2024-07-27T03:12:21.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.046+0000 7f431d227640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42fc077010 0x7f42fc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.046+0000 7f431d227640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42fc077010 0x7f42fc079520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f43140013f0 tx=0x7f43140068d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:21.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.050+0000 7f430dffb640 1 -- 172.21.15.120:0/939381826 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f4308061ea0 con 0x7f431815c8c0 2024-07-27T03:12:21.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.236+0000 7f431f48b640 1 -- 172.21.15.120:0/939381826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43180ce200 con 0x7f431815c8c0 2024-07-27T03:12:21.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.237+0000 7f430dffb640 1 -- 172.21.15.120:0/939381826 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16689 (secure 0 0 0) 0x7f43080663f0 con 0x7f431815c8c0 2024-07-27T03:12:21.239 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:21.240 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":57,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:11:21.094416+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:11:17.121357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-07-27T03:11:18.418999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:12:21.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 -- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42fc077010 msgr2=0x7f42fc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42fc077010 0x7f42fc079520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f43140013f0 tx=0x7f43140068d0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 -- 172.21.15.120:0/939381826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f431815c8c0 msgr2=0x7f43181f6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f431815c8c0 0x7f43181f6760 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4308011b10 tx=0x7f4308009e00 comp rx=0 tx=0).stop 2024-07-27T03:12:21.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 -- 172.21.15.120:0/939381826 shutdown_connections 2024-07-27T03:12:21.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42fc077010 0x7f42fc079520 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f431815c8c0 0x7f43181f6760 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f431815c080 0x7f431809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 --2- 172.21.15.120:0/939381826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4304004d40 0x7f43180cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 -- 172.21.15.120:0/939381826 >> 172.21.15.120:0/939381826 conn(0x7f431808d690 msgr2=0x7f43180b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:21.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 -- 172.21.15.120:0/939381826 shutdown_connections 2024-07-27T03:12:21.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.239+0000 7f431f48b640 1 -- 172.21.15.120:0/939381826 wait complete. 2024-07-27T03:12:21.253 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-07-27T03:12:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.365+0000 7f66f06f9640 1 -- 172.21.15.120:0/886538464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f66e806eb00 msgr2=0x7f66e806ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.365+0000 7f66f06f9640 1 --2- 172.21.15.120:0/886538464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f66e806eb00 0x7f66e806ef10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f66e0005fd0 tx=0x7f66e002a5d0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.365+0000 7f66f06f9640 1 -- 172.21.15.120:0/886538464 shutdown_connections 2024-07-27T03:12:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.365+0000 7f66f06f9640 1 --2- 172.21.15.120:0/886538464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f66e806eb00 0x7f66e806ef10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.365+0000 7f66f06f9640 1 --2- 172.21.15.120:0/886538464 >> v2:172.21.15.121:3300/0 conn(0x7f66e815c000 0x7f66e815c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.365+0000 7f66f06f9640 1 -- 172.21.15.120:0/886538464 >> 172.21.15.120:0/886538464 conn(0x7f66e80b1a10 msgr2=0x7f66e80b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.365+0000 7f66f06f9640 1 -- 172.21.15.120:0/886538464 shutdown_connections 2024-07-27T03:12:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.365+0000 7f66f06f9640 1 -- 172.21.15.120:0/886538464 wait complete. 2024-07-27T03:12:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.367+0000 7f66f06f9640 1 Processor -- start 2024-07-27T03:12:21.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.367+0000 7f66f06f9640 1 -- start start 2024-07-27T03:12:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.368+0000 7f66f06f9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e806eb00 0x7f66e809d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.368+0000 7f66f06f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f66e81585d0 0x7f66e8151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.368+0000 7f66f06f9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66e815c000 0x7f66e80c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.368+0000 7f66f06f9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f66e806e6b0 con 0x7f66e806eb00 2024-07-27T03:12:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.368+0000 7f66f06f9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f66e806e530 con 0x7f66e815c000 2024-07-27T03:12:21.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.368+0000 7f66f06f9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f66e806e830 con 0x7f66e81585d0 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.368+0000 7f66ee495640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e806eb00 0x7f66e809d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.368+0000 7f66ee495640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e806eb00 0x7f66e809d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60142/0 (socket says 172.21.15.120:60142) 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66ee495640 1 -- 172.21.15.120:0/1278906357 learned_addr learned my addr 172.21.15.120:0/1278906357 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66eec96640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66e815c000 0x7f66e80c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66edc94640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f66e81585d0 0x7f66e8151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66ee495640 1 -- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f66e81585d0 msgr2=0x7f66e8151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66ee495640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f66e81585d0 0x7f66e8151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66ee495640 1 -- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66e815c000 msgr2=0x7f66e80c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66ee495640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66e815c000 0x7f66e80c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66ee495640 1 -- 172.21.15.120:0/1278906357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e809c950 con 0x7f66e806eb00 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66ee495640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e806eb00 0x7f66e809d9b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c6c0 tx=0x7f66e400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66deffd640 1 -- 172.21.15.120:0/1278906357 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4003b70 con 0x7f66e806eb00 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66deffd640 1 -- 172.21.15.120:0/1278906357 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66e4003d10 con 0x7f66e806eb00 2024-07-27T03:12:21.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66deffd640 1 -- 172.21.15.120:0/1278906357 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4005330 con 0x7f66e806eb00 2024-07-27T03:12:21.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66f06f9640 1 -- 172.21.15.120:0/1278906357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e809cbf0 con 0x7f66e806eb00 2024-07-27T03:12:21.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.369+0000 7f66f06f9640 1 -- 172.21.15.120:0/1278906357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e809d1b0 con 0x7f66e806eb00 2024-07-27T03:12:21.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.370+0000 7f66f06f9640 1 -- 172.21.15.120:0/1278906357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e806ef10 con 0x7f66e806eb00 2024-07-27T03:12:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.371+0000 7f66deffd640 1 -- 172.21.15.120:0/1278906357 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f66e40054d0 con 0x7f66e806eb00 2024-07-27T03:12:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.371+0000 7f66deffd640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f66cc077040 0x7f66cc079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.372+0000 7f66deffd640 1 -- 172.21.15.120:0/1278906357 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f66e4098540 con 0x7f66e806eb00 2024-07-27T03:12:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.372+0000 7f66edc94640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f66cc077040 0x7f66cc079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.372+0000 7f66edc94640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f66cc077040 0x7f66cc079550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f66e8157500 tx=0x7f66d8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:21.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.376+0000 7f66deffd640 1 -- 172.21.15.120:0/1278906357 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f66e806f450 con 0x7f66e806eb00 2024-07-27T03:12:21.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.597+0000 7f66f06f9640 1 -- 172.21.15.120:0/1278906357 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f66e8159e90 con 0x7f66e806eb00 2024-07-27T03:12:21.600 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-07-27T03:12:21.598+0000 7fd09694b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-27T03:12:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.601+0000 7f66deffd640 1 -- 172.21.15.120:0/1278906357 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) ==== 161+0+0 (secure 0 0 0) 0x7f66e4061180 con 0x7f66e806eb00 2024-07-27T03:12:21.604 INFO:teuthology.orchestra.run.smithi120.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-07-27T03:12:21.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 -- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f66cc077040 msgr2=0x7f66cc079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f66cc077040 0x7f66cc079550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f66e8157500 tx=0x7f66d8005f90 comp rx=0 tx=0).stop 2024-07-27T03:12:21.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 -- 172.21.15.120:0/1278906357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e806eb00 msgr2=0x7f66e809d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e806eb00 0x7f66e809d9b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c6c0 tx=0x7f66e400cb80 comp rx=0 tx=0).stop 2024-07-27T03:12:21.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 -- 172.21.15.120:0/1278906357 shutdown_connections 2024-07-27T03:12:21.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f66cc077040 0x7f66cc079550 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66e815c000 0x7f66e80c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f66e81585d0 0x7f66e8151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 --2- 172.21.15.120:0/1278906357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f66e806eb00 0x7f66e809d9b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 -- 172.21.15.120:0/1278906357 >> 172.21.15.120:0/1278906357 conn(0x7f66e80b1a10 msgr2=0x7f66e80b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:21.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 -- 172.21.15.120:0/1278906357 shutdown_connections 2024-07-27T03:12:21.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.604+0000 7f66f06f9640 1 -- 172.21.15.120:0/1278906357 wait complete. 2024-07-27T03:12:21.623 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-07-27T03:12:21.671 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-07-27T03:12:21.673 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-07-27T03:12:21.677 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-07-27T03:12:21.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.744+0000 7fc97d05a640 1 -- 172.21.15.120:0/4073904329 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9780b4740 msgr2=0x7fc9780b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.744+0000 7fc97d05a640 1 --2- 172.21.15.120:0/4073904329 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9780b4740 0x7fc9780b2c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc968009830 tx=0x7fc96802a510 comp rx=0 tx=0).stop 2024-07-27T03:12:21.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.744+0000 7fc97d05a640 1 -- 172.21.15.120:0/4073904329 shutdown_connections 2024-07-27T03:12:21.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.744+0000 7fc97d05a640 1 --2- 172.21.15.120:0/4073904329 >> v2:172.21.15.121:3300/0 conn(0x7fc9780d27e0 0x7fc9780d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.744+0000 7fc97d05a640 1 --2- 172.21.15.120:0/4073904329 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9780b4740 0x7fc9780b2c40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.744+0000 7fc97d05a640 1 -- 172.21.15.120:0/4073904329 >> 172.21.15.120:0/4073904329 conn(0x7fc97808d690 msgr2=0x7fc97809d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:21.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.744+0000 7fc97d05a640 1 -- 172.21.15.120:0/4073904329 shutdown_connections 2024-07-27T03:12:21.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.744+0000 7fc97d05a640 1 -- 172.21.15.120:0/4073904329 wait complete. 2024-07-27T03:12:21.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.746+0000 7fc97d05a640 1 Processor -- start 2024-07-27T03:12:21.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.746+0000 7fc97d05a640 1 -- start start 2024-07-27T03:12:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.747+0000 7fc97d05a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9780b4740 0x7fc97809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.747+0000 7fc97d05a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9780d09c0 0x7fc9781f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.747+0000 7fc97d05a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9780d27e0 0x7fc9781f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.747+0000 7fc97d05a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc9780cef70 con 0x7fc9780d09c0 2024-07-27T03:12:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.747+0000 7fc97d05a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc9780cedf0 con 0x7fc9780b4740 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.747+0000 7fc97d05a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc9780cf0f0 con 0x7fc9780d27e0 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9780d09c0 0x7fc9781f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9780d09c0 0x7fc9781f8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51704/0 (socket says 172.21.15.120:51704) 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96e59c640 1 -- 172.21.15.120:0/3816663576 learned_addr learned my addr 172.21.15.120:0/3816663576 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc976d9d640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9780b4740 0x7fc97809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc97759e640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9780d27e0 0x7fc9781f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96e59c640 1 -- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9780d27e0 msgr2=0x7fc9781f9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96e59c640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9780d27e0 0x7fc9781f9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96e59c640 1 -- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9780b4740 msgr2=0x7fc97809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96e59c640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9780b4740 0x7fc97809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96e59c640 1 -- 172.21.15.120:0/3816663576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9780b7ef0 con 0x7fc9780d09c0 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc976d9d640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9780b4740 0x7fc97809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:12:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96e59c640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9780d09c0 0x7fc9781f8b00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc96000e9c0 tx=0x7fc96000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:21.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96ffff640 1 -- 172.21.15.120:0/3816663576 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96000cd80 con 0x7fc9780d09c0 2024-07-27T03:12:21.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96ffff640 1 -- 172.21.15.120:0/3816663576 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc960004020 con 0x7fc9780d09c0 2024-07-27T03:12:21.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc97d05a640 1 -- 172.21.15.120:0/3816663576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9780b81d0 con 0x7fc9780d09c0 2024-07-27T03:12:21.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc96ffff640 1 -- 172.21.15.120:0/3816663576 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960004450 con 0x7fc9780d09c0 2024-07-27T03:12:21.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.748+0000 7fc97d05a640 1 -- 172.21.15.120:0/3816663576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97814fe20 con 0x7fc9780d09c0 2024-07-27T03:12:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.749+0000 7fc97d05a640 1 -- 172.21.15.120:0/3816663576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9780b86f0 con 0x7fc9780d09c0 2024-07-27T03:12:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.750+0000 7fc96ffff640 1 -- 172.21.15.120:0/3816663576 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc9600035f0 con 0x7fc9780d09c0 2024-07-27T03:12:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.751+0000 7fc96ffff640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc958077010 0x7fc958079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.751+0000 7fc96ffff640 1 -- 172.21.15.120:0/3816663576 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5967+0+0 (secure 0 0 0) 0x7fc960099100 con 0x7fc9780d09c0 2024-07-27T03:12:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.751+0000 7fc976d9d640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc958077010 0x7fc958079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:21.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.751+0000 7fc976d9d640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc958077010 0x7fc958079520 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc968034000 tx=0x7fc968004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:21.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.755+0000 7fc96ffff640 1 -- 172.21.15.120:0/3816663576 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc9780b86f0 con 0x7fc9780d09c0 2024-07-27T03:12:21.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:21.973+0000 7fc97d05a640 1 -- 172.21.15.120:0/3816663576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc9780b7c80 con 0x7fc9780d09c0 2024-07-27T03:12:22.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.603+0000 7fc96ffff640 1 -- 172.21.15.120:0/3816663576 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) ==== 104+0+0 (secure 0 0 0) 0x7fc960061c40 con 0x7fc9780d09c0 2024-07-27T03:12:22.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 -- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc958077010 msgr2=0x7fc958079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:22.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc958077010 0x7fc958079520 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc968034000 tx=0x7fc968004730 comp rx=0 tx=0).stop 2024-07-27T03:12:22.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 -- 172.21.15.120:0/3816663576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9780d09c0 msgr2=0x7fc9781f8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:22.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9780d09c0 0x7fc9781f8b00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc96000e9c0 tx=0x7fc96000ee80 comp rx=0 tx=0).stop 2024-07-27T03:12:22.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 -- 172.21.15.120:0/3816663576 shutdown_connections 2024-07-27T03:12:22.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc958077010 0x7fc958079520 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:22.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9780d09c0 0x7fc9781f8b00 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:22.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc9780d27e0 0x7fc9781f9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:22.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 --2- 172.21.15.120:0/3816663576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9780b4740 0x7fc97809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:22.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 -- 172.21.15.120:0/3816663576 >> 172.21.15.120:0/3816663576 conn(0x7fc97808d690 msgr2=0x7fc97815f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:22.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 -- 172.21.15.120:0/3816663576 shutdown_connections 2024-07-27T03:12:22.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.606+0000 7fc97d05a640 1 -- 172.21.15.120:0/3816663576 wait complete. 2024-07-27T03:12:22.623 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-07-27T03:12:22.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.744+0000 7f301a14d640 1 -- 172.21.15.120:0/231105751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3014152060 msgr2=0x7f3014073430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:22.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.744+0000 7f301a14d640 1 --2- 172.21.15.120:0/231105751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3014152060 0x7f3014073430 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3004005fd0 tx=0x7f300402a5d0 comp rx=0 tx=0).stop 2024-07-27T03:12:22.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.745+0000 7f301a14d640 1 -- 172.21.15.120:0/231105751 shutdown_connections 2024-07-27T03:12:22.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.745+0000 7f301a14d640 1 --2- 172.21.15.120:0/231105751 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f301415c140 0x7f301406f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:22.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.745+0000 7f301a14d640 1 --2- 172.21.15.120:0/231105751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3014152060 0x7f3014073430 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:22.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.745+0000 7f301a14d640 1 -- 172.21.15.120:0/231105751 >> 172.21.15.120:0/231105751 conn(0x7f301406dec0 msgr2=0x7f30140b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:22.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.745+0000 7f301a14d640 1 -- 172.21.15.120:0/231105751 shutdown_connections 2024-07-27T03:12:22.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.745+0000 7f301a14d640 1 -- 172.21.15.120:0/231105751 wait complete. 2024-07-27T03:12:22.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.746+0000 7f301a14d640 1 Processor -- start 2024-07-27T03:12:22.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.747+0000 7f301a14d640 1 -- start start 2024-07-27T03:12:22.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f301a14d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014073970 0x7f3014142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:22.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f301a14d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3014152060 0x7f301414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:22.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f301a14d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301415c140 0x7f301414e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:22.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f301a14d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f301406fbe0 con 0x7f301415c140 2024-07-27T03:12:22.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f301a14d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f30141526c0 con 0x7f3014073970 2024-07-27T03:12:22.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f301a14d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f301406fd60 con 0x7f3014152060 2024-07-27T03:12:22.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f3013fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301415c140 0x7f301414e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:22.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f3013fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301415c140 0x7f301414e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51714/0 (socket says 172.21.15.120:51714) 2024-07-27T03:12:22.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f3013fff640 1 -- 172.21.15.120:0/1433345516 learned_addr learned my addr 172.21.15.120:0/1433345516 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:22.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f30137fe640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014073970 0x7f3014142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:22.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f3012ffd640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3014152060 0x7f301414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f3013fff640 1 -- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3014152060 msgr2=0x7f301414e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f3013fff640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3014152060 0x7f301414e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f3013fff640 1 -- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014073970 msgr2=0x7f3014142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f3013fff640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014073970 0x7f3014142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f3013fff640 1 -- 172.21.15.120:0/1433345516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3014152e20 con 0x7f301415c140 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f30137fe640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014073970 0x7f3014142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f3013fff640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301415c140 0x7f301414e800 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f300c00ea70 tx=0x7f300c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.748+0000 7f2ffbfff640 1 -- 172.21.15.120:0/1433345516 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c00ce40 con 0x7f301415c140 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.749+0000 7f2ffbfff640 1 -- 172.21.15.120:0/1433345516 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f300c004c10 con 0x7f301415c140 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.749+0000 7f301a14d640 1 -- 172.21.15.120:0/1433345516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3014153100 con 0x7f301415c140 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.749+0000 7f2ffbfff640 1 -- 172.21.15.120:0/1433345516 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c005020 con 0x7f301415c140 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.749+0000 7f301a14d640 1 -- 172.21.15.120:0/1433345516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30141536c0 con 0x7f301415c140 2024-07-27T03:12:22.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.749+0000 7f301a14d640 1 -- 172.21.15.120:0/1433345516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f301406a060 con 0x7f301415c140 2024-07-27T03:12:22.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.750+0000 7f2ffbfff640 1 -- 172.21.15.120:0/1433345516 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f300c0051c0 con 0x7f301415c140 2024-07-27T03:12:22.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.751+0000 7f2ffbfff640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000079250 0x7f300007b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:22.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.751+0000 7f2ffbfff640 1 -- 172.21.15.120:0/1433345516 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5967+0+0 (secure 0 0 0) 0x7f300c0997e0 con 0x7f301415c140 2024-07-27T03:12:22.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.751+0000 7f30137fe640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000079250 0x7f300007b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:22.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.752+0000 7f30137fe640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000079250 0x7f300007b760 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3004033000 tx=0x7f3004004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:22.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.755+0000 7f2ffbfff640 1 -- 172.21.15.120:0/1433345516 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f301406a060 con 0x7f301415c140 2024-07-27T03:12:22.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:22.936+0000 7f301a14d640 1 -- 172.21.15.120:0/1433345516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3014152bb0 con 0x7f301415c140 2024-07-27T03:12:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.711+0000 7f2ffbfff640 1 -- 172.21.15.120:0/1433345516 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) ==== 181+0+0 (secure 0 0 0) 0x7f300c0628e0 con 0x7f301415c140 2024-07-27T03:12:23.714 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' removed 2024-07-27T03:12:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.714+0000 7f301a14d640 1 -- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000079250 msgr2=0x7f300007b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.714+0000 7f301a14d640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000079250 0x7f300007b760 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3004033000 tx=0x7f3004004730 comp rx=0 tx=0).stop 2024-07-27T03:12:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.714+0000 7f301a14d640 1 -- 172.21.15.120:0/1433345516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301415c140 msgr2=0x7f301414e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.715+0000 7f301a14d640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301415c140 0x7f301414e800 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f300c00ea70 tx=0x7f300c00ef30 comp rx=0 tx=0).stop 2024-07-27T03:12:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.715+0000 7f301a14d640 1 -- 172.21.15.120:0/1433345516 shutdown_connections 2024-07-27T03:12:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.715+0000 7f301a14d640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f3000079250 0x7f300007b760 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.715+0000 7f301a14d640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301415c140 0x7f301414e800 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.715+0000 7f301a14d640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3014152060 0x7f301414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.715+0000 7f301a14d640 1 --2- 172.21.15.120:0/1433345516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3014073970 0x7f3014142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.715+0000 7f301a14d640 1 -- 172.21.15.120:0/1433345516 >> 172.21.15.120:0/1433345516 conn(0x7f301406dec0 msgr2=0x7f30140b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.715+0000 7f301a14d640 1 -- 172.21.15.120:0/1433345516 shutdown_connections 2024-07-27T03:12:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.715+0000 7f301a14d640 1 -- 172.21.15.120:0/1433345516 wait complete. 2024-07-27T03:12:23.732 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-07-27T03:12:23.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.853+0000 7ff2f0dab640 1 -- 172.21.15.120:0/795594995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec0b9ad0 msgr2=0x7ff2ec0d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:23.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.853+0000 7ff2f0dab640 1 --2- 172.21.15.120:0/795594995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec0b9ad0 0x7ff2ec0d0ee0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009820 tx=0x7ff2dc02a480 comp rx=0 tx=0).stop 2024-07-27T03:12:23.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.853+0000 7ff2f0dab640 1 -- 172.21.15.120:0/795594995 shutdown_connections 2024-07-27T03:12:23.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.853+0000 7ff2f0dab640 1 --2- 172.21.15.120:0/795594995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec0b9ad0 0x7ff2ec0d0ee0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:23.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.853+0000 7ff2f0dab640 1 -- 172.21.15.120:0/795594995 >> 172.21.15.120:0/795594995 conn(0x7ff2ec08d8f0 msgr2=0x7ff2ec09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:23.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.853+0000 7ff2f0dab640 1 -- 172.21.15.120:0/795594995 shutdown_connections 2024-07-27T03:12:23.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.853+0000 7ff2f0dab640 1 -- 172.21.15.120:0/795594995 wait complete. 2024-07-27T03:12:23.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.855+0000 7ff2f0dab640 1 Processor -- start 2024-07-27T03:12:23.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.855+0000 7ff2f0dab640 1 -- start start 2024-07-27T03:12:23.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.856+0000 7ff2f0dab640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2ec0b2ea0 0x7ff2ec152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:23.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.856+0000 7ff2f0dab640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec0b9ad0 0x7ff2ec0b8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:23.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.856+0000 7ff2f0dab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec0ceb10 0x7ff2ec15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:23.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.856+0000 7ff2f0dab640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec169b30 con 0x7ff2ec0b9ad0 2024-07-27T03:12:23.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.856+0000 7ff2f0dab640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1699b0 con 0x7ff2ec0ceb10 2024-07-27T03:12:23.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.856+0000 7ff2f0dab640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ec169cb0 con 0x7ff2ec0b2ea0 2024-07-27T03:12:23.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e9d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec0b9ad0 0x7ff2ec0b8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:23.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e9d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec0b9ad0 0x7ff2ec0b8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51730/0 (socket says 172.21.15.120:51730) 2024-07-27T03:12:23.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e9d9b640 1 -- 172.21.15.120:0/1622862504 learned_addr learned my addr 172.21.15.120:0/1622862504 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2ead9d640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec0ceb10 0x7ff2ec15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2ea59c640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2ec0b2ea0 0x7ff2ec152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e9d9b640 1 -- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2ec0b2ea0 msgr2=0x7ff2ec152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e9d9b640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2ec0b2ea0 0x7ff2ec152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e9d9b640 1 -- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec0ceb10 msgr2=0x7ff2ec15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e9d9b640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec0ceb10 0x7ff2ec15a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e9d9b640 1 -- 172.21.15.120:0/1622862504 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec1f9b90 con 0x7ff2ec0b9ad0 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e9d9b640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec0b9ad0 0x7ff2ec0b8680 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400b3e0 tx=0x7ff2d400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e2ffd640 1 -- 172.21.15.120:0/1622862504 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4015020 con 0x7ff2ec0b9ad0 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e2ffd640 1 -- 172.21.15.120:0/1622862504 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2d4011920 con 0x7ff2ec0b9ad0 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2f0dab640 1 -- 172.21.15.120:0/1622862504 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ec1f8f80 con 0x7ff2ec0b9ad0 2024-07-27T03:12:23.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2e2ffd640 1 -- 172.21.15.120:0/1622862504 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4011d70 con 0x7ff2ec0b9ad0 2024-07-27T03:12:23.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.857+0000 7ff2f0dab640 1 -- 172.21.15.120:0/1622862504 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ec1f9540 con 0x7ff2ec0b9ad0 2024-07-27T03:12:23.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.858+0000 7ff2f0dab640 1 -- 172.21.15.120:0/1622862504 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2ec1f8cf0 con 0x7ff2ec0b9ad0 2024-07-27T03:12:23.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.859+0000 7ff2e2ffd640 1 -- 172.21.15.120:0/1622862504 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff2d4018020 con 0x7ff2ec0b9ad0 2024-07-27T03:12:23.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.860+0000 7ff2e2ffd640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2cc077010 0x7ff2cc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:23.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.860+0000 7ff2e2ffd640 1 -- 172.21.15.120:0/1622862504 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5529+0+0 (secure 0 0 0) 0x7ff2d4098640 con 0x7ff2ec0b9ad0 2024-07-27T03:12:23.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.860+0000 7ff2ea59c640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2cc077010 0x7ff2cc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:23.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.860+0000 7ff2ea59c640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2cc077010 0x7ff2cc079520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc034000 tx=0x7ff2dc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:23.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:23.864+0000 7ff2e2ffd640 1 -- 172.21.15.120:0/1622862504 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff2d401f020 con 0x7ff2ec0b9ad0 2024-07-27T03:12:24.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.047+0000 7ff2f0dab640 1 -- 172.21.15.120:0/1622862504 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff2ec0d0ee0 con 0x7ff2ec0b9ad0 2024-07-27T03:12:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.718+0000 7ff2e2ffd640 1 -- 172.21.15.120:0/1622862504 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) ==== 169+0+0 (secure 0 0 0) 0x7ff2d40612a0 con 0x7ff2ec0b9ad0 2024-07-27T03:12:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' removed 2024-07-27T03:12:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.722+0000 7ff2f0dab640 1 -- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2cc077010 msgr2=0x7ff2cc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.722+0000 7ff2f0dab640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2cc077010 0x7ff2cc079520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc034000 tx=0x7ff2dc004730 comp rx=0 tx=0).stop 2024-07-27T03:12:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.722+0000 7ff2f0dab640 1 -- 172.21.15.120:0/1622862504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec0b9ad0 msgr2=0x7ff2ec0b8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.722+0000 7ff2f0dab640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec0b9ad0 0x7ff2ec0b8680 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400b3e0 tx=0x7ff2d400b8a0 comp rx=0 tx=0).stop 2024-07-27T03:12:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.722+0000 7ff2f0dab640 1 -- 172.21.15.120:0/1622862504 shutdown_connections 2024-07-27T03:12:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.722+0000 7ff2f0dab640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2cc077010 0x7ff2cc079520 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc034000 tx=0x7ff2dc004730 comp rx=0 tx=0).stop 2024-07-27T03:12:24.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.722+0000 7ff2f0dab640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec0b9ad0 0x7ff2ec0b8680 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.722+0000 7ff2f0dab640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec0ceb10 0x7ff2ec15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.722+0000 7ff2f0dab640 1 --2- 172.21.15.120:0/1622862504 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2ec0b2ea0 0x7ff2ec152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.722+0000 7ff2f0dab640 1 -- 172.21.15.120:0/1622862504 >> 172.21.15.120:0/1622862504 conn(0x7ff2ec08d8f0 msgr2=0x7ff2ec06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.723+0000 7ff2f0dab640 1 -- 172.21.15.120:0/1622862504 shutdown_connections 2024-07-27T03:12:24.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.723+0000 7ff2f0dab640 1 -- 172.21.15.120:0/1622862504 wait complete. 2024-07-27T03:12:24.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-07-27T03:12:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.853+0000 7feee228b640 1 -- 172.21.15.120:0/3373325821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feedc15c220 msgr2=0x7feedc152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.853+0000 7feee228b640 1 --2- 172.21.15.120:0/3373325821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feedc15c220 0x7feedc152160 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7feedc15bd00 tx=0x7feecc02a560 comp rx=0 tx=0).stop 2024-07-27T03:12:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.853+0000 7feee228b640 1 -- 172.21.15.120:0/3373325821 shutdown_connections 2024-07-27T03:12:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.853+0000 7feee228b640 1 --2- 172.21.15.120:0/3373325821 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feedc15ec20 0x7feedc15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.853+0000 7feee228b640 1 --2- 172.21.15.120:0/3373325821 >> v2:172.21.15.121:3300/0 conn(0x7feedc0b5cd0 0x7feedc0b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.853+0000 7feee228b640 1 --2- 172.21.15.120:0/3373325821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feedc15c220 0x7feedc152160 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.853+0000 7feee228b640 1 -- 172.21.15.120:0/3373325821 >> 172.21.15.120:0/3373325821 conn(0x7feedc06cba0 msgr2=0x7feedc06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.853+0000 7feee228b640 1 -- 172.21.15.120:0/3373325821 shutdown_connections 2024-07-27T03:12:24.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.853+0000 7feee228b640 1 -- 172.21.15.120:0/3373325821 wait complete. 2024-07-27T03:12:24.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.854+0000 7feee228b640 1 Processor -- start 2024-07-27T03:12:24.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.855+0000 7feee228b640 1 -- start start 2024-07-27T03:12:24.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee228b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feedc0b5cd0 0x7feedc1408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:24.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee228b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feedc15c220 0x7feedc142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:24.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee228b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feedc15ec20 0x7feedc1434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:24.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee228b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7feedc0cd920 con 0x7feedc15ec20 2024-07-27T03:12:24.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee228b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feedc0cd7a0 con 0x7feedc0b5cd0 2024-07-27T03:12:24.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee228b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7feedc0cdaa0 con 0x7feedc15c220 2024-07-27T03:12:24.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee0828640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feedc15ec20 0x7feedc1434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:24.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee0828640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feedc15ec20 0x7feedc1434e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51740/0 (socket says 172.21.15.120:51740) 2024-07-27T03:12:24.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee0828640 1 -- 172.21.15.120:0/1098330848 learned_addr learned my addr 172.21.15.120:0/1098330848 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:24.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feedbfff640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feedc0b5cd0 0x7feedc1408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feedb7fe640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feedc15c220 0x7feedc142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee0828640 1 -- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feedc15c220 msgr2=0x7feedc142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee0828640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feedc15c220 0x7feedc142fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee0828640 1 -- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feedc0b5cd0 msgr2=0x7feedc1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee0828640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feedc0b5cd0 0x7feedc1408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.856+0000 7feee0828640 1 -- 172.21.15.120:0/1098330848 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc1f2f50 con 0x7feedc15ec20 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.857+0000 7feee0828640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feedc15ec20 0x7feedc1434e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feed400caa0 tx=0x7feed400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.857+0000 7feed8ff9640 1 -- 172.21.15.120:0/1098330848 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed400ad30 con 0x7feedc15ec20 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.857+0000 7feed8ff9640 1 -- 172.21.15.120:0/1098330848 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feed400f450 con 0x7feedc15ec20 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.857+0000 7feed8ff9640 1 -- 172.21.15.120:0/1098330848 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed400f8a0 con 0x7feedc15ec20 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.857+0000 7feee228b640 1 -- 172.21.15.120:0/1098330848 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feedc143dc0 con 0x7feedc15ec20 2024-07-27T03:12:24.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.857+0000 7feee228b640 1 -- 172.21.15.120:0/1098330848 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feedc1f34f0 con 0x7feedc15ec20 2024-07-27T03:12:24.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.858+0000 7feee228b640 1 -- 172.21.15.120:0/1098330848 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feedc1f2d80 con 0x7feedc15ec20 2024-07-27T03:12:24.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.858+0000 7feed8ff9640 1 -- 172.21.15.120:0/1098330848 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7feed400fa40 con 0x7feedc15ec20 2024-07-27T03:12:24.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.859+0000 7feed8ff9640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feec8077010 0x7feec8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:24.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.859+0000 7feed8ff9640 1 -- 172.21.15.120:0/1098330848 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5115+0+0 (secure 0 0 0) 0x7feed40990c0 con 0x7feedc15ec20 2024-07-27T03:12:24.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.859+0000 7feedbfff640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feec8077010 0x7feec8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:24.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.860+0000 7feedbfff640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feec8077010 0x7feec8079520 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feecc033000 tx=0x7feecc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:24.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:24.864+0000 7feed8ff9640 1 -- 172.21.15.120:0/1098330848 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7feed4014030 con 0x7feedc15ec20 2024-07-27T03:12:25.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.052+0000 7feee228b640 1 -- 172.21.15.120:0/1098330848 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7feedc0ce030 con 0x7feedc15ec20 2024-07-27T03:12:25.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.055+0000 7feed8ff9640 1 -- 172.21.15.120:0/1098330848 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v36) ==== 71+0+0 (secure 0 0 0) 0x7feed4062510 con 0x7feedc15ec20 2024-07-27T03:12:25.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 -- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feec8077010 msgr2=0x7feec8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:25.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feec8077010 0x7feec8079520 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feecc033000 tx=0x7feecc004730 comp rx=0 tx=0).stop 2024-07-27T03:12:25.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 -- 172.21.15.120:0/1098330848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feedc15ec20 msgr2=0x7feedc1434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:25.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feedc15ec20 0x7feedc1434e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feed400caa0 tx=0x7feed400cf60 comp rx=0 tx=0).stop 2024-07-27T03:12:25.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 -- 172.21.15.120:0/1098330848 shutdown_connections 2024-07-27T03:12:25.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7feec8077010 0x7feec8079520 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feedc15ec20 0x7feedc1434e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feedc15c220 0x7feedc142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 --2- 172.21.15.120:0/1098330848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feedc0b5cd0 0x7feedc1408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 -- 172.21.15.120:0/1098330848 >> 172.21.15.120:0/1098330848 conn(0x7feedc06cba0 msgr2=0x7feedc15d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:25.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 -- 172.21.15.120:0/1098330848 shutdown_connections 2024-07-27T03:12:25.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.058+0000 7feee228b640 1 -- 172.21.15.120:0/1098330848 wait complete. 2024-07-27T03:12:25.072 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_random_overried_rank_mask' 2024-07-27T03:12:25.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.183+0000 7ff320e0c640 1 -- 172.21.15.120:0/1779493148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff31c0715e0 msgr2=0x7ff31c0719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:25.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.183+0000 7ff320e0c640 1 --2- 172.21.15.120:0/1779493148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff31c0715e0 0x7ff31c0719f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff31c076570 tx=0x7ff31402a9c0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.183+0000 7ff320e0c640 1 -- 172.21.15.120:0/1779493148 shutdown_connections 2024-07-27T03:12:25.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.183+0000 7ff320e0c640 1 --2- 172.21.15.120:0/1779493148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff31c0715e0 0x7ff31c0719f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.183+0000 7ff320e0c640 1 --2- 172.21.15.120:0/1779493148 >> v2:172.21.15.121:3300/0 conn(0x7ff31c0b4d30 0x7ff31c158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.183+0000 7ff320e0c640 1 --2- 172.21.15.120:0/1779493148 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff31c15c500 0x7ff31c074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.183+0000 7ff320e0c640 1 -- 172.21.15.120:0/1779493148 >> 172.21.15.120:0/1779493148 conn(0x7ff31c0d0f00 msgr2=0x7ff31c0d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:25.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.183+0000 7ff320e0c640 1 -- 172.21.15.120:0/1779493148 shutdown_connections 2024-07-27T03:12:25.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.183+0000 7ff320e0c640 1 -- 172.21.15.120:0/1779493148 wait complete. 2024-07-27T03:12:25.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.185+0000 7ff320e0c640 1 Processor -- start 2024-07-27T03:12:25.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.185+0000 7ff320e0c640 1 -- start start 2024-07-27T03:12:25.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff320e0c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff31c0715e0 0x7ff31c154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:25.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff320e0c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff31c0b4d30 0x7ff31c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:25.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff320e0c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff31c15c500 0x7ff31c06c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:25.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff320e0c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c15f1b0 con 0x7ff31c0b4d30 2024-07-27T03:12:25.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff320e0c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c15f030 con 0x7ff31c15c500 2024-07-27T03:12:25.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff320e0c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff31c15f330 con 0x7ff31c0715e0 2024-07-27T03:12:25.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff311d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff31c0b4d30 0x7ff31c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:25.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff311d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff31c0b4d30 0x7ff31c0ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51758/0 (socket says 172.21.15.120:51758) 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff311d9b640 1 -- 172.21.15.120:0/272162215 learned_addr learned my addr 172.21.15.120:0/272162215 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff31a59c640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff31c0715e0 0x7ff31c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff31ad9d640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff31c15c500 0x7ff31c06c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff311d9b640 1 -- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff31c0715e0 msgr2=0x7ff31c154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff311d9b640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff31c0715e0 0x7ff31c154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff311d9b640 1 -- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff31c15c500 msgr2=0x7ff31c06c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff311d9b640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff31c15c500 0x7ff31c06c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff311d9b640 1 -- 172.21.15.120:0/272162215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c1f3780 con 0x7ff31c0b4d30 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff311d9b640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff31c0b4d30 0x7ff31c0ccb30 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff30400d620 tx=0x7ff30400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff3137fe640 1 -- 172.21.15.120:0/272162215 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304017070 con 0x7ff31c0b4d30 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff3137fe640 1 -- 172.21.15.120:0/272162215 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff304009a70 con 0x7ff31c0b4d30 2024-07-27T03:12:25.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff3137fe640 1 -- 172.21.15.120:0/272162215 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304010460 con 0x7ff31c0b4d30 2024-07-27T03:12:25.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.187+0000 7ff320e0c640 1 -- 172.21.15.120:0/272162215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff31c1f3a60 con 0x7ff31c0b4d30 2024-07-27T03:12:25.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.188+0000 7ff320e0c640 1 -- 172.21.15.120:0/272162215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff31c1f4020 con 0x7ff31c0b4d30 2024-07-27T03:12:25.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.189+0000 7ff320e0c640 1 -- 172.21.15.120:0/272162215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff31c1f34f0 con 0x7ff31c0b4d30 2024-07-27T03:12:25.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.189+0000 7ff3137fe640 1 -- 172.21.15.120:0/272162215 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff30401a070 con 0x7ff31c0b4d30 2024-07-27T03:12:25.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.190+0000 7ff3137fe640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2fc077010 0x7ff2fc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:25.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.190+0000 7ff3137fe640 1 -- 172.21.15.120:0/272162215 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5115+0+0 (secure 0 0 0) 0x7ff304098610 con 0x7ff31c0b4d30 2024-07-27T03:12:25.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.190+0000 7ff31a59c640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2fc077010 0x7ff2fc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:25.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.191+0000 7ff31a59c640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2fc077010 0x7ff2fc079520 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff30c005fd0 tx=0x7ff30c00a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:25.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.194+0000 7ff3137fe640 1 -- 172.21.15.120:0/272162215 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff304061410 con 0x7ff31c0b4d30 2024-07-27T03:12:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.458+0000 7ff320e0c640 1 -- 172.21.15.120:0/272162215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_random_overried_rank_mask"]} v 0) -- 0x7ff31c158da0 con 0x7ff31c0b4d30 2024-07-27T03:12:25.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.720+0000 7ff3137fe640 1 -- 172.21.15.120:0/272162215 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_exports.TestBalMask.test_ephemeral_random_overried_rank_mask"]}]=0 v192) ==== 157+0+0 (secure 0 0 0) 0x7ff304098020 con 0x7ff31c0b4d30 2024-07-27T03:12:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 -- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2fc077010 msgr2=0x7ff2fc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2fc077010 0x7ff2fc079520 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff30c005fd0 tx=0x7ff30c00a250 comp rx=0 tx=0).stop 2024-07-27T03:12:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 -- 172.21.15.120:0/272162215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff31c0b4d30 msgr2=0x7ff31c0ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff31c0b4d30 0x7ff31c0ccb30 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff30400d620 tx=0x7ff30400dae0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 -- 172.21.15.120:0/272162215 shutdown_connections 2024-07-27T03:12:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff2fc077010 0x7ff2fc079520 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff31c0b4d30 0x7ff31c0ccb30 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff31c15c500 0x7ff31c06c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 --2- 172.21.15.120:0/272162215 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff31c0715e0 0x7ff31c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 -- 172.21.15.120:0/272162215 >> 172.21.15.120:0/272162215 conn(0x7ff31c0d0f00 msgr2=0x7ff31c070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:25.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 -- 172.21.15.120:0/272162215 shutdown_connections 2024-07-27T03:12:25.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.722+0000 7ff320e0c640 1 -- 172.21.15.120:0/272162215 wait complete. 2024-07-27T03:12:25.736 INFO:tasks.cephfs_test_runner:that ephemeral random overrides ceph.dir.bal.mask. ... ok 2024-07-27T03:12:25.737 INFO:tasks.cephfs_test_runner:Starting test: test_mds_failover (tasks.cephfs.test_exports.TestBalMask) That MDS failover does not affect the ceph.dir.bal.mask. 2024-07-27T03:12:25.737 INFO:tasks.cephfs_test_runner:test_mds_failover (tasks.cephfs.test_exports.TestBalMask) 2024-07-27T03:12:25.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:12:25.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.848+0000 7febc9c43640 1 -- 172.21.15.120:0/2123680505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc40d0500 msgr2=0x7febc40d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:25.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.848+0000 7febc9c43640 1 --2- 172.21.15.120:0/2123680505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc40d0500 0x7febc40d0910 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7febc40738d0 tx=0x7febb802a4d0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.848+0000 7febc9c43640 1 -- 172.21.15.120:0/2123680505 shutdown_connections 2024-07-27T03:12:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.848+0000 7febc9c43640 1 --2- 172.21.15.120:0/2123680505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc40d0500 0x7febc40d0910 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.848+0000 7febc9c43640 1 --2- 172.21.15.120:0/2123680505 >> v2:172.21.15.121:3300/0 conn(0x7febc40b2110 0x7febc40b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.848+0000 7febc9c43640 1 -- 172.21.15.120:0/2123680505 >> 172.21.15.120:0/2123680505 conn(0x7febc40b3920 msgr2=0x7febc40b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.849+0000 7febc9c43640 1 -- 172.21.15.120:0/2123680505 shutdown_connections 2024-07-27T03:12:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.849+0000 7febc9c43640 1 -- 172.21.15.120:0/2123680505 wait complete. 2024-07-27T03:12:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.850+0000 7febc9c43640 1 Processor -- start 2024-07-27T03:12:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.850+0000 7febc9c43640 1 -- start start 2024-07-27T03:12:25.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc9c43640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc40b2110 0x7febc414cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc9c43640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febc40b4fd0 0x7febc414fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc9c43640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc40d0500 0x7febc40c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc9c43640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7febc40b5af0 con 0x7febc40b2110 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc9c43640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7febc415fcf0 con 0x7febc40d0500 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc9c43640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7febc40b5c70 con 0x7febc40b4fd0 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc40b2110 0x7febc414cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc40b2110 0x7febc414cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51770/0 (socket says 172.21.15.120:51770) 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc37fe640 1 -- 172.21.15.120:0/4049630261 learned_addr learned my addr 172.21.15.120:0/4049630261 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc3fff640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc40d0500 0x7febc40c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc2ffd640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febc40b4fd0 0x7febc414fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc37fe640 1 -- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febc40b4fd0 msgr2=0x7febc414fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc37fe640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febc40b4fd0 0x7febc414fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc37fe640 1 -- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc40d0500 msgr2=0x7febc40c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:25.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc37fe640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc40d0500 0x7febc40c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:25.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc37fe640 1 -- 172.21.15.120:0/4049630261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc40c7eb0 con 0x7febc40b2110 2024-07-27T03:12:25.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc3fff640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc40d0500 0x7febc40c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:25.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc2ffd640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febc40b4fd0 0x7febc414fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:25.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febc37fe640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc40b2110 0x7febc414cb30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7febb400d6d0 tx=0x7febb400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:25.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.852+0000 7febabfff640 1 -- 172.21.15.120:0/4049630261 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4017070 con 0x7febc40b2110 2024-07-27T03:12:25.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.853+0000 7febabfff640 1 -- 172.21.15.120:0/4049630261 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febb4005330 con 0x7febc40b2110 2024-07-27T03:12:25.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.853+0000 7febc9c43640 1 -- 172.21.15.120:0/4049630261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc40c8190 con 0x7febc40b2110 2024-07-27T03:12:25.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.853+0000 7febabfff640 1 -- 172.21.15.120:0/4049630261 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4009820 con 0x7febc40b2110 2024-07-27T03:12:25.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.853+0000 7febc9c43640 1 -- 172.21.15.120:0/4049630261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc40c8750 con 0x7febc40b2110 2024-07-27T03:12:25.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.854+0000 7febc9c43640 1 -- 172.21.15.120:0/4049630261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc40b6120 con 0x7febc40b2110 2024-07-27T03:12:25.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.854+0000 7febabfff640 1 -- 172.21.15.120:0/4049630261 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7febb4009bd0 con 0x7febc40b2110 2024-07-27T03:12:25.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.855+0000 7febabfff640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7febb0077010 0x7febb0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:25.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.855+0000 7febabfff640 1 -- 172.21.15.120:0/4049630261 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5115+0+0 (secure 0 0 0) 0x7febb4098960 con 0x7febc40b2110 2024-07-27T03:12:25.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.855+0000 7febc2ffd640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7febb0077010 0x7febb0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:25.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.856+0000 7febc2ffd640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7febb0077010 0x7febb0079520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7febb8033000 tx=0x7febb8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:25.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:25.859+0000 7febabfff640 1 -- 172.21.15.120:0/4049630261 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7febb4061db0 con 0x7febc40b2110 2024-07-27T03:12:26.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.046+0000 7febc9c43640 1 -- 172.21.15.120:0/4049630261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7febc415dfb0 con 0x7febc40b2110 2024-07-27T03:12:26.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.047+0000 7febabfff640 1 -- 172.21.15.120:0/4049630261 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+13310 (secure 0 0 0) 0x7febb406a080 con 0x7febc40b2110 2024-07-27T03:12:26.050 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:26.050 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":60,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:12:24.712508+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6834/1057652547":"2024-07-28T03:12:21.598489+0000","172.21.15.121:6837/1057652547":"2024-07-28T03:12:21.598489+0000","172.21.15.120:6835/3550669358":"2024-07-28T03:12:21.598494+0000","172.21.15.120:6833/3550669358":"2024-07-28T03:12:21.598494+0000","172.21.15.120:6834/2987877930":"2024-07-28T03:12:21.598471+0000","172.21.15.120:6832/2987877930":"2024-07-28T03:12:21.598471+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:12:26.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 -- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7febb0077010 msgr2=0x7febb0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:26.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7febb0077010 0x7febb0079520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7febb8033000 tx=0x7febb8004730 comp rx=0 tx=0).stop 2024-07-27T03:12:26.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 -- 172.21.15.120:0/4049630261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc40b2110 msgr2=0x7febc414cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:26.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc40b2110 0x7febc414cb30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7febb400d6d0 tx=0x7febb400db90 comp rx=0 tx=0).stop 2024-07-27T03:12:26.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 -- 172.21.15.120:0/4049630261 shutdown_connections 2024-07-27T03:12:26.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7febb0077010 0x7febb0079520 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc40d0500 0x7febc40c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febc40b4fd0 0x7febc414fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 --2- 172.21.15.120:0/4049630261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc40b2110 0x7febc414cb30 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 -- 172.21.15.120:0/4049630261 >> 172.21.15.120:0/4049630261 conn(0x7febc40b3920 msgr2=0x7febc415e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:26.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 -- 172.21.15.120:0/4049630261 shutdown_connections 2024-07-27T03:12:26.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.049+0000 7febc9c43640 1 -- 172.21.15.120:0/4049630261 wait complete. 2024-07-27T03:12:26.064 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-27T03:08:28.548271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-07-27T03:12:26.064 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-07-27T03:12:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.179+0000 7f430b16b640 1 -- 172.21.15.120:0/2310958241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43040b92c0 msgr2=0x7f43040cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.179+0000 7f430b16b640 1 --2- 172.21.15.120:0/2310958241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43040b92c0 0x7f43040cecc0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f43040ce750 tx=0x7f42f402a5f0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.179+0000 7f430b16b640 1 -- 172.21.15.120:0/2310958241 shutdown_connections 2024-07-27T03:12:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.179+0000 7f430b16b640 1 --2- 172.21.15.120:0/2310958241 >> v2:172.21.15.121:3300/0 conn(0x7f43040cf200 0x7f43040cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.179+0000 7f430b16b640 1 --2- 172.21.15.120:0/2310958241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43040b92c0 0x7f43040cecc0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.179+0000 7f430b16b640 1 -- 172.21.15.120:0/2310958241 >> 172.21.15.120:0/2310958241 conn(0x7f43040d3f70 msgr2=0x7f43040d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.179+0000 7f430b16b640 1 -- 172.21.15.120:0/2310958241 shutdown_connections 2024-07-27T03:12:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.179+0000 7f430b16b640 1 -- 172.21.15.120:0/2310958241 wait complete. 2024-07-27T03:12:26.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.180+0000 7f430b16b640 1 Processor -- start 2024-07-27T03:12:26.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.181+0000 7f430b16b640 1 -- start start 2024-07-27T03:12:26.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f430b16b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43040b92c0 0x7f43040a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:26.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f430b16b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43040cf200 0x7f430409dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:26.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f430b16b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43040d0730 0x7f43040cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:26.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f430b16b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f43040b4f60 con 0x7f43040d0730 2024-07-27T03:12:26.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f430b16b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43040b4de0 con 0x7f43040cf200 2024-07-27T03:12:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f430b16b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f43040b50e0 con 0x7f43040b92c0 2024-07-27T03:12:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f4309708640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43040d0730 0x7f43040cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f4309708640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43040d0730 0x7f43040cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51788/0 (socket says 172.21.15.120:51788) 2024-07-27T03:12:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f4309708640 1 -- 172.21.15.120:0/387378336 learned_addr learned my addr 172.21.15.120:0/387378336 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f4308f07640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43040b92c0 0x7f43040a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f4303fff640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43040cf200 0x7f430409dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f4309708640 1 -- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43040b92c0 msgr2=0x7f43040a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f4309708640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43040b92c0 0x7f43040a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f4309708640 1 -- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43040cf200 msgr2=0x7f430409dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f4309708640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43040cf200 0x7f430409dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f4309708640 1 -- 172.21.15.120:0/387378336 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430415d150 con 0x7f43040d0730 2024-07-27T03:12:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.182+0000 7f4303fff640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43040cf200 0x7f430409dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.183+0000 7f4309708640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43040d0730 0x7f43040cbaa0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00c6c0 tx=0x7f42fc00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.183+0000 7f43017fa640 1 -- 172.21.15.120:0/387378336 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc003b70 con 0x7f43040d0730 2024-07-27T03:12:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.183+0000 7f43017fa640 1 -- 172.21.15.120:0/387378336 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42fc003d30 con 0x7f43040d0730 2024-07-27T03:12:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.183+0000 7f430b16b640 1 -- 172.21.15.120:0/387378336 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43040a0640 con 0x7f43040d0730 2024-07-27T03:12:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.183+0000 7f43017fa640 1 -- 172.21.15.120:0/387378336 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc005330 con 0x7f43040d0730 2024-07-27T03:12:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.183+0000 7f430b16b640 1 -- 172.21.15.120:0/387378336 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43040a0c00 con 0x7f43040d0730 2024-07-27T03:12:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.184+0000 7f430b16b640 1 -- 172.21.15.120:0/387378336 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43040d1660 con 0x7f43040d0730 2024-07-27T03:12:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.184+0000 7f43017fa640 1 -- 172.21.15.120:0/387378336 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f42fc0054d0 con 0x7f43040d0730 2024-07-27T03:12:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.185+0000 7f43017fa640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42f0077040 0x7f42f0079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.185+0000 7f43017fa640 1 -- 172.21.15.120:0/387378336 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5115+0+0 (secure 0 0 0) 0x7f42fc0984c0 con 0x7f43040d0730 2024-07-27T03:12:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.185+0000 7f4308f07640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42f0077040 0x7f42f0079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:26.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.186+0000 7f4308f07640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42f0077040 0x7f42f0079550 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f42f4033000 tx=0x7f42f4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:26.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.189+0000 7f43017fa640 1 -- 172.21.15.120:0/387378336 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f42fc0619a0 con 0x7f43040d0730 2024-07-27T03:12:26.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.371+0000 7f430b16b640 1 -- 172.21.15.120:0/387378336 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f430415e820 con 0x7f43040d0730 2024-07-27T03:12:26.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.371+0000 7f43017fa640 1 -- 172.21.15.120:0/387378336 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f42fc0612a0 con 0x7f43040d0730 2024-07-27T03:12:26.374 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-07-27T03:12:26.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.373+0000 7f430b16b640 1 -- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42f0077040 msgr2=0x7f42f0079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:26.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.373+0000 7f430b16b640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42f0077040 0x7f42f0079550 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f42f4033000 tx=0x7f42f4004730 comp rx=0 tx=0).stop 2024-07-27T03:12:26.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.373+0000 7f430b16b640 1 -- 172.21.15.120:0/387378336 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43040d0730 msgr2=0x7f43040cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:26.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.373+0000 7f430b16b640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43040d0730 0x7f43040cbaa0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00c6c0 tx=0x7f42fc00cb80 comp rx=0 tx=0).stop 2024-07-27T03:12:26.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.374+0000 7f430b16b640 1 -- 172.21.15.120:0/387378336 shutdown_connections 2024-07-27T03:12:26.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.374+0000 7f430b16b640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f42f0077040 0x7f42f0079550 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.374+0000 7f430b16b640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43040d0730 0x7f43040cbaa0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.374+0000 7f430b16b640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43040cf200 0x7f430409dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.374+0000 7f430b16b640 1 --2- 172.21.15.120:0/387378336 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f43040b92c0 0x7f43040a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.374+0000 7f430b16b640 1 -- 172.21.15.120:0/387378336 >> 172.21.15.120:0/387378336 conn(0x7f43040d3f70 msgr2=0x7f43040b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:26.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.374+0000 7f430b16b640 1 -- 172.21.15.120:0/387378336 shutdown_connections 2024-07-27T03:12:26.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.374+0000 7f430b16b640 1 -- 172.21.15.120:0/387378336 wait complete. 2024-07-27T03:12:26.387 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_exports.TestBalMask.test_mds_failover' 2024-07-27T03:12:26.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.497+0000 7fb052084640 1 -- 172.21.15.120:0/3933526041 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb038003a00 msgr2=0x7fb038003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:26.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.497+0000 7fb052084640 1 --2- 172.21.15.120:0/3933526041 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb038003a00 0x7fb038003e70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00c4a0 tx=0x7fb038005830 comp rx=0 tx=0).stop 2024-07-27T03:12:26.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.497+0000 7fb04bfff640 1 -- 172.21.15.120:0/3933526041 reap_dead start 2024-07-27T03:12:26.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.497+0000 7fb052084640 1 -- 172.21.15.120:0/3933526041 shutdown_connections 2024-07-27T03:12:26.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.497+0000 7fb052084640 1 -- 172.21.15.120:0/3933526041 >> 172.21.15.120:0/3933526041 conn(0x7fb04c0b1a10 msgr2=0x7fb04c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:26.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.497+0000 7fb052084640 1 -- 172.21.15.120:0/3933526041 shutdown_connections 2024-07-27T03:12:26.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.497+0000 7fb052084640 1 -- 172.21.15.120:0/3933526041 wait complete. 2024-07-27T03:12:26.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.499+0000 7fb052084640 1 Processor -- start 2024-07-27T03:12:26.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.499+0000 7fb052084640 1 -- start start 2024-07-27T03:12:26.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.500+0000 7fb052084640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb038003a00 0x7fb04c155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:26.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.500+0000 7fb052084640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb04c142de0 0x7fb04c0b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:26.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.500+0000 7fb052084640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb04c1431f0 0x7fb04c0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:26.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.500+0000 7fb052084640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c15f0d0 con 0x7fb038003a00 2024-07-27T03:12:26.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.500+0000 7fb052084640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb04c15ef50 con 0x7fb04c142de0 2024-07-27T03:12:26.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.500+0000 7fb052084640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb04c15f250 con 0x7fb04c1431f0 2024-07-27T03:12:26.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.500+0000 7fb04b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb038003a00 0x7fb04c155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:26.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.500+0000 7fb04b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb038003a00 0x7fb04c155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51808/0 (socket says 172.21.15.120:51808) 2024-07-27T03:12:26.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.500+0000 7fb04b7fe640 1 -- 172.21.15.120:0/1132831785 learned_addr learned my addr 172.21.15.120:0/1132831785 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:26.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb04bfff640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb04c1431f0 0x7fb04c0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:26.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb04affd640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb04c142de0 0x7fb04c0b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:26.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb04b7fe640 1 -- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb04c1431f0 msgr2=0x7fb04c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:26.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb04b7fe640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb04c1431f0 0x7fb04c0b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb04b7fe640 1 -- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb04c142de0 msgr2=0x7fb04c0b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:26.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb04b7fe640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb04c142de0 0x7fb04c0b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:26.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb04b7fe640 1 -- 172.21.15.120:0/1132831785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04c145dd0 con 0x7fb038003a00 2024-07-27T03:12:26.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb04b7fe640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb038003a00 0x7fb04c155bf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00c5c0 tx=0x7fb03c006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:26.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb043fff640 1 -- 172.21.15.120:0/1132831785 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c038030 con 0x7fb038003a00 2024-07-27T03:12:26.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb043fff640 1 -- 172.21.15.120:0/1132831785 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb03c001180 con 0x7fb038003a00 2024-07-27T03:12:26.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb052084640 1 -- 172.21.15.120:0/1132831785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04c1460b0 con 0x7fb038003a00 2024-07-27T03:12:26.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb043fff640 1 -- 172.21.15.120:0/1132831785 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c02b8a0 con 0x7fb038003a00 2024-07-27T03:12:26.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.501+0000 7fb052084640 1 -- 172.21.15.120:0/1132831785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb04c146670 con 0x7fb038003a00 2024-07-27T03:12:26.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.502+0000 7fb052084640 1 -- 172.21.15.120:0/1132831785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb04c15f7e0 con 0x7fb038003a00 2024-07-27T03:12:26.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.503+0000 7fb043fff640 1 -- 172.21.15.120:0/1132831785 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb03c03e030 con 0x7fb038003a00 2024-07-27T03:12:26.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.503+0000 7fb043fff640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb02c077010 0x7fb02c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:26.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.504+0000 7fb043fff640 1 -- 172.21.15.120:0/1132831785 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5115+0+0 (secure 0 0 0) 0x7fb03c0b7e20 con 0x7fb038003a00 2024-07-27T03:12:26.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.504+0000 7fb04affd640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb02c077010 0x7fb02c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:26.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.504+0000 7fb04affd640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb02c077010 0x7fb02c079520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb034009a80 tx=0x7fb034005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:26.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.508+0000 7fb043fff640 1 -- 172.21.15.120:0/1132831785 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb04c074230 con 0x7fb038003a00 2024-07-27T03:12:26.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:26.765+0000 7fb052084640 1 -- 172.21.15.120:0/1132831785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_exports.TestBalMask.test_mds_failover"]} v 0) -- 0x7fb04c0b13e0 con 0x7fb038003a00 2024-07-27T03:12:27.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.726+0000 7fb043fff640 1 -- 172.21.15.120:0/1132831785 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_exports.TestBalMask.test_mds_failover"]}]=0 v194) ==== 137+0+0 (secure 0 0 0) 0x7fb03c081350 con 0x7fb038003a00 2024-07-27T03:12:27.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 -- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb02c077010 msgr2=0x7fb02c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:27.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb02c077010 0x7fb02c079520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb034009a80 tx=0x7fb034005f90 comp rx=0 tx=0).stop 2024-07-27T03:12:27.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 -- 172.21.15.120:0/1132831785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb038003a00 msgr2=0x7fb04c155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:27.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb038003a00 0x7fb04c155bf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00c5c0 tx=0x7fb03c006290 comp rx=0 tx=0).stop 2024-07-27T03:12:27.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 -- 172.21.15.120:0/1132831785 shutdown_connections 2024-07-27T03:12:27.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb02c077010 0x7fb02c079520 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:27.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb04c1431f0 0x7fb04c0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:27.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb04c142de0 0x7fb04c0b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:27.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 --2- 172.21.15.120:0/1132831785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb038003a00 0x7fb04c155bf0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:27.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 -- 172.21.15.120:0/1132831785 >> 172.21.15.120:0/1132831785 conn(0x7fb04c0b1a10 msgr2=0x7fb04c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:27.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 -- 172.21.15.120:0/1132831785 shutdown_connections 2024-07-27T03:12:27.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.729+0000 7fb052084640 1 -- 172.21.15.120:0/1132831785 wait complete. 2024-07-27T03:12:27.746 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-07-27T03:12:27.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.864+0000 7f2f8720c640 1 -- 172.21.15.120:0/268589742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f800b4740 msgr2=0x7f2f800b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:27.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.864+0000 7f2f8720c640 1 --2- 172.21.15.120:0/268589742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f800b4740 0x7f2f800b2c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009830 tx=0x7f2f7002a510 comp rx=0 tx=0).stop 2024-07-27T03:12:27.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.864+0000 7f2f8720c640 1 -- 172.21.15.120:0/268589742 shutdown_connections 2024-07-27T03:12:27.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.864+0000 7f2f8720c640 1 --2- 172.21.15.120:0/268589742 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f800d27e0 0x7f2f800d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:27.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.864+0000 7f2f8720c640 1 --2- 172.21.15.120:0/268589742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f800b4740 0x7f2f800b2c40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:27.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.864+0000 7f2f8720c640 1 -- 172.21.15.120:0/268589742 >> 172.21.15.120:0/268589742 conn(0x7f2f8008d690 msgr2=0x7f2f8009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:27.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.864+0000 7f2f8720c640 1 -- 172.21.15.120:0/268589742 shutdown_connections 2024-07-27T03:12:27.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.864+0000 7f2f8720c640 1 -- 172.21.15.120:0/268589742 wait complete. 2024-07-27T03:12:27.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.865+0000 7f2f8720c640 1 Processor -- start 2024-07-27T03:12:27.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.865+0000 7f2f8720c640 1 -- start start 2024-07-27T03:12:27.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f8720c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f800b4740 0x7f2f8014df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:27.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f8720c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f800d09c0 0x7f2f8014e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:27.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f8720c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f800d27e0 0x7f2f800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:27.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f8720c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2f800cef70 con 0x7f2f800d09c0 2024-07-27T03:12:27.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f8720c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2f800cedf0 con 0x7f2f800b4740 2024-07-27T03:12:27.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f8720c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2f800cf0f0 con 0x7f2f800d27e0 2024-07-27T03:12:27.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f7ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f800d09c0 0x7f2f8014e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:27.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f7ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f800d09c0 0x7f2f8014e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51824/0 (socket says 172.21.15.120:51824) 2024-07-27T03:12:27.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f7ffff640 1 -- 172.21.15.120:0/2214013143 learned_addr learned my addr 172.21.15.120:0/2214013143 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:27.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f84fa8640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f800b4740 0x7f2f8014df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:27.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f857a9640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f800d27e0 0x7f2f800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:27.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f7ffff640 1 -- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f800d27e0 msgr2=0x7f2f800b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:27.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f7ffff640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f800d27e0 0x7f2f800b8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:27.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f7ffff640 1 -- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f800b4740 msgr2=0x7f2f8014df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:27.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f7ffff640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f800b4740 0x7f2f8014df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:27.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.867+0000 7f2f7ffff640 1 -- 172.21.15.120:0/2214013143 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f80151430 con 0x7f2f800d09c0 2024-07-27T03:12:27.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.868+0000 7f2f7ffff640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f800d09c0 0x7f2f8014e6e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2f740058c0 tx=0x7f2f7400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:27.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.868+0000 7f2f7d7fa640 1 -- 172.21.15.120:0/2214013143 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400cd00 con 0x7f2f800d09c0 2024-07-27T03:12:27.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.868+0000 7f2f7d7fa640 1 -- 172.21.15.120:0/2214013143 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f74004030 con 0x7f2f800d09c0 2024-07-27T03:12:27.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.868+0000 7f2f8720c640 1 -- 172.21.15.120:0/2214013143 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f800b7fd0 con 0x7f2f800d09c0 2024-07-27T03:12:27.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.868+0000 7f2f7d7fa640 1 -- 172.21.15.120:0/2214013143 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74004460 con 0x7f2f800d09c0 2024-07-27T03:12:27.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.868+0000 7f2f8720c640 1 -- 172.21.15.120:0/2214013143 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8014ef10 con 0x7f2f800d09c0 2024-07-27T03:12:27.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.869+0000 7f2f8720c640 1 -- 172.21.15.120:0/2214013143 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f801511a0 con 0x7f2f800d09c0 2024-07-27T03:12:27.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.870+0000 7f2f7d7fa640 1 -- 172.21.15.120:0/2214013143 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2f740035f0 con 0x7f2f800d09c0 2024-07-27T03:12:27.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.870+0000 7f2f7d7fa640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f6c077040 0x7f2f6c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:27.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.870+0000 7f2f7d7fa640 1 -- 172.21.15.120:0/2214013143 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5115+0+0 (secure 0 0 0) 0x7f2f74098fd0 con 0x7f2f800d09c0 2024-07-27T03:12:27.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.870+0000 7f2f84fa8640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f6c077040 0x7f2f6c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:27.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.871+0000 7f2f84fa8640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f6c077040 0x7f2f6c079550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2f70034000 tx=0x7f2f70004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:27.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:27.875+0000 7f2f7d7fa640 1 -- 172.21.15.120:0/2214013143 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f2f74062430 con 0x7f2f800d09c0 2024-07-27T03:12:28.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.058+0000 7f2f8720c640 1 -- 172.21.15.120:0/2214013143 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f2f800d2bf0 con 0x7f2f800d09c0 2024-07-27T03:12:28.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.058+0000 7f2f7d7fa640 1 -- 172.21.15.120:0/2214013143 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v36) ==== 59+0+1998 (secure 0 0 0) 0x7f2f74061d30 con 0x7f2f800d09c0 2024-07-27T03:12:28.062 INFO:teuthology.orchestra.run.smithi120.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-07-27T03:12:28.062 INFO:teuthology.orchestra.run.smithi120.stdout:mon advanced mon_op_complaint_time 120 2024-07-27T03:12:28.062 INFO:teuthology.orchestra.run.smithi120.stdout:mon dev mon_warn_on_pool_no_app false 2024-07-27T03:12:28.062 INFO:teuthology.orchestra.run.smithi120.stdout:osd advanced osd_op_complaint_time 180.000000 2024-07-27T03:12:28.062 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5257.409462 2024-07-27T03:12:28.062 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6039.326463 2024-07-27T03:12:28.062 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5855.738461 2024-07-27T03:12:28.062 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4876.658742 2024-07-27T03:12:28.062 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4850.335109 2024-07-27T03:12:28.062 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5729.677637 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5061.056911 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5680.764045 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_mds 20/20 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_mds_balancer 20/20 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced debug_ms 2/2 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_debug_frag true 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_debug_scatterstat true 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced mds_op_complaint_time 180.000000 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:mds dev mds_verify_scatter true 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced osd_op_complaint_time 180.000000 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced rados_mon_op_timeout 900 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:mds advanced rados_osd_op_timeout 900 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced client_mount_timeout 600 2024-07-27T03:12:28.063 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced debug_client 20/20 2024-07-27T03:12:28.064 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced debug_ms 1/1 2024-07-27T03:12:28.064 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced rados_mon_op_timeout 900 2024-07-27T03:12:28.064 INFO:teuthology.orchestra.run.smithi120.stdout:client advanced rados_osd_op_timeout 900 2024-07-27T03:12:28.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.060+0000 7f2f8720c640 1 -- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f6c077040 msgr2=0x7f2f6c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.060+0000 7f2f8720c640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f6c077040 0x7f2f6c079550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2f70034000 tx=0x7f2f70004730 comp rx=0 tx=0).stop 2024-07-27T03:12:28.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.060+0000 7f2f8720c640 1 -- 172.21.15.120:0/2214013143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f800d09c0 msgr2=0x7f2f8014e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.060+0000 7f2f8720c640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f800d09c0 0x7f2f8014e6e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2f740058c0 tx=0x7f2f7400ee50 comp rx=0 tx=0).stop 2024-07-27T03:12:28.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.061+0000 7f2f8720c640 1 -- 172.21.15.120:0/2214013143 shutdown_connections 2024-07-27T03:12:28.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.061+0000 7f2f8720c640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2f6c077040 0x7f2f6c079550 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.061+0000 7f2f8720c640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2f800d09c0 0x7f2f8014e6e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.061+0000 7f2f8720c640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f800d27e0 0x7f2f800b8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.061+0000 7f2f8720c640 1 --2- 172.21.15.120:0/2214013143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f800b4740 0x7f2f8014df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.061+0000 7f2f8720c640 1 -- 172.21.15.120:0/2214013143 >> 172.21.15.120:0/2214013143 conn(0x7f2f8008d690 msgr2=0x7f2f800b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:28.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.061+0000 7f2f8720c640 1 -- 172.21.15.120:0/2214013143 shutdown_connections 2024-07-27T03:12:28.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.061+0000 7f2f8720c640 1 -- 172.21.15.120:0/2214013143 wait complete. 2024-07-27T03:12:28.075 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-07-27T03:12:28.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.190+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/136284597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f540041c0 msgr2=0x7f0f54004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.190+0000 7f0f6d0f2640 1 --2- 172.21.15.120:0/136284597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f540041c0 0x7f0f54004800 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0f50001830 tx=0x7f0f54005830 comp rx=0 tx=0).stop 2024-07-27T03:12:28.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.190+0000 7f0f6759e640 1 -- 172.21.15.120:0/136284597 reap_dead start 2024-07-27T03:12:28.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.190+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/136284597 shutdown_connections 2024-07-27T03:12:28.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.190+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/136284597 >> 172.21.15.120:0/136284597 conn(0x7f0f680b3920 msgr2=0x7f0f680b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:28.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.191+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/136284597 shutdown_connections 2024-07-27T03:12:28.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.191+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/136284597 wait complete. 2024-07-27T03:12:28.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.192+0000 7f0f6d0f2640 1 Processor -- start 2024-07-27T03:12:28.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.193+0000 7f0f6d0f2640 1 -- start start 2024-07-27T03:12:28.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6d0f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f540041c0 0x7f0f681f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:28.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6d0f2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f681554e0 0x7f0f680ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:28.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6d0f2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f680cf290 0x7f0f680c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:28.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6d0f2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6815f250 con 0x7f0f680cf290 2024-07-27T03:12:28.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6d0f2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6815f0d0 con 0x7f0f540041c0 2024-07-27T03:12:28.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6d0f2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6815f3d0 con 0x7f0f681554e0 2024-07-27T03:12:28.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6759e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f680cf290 0x7f0f680c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:28.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6759e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f680cf290 0x7f0f680c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51846/0 (socket says 172.21.15.120:51846) 2024-07-27T03:12:28.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6759e640 1 -- 172.21.15.120:0/580576584 learned_addr learned my addr 172.21.15.120:0/580576584 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:28.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6759e640 1 -- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f681554e0 msgr2=0x7f0f680ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6759e640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f681554e0 0x7f0f680ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6759e640 1 -- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f540041c0 msgr2=0x7f0f681f66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6759e640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f540041c0 0x7f0f681f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6759e640 1 -- 172.21.15.120:0/580576584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f680cf6a0 con 0x7f0f680cf290 2024-07-27T03:12:28.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.194+0000 7f0f6759e640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f680cf290 0x7f0f680c8ec0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0f680b7e40 tx=0x7f0f60006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:28.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.195+0000 7f0f5ffff640 1 -- 172.21.15.120:0/580576584 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60011900 con 0x7f0f680cf290 2024-07-27T03:12:28.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.195+0000 7f0f5ffff640 1 -- 172.21.15.120:0/580576584 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f60018070 con 0x7f0f680cf290 2024-07-27T03:12:28.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.195+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/580576584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f681f6c10 con 0x7f0f680cf290 2024-07-27T03:12:28.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.195+0000 7f0f5ffff640 1 -- 172.21.15.120:0/580576584 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60011d80 con 0x7f0f680cf290 2024-07-27T03:12:28.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.195+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/580576584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f681f7400 con 0x7f0f680cf290 2024-07-27T03:12:28.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.196+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/580576584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f681f6e90 con 0x7f0f680cf290 2024-07-27T03:12:28.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.197+0000 7f0f5ffff640 1 -- 172.21.15.120:0/580576584 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0f6001d460 con 0x7f0f680cf290 2024-07-27T03:12:28.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.197+0000 7f0f5ffff640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f48077010 0x7f0f48079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:28.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.197+0000 7f0f5ffff640 1 -- 172.21.15.120:0/580576584 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5115+0+0 (secure 0 0 0) 0x7f0f60099040 con 0x7f0f680cf290 2024-07-27T03:12:28.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.197+0000 7f0f66d9d640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f48077010 0x7f0f48079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:28.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.198+0000 7f0f66d9d640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f48077010 0x7f0f48079520 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009ab0 tx=0x7f0f58009390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:28.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.202+0000 7f0f5ffff640 1 -- 172.21.15.120:0/580576584 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f0f680cf6a0 con 0x7f0f680cf290 2024-07-27T03:12:28.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.382+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/580576584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0f6815f960 con 0x7f0f680cf290 2024-07-27T03:12:28.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.386+0000 7f0f5ffff640 1 -- 172.21.15.120:0/580576584 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v37)=0 v37) ==== 122+0+0 (secure 0 0 0) 0x7f0f60062490 con 0x7f0f680cf290 2024-07-27T03:12:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f48077010 msgr2=0x7f0f48079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f48077010 0x7f0f48079520 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009ab0 tx=0x7f0f58009390 comp rx=0 tx=0).stop 2024-07-27T03:12:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/580576584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f680cf290 msgr2=0x7f0f680c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f680cf290 0x7f0f680c8ec0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0f680b7e40 tx=0x7f0f60006430 comp rx=0 tx=0).stop 2024-07-27T03:12:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/580576584 shutdown_connections 2024-07-27T03:12:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f0f48077010 0x7f0f48079520 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f680cf290 0x7f0f680c8ec0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0f681554e0 0x7f0f680ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 --2- 172.21.15.120:0/580576584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f540041c0 0x7f0f681f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/580576584 >> 172.21.15.120:0/580576584 conn(0x7f0f680b3920 msgr2=0x7f0f680b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/580576584 shutdown_connections 2024-07-27T03:12:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.388+0000 7f0f6d0f2640 1 -- 172.21.15.120:0/580576584 wait complete. 2024-07-27T03:12:28.402 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-07-27T03:12:28.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:12:28.441 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:12:28.484 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-07-27T03:12:28.484 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:28.484 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:28.500 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:12:28.501 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:12:28.502 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:28.544 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:12:28.544 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:28.544 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:28.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:12:28.560 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:12:28.560 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:28.603 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:12:28.603 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-07-27T03:12:28.604 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:12:28.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.716+0000 7f8801538640 1 -- 172.21.15.120:0/848503117 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87e8003a30 msgr2=0x7f87e8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.716+0000 7f8801538640 1 --2- 172.21.15.120:0/848503117 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87e8003a30 0x7f87e8003ea0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f87ec001660 tx=0x7f87e8005830 comp rx=0 tx=0).stop 2024-07-27T03:12:28.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.716+0000 7f87fb7fe640 1 -- 172.21.15.120:0/848503117 reap_dead start 2024-07-27T03:12:28.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.716+0000 7f8801538640 1 -- 172.21.15.120:0/848503117 shutdown_connections 2024-07-27T03:12:28.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.716+0000 7f8801538640 1 -- 172.21.15.120:0/848503117 >> 172.21.15.120:0/848503117 conn(0x7f87fc08d690 msgr2=0x7f87fc09d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:28.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.716+0000 7f8801538640 1 -- 172.21.15.120:0/848503117 shutdown_connections 2024-07-27T03:12:28.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.716+0000 7f8801538640 1 -- 172.21.15.120:0/848503117 wait complete. 2024-07-27T03:12:28.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.718+0000 7f8801538640 1 Processor -- start 2024-07-27T03:12:28.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.718+0000 7f8801538640 1 -- start start 2024-07-27T03:12:28.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.719+0000 7f8801538640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87e8003a30 0x7f87fc0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:28.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.719+0000 7f8801538640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87fc14dce0 0x7f87fc0b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:28.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.719+0000 7f8801538640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc0b7320 0x7f87fc1f8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:28.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.719+0000 7f8801538640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc0d1250 con 0x7f87fc14dce0 2024-07-27T03:12:28.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.719+0000 7f8801538640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc0d10d0 con 0x7f87fc0b7320 2024-07-27T03:12:28.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.719+0000 7f8801538640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f87fc0cebe0 con 0x7f87e8003a30 2024-07-27T03:12:28.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.719+0000 7f87f27fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87fc14dce0 0x7f87fc0b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:28.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87f27fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87fc14dce0 0x7f87fc0b6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51862/0 (socket says 172.21.15.120:51862) 2024-07-27T03:12:28.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87f27fc640 1 -- 172.21.15.120:0/762198585 learned_addr learned my addr 172.21.15.120:0/762198585 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:28.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87faffd640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87e8003a30 0x7f87fc0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:28.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87fb7fe640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc0b7320 0x7f87fc1f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87f27fc640 1 -- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87e8003a30 msgr2=0x7f87fc0cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87f27fc640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87e8003a30 0x7f87fc0cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87f27fc640 1 -- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc0b7320 msgr2=0x7f87fc1f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87f27fc640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc0b7320 0x7f87fc1f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87f27fc640 1 -- 172.21.15.120:0/762198585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc0cb190 con 0x7f87fc14dce0 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87f27fc640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87fc14dce0 0x7f87fc0b6de0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f87e40066b0 tx=0x7f87e40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87f3fff640 1 -- 172.21.15.120:0/762198585 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4011700 con 0x7f87fc14dce0 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87f3fff640 1 -- 172.21.15.120:0/762198585 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87e4016020 con 0x7f87fc14dce0 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f87f3fff640 1 -- 172.21.15.120:0/762198585 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4011b20 con 0x7f87fc14dce0 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f8801538640 1 -- 172.21.15.120:0/762198585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87fc0cb430 con 0x7f87fc14dce0 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.720+0000 7f8801538640 1 -- 172.21.15.120:0/762198585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87fc14e0f0 con 0x7f87fc14dce0 2024-07-27T03:12:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.721+0000 7f8801538640 1 -- 172.21.15.120:0/762198585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87fc0c82b0 con 0x7f87fc14dce0 2024-07-27T03:12:28.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.722+0000 7f87f3fff640 1 -- 172.21.15.120:0/762198585 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f87e4011cc0 con 0x7f87fc14dce0 2024-07-27T03:12:28.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.722+0000 7f87f3fff640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87dc077040 0x7f87dc079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:28.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.723+0000 7f87f3fff640 1 -- 172.21.15.120:0/762198585 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5115+0+0 (secure 0 0 0) 0x7f87e4098c90 con 0x7f87fc14dce0 2024-07-27T03:12:28.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.723+0000 7f87faffd640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87dc077040 0x7f87dc079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:28.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.723+0000 7f87faffd640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87dc077040 0x7f87dc079550 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f87ec032000 tx=0x7f87ec001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:28.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.727+0000 7f87f3fff640 1 -- 172.21.15.120:0/762198585 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f87e4020030 con 0x7f87fc14dce0 2024-07-27T03:12:28.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.949+0000 7f8801538640 1 -- 172.21.15.120:0/762198585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87fc0cf170 con 0x7f87fc14dce0 2024-07-27T03:12:28.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.950+0000 7f87f3fff640 1 -- 172.21.15.120:0/762198585 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+3917 (secure 0 0 0) 0x7f87e4062180 con 0x7f87fc14dce0 2024-07-27T03:12:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:28.953 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":60,"btime":"2024-07-27T03:12:22:602055+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/3598257167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":3598257167},{"type":"v1","addr":"172.21.15.121:6836","nonce":3598257167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46},{"gid":5734,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/30970854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":30970854},{"type":"v1","addr":"172.21.15.121:6837","nonce":30970854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6066,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/1777859666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1777859666},{"type":"v1","addr":"172.21.15.120:6833","nonce":1777859666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":6072,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2069325522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2069325522},{"type":"v1","addr":"172.21.15.120:6835","nonce":2069325522}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[]} 2024-07-27T03:12:28.953 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 60 2024-07-27T03:12:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 -- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87dc077040 msgr2=0x7f87dc079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87dc077040 0x7f87dc079550 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f87ec032000 tx=0x7f87ec001190 comp rx=0 tx=0).stop 2024-07-27T03:12:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 -- 172.21.15.120:0/762198585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87fc14dce0 msgr2=0x7f87fc0b6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87fc14dce0 0x7f87fc0b6de0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f87e40066b0 tx=0x7f87e40039c0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 -- 172.21.15.120:0/762198585 shutdown_connections 2024-07-27T03:12:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f87dc077040 0x7f87dc079550 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87fc14dce0 0x7f87fc0b6de0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87fc0b7320 0x7f87fc1f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 --2- 172.21.15.120:0/762198585 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87e8003a30 0x7f87fc0cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:28.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 -- 172.21.15.120:0/762198585 >> 172.21.15.120:0/762198585 conn(0x7f87fc08d690 msgr2=0x7f87fc0b6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:28.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 -- 172.21.15.120:0/762198585 shutdown_connections 2024-07-27T03:12:28.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:28.952+0000 7f8801538640 1 -- 172.21.15.120:0/762198585 wait complete. 2024-07-27T03:12:28.967 INFO:tasks.ceph.mds.a:Restarting daemon 2024-07-27T03:12:28.967 INFO:tasks.ceph.mds.a:Stopping old one... 2024-07-27T03:12:28.967 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-07-27T03:12:28.968 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:12:28.968 INFO:tasks.ceph.mds.c:Restarting daemon 2024-07-27T03:12:28.968 INFO:tasks.ceph.mds.c:Stopping old one... 2024-07-27T03:12:28.968 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-07-27T03:12:28.968 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:12:28.968 INFO:tasks.ceph.mds.b:Restarting daemon 2024-07-27T03:12:28.968 INFO:tasks.ceph.mds.b:Stopping old one... 2024-07-27T03:12:28.969 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-07-27T03:12:28.969 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:12:28.969 INFO:tasks.ceph.mds.d:Restarting daemon 2024-07-27T03:12:28.969 INFO:tasks.ceph.mds.d:Stopping old one... 2024-07-27T03:12:28.969 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-07-27T03:12:28.969 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:12:28.980 INFO:tasks.ceph.mds.a:Stopped 2024-07-27T03:12:28.980 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-07-27T03:12:28.981 INFO:tasks.ceph.mds.c:Stopped 2024-07-27T03:12:28.981 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-07-27T03:12:28.985 INFO:tasks.ceph.mds.d:Stopped 2024-07-27T03:12:28.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-07-27T03:12:28.986 INFO:tasks.ceph.mds.b:Stopped 2024-07-27T03:12:28.986 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-07-27T03:12:29.023 INFO:tasks.ceph.mds.a:Started 2024-07-27T03:12:29.024 DEBUG:teuthology.parallel:result is None 2024-07-27T03:12:29.024 INFO:tasks.ceph.mds.c:Started 2024-07-27T03:12:29.025 DEBUG:teuthology.parallel:result is None 2024-07-27T03:12:29.028 INFO:tasks.ceph.mds.d:Started 2024-07-27T03:12:29.029 DEBUG:teuthology.parallel:result is None 2024-07-27T03:12:29.030 INFO:tasks.ceph.mds.b:Started 2024-07-27T03:12:29.030 DEBUG:teuthology.parallel:result is None 2024-07-27T03:12:29.031 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-07-27T03:12:29.109 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-07-27T03:12:29.110 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-07-27T03:12:29.125 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-07-27T03:12:29.125 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-07-27T03:12:29.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.150+0000 7f1177738640 1 -- 172.21.15.120:0/248301556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11700b4740 msgr2=0x7f11700b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:29.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.150+0000 7f1177738640 1 --2- 172.21.15.120:0/248301556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11700b4740 0x7f11700b2c40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1160009830 tx=0x7f116002a5c0 comp rx=0 tx=0).stop 2024-07-27T03:12:29.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.150+0000 7f1177738640 1 -- 172.21.15.120:0/248301556 shutdown_connections 2024-07-27T03:12:29.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.150+0000 7f1177738640 1 --2- 172.21.15.120:0/248301556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11700b4740 0x7f11700b2c40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:29.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.150+0000 7f1177738640 1 -- 172.21.15.120:0/248301556 >> 172.21.15.120:0/248301556 conn(0x7f117008d690 msgr2=0x7f117009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:29.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.150+0000 7f1177738640 1 -- 172.21.15.120:0/248301556 shutdown_connections 2024-07-27T03:12:29.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.150+0000 7f1177738640 1 -- 172.21.15.120:0/248301556 wait complete. 2024-07-27T03:12:29.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.152+0000 7f1177738640 1 Processor -- start 2024-07-27T03:12:29.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.152+0000 7f1177738640 1 -- start start 2024-07-27T03:12:29.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.153+0000 7f1177738640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11700b4740 0x7f11701f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:29.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.153+0000 7f1177738640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11700d27e0 0x7f1170154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:29.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.153+0000 7f1177738640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1170157430 0x7f1170157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:29.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.153+0000 7f1177738640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f11700d2d70 con 0x7f11700b4740 2024-07-27T03:12:29.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.153+0000 7f1177738640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11700d2bf0 con 0x7f11700d27e0 2024-07-27T03:12:29.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.153+0000 7f1177738640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f11700d2ef0 con 0x7f1170157430 2024-07-27T03:12:29.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.153+0000 7f11754d4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11700b4740 0x7f11701f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:29.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.153+0000 7f11754d4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11700b4740 0x7f11701f88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51908/0 (socket says 172.21.15.120:51908) 2024-07-27T03:12:29.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.153+0000 7f11754d4640 1 -- 172.21.15.120:0/1003525048 learned_addr learned my addr 172.21.15.120:0/1003525048 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:29.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.153+0000 7f1175cd5640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1170157430 0x7f1170157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:29.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.153+0000 7f1174cd3640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11700d27e0 0x7f1170154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:29.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f11754d4640 1 -- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1170157430 msgr2=0x7f1170157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:29.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f11754d4640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1170157430 0x7f1170157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:29.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f11754d4640 1 -- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11700d27e0 msgr2=0x7f1170154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:29.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f11754d4640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11700d27e0 0x7f1170154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:29.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f11754d4640 1 -- 172.21.15.120:0/1003525048 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1170157d80 con 0x7f11700b4740 2024-07-27T03:12:29.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f1174cd3640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11700d27e0 0x7f1170154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:29.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f11754d4640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11700b4740 0x7f11701f88f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f116002abb0 tx=0x7f1160033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:29.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f116dffb640 1 -- 172.21.15.120:0/1003525048 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160031b50 con 0x7f11700b4740 2024-07-27T03:12:29.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f116dffb640 1 -- 172.21.15.120:0/1003525048 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1160031de0 con 0x7f11700b4740 2024-07-27T03:12:29.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f1177738640 1 -- 172.21.15.120:0/1003525048 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11701f9320 con 0x7f11700b4740 2024-07-27T03:12:29.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f116dffb640 1 -- 172.21.15.120:0/1003525048 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1160005280 con 0x7f11700b4740 2024-07-27T03:12:29.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.154+0000 7f1177738640 1 -- 172.21.15.120:0/1003525048 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f117015f370 con 0x7f11700b4740 2024-07-27T03:12:29.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.155+0000 7f1177738640 1 -- 172.21.15.120:0/1003525048 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11700b2c40 con 0x7f11700b4740 2024-07-27T03:12:29.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.156+0000 7f116dffb640 1 -- 172.21.15.120:0/1003525048 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1160005420 con 0x7f11700b4740 2024-07-27T03:12:29.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.156+0000 7f116dffb640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f115c077040 0x7f115c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:29.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.157+0000 7f116dffb640 1 -- 172.21.15.120:0/1003525048 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5115+0+0 (secure 0 0 0) 0x7f11600b96a0 con 0x7f11700b4740 2024-07-27T03:12:29.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.157+0000 7f1174cd3640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f115c077040 0x7f115c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:29.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.157+0000 7f1174cd3640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f115c077040 0x7f115c079550 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1164007fd0 tx=0x7f1164009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:29.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.161+0000 7f116dffb640 1 -- 172.21.15.120:0/1003525048 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f1170157d80 con 0x7f11700b4740 2024-07-27T03:12:29.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:29.357+0000 7f1177738640 1 -- 172.21.15.120:0/1003525048 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f11700b6470 con 0x7f11700b4740 2024-07-27T03:12:30.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.401+0000 7f116dffb640 1 -- 172.21.15.120:0/1003525048 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v65) ==== 97+0+0 (secure 0 0 0) 0x7f116003f030 con 0x7f11700b4740 2024-07-27T03:12:30.404 INFO:teuthology.orchestra.run.smithi120.stderr: removed all blocklist entries 2024-07-27T03:12:30.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.404+0000 7f1177738640 1 -- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f115c077040 msgr2=0x7f115c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:30.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.404+0000 7f1177738640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f115c077040 0x7f115c079550 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1164007fd0 tx=0x7f1164009040 comp rx=0 tx=0).stop 2024-07-27T03:12:30.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.404+0000 7f1177738640 1 -- 172.21.15.120:0/1003525048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11700b4740 msgr2=0x7f11701f88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:30.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.404+0000 7f1177738640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11700b4740 0x7f11701f88f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f116002abb0 tx=0x7f1160033ba0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.405+0000 7f1177738640 1 -- 172.21.15.120:0/1003525048 shutdown_connections 2024-07-27T03:12:30.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.405+0000 7f1177738640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f115c077040 0x7f115c079550 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.405+0000 7f1177738640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1170157430 0x7f1170157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.405+0000 7f1177738640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11700d27e0 0x7f1170154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.405+0000 7f1177738640 1 --2- 172.21.15.120:0/1003525048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11700b4740 0x7f11701f88f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.405+0000 7f1177738640 1 -- 172.21.15.120:0/1003525048 >> 172.21.15.120:0/1003525048 conn(0x7f117008d690 msgr2=0x7f11700b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:30.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.405+0000 7f1177738640 1 -- 172.21.15.120:0/1003525048 shutdown_connections 2024-07-27T03:12:30.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.405+0000 7f1177738640 1 -- 172.21.15.120:0/1003525048 wait complete. 2024-07-27T03:12:30.421 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-07-27T03:12:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.539+0000 7f79d76bf640 1 -- 172.21.15.120:0/3321240728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79d00cf480 msgr2=0x7f79d00735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.539+0000 7f79d76bf640 1 --2- 172.21.15.120:0/3321240728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79d00cf480 0x7f79d00735f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f79c0005fd0 tx=0x7f79c002a5d0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.539+0000 7f79d76bf640 1 -- 172.21.15.120:0/3321240728 shutdown_connections 2024-07-27T03:12:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.539+0000 7f79d76bf640 1 --2- 172.21.15.120:0/3321240728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79d00cf480 0x7f79d00735f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.539+0000 7f79d76bf640 1 --2- 172.21.15.120:0/3321240728 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f79d015f760 0x7f79d006e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.539+0000 7f79d76bf640 1 -- 172.21.15.120:0/3321240728 >> 172.21.15.120:0/3321240728 conn(0x7f79d00b1a10 msgr2=0x7f79d00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.539+0000 7f79d76bf640 1 -- 172.21.15.120:0/3321240728 shutdown_connections 2024-07-27T03:12:30.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.539+0000 7f79d76bf640 1 -- 172.21.15.120:0/3321240728 wait complete. 2024-07-27T03:12:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.541+0000 7f79d76bf640 1 Processor -- start 2024-07-27T03:12:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.541+0000 7f79d76bf640 1 -- start start 2024-07-27T03:12:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.542+0000 7f79d76bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79d0073b30 0x7f79d009d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.542+0000 7f79d76bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79d00cf480 0x7f79d009d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:30.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.542+0000 7f79d76bf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f79d015f760 0x7f79d0157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.542+0000 7f79d76bf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01559a0 con 0x7f79d00cf480 2024-07-27T03:12:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.542+0000 7f79d76bf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0155820 con 0x7f79d0073b30 2024-07-27T03:12:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.542+0000 7f79d76bf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f79d00cfa80 con 0x7f79d015f760 2024-07-27T03:12:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.542+0000 7f79d4c5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79d00cf480 0x7f79d009d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.542+0000 7f79d4c5a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79d00cf480 0x7f79d009d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51922/0 (socket says 172.21.15.120:51922) 2024-07-27T03:12:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.542+0000 7f79d4c5a640 1 -- 172.21.15.120:0/2744530411 learned_addr learned my addr 172.21.15.120:0/2744530411 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.542+0000 7f79d545b640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79d0073b30 0x7f79d009d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.542+0000 7f79d5c5c640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f79d015f760 0x7f79d0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.543+0000 7f79d4c5a640 1 -- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f79d015f760 msgr2=0x7f79d0157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.543+0000 7f79d4c5a640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f79d015f760 0x7f79d0157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.543+0000 7f79d4c5a640 1 -- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79d0073b30 msgr2=0x7f79d009d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.543+0000 7f79d4c5a640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79d0073b30 0x7f79d009d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.543+0000 7f79d4c5a640 1 -- 172.21.15.120:0/2744530411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d014b010 con 0x7f79d00cf480 2024-07-27T03:12:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.543+0000 7f79d4c5a640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79d00cf480 0x7f79d009d600 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f79c0000c00 tx=0x7f79c00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.543+0000 7f79c5ffb640 1 -- 172.21.15.120:0/2744530411 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0035040 con 0x7f79d00cf480 2024-07-27T03:12:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.543+0000 7f79c5ffb640 1 -- 172.21.15.120:0/2744530411 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79c0005600 con 0x7f79d00cf480 2024-07-27T03:12:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.543+0000 7f79c5ffb640 1 -- 172.21.15.120:0/2744530411 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0003ea0 con 0x7f79d00cf480 2024-07-27T03:12:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.543+0000 7f79d76bf640 1 -- 172.21.15.120:0/2744530411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d0158630 con 0x7f79d00cf480 2024-07-27T03:12:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.543+0000 7f79d76bf640 1 -- 172.21.15.120:0/2744530411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d0158bf0 con 0x7f79d00cf480 2024-07-27T03:12:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.544+0000 7f79d76bf640 1 -- 172.21.15.120:0/2744530411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d00735f0 con 0x7f79d00cf480 2024-07-27T03:12:30.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.545+0000 7f79c5ffb640 1 -- 172.21.15.120:0/2744530411 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f79c00049e0 con 0x7f79d00cf480 2024-07-27T03:12:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.545+0000 7f79c5ffb640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f79b4077040 0x7f79b4079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.546+0000 7f79c5ffb640 1 -- 172.21.15.120:0/2744530411 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f79c00bb000 con 0x7f79d00cf480 2024-07-27T03:12:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.546+0000 7f79d545b640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f79b4077040 0x7f79b4079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.546+0000 7f79d545b640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f79b4077040 0x7f79b4079550 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f79d00703b0 tx=0x7f79cc009600 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:30.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.549+0000 7f79c5ffb640 1 -- 172.21.15.120:0/2744530411 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f79c0084630 con 0x7f79d00cf480 2024-07-27T03:12:30.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.805+0000 7f79d76bf640 1 -- 172.21.15.120:0/2744530411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f79d0158dc0 con 0x7f79d00cf480 2024-07-27T03:12:30.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.805+0000 7f79c5ffb640 1 -- 172.21.15.120:0/2744530411 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f79c0083f30 con 0x7f79d00cf480 2024-07-27T03:12:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:30.808 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:12:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_dump": [ 2024-07-27T03:12:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.a", 2024-07-27T03:12:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRm7HVTGBAADA2eiX5COiTN6OTelto+6g==", 2024-07-27T03:12:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.b", 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmMfl8JRAA+4W3m5lICDf6dIU1dELj5Q==", 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.c", 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmDnDuHxAAWKoH2jvhBqPNxL7NrtCJuw==", 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.d", 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmxkcwLRAAMzpPET/zdPCxfhbsMeLJuQ==", 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.0", 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCCZKRmtTNTChAAYbSo/j1WO/4nocsPhy8JRw==", 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.1", 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCFZKRmLRqlCBAAYgYpmzL3If445MkxGxBKHw==", 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.2", 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCIZKRmDhKBBhAAl6K58lvyVrAqfWffwAr1Mg==", 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.3", 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCLZKRmUDrLBBAAyUyAP/dCtMZVZpzi7TZIzA==", 2024-07-27T03:12:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.4", 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCRZKRmXRMoCRAAcfX7u17DIoxM9dK3/TFu8Q==", 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.5", 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCUZKRmyaL0BxAANbxggtK64zbog9+KDXeOew==", 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.6", 2024-07-27T03:12:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCXZKRmATKrBhAAeEBqJxkOoQozFzw1yeL6lw==", 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.7", 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCaZKRmCh6nBBAA8Cc+xOuBxqDAUgpweyq23A==", 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-07-27T03:12:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.0", 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmI8baMRAArCIL9NNNVlevij0JAWwGwg==", 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow r", 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.1", 2024-07-27T03:12:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmgOpnORAAkcLaNUd6cnsV/sHwOOI+2w==", 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.2", 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmwOSdNRAALgx82wMQ+5fPOrFL/qhj8g==", 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:12:30.818 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.3", 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB/ZKRmHh6PARAAZ9nBBam/kVvT6C1aFbNC3g==", 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.admin", 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB9ZKRmpVPmNRAAay22/X8LO2KsI86ehHZ/MA==", 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.x", 2024-07-27T03:12:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmFsR+FBAA8tKKAi2Y/Yaxxca+ep3BRQ==", 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.y", 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQB+ZKRmWLnrDxAAfy1pvcoGJESVPs9k+so+/A==", 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-07-27T03:12:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-07-27T03:12:30.822 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:12:30.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.807+0000 7f79d76bf640 1 -- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f79b4077040 msgr2=0x7f79b4079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:30.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.807+0000 7f79d76bf640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f79b4077040 0x7f79b4079550 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f79d00703b0 tx=0x7f79cc009600 comp rx=0 tx=0).stop 2024-07-27T03:12:30.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.807+0000 7f79d76bf640 1 -- 172.21.15.120:0/2744530411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79d00cf480 msgr2=0x7f79d009d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:30.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.807+0000 7f79d76bf640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79d00cf480 0x7f79d009d600 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f79c0000c00 tx=0x7f79c00038a0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.807+0000 7f79d76bf640 1 -- 172.21.15.120:0/2744530411 shutdown_connections 2024-07-27T03:12:30.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.807+0000 7f79d76bf640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f79b4077040 0x7f79b4079550 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.807+0000 7f79d76bf640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79d00cf480 0x7f79d009d600 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.807+0000 7f79d76bf640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f79d015f760 0x7f79d0157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.808+0000 7f79d76bf640 1 --2- 172.21.15.120:0/2744530411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f79d0073b30 0x7f79d009d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.808+0000 7f79d76bf640 1 -- 172.21.15.120:0/2744530411 >> 172.21.15.120:0/2744530411 conn(0x7f79d00b1a10 msgr2=0x7f79d00adcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:30.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.808+0000 7f79d76bf640 1 -- 172.21.15.120:0/2744530411 shutdown_connections 2024-07-27T03:12:30.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.808+0000 7f79d76bf640 1 -- 172.21.15.120:0/2744530411 wait complete. 2024-07-27T03:12:30.825 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-07-27T03:12:30.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.935+0000 7fb3dc884640 1 -- 172.21.15.120:0/4148198579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d815f7c0 msgr2=0x7fb3d806e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:30.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.935+0000 7fb3dc884640 1 --2- 172.21.15.120:0/4148198579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d815f7c0 0x7fb3d806e270 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8005fd0 tx=0x7fb3c802a540 comp rx=0 tx=0).stop 2024-07-27T03:12:30.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.935+0000 7fb3dc884640 1 -- 172.21.15.120:0/4148198579 shutdown_connections 2024-07-27T03:12:30.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.935+0000 7fb3dc884640 1 --2- 172.21.15.120:0/4148198579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3d80b41c0 0x7fb3d815ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.935+0000 7fb3dc884640 1 --2- 172.21.15.120:0/4148198579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d815f7c0 0x7fb3d806e270 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.935+0000 7fb3dc884640 1 -- 172.21.15.120:0/4148198579 >> 172.21.15.120:0/4148198579 conn(0x7fb3d80b1a10 msgr2=0x7fb3d80b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:30.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.935+0000 7fb3dc884640 1 -- 172.21.15.120:0/4148198579 shutdown_connections 2024-07-27T03:12:30.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.935+0000 7fb3dc884640 1 -- 172.21.15.120:0/4148198579 wait complete. 2024-07-27T03:12:30.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.937+0000 7fb3dc884640 1 Processor -- start 2024-07-27T03:12:30.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.937+0000 7fb3dc884640 1 -- start start 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3dc884640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d80b41c0 0x7fb3d8157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3dc884640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3d815f160 0x7fb3d809bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3dc884640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3d815f7c0 0x7fb3d809ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3dc884640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d8155790 con 0x7fb3d80b41c0 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3dc884640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d8155610 con 0x7fb3d815f160 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3dc884640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d8155910 con 0x7fb3d815f7c0 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d80b41c0 0x7fb3d8157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d80b41c0 0x7fb3d8157660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51940/0 (socket says 172.21.15.120:51940) 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d659c640 1 -- 172.21.15.120:0/1175657167 learned_addr learned my addr 172.21.15.120:0/1175657167 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d5d9b640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3d815f160 0x7fb3d809bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d6d9d640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3d815f7c0 0x7fb3d809ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:30.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d659c640 1 -- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3d815f7c0 msgr2=0x7fb3d809ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d659c640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3d815f7c0 0x7fb3d809ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d659c640 1 -- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3d815f160 msgr2=0x7fb3d809bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d659c640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3d815f160 0x7fb3d809bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d659c640 1 -- 172.21.15.120:0/1175657167 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d8155e30 con 0x7fb3d80b41c0 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d5d9b640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3d815f160 0x7fb3d809bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.938+0000 7fb3d6d9d640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3d815f7c0 0x7fb3d809ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.939+0000 7fb3d659c640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d80b41c0 0x7fb3d8157660 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8034040 tx=0x7fb3c80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.939+0000 7fb3c6ffd640 1 -- 172.21.15.120:0/1175657167 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c803e030 con 0x7fb3d80b41c0 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.939+0000 7fb3c6ffd640 1 -- 172.21.15.120:0/1175657167 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3c8003d90 con 0x7fb3d80b41c0 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.939+0000 7fb3c6ffd640 1 -- 172.21.15.120:0/1175657167 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8035040 con 0x7fb3d80b41c0 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.939+0000 7fb3dc884640 1 -- 172.21.15.120:0/1175657167 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d8156110 con 0x7fb3d80b41c0 2024-07-27T03:12:30.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.939+0000 7fb3dc884640 1 -- 172.21.15.120:0/1175657167 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d81566d0 con 0x7fb3d80b41c0 2024-07-27T03:12:30.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.940+0000 7fb3dc884640 1 -- 172.21.15.120:0/1175657167 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d80cf060 con 0x7fb3d80b41c0 2024-07-27T03:12:30.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.940+0000 7fb3c6ffd640 1 -- 172.21.15.120:0/1175657167 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb3c8041030 con 0x7fb3d80b41c0 2024-07-27T03:12:30.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.941+0000 7fb3c6ffd640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b8077010 0x7fb3b8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:30.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.941+0000 7fb3c6ffd640 1 -- 172.21.15.120:0/1175657167 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7fb3c80b90c0 con 0x7fb3d80b41c0 2024-07-27T03:12:30.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.941+0000 7fb3d5d9b640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b8077010 0x7fb3b8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:30.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.942+0000 7fb3d5d9b640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b8077010 0x7fb3b8079520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80b10b0 tx=0x7fb3cc005f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:30.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:30.945+0000 7fb3c6ffd640 1 -- 172.21.15.120:0/1175657167 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb3c8082610 con 0x7fb3d80b41c0 2024-07-27T03:12:31.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.132+0000 7fb3dc884640 1 -- 172.21.15.120:0/1175657167 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb3d815ec20 con 0x7fb3d80b41c0 2024-07-27T03:12:31.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.132+0000 7fb3c6ffd640 1 -- 172.21.15.120:0/1175657167 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) ==== 84+0+65 (secure 0 0 0) 0x7fb3c8081f10 con 0x7fb3d80b41c0 2024-07-27T03:12:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:31.135 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-07-27T03:12:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-07-27T03:12:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2024-07-27T03:12:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2024-07-27T03:12:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-07-27T03:12:31.136 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-07-27T03:12:31.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.134+0000 7fb3dc884640 1 -- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b8077010 msgr2=0x7fb3b8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:31.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.134+0000 7fb3dc884640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b8077010 0x7fb3b8079520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80b10b0 tx=0x7fb3cc005f10 comp rx=0 tx=0).stop 2024-07-27T03:12:31.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.134+0000 7fb3dc884640 1 -- 172.21.15.120:0/1175657167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d80b41c0 msgr2=0x7fb3d8157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.134+0000 7fb3dc884640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d80b41c0 0x7fb3d8157660 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8034040 tx=0x7fb3c80038a0 comp rx=0 tx=0).stop 2024-07-27T03:12:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.134+0000 7fb3dc884640 1 -- 172.21.15.120:0/1175657167 shutdown_connections 2024-07-27T03:12:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.134+0000 7fb3dc884640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb3b8077010 0x7fb3b8079520 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.134+0000 7fb3dc884640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb3d815f7c0 0x7fb3d809ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.134+0000 7fb3dc884640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3d815f160 0x7fb3d809bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.134+0000 7fb3dc884640 1 --2- 172.21.15.120:0/1175657167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3d80b41c0 0x7fb3d8157660 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.134+0000 7fb3dc884640 1 -- 172.21.15.120:0/1175657167 >> 172.21.15.120:0/1175657167 conn(0x7fb3d80b1a10 msgr2=0x7fb3d8159770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.135+0000 7fb3dc884640 1 -- 172.21.15.120:0/1175657167 shutdown_connections 2024-07-27T03:12:31.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.135+0000 7fb3dc884640 1 -- 172.21.15.120:0/1175657167 wait complete. 2024-07-27T03:12:31.149 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-07-27T03:12:31.149 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-07-27T03:12:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.265+0000 7fa03e98f640 1 -- 172.21.15.120:0/1158334181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0380d2960 msgr2=0x7fa03815c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.265+0000 7fa03e98f640 1 --2- 172.21.15.120:0/1158334181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0380d2960 0x7fa03815c480 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa028005fd0 tx=0x7fa02802a5d0 comp rx=0 tx=0).stop 2024-07-27T03:12:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.265+0000 7fa03e98f640 1 -- 172.21.15.120:0/1158334181 shutdown_connections 2024-07-27T03:12:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.265+0000 7fa03e98f640 1 --2- 172.21.15.120:0/1158334181 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0380ce830 0x7fa0380cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.265+0000 7fa03e98f640 1 --2- 172.21.15.120:0/1158334181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0380d2960 0x7fa03815c480 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.265+0000 7fa03e98f640 1 -- 172.21.15.120:0/1158334181 >> 172.21.15.120:0/1158334181 conn(0x7fa0380d1e40 msgr2=0x7fa0380d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.265+0000 7fa03e98f640 1 -- 172.21.15.120:0/1158334181 shutdown_connections 2024-07-27T03:12:31.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.265+0000 7fa03e98f640 1 -- 172.21.15.120:0/1158334181 wait complete. 2024-07-27T03:12:31.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.267+0000 7fa03e98f640 1 Processor -- start 2024-07-27T03:12:31.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.267+0000 7fa03e98f640 1 -- start start 2024-07-27T03:12:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03e98f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0380ce830 0x7fa03814c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03e98f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0380cfd40 0x7fa0381f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03e98f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0380d2960 0x7fa0381f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03e98f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa0380b6590 con 0x7fa0380d2960 2024-07-27T03:12:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03e98f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa0380b6410 con 0x7fa0380cfd40 2024-07-27T03:12:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03e98f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa0380b6710 con 0x7fa0380ce830 2024-07-27T03:12:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03cf2c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0380d2960 0x7fa0381f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03cf2c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0380d2960 0x7fa0381f71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51950/0 (socket says 172.21.15.120:51950) 2024-07-27T03:12:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03cf2c640 1 -- 172.21.15.120:0/999761938 learned_addr learned my addr 172.21.15.120:0/999761938 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03cf2c640 1 -- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0380ce830 msgr2=0x7fa03814c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03cf2c640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0380ce830 0x7fa03814c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03cf2c640 1 -- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0380cfd40 msgr2=0x7fa0381f6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa02ffff640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0380cfd40 0x7fa0381f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.268+0000 7fa03cf2c640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0380cfd40 0x7fa0381f6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.269+0000 7fa03cf2c640 1 -- 172.21.15.120:0/999761938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0380b0af0 con 0x7fa0380d2960 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.269+0000 7fa03cf2c640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0380d2960 0x7fa0381f71b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa03000c730 tx=0x7fa03000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.269+0000 7fa0357fa640 1 -- 172.21.15.120:0/999761938 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa030003b70 con 0x7fa0380d2960 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.269+0000 7fa0357fa640 1 -- 172.21.15.120:0/999761938 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa030003d10 con 0x7fa0380d2960 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.269+0000 7fa03e98f640 1 -- 172.21.15.120:0/999761938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0380b0dd0 con 0x7fa0380d2960 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.269+0000 7fa0357fa640 1 -- 172.21.15.120:0/999761938 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa030005330 con 0x7fa0380d2960 2024-07-27T03:12:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.269+0000 7fa03e98f640 1 -- 172.21.15.120:0/999761938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0380b1390 con 0x7fa0380d2960 2024-07-27T03:12:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.270+0000 7fa03e98f640 1 -- 172.21.15.120:0/999761938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0380d0a90 con 0x7fa0380d2960 2024-07-27T03:12:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.270+0000 7fa0357fa640 1 -- 172.21.15.120:0/999761938 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fa0300054d0 con 0x7fa0380d2960 2024-07-27T03:12:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.271+0000 7fa0357fa640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa018077040 0x7fa018079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:31.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.271+0000 7fa0357fa640 1 -- 172.21.15.120:0/999761938 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7fa030098180 con 0x7fa0380d2960 2024-07-27T03:12:31.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.271+0000 7fa037fff640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa018077040 0x7fa018079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:31.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.272+0000 7fa037fff640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa018077040 0x7fa018079550 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa028033000 tx=0x7fa0280046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.276+0000 7fa0357fa640 1 -- 172.21.15.120:0/999761938 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fa0380cf180 con 0x7fa0380d2960 2024-07-27T03:12:31.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:31.458+0000 7fa03e98f640 1 -- 172.21.15.120:0/999761938 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa0381f7780 con 0x7fa0380d2960 2024-07-27T03:12:32.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.404+0000 7fa0357fa640 1 -- 172.21.15.120:0/999761938 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) ==== 138+0+0 (secure 0 0 0) 0x7fa030096e20 con 0x7fa0380d2960 2024-07-27T03:12:32.407 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2024-07-27T03:12:32.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 -- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa018077040 msgr2=0x7fa018079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:32.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa018077040 0x7fa018079550 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa028033000 tx=0x7fa0280046c0 comp rx=0 tx=0).stop 2024-07-27T03:12:32.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 -- 172.21.15.120:0/999761938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0380d2960 msgr2=0x7fa0381f71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:32.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0380d2960 0x7fa0381f71b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa03000c730 tx=0x7fa03000cb30 comp rx=0 tx=0).stop 2024-07-27T03:12:32.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 -- 172.21.15.120:0/999761938 shutdown_connections 2024-07-27T03:12:32.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa018077040 0x7fa018079550 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:32.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0380d2960 0x7fa0381f71b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:32.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa0380cfd40 0x7fa0381f6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:32.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 --2- 172.21.15.120:0/999761938 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa0380ce830 0x7fa03814c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:32.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 -- 172.21.15.120:0/999761938 >> 172.21.15.120:0/999761938 conn(0x7fa0380d1e40 msgr2=0x7fa03815f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:32.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 -- 172.21.15.120:0/999761938 shutdown_connections 2024-07-27T03:12:32.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.407+0000 7fa03e98f640 1 -- 172.21.15.120:0/999761938 wait complete. 2024-07-27T03:12:32.425 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-07-27T03:12:32.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.545+0000 7f170736b640 1 -- 172.21.15.120:0/2123376603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17000d0f00 msgr2=0x7f17000cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:32.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.545+0000 7f170736b640 1 --2- 172.21.15.120:0/2123376603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17000d0f00 0x7f17000cebe0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f17000d24d0 tx=0x7f16f802aaa0 comp rx=0 tx=0).stop 2024-07-27T03:12:32.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.545+0000 7f170736b640 1 -- 172.21.15.120:0/2123376603 shutdown_connections 2024-07-27T03:12:32.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.545+0000 7f170736b640 1 --2- 172.21.15.120:0/2123376603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17000d0f00 0x7f17000cebe0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:32.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.545+0000 7f170736b640 1 --2- 172.21.15.120:0/2123376603 >> v2:172.21.15.121:3300/0 conn(0x7f17000b2c40 0x7f17000d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:32.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.545+0000 7f170736b640 1 -- 172.21.15.120:0/2123376603 >> 172.21.15.120:0/2123376603 conn(0x7f170008d690 msgr2=0x7f170009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:32.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.546+0000 7f170736b640 1 -- 172.21.15.120:0/2123376603 shutdown_connections 2024-07-27T03:12:32.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.546+0000 7f170736b640 1 -- 172.21.15.120:0/2123376603 wait complete. 2024-07-27T03:12:32.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.547+0000 7f170736b640 1 Processor -- start 2024-07-27T03:12:32.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.547+0000 7f170736b640 1 -- start start 2024-07-27T03:12:32.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f170736b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f17000b2c40 0x7f17001f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:32.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f170736b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17000b4740 0x7f1700159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:32.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f170736b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17000d0f00 0x7f17000caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f170736b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f17000d3070 con 0x7f17000b4740 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f170736b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f17000d2ef0 con 0x7f17000d0f00 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f170736b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f17000cf120 con 0x7f17000b2c40 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f1704906640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17000b4740 0x7f1700159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f1704906640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17000b4740 0x7f1700159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58984/0 (socket says 172.21.15.120:58984) 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f1704906640 1 -- 172.21.15.120:0/4117006033 learned_addr learned my addr 172.21.15.120:0/4117006033 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f1705107640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f17000b2c40 0x7f17001f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f1705908640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17000d0f00 0x7f17000caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f1704906640 1 -- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f17000b2c40 msgr2=0x7f17001f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f1704906640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f17000b2c40 0x7f17001f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f1704906640 1 -- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17000d0f00 msgr2=0x7f17000caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:32.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f1704906640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17000d0f00 0x7f17000caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:32.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f1704906640 1 -- 172.21.15.120:0/4117006033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17001f54f0 con 0x7f17000b4740 2024-07-27T03:12:32.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f1704906640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17000b4740 0x7f1700159460 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f16f000e7c0 tx=0x7f16f000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:32.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f16f5ffb640 1 -- 172.21.15.120:0/4117006033 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f000ccc0 con 0x7f17000b4740 2024-07-27T03:12:32.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f16f5ffb640 1 -- 172.21.15.120:0/4117006033 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16f0010430 con 0x7f17000b4740 2024-07-27T03:12:32.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f16f5ffb640 1 -- 172.21.15.120:0/4117006033 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0010860 con 0x7f17000b4740 2024-07-27T03:12:32.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.549+0000 7f170736b640 1 -- 172.21.15.120:0/4117006033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17001f57b0 con 0x7f17000b4740 2024-07-27T03:12:32.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.550+0000 7f170736b640 1 -- 172.21.15.120:0/4117006033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17001f5d70 con 0x7f17000b4740 2024-07-27T03:12:32.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.551+0000 7f170736b640 1 -- 172.21.15.120:0/4117006033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17000d09c0 con 0x7f17000b4740 2024-07-27T03:12:32.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.552+0000 7f16f5ffb640 1 -- 172.21.15.120:0/4117006033 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f16f0010a00 con 0x7f17000b4740 2024-07-27T03:12:32.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.552+0000 7f16f5ffb640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16e4077010 0x7f16e4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:32.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.552+0000 7f16f5ffb640 1 -- 172.21.15.120:0/4117006033 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5227+0+0 (secure 0 0 0) 0x7f16f0099820 con 0x7f17000b4740 2024-07-27T03:12:32.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.552+0000 7f1705107640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16e4077010 0x7f16e4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:32.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.553+0000 7f1705107640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16e4077010 0x7f16e4079520 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f16fc000f60 tx=0x7f16fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:32.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.556+0000 7f16f5ffb640 1 -- 172.21.15.120:0/4117006033 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f16f0062690 con 0x7f17000b4740 2024-07-27T03:12:32.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:32.738+0000 7f170736b640 1 -- 172.21.15.120:0/4117006033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f170015dac0 con 0x7f17000b4740 2024-07-27T03:12:33.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.406+0000 7f16f5ffb640 1 -- 172.21.15.120:0/4117006033 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) ==== 170+0+0 (secure 0 0 0) 0x7f16f0066be0 con 0x7f17000b4740 2024-07-27T03:12:33.410 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2024-07-27T03:12:33.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 -- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16e4077010 msgr2=0x7f16e4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:33.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16e4077010 0x7f16e4079520 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f16fc000f60 tx=0x7f16fc009040 comp rx=0 tx=0).stop 2024-07-27T03:12:33.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 -- 172.21.15.120:0/4117006033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17000b4740 msgr2=0x7f1700159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:33.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17000b4740 0x7f1700159460 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f16f000e7c0 tx=0x7f16f000ec80 comp rx=0 tx=0).stop 2024-07-27T03:12:33.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 -- 172.21.15.120:0/4117006033 shutdown_connections 2024-07-27T03:12:33.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f16e4077010 0x7f16e4079520 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:33.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17000b4740 0x7f1700159460 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:33.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17000d0f00 0x7f17000caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:33.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 --2- 172.21.15.120:0/4117006033 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f17000b2c40 0x7f17001f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:33.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 -- 172.21.15.120:0/4117006033 >> 172.21.15.120:0/4117006033 conn(0x7f170008d690 msgr2=0x7f170015d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:33.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 -- 172.21.15.120:0/4117006033 shutdown_connections 2024-07-27T03:12:33.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.410+0000 7f170736b640 1 -- 172.21.15.120:0/4117006033 wait complete. 2024-07-27T03:12:33.436 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-07-27T03:12:33.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.555+0000 7f27d6884640 1 -- 172.21.15.120:0/3645344368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27d0164ed0 msgr2=0x7f27d01672f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:33.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.555+0000 7f27d6884640 1 --2- 172.21.15.120:0/3645344368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27d0164ed0 0x7f27d01672f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f27c8005fd0 tx=0x7f27c802a940 comp rx=0 tx=0).stop 2024-07-27T03:12:33.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.555+0000 7f27d6884640 1 -- 172.21.15.120:0/3645344368 shutdown_connections 2024-07-27T03:12:33.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.555+0000 7f27d6884640 1 --2- 172.21.15.120:0/3645344368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27d0164ed0 0x7f27d01672f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:33.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.555+0000 7f27d6884640 1 -- 172.21.15.120:0/3645344368 >> 172.21.15.120:0/3645344368 conn(0x7f27d00b1a10 msgr2=0x7f27d00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:33.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.555+0000 7f27d6884640 1 -- 172.21.15.120:0/3645344368 shutdown_connections 2024-07-27T03:12:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.555+0000 7f27d6884640 1 -- 172.21.15.120:0/3645344368 wait complete. 2024-07-27T03:12:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.556+0000 7f27d6884640 1 Processor -- start 2024-07-27T03:12:33.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.557+0000 7f27d6884640 1 -- start start 2024-07-27T03:12:33.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d6884640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d00aebf0 0x7f27d015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:33.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d6884640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27d0145390 0x7f27d013f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:33.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d6884640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27d0164ed0 0x7f27d013fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:33.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d6884640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f27d0167830 con 0x7f27d0164ed0 2024-07-27T03:12:33.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d6884640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f27d01451f0 con 0x7f27d00aebf0 2024-07-27T03:12:33.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d6884640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f27d01679b0 con 0x7f27d0145390 2024-07-27T03:12:33.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d4e21640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27d0164ed0 0x7f27d013fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:33.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d4e21640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27d0164ed0 0x7f27d013fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59004/0 (socket says 172.21.15.120:59004) 2024-07-27T03:12:33.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d4e21640 1 -- 172.21.15.120:0/297290241 learned_addr learned my addr 172.21.15.120:0/297290241 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:33.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27cffff640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d00aebf0 0x7f27d015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27cf7fe640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27d0145390 0x7f27d013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d4e21640 1 -- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27d0145390 msgr2=0x7f27d013f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d4e21640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27d0145390 0x7f27d013f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d4e21640 1 -- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d00aebf0 msgr2=0x7f27d015b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d4e21640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d00aebf0 0x7f27d015b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27d4e21640 1 -- 172.21.15.120:0/297290241 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d013edd0 con 0x7f27d0164ed0 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27cffff640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d00aebf0 0x7f27d015b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.558+0000 7f27cf7fe640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27d0145390 0x7f27d013f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.559+0000 7f27d4e21640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27d0164ed0 0x7f27d013fa50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009cd0 tx=0x7f27c8031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.559+0000 7f27ccff9640 1 -- 172.21.15.120:0/297290241 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c803e070 con 0x7f27d0164ed0 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.559+0000 7f27ccff9640 1 -- 172.21.15.120:0/297290241 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27c8004560 con 0x7f27d0164ed0 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.559+0000 7f27d6884640 1 -- 172.21.15.120:0/297290241 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d01417b0 con 0x7f27d0164ed0 2024-07-27T03:12:33.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.559+0000 7f27ccff9640 1 -- 172.21.15.120:0/297290241 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8043460 con 0x7f27d0164ed0 2024-07-27T03:12:33.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.559+0000 7f27d6884640 1 -- 172.21.15.120:0/297290241 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d013ea60 con 0x7f27d0164ed0 2024-07-27T03:12:33.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.560+0000 7f27d6884640 1 -- 172.21.15.120:0/297290241 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d01f3e60 con 0x7f27d0164ed0 2024-07-27T03:12:33.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.561+0000 7f27ccff9640 1 -- 172.21.15.120:0/297290241 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f27c8043600 con 0x7f27d0164ed0 2024-07-27T03:12:33.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.561+0000 7f27ccff9640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f27bc077040 0x7f27bc079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:33.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.561+0000 7f27ccff9640 1 -- 172.21.15.120:0/297290241 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5609+0+0 (secure 0 0 0) 0x7f27c80ba4a0 con 0x7f27d0164ed0 2024-07-27T03:12:33.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.562+0000 7f27cffff640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f27bc077040 0x7f27bc079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:33.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.562+0000 7f27cffff640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f27bc077040 0x7f27bc079550 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f27c0007fd0 tx=0x7f27c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:33.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.565+0000 7f27ccff9640 1 -- 172.21.15.120:0/297290241 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f27c8083790 con 0x7f27d0164ed0 2024-07-27T03:12:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:33.786+0000 7f27d6884640 1 -- 172.21.15.120:0/297290241 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f27d00af000 con 0x7f27d0164ed0 2024-07-27T03:12:34.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.427+0000 7f27ccff9640 1 -- 172.21.15.120:0/297290241 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v62) ==== 174+0+0 (secure 0 0 0) 0x7f27c8041e40 con 0x7f27d0164ed0 2024-07-27T03:12:34.430 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 10 and data pool 11 2024-07-27T03:12:34.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.429+0000 7f27d6884640 1 -- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f27bc077040 msgr2=0x7f27bc079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:34.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.429+0000 7f27d6884640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f27bc077040 0x7f27bc079550 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f27c0007fd0 tx=0x7f27c0009040 comp rx=0 tx=0).stop 2024-07-27T03:12:34.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.429+0000 7f27d6884640 1 -- 172.21.15.120:0/297290241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27d0164ed0 msgr2=0x7f27d013fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:34.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.429+0000 7f27d6884640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27d0164ed0 0x7f27d013fa50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009cd0 tx=0x7f27c8031ea0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.430+0000 7f27d6884640 1 -- 172.21.15.120:0/297290241 shutdown_connections 2024-07-27T03:12:34.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.430+0000 7f27d6884640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f27bc077040 0x7f27bc079550 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.430+0000 7f27d6884640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27d0164ed0 0x7f27d013fa50 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.430+0000 7f27d6884640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f27d0145390 0x7f27d013f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.430+0000 7f27d6884640 1 --2- 172.21.15.120:0/297290241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d00aebf0 0x7f27d015b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.430+0000 7f27d6884640 1 -- 172.21.15.120:0/297290241 >> 172.21.15.120:0/297290241 conn(0x7f27d00b1a10 msgr2=0x7f27d00b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:34.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.430+0000 7f27d6884640 1 -- 172.21.15.120:0/297290241 shutdown_connections 2024-07-27T03:12:34.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.430+0000 7f27d6884640 1 -- 172.21.15.120:0/297290241 wait complete. 2024-07-27T03:12:34.459 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:12:34.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.572+0000 7f6efa48b640 1 -- 172.21.15.120:0/3762352533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6edc004800 msgr2=0x7f6edc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:34.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.572+0000 7f6efa48b640 1 --2- 172.21.15.120:0/3762352533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6edc004800 0x7f6edc004c10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40ae680 tx=0x7f6edc005830 comp rx=0 tx=0).stop 2024-07-27T03:12:34.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.572+0000 7f6ef8a28640 1 -- 172.21.15.120:0/3762352533 reap_dead start 2024-07-27T03:12:34.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.572+0000 7f6efa48b640 1 -- 172.21.15.120:0/3762352533 shutdown_connections 2024-07-27T03:12:34.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.572+0000 7f6efa48b640 1 -- 172.21.15.120:0/3762352533 >> 172.21.15.120:0/3762352533 conn(0x7f6ef40b1a10 msgr2=0x7f6ef40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:34.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.572+0000 7f6efa48b640 1 -- 172.21.15.120:0/3762352533 shutdown_connections 2024-07-27T03:12:34.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.572+0000 7f6efa48b640 1 -- 172.21.15.120:0/3762352533 wait complete. 2024-07-27T03:12:34.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.574+0000 7f6efa48b640 1 Processor -- start 2024-07-27T03:12:34.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.574+0000 7f6efa48b640 1 -- start start 2024-07-27T03:12:34.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6efa48b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6edc004800 0x7f6ef413e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:34.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6efa48b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ef413efa0 0x7f6ef413f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6efa48b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef41595c0 0x7f6ef41599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6efa48b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef40af4d0 con 0x7f6ef41595c0 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6efa48b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef40af350 con 0x7f6edc004800 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6efa48b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef40af650 con 0x7f6ef413efa0 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef8a28640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef41595c0 0x7f6ef41599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef8a28640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef41595c0 0x7f6ef41599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59030/0 (socket says 172.21.15.120:59030) 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef8a28640 1 -- 172.21.15.120:0/1234125687 learned_addr learned my addr 172.21.15.120:0/1234125687 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef3fff640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6edc004800 0x7f6ef413e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef37fe640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ef413efa0 0x7f6ef413f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef8a28640 1 -- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ef413efa0 msgr2=0x7f6ef413f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef8a28640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ef413efa0 0x7f6ef413f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef8a28640 1 -- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6edc004800 msgr2=0x7f6ef413e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:34.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef8a28640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6edc004800 0x7f6ef413e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef8a28640 1 -- 172.21.15.120:0/1234125687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef4159f10 con 0x7f6ef41595c0 2024-07-27T03:12:34.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef8a28640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef41595c0 0x7f6ef41599d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6ef409e030 tx=0x7f6eec001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:34.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef0ff9640 1 -- 172.21.15.120:0/1234125687 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec011900 con 0x7f6ef41595c0 2024-07-27T03:12:34.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef0ff9640 1 -- 172.21.15.120:0/1234125687 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6eec018070 con 0x7f6ef41595c0 2024-07-27T03:12:34.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6efa48b640 1 -- 172.21.15.120:0/1234125687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef413fc60 con 0x7f6ef41595c0 2024-07-27T03:12:34.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6ef0ff9640 1 -- 172.21.15.120:0/1234125687 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec011d60 con 0x7f6ef41595c0 2024-07-27T03:12:34.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.576+0000 7f6efa48b640 1 -- 172.21.15.120:0/1234125687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef4140220 con 0x7f6ef41595c0 2024-07-27T03:12:34.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.577+0000 7f6efa48b640 1 -- 172.21.15.120:0/1234125687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef413f9d0 con 0x7f6ef41595c0 2024-07-27T03:12:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.578+0000 7f6ef0ff9640 1 -- 172.21.15.120:0/1234125687 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6eec01d460 con 0x7f6ef41595c0 2024-07-27T03:12:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.579+0000 7f6ef0ff9640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6ee0077010 0x7f6ee0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.579+0000 7f6ef0ff9640 1 -- 172.21.15.120:0/1234125687 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f6eec099170 con 0x7f6ef41595c0 2024-07-27T03:12:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.579+0000 7f6ef3fff640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6ee0077010 0x7f6ee0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:34.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.579+0000 7f6ef3fff640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6ee0077010 0x7f6ee0079520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4001010 tx=0x7f6ee40067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:34.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.583+0000 7f6ef0ff9640 1 -- 172.21.15.120:0/1234125687 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6ef4159f10 con 0x7f6ef41595c0 2024-07-27T03:12:34.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.768+0000 7f6efa48b640 1 -- 172.21.15.120:0/1234125687 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ef40735f0 con 0x7f6ef41595c0 2024-07-27T03:12:34.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.769+0000 7f6ef0ff9640 1 -- 172.21.15.120:0/1234125687 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16705 (secure 0 0 0) 0x7f6eec062370 con 0x7f6ef41595c0 2024-07-27T03:12:34.772 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:34.772 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":68,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:12:33.787474+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:12:31.463339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-07-27T03:12:32.742612+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:12:34.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 -- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6ee0077010 msgr2=0x7f6ee0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:34.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6ee0077010 0x7f6ee0079520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4001010 tx=0x7f6ee40067a0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 -- 172.21.15.120:0/1234125687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef41595c0 msgr2=0x7f6ef41599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:34.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef41595c0 0x7f6ef41599d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6ef409e030 tx=0x7f6eec001c10 comp rx=0 tx=0).stop 2024-07-27T03:12:34.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 -- 172.21.15.120:0/1234125687 shutdown_connections 2024-07-27T03:12:34.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6ee0077010 0x7f6ee0079520 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ef41595c0 0x7f6ef41599d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6ef413efa0 0x7f6ef413f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 --2- 172.21.15.120:0/1234125687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6edc004800 0x7f6ef413e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 -- 172.21.15.120:0/1234125687 >> 172.21.15.120:0/1234125687 conn(0x7f6ef40b1a10 msgr2=0x7f6ef40ad0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:34.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 -- 172.21.15.120:0/1234125687 shutdown_connections 2024-07-27T03:12:34.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.771+0000 7f6efa48b640 1 -- 172.21.15.120:0/1234125687 wait complete. 2024-07-27T03:12:34.786 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:12:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.897+0000 7efcbf07d640 1 -- 172.21.15.120:0/1234213782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcb806e270 msgr2=0x7efcb8073af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.897+0000 7efcbf07d640 1 --2- 172.21.15.120:0/1234213782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcb806e270 0x7efcb8073af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efca8009830 tx=0x7efca802a410 comp rx=0 tx=0).stop 2024-07-27T03:12:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.897+0000 7efcbf07d640 1 -- 172.21.15.120:0/1234213782 shutdown_connections 2024-07-27T03:12:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.897+0000 7efcbf07d640 1 --2- 172.21.15.120:0/1234213782 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcb815ec10 0x7efcb815f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.897+0000 7efcbf07d640 1 --2- 172.21.15.120:0/1234213782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcb806e270 0x7efcb8073af0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.897+0000 7efcbf07d640 1 -- 172.21.15.120:0/1234213782 >> 172.21.15.120:0/1234213782 conn(0x7efcb80b1a10 msgr2=0x7efcb80b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.897+0000 7efcbf07d640 1 -- 172.21.15.120:0/1234213782 shutdown_connections 2024-07-27T03:12:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.897+0000 7efcbf07d640 1 -- 172.21.15.120:0/1234213782 wait complete. 2024-07-27T03:12:34.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.899+0000 7efcbf07d640 1 Processor -- start 2024-07-27T03:12:34.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.899+0000 7efcbf07d640 1 -- start start 2024-07-27T03:12:34.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.900+0000 7efcbf07d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb806e270 0x7efcb81435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:34.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.900+0000 7efcbf07d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcb81522e0 0x7efcb8159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:34.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.900+0000 7efcbf07d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcb815ec10 0x7efcb8159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:34.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.900+0000 7efcbf07d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efcb815f8f0 con 0x7efcb806e270 2024-07-27T03:12:34.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.900+0000 7efcbf07d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efcb815f770 con 0x7efcb815ec10 2024-07-27T03:12:34.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.900+0000 7efcbf07d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7efcb815fa70 con 0x7efcb81522e0 2024-07-27T03:12:34.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbce19640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb806e270 0x7efcb81435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbce19640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb806e270 0x7efcb81435b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59036/0 (socket says 172.21.15.120:59036) 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbce19640 1 -- 172.21.15.120:0/1776368394 learned_addr learned my addr 172.21.15.120:0/1776368394 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbd61a640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcb815ec10 0x7efcb8159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcaffff640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcb81522e0 0x7efcb8159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbce19640 1 -- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcb81522e0 msgr2=0x7efcb8159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbce19640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcb81522e0 0x7efcb8159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbce19640 1 -- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcb815ec10 msgr2=0x7efcb8159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbce19640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcb815ec10 0x7efcb8159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbce19640 1 -- 172.21.15.120:0/1776368394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb81f4220 con 0x7efcb806e270 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcaffff640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcb81522e0 0x7efcb8159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbce19640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb806e270 0x7efcb81435b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efcb400c530 tx=0x7efcb400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcad7fa640 1 -- 172.21.15.120:0/1776368394 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4016020 con 0x7efcb806e270 2024-07-27T03:12:34.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcad7fa640 1 -- 172.21.15.120:0/1776368394 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcb4012940 con 0x7efcb806e270 2024-07-27T03:12:34.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbf07d640 1 -- 172.21.15.120:0/1776368394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb81f3610 con 0x7efcb806e270 2024-07-27T03:12:34.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcad7fa640 1 -- 172.21.15.120:0/1776368394 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4012d90 con 0x7efcb806e270 2024-07-27T03:12:34.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.901+0000 7efcbf07d640 1 -- 172.21.15.120:0/1776368394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb81f3bd0 con 0x7efcb806e270 2024-07-27T03:12:34.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.902+0000 7efcbf07d640 1 -- 172.21.15.120:0/1776368394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb815f020 con 0x7efcb806e270 2024-07-27T03:12:34.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.903+0000 7efcad7fa640 1 -- 172.21.15.120:0/1776368394 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7efcb4019020 con 0x7efcb806e270 2024-07-27T03:12:34.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.903+0000 7efcad7fa640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efca4077010 0x7efca4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:34.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.904+0000 7efcad7fa640 1 -- 172.21.15.120:0/1776368394 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7efcb4098890 con 0x7efcb806e270 2024-07-27T03:12:34.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.904+0000 7efcaffff640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efca4077010 0x7efca4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:34.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.904+0000 7efcaffff640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efca4077010 0x7efca4079520 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efca8034000 tx=0x7efca8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:34.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:34.908+0000 7efcad7fa640 1 -- 172.21.15.120:0/1776368394 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7efcb4020020 con 0x7efcb806e270 2024-07-27T03:12:35.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.091+0000 7efcbf07d640 1 -- 172.21.15.120:0/1776368394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcb8155ce0 con 0x7efcb806e270 2024-07-27T03:12:35.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.092+0000 7efcad7fa640 1 -- 172.21.15.120:0/1776368394 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16705 (secure 0 0 0) 0x7efcb4061b20 con 0x7efcb806e270 2024-07-27T03:12:35.094 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:35.095 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":68,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:12:33.787474+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:12:31.463339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-07-27T03:12:32.742612+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:12:35.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 -- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efca4077010 msgr2=0x7efca4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efca4077010 0x7efca4079520 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efca8034000 tx=0x7efca8004730 comp rx=0 tx=0).stop 2024-07-27T03:12:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 -- 172.21.15.120:0/1776368394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb806e270 msgr2=0x7efcb81435b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb806e270 0x7efcb81435b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efcb400c530 tx=0x7efcb400c9f0 comp rx=0 tx=0).stop 2024-07-27T03:12:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 -- 172.21.15.120:0/1776368394 shutdown_connections 2024-07-27T03:12:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7efca4077010 0x7efca4079520 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efcb815ec10 0x7efcb8159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efcb81522e0 0x7efcb8159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 --2- 172.21.15.120:0/1776368394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb806e270 0x7efcb81435b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 -- 172.21.15.120:0/1776368394 >> 172.21.15.120:0/1776368394 conn(0x7efcb80b1a10 msgr2=0x7efcb80afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:35.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 -- 172.21.15.120:0/1776368394 shutdown_connections 2024-07-27T03:12:35.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.094+0000 7efcbf07d640 1 -- 172.21.15.120:0/1776368394 wait complete. 2024-07-27T03:12:35.108 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-07-27T03:12:35.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.223+0000 7fd422938640 1 -- 172.21.15.120:0/56707423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41c15c0c0 msgr2=0x7fd41c073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:35.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.223+0000 7fd422938640 1 --2- 172.21.15.120:0/56707423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41c15c0c0 0x7fd41c073560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009820 tx=0x7fd40c02a370 comp rx=0 tx=0).stop 2024-07-27T03:12:35.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.223+0000 7fd422938640 1 -- 172.21.15.120:0/56707423 shutdown_connections 2024-07-27T03:12:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.223+0000 7fd422938640 1 --2- 172.21.15.120:0/56707423 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41c0cfad0 0x7fd41c0cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.223+0000 7fd422938640 1 --2- 172.21.15.120:0/56707423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41c15c0c0 0x7fd41c073560 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.223+0000 7fd422938640 1 -- 172.21.15.120:0/56707423 >> 172.21.15.120:0/56707423 conn(0x7fd41c0b2ca0 msgr2=0x7fd41c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.223+0000 7fd422938640 1 -- 172.21.15.120:0/56707423 shutdown_connections 2024-07-27T03:12:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.223+0000 7fd422938640 1 -- 172.21.15.120:0/56707423 wait complete. 2024-07-27T03:12:35.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.225+0000 7fd422938640 1 Processor -- start 2024-07-27T03:12:35.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.225+0000 7fd422938640 1 -- start start 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.226+0000 7fd422938640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41c073aa0 0x7fd41c147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.226+0000 7fd422938640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0cfad0 0x7fd41c0b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.226+0000 7fd422938640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41c15c0c0 0x7fd41c0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.226+0000 7fd422938640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0cecd0 con 0x7fd41c0cfad0 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.226+0000 7fd422938640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0ceb50 con 0x7fd41c073aa0 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.226+0000 7fd422938640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c0cee50 con 0x7fd41c15c0c0 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd41b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0cfad0 0x7fd41c0b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd41b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0cfad0 0x7fd41c0b4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59038/0 (socket says 172.21.15.120:59038) 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd41b7fe640 1 -- 172.21.15.120:0/103703126 learned_addr learned my addr 172.21.15.120:0/103703126 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd420ed5640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41c15c0c0 0x7fd41c0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd41bfff640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41c073aa0 0x7fd41c147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:35.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd41b7fe640 1 -- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41c15c0c0 msgr2=0x7fd41c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd41b7fe640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41c15c0c0 0x7fd41c0b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd41b7fe640 1 -- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41c073aa0 msgr2=0x7fd41c147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd41b7fe640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41c073aa0 0x7fd41c147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd41b7fe640 1 -- 172.21.15.120:0/103703126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c1535c0 con 0x7fd41c0cfad0 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd41bfff640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41c073aa0 0x7fd41c147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd41b7fe640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0cfad0 0x7fd41c0b4020 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c500 tx=0x7fd41000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd418ff9640 1 -- 172.21.15.120:0/103703126 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410016020 con 0x7fd41c0cfad0 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd418ff9640 1 -- 172.21.15.120:0/103703126 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd410012920 con 0x7fd41c0cfad0 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd422938640 1 -- 172.21.15.120:0/103703126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c1538a0 con 0x7fd41c0cfad0 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd418ff9640 1 -- 172.21.15.120:0/103703126 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410012d70 con 0x7fd41c0cfad0 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.227+0000 7fd422938640 1 -- 172.21.15.120:0/103703126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c155fe0 con 0x7fd41c0cfad0 2024-07-27T03:12:35.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.228+0000 7fd422938640 1 -- 172.21.15.120:0/103703126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41c153330 con 0x7fd41c0cfad0 2024-07-27T03:12:35.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.229+0000 7fd418ff9640 1 -- 172.21.15.120:0/103703126 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd410019020 con 0x7fd41c0cfad0 2024-07-27T03:12:35.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.229+0000 7fd418ff9640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd408077010 0x7fd408079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:35.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.230+0000 7fd418ff9640 1 -- 172.21.15.120:0/103703126 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fd410098a70 con 0x7fd41c0cfad0 2024-07-27T03:12:35.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.230+0000 7fd41bfff640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd408077010 0x7fd408079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:35.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.230+0000 7fd41bfff640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd408077010 0x7fd408079520 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd40c034000 tx=0x7fd40c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:35.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.234+0000 7fd418ff9640 1 -- 172.21.15.120:0/103703126 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd410020020 con 0x7fd41c0cfad0 2024-07-27T03:12:35.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:35.457+0000 7fd422938640 1 -- 172.21.15.120:0/103703126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd41c0cf3b0 con 0x7fd41c0cfad0 2024-07-27T03:12:36.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.453+0000 7fd418ff9640 1 -- 172.21.15.120:0/103703126 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) ==== 118+0+0 (secure 0 0 0) 0x7fd41c15b640 con 0x7fd41c0cfad0 2024-07-27T03:12:36.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 -- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd408077010 msgr2=0x7fd408079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:36.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd408077010 0x7fd408079520 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd40c034000 tx=0x7fd40c004730 comp rx=0 tx=0).stop 2024-07-27T03:12:36.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 -- 172.21.15.120:0/103703126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0cfad0 msgr2=0x7fd41c0b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:36.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0cfad0 0x7fd41c0b4020 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c500 tx=0x7fd41000c9c0 comp rx=0 tx=0).stop 2024-07-27T03:12:36.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 -- 172.21.15.120:0/103703126 shutdown_connections 2024-07-27T03:12:36.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd408077010 0x7fd408079520 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:36.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0cfad0 0x7fd41c0b4020 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:36.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd41c15c0c0 0x7fd41c0b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:36.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 --2- 172.21.15.120:0/103703126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd41c073aa0 0x7fd41c147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:36.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 -- 172.21.15.120:0/103703126 >> 172.21.15.120:0/103703126 conn(0x7fd41c0b2ca0 msgr2=0x7fd41c0b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:36.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 -- 172.21.15.120:0/103703126 shutdown_connections 2024-07-27T03:12:36.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.456+0000 7fd422938640 1 -- 172.21.15.120:0/103703126 wait complete. 2024-07-27T03:12:36.473 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-07-27T03:12:36.473 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-07-27T03:12:36.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.592+0000 7faf35a22640 1 -- 172.21.15.120:0/2697664537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf18004800 msgr2=0x7faf18004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:36.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.592+0000 7faf35a22640 1 --2- 172.21.15.120:0/2697664537 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf18004800 0x7faf18004c10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7faf24009b20 tx=0x7faf18005830 comp rx=0 tx=0).stop 2024-07-27T03:12:36.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.592+0000 7faf2f7fe640 1 -- 172.21.15.120:0/2697664537 reap_dead start 2024-07-27T03:12:36.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.592+0000 7faf35a22640 1 -- 172.21.15.120:0/2697664537 shutdown_connections 2024-07-27T03:12:36.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.592+0000 7faf35a22640 1 -- 172.21.15.120:0/2697664537 >> 172.21.15.120:0/2697664537 conn(0x7faf3008d690 msgr2=0x7faf3009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:36.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.592+0000 7faf35a22640 1 -- 172.21.15.120:0/2697664537 shutdown_connections 2024-07-27T03:12:36.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.592+0000 7faf35a22640 1 -- 172.21.15.120:0/2697664537 wait complete. 2024-07-27T03:12:36.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.594+0000 7faf35a22640 1 Processor -- start 2024-07-27T03:12:36.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.595+0000 7faf35a22640 1 -- start start 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf35a22640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf18004800 0x7faf300cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf35a22640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf3015c4c0 0x7faf3014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf35a22640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf30160e70 0x7faf3006e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf35a22640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7faf300cf2f0 con 0x7faf30160e70 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf35a22640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faf300d3100 con 0x7faf3015c4c0 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf35a22640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7faf300cf470 con 0x7faf18004800 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf2f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf30160e70 0x7faf3006e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf2f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf30160e70 0x7faf3006e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59050/0 (socket says 172.21.15.120:59050) 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf2f7fe640 1 -- 172.21.15.120:0/162190052 learned_addr learned my addr 172.21.15.120:0/162190052 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf2effd640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf18004800 0x7faf300cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf2e7fc640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf3015c4c0 0x7faf3014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:36.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf2f7fe640 1 -- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf18004800 msgr2=0x7faf300cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:36.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf2f7fe640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf18004800 0x7faf300cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:36.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf2f7fe640 1 -- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf3015c4c0 msgr2=0x7faf3014db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:36.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf2f7fe640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf3015c4c0 0x7faf3014db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:36.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf2f7fe640 1 -- 172.21.15.120:0/162190052 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf30150d50 con 0x7faf30160e70 2024-07-27T03:12:36.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf2f7fe640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf30160e70 0x7faf3006e380 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7faf3008d410 tx=0x7faf28006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:36.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf17fff640 1 -- 172.21.15.120:0/162190052 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2800fa80 con 0x7faf30160e70 2024-07-27T03:12:36.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.596+0000 7faf17fff640 1 -- 172.21.15.120:0/162190052 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf2800fc20 con 0x7faf30160e70 2024-07-27T03:12:36.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.597+0000 7faf35a22640 1 -- 172.21.15.120:0/162190052 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf30151150 con 0x7faf30160e70 2024-07-27T03:12:36.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.597+0000 7faf17fff640 1 -- 172.21.15.120:0/162190052 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28011430 con 0x7faf30160e70 2024-07-27T03:12:36.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.597+0000 7faf35a22640 1 -- 172.21.15.120:0/162190052 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf30160670 con 0x7faf30160e70 2024-07-27T03:12:36.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.598+0000 7faf35a22640 1 -- 172.21.15.120:0/162190052 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf301601b0 con 0x7faf30160e70 2024-07-27T03:12:36.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.599+0000 7faf17fff640 1 -- 172.21.15.120:0/162190052 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7faf280115d0 con 0x7faf30160e70 2024-07-27T03:12:36.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.599+0000 7faf17fff640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faf1c077010 0x7faf1c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:36.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.599+0000 7faf17fff640 1 -- 172.21.15.120:0/162190052 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7faf280990e0 con 0x7faf30160e70 2024-07-27T03:12:36.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.599+0000 7faf2effd640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faf1c077010 0x7faf1c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:36.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.600+0000 7faf2effd640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faf1c077010 0x7faf1c079520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faf200036b0 tx=0x7faf20006110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:36.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.604+0000 7faf17fff640 1 -- 172.21.15.120:0/162190052 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7faf301601b0 con 0x7faf30160e70 2024-07-27T03:12:36.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:36.822+0000 7faf35a22640 1 -- 172.21.15.120:0/162190052 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7faf300d0bf0 con 0x7faf30160e70 2024-07-27T03:12:37.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.458+0000 7faf17fff640 1 -- 172.21.15.120:0/162190052 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v66) ==== 122+0+0 (secure 0 0 0) 0x7faf300d1310 con 0x7faf30160e70 2024-07-27T03:12:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 -- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faf1c077010 msgr2=0x7faf1c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faf1c077010 0x7faf1c079520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faf200036b0 tx=0x7faf20006110 comp rx=0 tx=0).stop 2024-07-27T03:12:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 -- 172.21.15.120:0/162190052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf30160e70 msgr2=0x7faf3006e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf30160e70 0x7faf3006e380 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7faf3008d410 tx=0x7faf28006720 comp rx=0 tx=0).stop 2024-07-27T03:12:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 -- 172.21.15.120:0/162190052 shutdown_connections 2024-07-27T03:12:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7faf1c077010 0x7faf1c079520 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf30160e70 0x7faf3006e380 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf3015c4c0 0x7faf3014db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 --2- 172.21.15.120:0/162190052 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faf18004800 0x7faf300cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 -- 172.21.15.120:0/162190052 >> 172.21.15.120:0/162190052 conn(0x7faf3008d690 msgr2=0x7faf300b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:37.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 -- 172.21.15.120:0/162190052 shutdown_connections 2024-07-27T03:12:37.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.460+0000 7faf35a22640 1 -- 172.21.15.120:0/162190052 wait complete. 2024-07-27T03:12:37.475 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-07-27T03:12:37.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:12:37.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.586+0000 7f721969a640 1 -- 172.21.15.120:0/2861732170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72140b4740 msgr2=0x7f72140b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:37.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.586+0000 7f721969a640 1 --2- 172.21.15.120:0/2861732170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72140b4740 0x7f72140b2c40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7204005fd0 tx=0x7f720402a530 comp rx=0 tx=0).stop 2024-07-27T03:12:37.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.586+0000 7f721969a640 1 -- 172.21.15.120:0/2861732170 shutdown_connections 2024-07-27T03:12:37.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.586+0000 7f721969a640 1 --2- 172.21.15.120:0/2861732170 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72140d27e0 0x7f72140d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.586+0000 7f721969a640 1 --2- 172.21.15.120:0/2861732170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72140b4740 0x7f72140b2c40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.586+0000 7f721969a640 1 -- 172.21.15.120:0/2861732170 >> 172.21.15.120:0/2861732170 conn(0x7f721408d690 msgr2=0x7f721409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:37.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.586+0000 7f721969a640 1 -- 172.21.15.120:0/2861732170 shutdown_connections 2024-07-27T03:12:37.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.586+0000 7f721969a640 1 -- 172.21.15.120:0/2861732170 wait complete. 2024-07-27T03:12:37.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.588+0000 7f721969a640 1 Processor -- start 2024-07-27T03:12:37.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.588+0000 7f721969a640 1 -- start start 2024-07-27T03:12:37.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f721969a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72140b4740 0x7f72140b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:37.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f721969a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72140d09c0 0x7f72140c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:37.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f721969a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72140d27e0 0x7f72141f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:37.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f721969a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f72140cef70 con 0x7f72140b4740 2024-07-27T03:12:37.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f721969a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72140cedf0 con 0x7f72140d09c0 2024-07-27T03:12:37.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f721969a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f72140cf0f0 con 0x7f72140d27e0 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f7212ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72140b4740 0x7f72140b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f7212ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72140b4740 0x7f72140b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59082/0 (socket says 172.21.15.120:59082) 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f7212ffd640 1 -- 172.21.15.120:0/127784614 learned_addr learned my addr 172.21.15.120:0/127784614 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f720bfff640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72140d09c0 0x7f72140c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f72137fe640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72140d27e0 0x7f72141f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f7212ffd640 1 -- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72140d27e0 msgr2=0x7f72141f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f7212ffd640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72140d27e0 0x7f72141f8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f7212ffd640 1 -- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72140d09c0 msgr2=0x7f72140c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f7212ffd640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72140d09c0 0x7f72140c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f7212ffd640 1 -- 172.21.15.120:0/127784614 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72140b1c80 con 0x7f72140b4740 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f72137fe640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72140d27e0 0x7f72141f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:37.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.589+0000 7f7212ffd640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72140b4740 0x7f72140b1110 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7204034040 tx=0x7f72040039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.590+0000 7f720b7fe640 1 -- 172.21.15.120:0/127784614 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720403e030 con 0x7f72140b4740 2024-07-27T03:12:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.590+0000 7f720b7fe640 1 -- 172.21.15.120:0/127784614 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72040047a0 con 0x7f72140b4740 2024-07-27T03:12:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.590+0000 7f721969a640 1 -- 172.21.15.120:0/127784614 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72140b1f60 con 0x7f72140b4740 2024-07-27T03:12:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.590+0000 7f720b7fe640 1 -- 172.21.15.120:0/127784614 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204035040 con 0x7f72140b4740 2024-07-27T03:12:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.590+0000 7f721969a640 1 -- 172.21.15.120:0/127784614 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72140b2520 con 0x7f72140b4740 2024-07-27T03:12:37.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.591+0000 7f721969a640 1 -- 172.21.15.120:0/127784614 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72140d2bf0 con 0x7f72140b4740 2024-07-27T03:12:37.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.591+0000 7f720b7fe640 1 -- 172.21.15.120:0/127784614 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f7204041030 con 0x7f72140b4740 2024-07-27T03:12:37.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.592+0000 7f720b7fe640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f71f4077010 0x7f71f4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:37.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.592+0000 7f720b7fe640 1 -- 172.21.15.120:0/127784614 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f72040b90f0 con 0x7f72140b4740 2024-07-27T03:12:37.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.592+0000 7f720bfff640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f71f4077010 0x7f71f4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:37.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.592+0000 7f720bfff640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f71f4077010 0x7f71f4079520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0058c0 tx=0x7f71fc005f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:37.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.596+0000 7f720b7fe640 1 -- 172.21.15.120:0/127784614 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f7204081ca0 con 0x7f72140b4740 2024-07-27T03:12:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.815+0000 7f721969a640 1 -- 172.21.15.120:0/127784614 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72140ca800 con 0x7f72140b4740 2024-07-27T03:12:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.816+0000 7f720b7fe640 1 -- 172.21.15.120:0/127784614 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7f72040861f0 con 0x7f72140b4740 2024-07-27T03:12:37.819 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:37.819 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":66,"btime":"2024-07-27T03:12:37:453984+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2578460445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2578460445},{"type":"v1","addr":"172.21.15.120:6835","nonce":2578460445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":5489,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2998929726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2998929726},{"type":"v1","addr":"172.21.15.121:6836","nonce":2998929726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3985484834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3985484834},{"type":"v1","addr":"172.21.15.120:6833","nonce":3985484834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:12:33.787428+0000","modified":"2024-07-27T03:12:36.823644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/7061533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":7061533},{"type":"v1","addr":"172.21.15.121:6837","nonce":7061533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6159,"qdb_cluster":[6159]},"id":5}]} 2024-07-27T03:12:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 66 2024-07-27T03:12:37.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 -- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f71f4077010 msgr2=0x7f71f4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:37.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f71f4077010 0x7f71f4079520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0058c0 tx=0x7f71fc005f60 comp rx=0 tx=0).stop 2024-07-27T03:12:37.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 -- 172.21.15.120:0/127784614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72140b4740 msgr2=0x7f72140b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:37.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72140b4740 0x7f72140b1110 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7204034040 tx=0x7f72040039e0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 -- 172.21.15.120:0/127784614 shutdown_connections 2024-07-27T03:12:37.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f71f4077010 0x7f71f4079520 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f72140d27e0 0x7f72141f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72140d09c0 0x7f72140c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 --2- 172.21.15.120:0/127784614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f72140b4740 0x7f72140b1110 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 -- 172.21.15.120:0/127784614 >> 172.21.15.120:0/127784614 conn(0x7f721408d690 msgr2=0x7f7214075970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:37.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 -- 172.21.15.120:0/127784614 shutdown_connections 2024-07-27T03:12:37.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.818+0000 7f721969a640 1 -- 172.21.15.120:0/127784614 wait complete. 2024-07-27T03:12:37.833 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:12:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.944+0000 7f1f88405640 1 -- 172.21.15.120:0/3726853174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f800d0f00 msgr2=0x7f1f800cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.944+0000 7f1f88405640 1 --2- 172.21.15.120:0/3726853174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f800d0f00 0x7f1f800cebe0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1f78005fd0 tx=0x7f1f7802aa90 comp rx=0 tx=0).stop 2024-07-27T03:12:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.944+0000 7f1f88405640 1 -- 172.21.15.120:0/3726853174 shutdown_connections 2024-07-27T03:12:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.944+0000 7f1f88405640 1 --2- 172.21.15.120:0/3726853174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f800d0f00 0x7f1f800cebe0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.944+0000 7f1f88405640 1 --2- 172.21.15.120:0/3726853174 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f800b2c40 0x7f1f800d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.944+0000 7f1f88405640 1 -- 172.21.15.120:0/3726853174 >> 172.21.15.120:0/3726853174 conn(0x7f1f8008d690 msgr2=0x7f1f8009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.944+0000 7f1f88405640 1 -- 172.21.15.120:0/3726853174 shutdown_connections 2024-07-27T03:12:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.944+0000 7f1f88405640 1 -- 172.21.15.120:0/3726853174 wait complete. 2024-07-27T03:12:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.946+0000 7f1f88405640 1 Processor -- start 2024-07-27T03:12:37.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.946+0000 7f1f88405640 1 -- start start 2024-07-27T03:12:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.947+0000 7f1f88405640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f800b2c40 0x7f1f800cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:37.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.947+0000 7f1f88405640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f800b4740 0x7f1f8006ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.947+0000 7f1f88405640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f800d0f00 0x7f1f8006e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.947+0000 7f1f88405640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1f800cf120 con 0x7f1f800b2c40 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.947+0000 7f1f88405640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1f800d3100 con 0x7f1f800d0f00 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.947+0000 7f1f88405640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f1f800cf2a0 con 0x7f1f800b4740 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.947+0000 7f1f861a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f800b2c40 0x7f1f800cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.947+0000 7f1f861a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f800b2c40 0x7f1f800cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59106/0 (socket says 172.21.15.120:59106) 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.947+0000 7f1f861a1640 1 -- 172.21.15.120:0/2152194558 learned_addr learned my addr 172.21.15.120:0/2152194558 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.947+0000 7f1f859a0640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f800b4740 0x7f1f8006ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.947+0000 7f1f869a2640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f800d0f00 0x7f1f8006e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.948+0000 7f1f861a1640 1 -- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f800b4740 msgr2=0x7f1f8006ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.948+0000 7f1f861a1640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f800b4740 0x7f1f8006ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.948+0000 7f1f861a1640 1 -- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f800d0f00 msgr2=0x7f1f8006e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:37.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.948+0000 7f1f861a1640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f800d0f00 0x7f1f8006e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.948+0000 7f1f861a1640 1 -- 172.21.15.120:0/2152194558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f801f8ac0 con 0x7f1f800b2c40 2024-07-27T03:12:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.948+0000 7f1f861a1640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f800b2c40 0x7f1f800cbca0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c3a0 tx=0x7f1f7000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.948+0000 7f1f7effd640 1 -- 172.21.15.120:0/2152194558 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70017070 con 0x7f1f800b2c40 2024-07-27T03:12:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.948+0000 7f1f7effd640 1 -- 172.21.15.120:0/2152194558 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f700053c0 con 0x7f1f800b2c40 2024-07-27T03:12:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.948+0000 7f1f88405640 1 -- 172.21.15.120:0/2152194558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f801f8da0 con 0x7f1f800b2c40 2024-07-27T03:12:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.948+0000 7f1f7effd640 1 -- 172.21.15.120:0/2152194558 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f70003850 con 0x7f1f800b2c40 2024-07-27T03:12:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.948+0000 7f1f88405640 1 -- 172.21.15.120:0/2152194558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f801f9360 con 0x7f1f800b2c40 2024-07-27T03:12:37.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.949+0000 7f1f88405640 1 -- 172.21.15.120:0/2152194558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f801f9740 con 0x7f1f800b2c40 2024-07-27T03:12:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.950+0000 7f1f7effd640 1 -- 172.21.15.120:0/2152194558 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1f7001a070 con 0x7f1f800b2c40 2024-07-27T03:12:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.950+0000 7f1f7effd640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f6c077010 0x7f1f6c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.950+0000 7f1f7effd640 1 -- 172.21.15.120:0/2152194558 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f1f70097bc0 con 0x7f1f800b2c40 2024-07-27T03:12:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.951+0000 7f1f859a0640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f6c077010 0x7f1f6c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:37.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.951+0000 7f1f859a0640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f6c077010 0x7f1f6c079520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1f800ca9b0 tx=0x7f1f74005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:37.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:37.955+0000 7f1f7effd640 1 -- 172.21.15.120:0/2152194558 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f1f801f9740 con 0x7f1f800b2c40 2024-07-27T03:12:38.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.137+0000 7f1f88405640 1 -- 172.21.15.120:0/2152194558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f800d09c0 con 0x7f1f800b2c40 2024-07-27T03:12:38.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.139+0000 7f1f7effd640 1 -- 172.21.15.120:0/2152194558 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16692 (secure 0 0 0) 0x7f1f800d1310 con 0x7f1f800b2c40 2024-07-27T03:12:38.142 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:38.142 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":69,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:12:35.438048+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:12:31.463339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-07-27T03:12:32.742612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:12:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 -- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f6c077010 msgr2=0x7f1f6c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f6c077010 0x7f1f6c079520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1f800ca9b0 tx=0x7f1f74005f90 comp rx=0 tx=0).stop 2024-07-27T03:12:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 -- 172.21.15.120:0/2152194558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f800b2c40 msgr2=0x7f1f800cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f800b2c40 0x7f1f800cbca0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c3a0 tx=0x7f1f7000c860 comp rx=0 tx=0).stop 2024-07-27T03:12:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 -- 172.21.15.120:0/2152194558 shutdown_connections 2024-07-27T03:12:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1f6c077010 0x7f1f6c079520 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1f800d0f00 0x7f1f8006e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1f800b4740 0x7f1f8006ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 --2- 172.21.15.120:0/2152194558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f800b2c40 0x7f1f800cbca0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 -- 172.21.15.120:0/2152194558 >> 172.21.15.120:0/2152194558 conn(0x7f1f8008d690 msgr2=0x7f1f800b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 -- 172.21.15.120:0/2152194558 shutdown_connections 2024-07-27T03:12:38.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.141+0000 7f1f88405640 1 -- 172.21.15.120:0/2152194558 wait complete. 2024-07-27T03:12:38.155 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-27T03:12:38.156 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:12:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.267+0000 7fc841996640 1 -- 172.21.15.120:0/929734096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c09b140 msgr2=0x7fc83c0b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.267+0000 7fc841996640 1 --2- 172.21.15.120:0/929734096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c09b140 0x7fc83c0b4ef0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0731b0 tx=0x7fc83402aa30 comp rx=0 tx=0).stop 2024-07-27T03:12:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.267+0000 7fc841996640 1 -- 172.21.15.120:0/929734096 shutdown_connections 2024-07-27T03:12:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.267+0000 7fc841996640 1 --2- 172.21.15.120:0/929734096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c09b140 0x7fc83c0b4ef0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.267+0000 7fc841996640 1 --2- 172.21.15.120:0/929734096 >> v2:172.21.15.121:3300/0 conn(0x7fc83c09b640 0x7fc83c0b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.267+0000 7fc841996640 1 -- 172.21.15.120:0/929734096 >> 172.21.15.120:0/929734096 conn(0x7fc83c0d20a0 msgr2=0x7fc83c0d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:38.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.267+0000 7fc841996640 1 -- 172.21.15.120:0/929734096 shutdown_connections 2024-07-27T03:12:38.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.267+0000 7fc841996640 1 -- 172.21.15.120:0/929734096 wait complete. 2024-07-27T03:12:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.269+0000 7fc841996640 1 Processor -- start 2024-07-27T03:12:38.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.269+0000 7fc841996640 1 -- start start 2024-07-27T03:12:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc841996640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc83c09b640 0x7fc83c14e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc841996640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0cf4e0 0x7fc83c1f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc841996640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc83c1f7230 0x7fc83c1f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc841996640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c0b5a50 con 0x7fc83c0cf4e0 2024-07-27T03:12:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc841996640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c0b58d0 con 0x7fc83c09b640 2024-07-27T03:12:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc841996640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc83c0b5bd0 con 0x7fc83c1f7230 2024-07-27T03:12:38.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc8327fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0cf4e0 0x7fc83c1f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc8327fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0cf4e0 0x7fc83c1f6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59118/0 (socket says 172.21.15.120:59118) 2024-07-27T03:12:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc8327fc640 1 -- 172.21.15.120:0/780266832 learned_addr learned my addr 172.21.15.120:0/780266832 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc83affd640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc83c09b640 0x7fc83c14e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc83b7fe640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc83c1f7230 0x7fc83c1f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc8327fc640 1 -- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc83c1f7230 msgr2=0x7fc83c1f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc8327fc640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc83c1f7230 0x7fc83c1f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc8327fc640 1 -- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc83c09b640 msgr2=0x7fc83c14e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc8327fc640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc83c09b640 0x7fc83c14e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.270+0000 7fc8327fc640 1 -- 172.21.15.120:0/780266832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c159c30 con 0x7fc83c0cf4e0 2024-07-27T03:12:38.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.271+0000 7fc8327fc640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0cf4e0 0x7fc83c1f6cf0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc82400b3c0 tx=0x7fc82400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:38.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.271+0000 7fc838ff9640 1 -- 172.21.15.120:0/780266832 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824011830 con 0x7fc83c0cf4e0 2024-07-27T03:12:38.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.271+0000 7fc838ff9640 1 -- 172.21.15.120:0/780266832 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc824016070 con 0x7fc83c0cf4e0 2024-07-27T03:12:38.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.271+0000 7fc838ff9640 1 -- 172.21.15.120:0/780266832 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824011da0 con 0x7fc83c0cf4e0 2024-07-27T03:12:38.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.271+0000 7fc841996640 1 -- 172.21.15.120:0/780266832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc83c15a900 con 0x7fc83c0cf4e0 2024-07-27T03:12:38.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.271+0000 7fc841996640 1 -- 172.21.15.120:0/780266832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83c15aec0 con 0x7fc83c0cf4e0 2024-07-27T03:12:38.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.272+0000 7fc841996640 1 -- 172.21.15.120:0/780266832 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc83c1599a0 con 0x7fc83c0cf4e0 2024-07-27T03:12:38.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.273+0000 7fc838ff9640 1 -- 172.21.15.120:0/780266832 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc82401b460 con 0x7fc83c0cf4e0 2024-07-27T03:12:38.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.273+0000 7fc838ff9640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc81c077010 0x7fc81c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:38.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.273+0000 7fc838ff9640 1 -- 172.21.15.120:0/780266832 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fc8240982f0 con 0x7fc83c0cf4e0 2024-07-27T03:12:38.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.273+0000 7fc83affd640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc81c077010 0x7fc81c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:38.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.274+0000 7fc83affd640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc81c077010 0x7fc81c079520 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00bb30 tx=0x7fc82c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:38.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.278+0000 7fc838ff9640 1 -- 172.21.15.120:0/780266832 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc824020020 con 0x7fc83c0cf4e0 2024-07-27T03:12:38.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.456+0000 7fc841996640 1 -- 172.21.15.120:0/780266832 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc83c0b60c0 con 0x7fc81c077010 2024-07-27T03:12:38.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.461+0000 7fc838ff9640 1 -- 172.21.15.120:0/780266832 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243786 (secure 0 0 0) 0x7fc83c0b60c0 con 0x7fc81c077010 2024-07-27T03:12:38.470 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:38.471 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:12:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.464+0000 7fc841996640 1 -- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc81c077010 msgr2=0x7fc81c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.464+0000 7fc841996640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc81c077010 0x7fc81c079520 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00bb30 tx=0x7fc82c00b2e0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.464+0000 7fc841996640 1 -- 172.21.15.120:0/780266832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0cf4e0 msgr2=0x7fc83c1f6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.464+0000 7fc841996640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0cf4e0 0x7fc83c1f6cf0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc82400b3c0 tx=0x7fc82400b880 comp rx=0 tx=0).stop 2024-07-27T03:12:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.464+0000 7fc841996640 1 -- 172.21.15.120:0/780266832 shutdown_connections 2024-07-27T03:12:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.464+0000 7fc841996640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc81c077010 0x7fc81c079520 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.464+0000 7fc841996640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc83c0cf4e0 0x7fc83c1f6cf0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.464+0000 7fc841996640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc83c1f7230 0x7fc83c1f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.464+0000 7fc841996640 1 --2- 172.21.15.120:0/780266832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc83c09b640 0x7fc83c14e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.464+0000 7fc841996640 1 -- 172.21.15.120:0/780266832 >> 172.21.15.120:0/780266832 conn(0x7fc83c0d20a0 msgr2=0x7fc83c0b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.465+0000 7fc841996640 1 -- 172.21.15.120:0/780266832 shutdown_connections 2024-07-27T03:12:38.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.465+0000 7fc841996640 1 -- 172.21.15.120:0/780266832 wait complete. 2024-07-27T03:12:38.479 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-07-27T03:12:36.593570+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":150,"acting":150,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":416436,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":408947,"kb_avail":754558284,"statfs":{"total":773094113280,"available":772667682816,"internally_reserved":0,"allocated":7532544,"data_stored":3828527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":418762288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.186206"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.419466+0000","last_change":"2024-07-27T03:12:33.419466+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.419466+0000","last_undegraded":"2024-07-27T03:12:33.419466+0000","last_fullsized":"2024-07-27T03:12:33.419466+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.414931+0000","last_change":"2024-07-27T03:12:33.414931+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.414931+0000","last_undegraded":"2024-07-27T03:12:33.414931+0000","last_fullsized":"2024-07-27T03:12:33.414931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.418259+0000","last_change":"2024-07-27T03:12:33.418259+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.418259+0000","last_undegraded":"2024-07-27T03:12:33.418259+0000","last_fullsized":"2024-07-27T03:12:33.418259+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.413218+0000","last_change":"2024-07-27T03:12:33.413218+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.413218+0000","last_undegraded":"2024-07-27T03:12:33.413218+0000","last_fullsized":"2024-07-27T03:12:33.413218+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.417891+0000","last_change":"2024-07-27T03:12:33.417891+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.417891+0000","last_undegraded":"2024-07-27T03:12:33.417891+0000","last_fullsized":"2024-07-27T03:12:33.417891+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.419393+0000","last_change":"2024-07-27T03:12:33.419393+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.419393+0000","last_undegraded":"2024-07-27T03:12:33.419393+0000","last_fullsized":"2024-07-27T03:12:33.419393+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.414456+0000","last_change":"2024-07-27T03:12:33.414456+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.414456+0000","last_undegraded":"2024-07-27T03:12:33.414456+0000","last_fullsized":"2024-07-27T03:12:33.414456+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.416168+0000","last_change":"2024-07-27T03:12:33.416168+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.416168+0000","last_undegraded":"2024-07-27T03:12:33.416168+0000","last_fullsized":"2024-07-27T03:12:33.416168+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.414920+0000","last_change":"2024-07-27T03:12:33.414920+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.414920+0000","last_undegraded":"2024-07-27T03:12:33.414920+0000","last_fullsized":"2024-07-27T03:12:33.414920+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.417345+0000","last_change":"2024-07-27T03:12:33.417345+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.417345+0000","last_undegraded":"2024-07-27T03:12:33.417345+0000","last_fullsized":"2024-07-27T03:12:33.417345+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.414260+0000","last_change":"2024-07-27T03:12:33.414260+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.414260+0000","last_undegraded":"2024-07-27T03:12:33.414260+0000","last_fullsized":"2024-07-27T03:12:33.414260+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.417952+0000","last_change":"2024-07-27T03:12:33.417952+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.417952+0000","last_undegraded":"2024-07-27T03:12:33.417952+0000","last_fullsized":"2024-07-27T03:12:33.417952+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.417296+0000","last_change":"2024-07-27T03:12:33.417296+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.417296+0000","last_undegraded":"2024-07-27T03:12:33.417296+0000","last_fullsized":"2024-07-27T03:12:33.417296+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.414096+0000","last_change":"2024-07-27T03:12:33.414096+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.414096+0000","last_undegraded":"2024-07-27T03:12:33.414096+0000","last_fullsized":"2024-07-27T03:12:33.414096+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.414361+0000","last_change":"2024-07-27T03:12:33.414361+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.414361+0000","last_undegraded":"2024-07-27T03:12:33.414361+0000","last_fullsized":"2024-07-27T03:12:33.414361+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.416760+0000","last_change":"2024-07-27T03:12:33.416760+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.416760+0000","last_undegraded":"2024-07-27T03:12:33.416760+0000","last_fullsized":"2024-07-27T03:12:33.416760+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.411801+0000","last_change":"2024-07-27T03:12:33.411801+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.411801+0000","last_undegraded":"2024-07-27T03:12:33.411801+0000","last_fullsized":"2024-07-27T03:12:33.411801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.412284+0000","last_change":"2024-07-27T03:12:33.412284+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.412284+0000","last_undegraded":"2024-07-27T03:12:33.412284+0000","last_fullsized":"2024-07-27T03:12:33.412284+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.420018+0000","last_change":"2024-07-27T03:12:33.420018+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.420018+0000","last_undegraded":"2024-07-27T03:12:33.420018+0000","last_fullsized":"2024-07-27T03:12:33.420018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.434355+0000","last_change":"2024-07-27T03:12:33.431797+0000","last_active":"2024-07-27T03:12:33.434355+0000","last_peered":"2024-07-27T03:12:33.434355+0000","last_clean":"2024-07-27T03:12:33.434355+0000","last_became_active":"2024-07-27T03:12:33.430788+0000","last_became_peered":"2024-07-27T03:12:33.430788+0000","last_unstale":"2024-07-27T03:12:33.434355+0000","last_undegraded":"2024-07-27T03:12:33.434355+0000","last_fullsized":"2024-07-27T03:12:33.434355+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:22:12.340319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.415452+0000","last_change":"2024-07-27T03:12:33.415452+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.415452+0000","last_undegraded":"2024-07-27T03:12:33.415452+0000","last_fullsized":"2024-07-27T03:12:33.415452+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.425992+0000","last_change":"2024-07-27T03:12:33.422577+0000","last_active":"2024-07-27T03:12:33.425992+0000","last_peered":"2024-07-27T03:12:33.425992+0000","last_clean":"2024-07-27T03:12:33.425992+0000","last_became_active":"2024-07-27T03:12:33.422261+0000","last_became_peered":"2024-07-27T03:12:33.422261+0000","last_unstale":"2024-07-27T03:12:33.425992+0000","last_undegraded":"2024-07-27T03:12:33.425992+0000","last_fullsized":"2024-07-27T03:12:33.425992+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:44:49.901029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.409880+0000","last_change":"2024-07-27T03:12:32.409880+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.409880+0000","last_undegraded":"2024-07-27T03:12:32.409880+0000","last_fullsized":"2024-07-27T03:12:32.409880+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.418738+0000","last_change":"2024-07-27T03:12:33.418738+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.418738+0000","last_undegraded":"2024-07-27T03:12:33.418738+0000","last_fullsized":"2024-07-27T03:12:33.418738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.412349+0000","last_change":"2024-07-27T03:12:32.412349+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.412349+0000","last_undegraded":"2024-07-27T03:12:32.412349+0000","last_fullsized":"2024-07-27T03:12:32.412349+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.411223+0000","last_change":"2024-07-27T03:12:33.411223+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.411223+0000","last_undegraded":"2024-07-27T03:12:33.411223+0000","last_fullsized":"2024-07-27T03:12:33.411223+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.435254+0000","last_change":"2024-07-27T03:12:33.434820+0000","last_active":"2024-07-27T03:12:33.435254+0000","last_peered":"2024-07-27T03:12:33.435254+0000","last_clean":"2024-07-27T03:12:33.435254+0000","last_became_active":"2024-07-27T03:12:33.434578+0000","last_became_peered":"2024-07-27T03:12:33.434578+0000","last_unstale":"2024-07-27T03:12:33.435254+0000","last_undegraded":"2024-07-27T03:12:33.435254+0000","last_fullsized":"2024-07-27T03:12:33.435254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:05:40.134492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.414365+0000","last_change":"2024-07-27T03:12:32.414365+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.414365+0000","last_undegraded":"2024-07-27T03:12:32.414365+0000","last_fullsized":"2024-07-27T03:12:32.414365+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.416862+0000","last_change":"2024-07-27T03:12:33.416862+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.416862+0000","last_undegraded":"2024-07-27T03:12:33.416862+0000","last_fullsized":"2024-07-27T03:12:33.416862+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.413068+0000","last_change":"2024-07-27T03:12:32.413068+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.413068+0000","last_undegraded":"2024-07-27T03:12:32.413068+0000","last_fullsized":"2024-07-27T03:12:32.413068+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.413783+0000","last_change":"2024-07-27T03:12:33.413783+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.413783+0000","last_undegraded":"2024-07-27T03:12:33.413783+0000","last_fullsized":"2024-07-27T03:12:33.413783+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.428586+0000","last_change":"2024-07-27T03:12:33.427013+0000","last_active":"2024-07-27T03:12:33.428586+0000","last_peered":"2024-07-27T03:12:33.428586+0000","last_clean":"2024-07-27T03:12:33.428586+0000","last_became_active":"2024-07-27T03:12:33.426637+0000","last_became_peered":"2024-07-27T03:12:33.426637+0000","last_unstale":"2024-07-27T03:12:33.428586+0000","last_undegraded":"2024-07-27T03:12:33.428586+0000","last_fullsized":"2024-07-27T03:12:33.428586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:40:05.532870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.413451+0000","last_change":"2024-07-27T03:12:33.413451+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.413451+0000","last_undegraded":"2024-07-27T03:12:33.413451+0000","last_fullsized":"2024-07-27T03:12:33.413451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.409687+0000","last_change":"2024-07-27T03:12:32.409687+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.409687+0000","last_undegraded":"2024-07-27T03:12:32.409687+0000","last_fullsized":"2024-07-27T03:12:32.409687+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.418744+0000","last_change":"2024-07-27T03:12:33.418744+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.418744+0000","last_undegraded":"2024-07-27T03:12:33.418744+0000","last_fullsized":"2024-07-27T03:12:33.418744+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.412365+0000","last_change":"2024-07-27T03:12:32.412365+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.412365+0000","last_undegraded":"2024-07-27T03:12:32.412365+0000","last_fullsized":"2024-07-27T03:12:32.412365+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.425665+0000","last_change":"2024-07-27T03:12:33.423119+0000","last_active":"2024-07-27T03:12:33.425665+0000","last_peered":"2024-07-27T03:12:33.425665+0000","last_clean":"2024-07-27T03:12:33.425665+0000","last_became_active":"2024-07-27T03:12:33.422807+0000","last_became_peered":"2024-07-27T03:12:33.422807+0000","last_unstale":"2024-07-27T03:12:33.425665+0000","last_undegraded":"2024-07-27T03:12:33.425665+0000","last_fullsized":"2024-07-27T03:12:33.425665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:25:56.379979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.414892+0000","last_change":"2024-07-27T03:12:33.414892+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.414892+0000","last_undegraded":"2024-07-27T03:12:33.414892+0000","last_fullsized":"2024-07-27T03:12:33.414892+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.413696+0000","last_change":"2024-07-27T03:12:32.413696+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.413696+0000","last_undegraded":"2024-07-27T03:12:32.413696+0000","last_fullsized":"2024-07-27T03:12:32.413696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.417811+0000","last_change":"2024-07-27T03:12:33.417811+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.417811+0000","last_undegraded":"2024-07-27T03:12:33.417811+0000","last_fullsized":"2024-07-27T03:12:33.417811+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.413452+0000","last_change":"2024-07-27T03:12:32.413452+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.413452+0000","last_undegraded":"2024-07-27T03:12:32.413452+0000","last_fullsized":"2024-07-27T03:12:32.413452+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.412320+0000","last_change":"2024-07-27T03:12:33.412320+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.412320+0000","last_undegraded":"2024-07-27T03:12:33.412320+0000","last_fullsized":"2024-07-27T03:12:33.412320+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.413642+0000","last_change":"2024-07-27T03:12:32.413642+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.413642+0000","last_undegraded":"2024-07-27T03:12:32.413642+0000","last_fullsized":"2024-07-27T03:12:32.413642+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.414308+0000","last_change":"2024-07-27T03:12:33.414308+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.414308+0000","last_undegraded":"2024-07-27T03:12:33.414308+0000","last_fullsized":"2024-07-27T03:12:33.414308+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.419839+0000","last_change":"2024-07-27T03:12:33.418267+0000","last_active":"2024-07-27T03:12:33.419839+0000","last_peered":"2024-07-27T03:12:33.419839+0000","last_clean":"2024-07-27T03:12:33.419839+0000","last_became_active":"2024-07-27T03:12:33.417912+0000","last_became_peered":"2024-07-27T03:12:33.417912+0000","last_unstale":"2024-07-27T03:12:33.419839+0000","last_undegraded":"2024-07-27T03:12:33.419839+0000","last_fullsized":"2024-07-27T03:12:33.419839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:43:38.480555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.416032+0000","last_change":"2024-07-27T03:12:33.416032+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.416032+0000","last_undegraded":"2024-07-27T03:12:33.416032+0000","last_fullsized":"2024-07-27T03:12:33.416032+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.409810+0000","last_change":"2024-07-27T03:12:32.409810+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.409810+0000","last_undegraded":"2024-07-27T03:12:32.409810+0000","last_fullsized":"2024-07-27T03:12:32.409810+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.413374+0000","last_change":"2024-07-27T03:12:32.413374+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.413374+0000","last_undegraded":"2024-07-27T03:12:32.413374+0000","last_fullsized":"2024-07-27T03:12:32.413374+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.418273+0000","last_change":"2024-07-27T03:12:33.418273+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.418273+0000","last_undegraded":"2024-07-27T03:12:33.418273+0000","last_fullsized":"2024-07-27T03:12:33.418273+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.410935+0000","last_change":"2024-07-27T03:12:32.410935+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.410935+0000","last_undegraded":"2024-07-27T03:12:32.410935+0000","last_fullsized":"2024-07-27T03:12:32.410935+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.412427+0000","last_change":"2024-07-27T03:12:32.412427+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.412427+0000","last_undegraded":"2024-07-27T03:12:32.412427+0000","last_fullsized":"2024-07-27T03:12:32.412427+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.414314+0000","last_change":"2024-07-27T03:12:33.414314+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.414314+0000","last_undegraded":"2024-07-27T03:12:33.414314+0000","last_fullsized":"2024-07-27T03:12:33.414314+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.427931+0000","last_change":"2024-07-27T03:12:33.426178+0000","last_active":"2024-07-27T03:12:33.427931+0000","last_peered":"2024-07-27T03:12:33.427931+0000","last_clean":"2024-07-27T03:12:33.427931+0000","last_became_active":"2024-07-27T03:12:33.425817+0000","last_became_peered":"2024-07-27T03:12:33.425817+0000","last_unstale":"2024-07-27T03:12:33.427931+0000","last_undegraded":"2024-07-27T03:12:33.427931+0000","last_fullsized":"2024-07-27T03:12:33.427931+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:08:55.044559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.416197+0000","last_change":"2024-07-27T03:12:33.416197+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.416197+0000","last_undegraded":"2024-07-27T03:12:33.416197+0000","last_fullsized":"2024-07-27T03:12:33.416197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.412740+0000","last_change":"2024-07-27T03:12:32.412740+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.412740+0000","last_undegraded":"2024-07-27T03:12:32.412740+0000","last_fullsized":"2024-07-27T03:12:32.412740+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.417392+0000","last_change":"2024-07-27T03:12:33.417392+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.417392+0000","last_undegraded":"2024-07-27T03:12:33.417392+0000","last_fullsized":"2024-07-27T03:12:33.417392+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.427944+0000","last_change":"2024-07-27T03:12:33.423345+0000","last_active":"2024-07-27T03:12:33.427944+0000","last_peered":"2024-07-27T03:12:33.427944+0000","last_clean":"2024-07-27T03:12:33.427944+0000","last_became_active":"2024-07-27T03:12:33.422991+0000","last_became_peered":"2024-07-27T03:12:33.422991+0000","last_unstale":"2024-07-27T03:12:33.427944+0000","last_undegraded":"2024-07-27T03:12:33.427944+0000","last_fullsized":"2024-07-27T03:12:33.427944+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:16:04.560217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.417939+0000","last_change":"2024-07-27T03:12:33.417939+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.417939+0000","last_undegraded":"2024-07-27T03:12:33.417939+0000","last_fullsized":"2024-07-27T03:12:33.417939+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.426075+0000","last_change":"2024-07-27T03:12:33.424227+0000","last_active":"2024-07-27T03:12:33.426075+0000","last_peered":"2024-07-27T03:12:33.426075+0000","last_clean":"2024-07-27T03:12:33.426075+0000","last_became_active":"2024-07-27T03:12:33.423846+0000","last_became_peered":"2024-07-27T03:12:33.423846+0000","last_unstale":"2024-07-27T03:12:33.426075+0000","last_undegraded":"2024-07-27T03:12:33.426075+0000","last_fullsized":"2024-07-27T03:12:33.426075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:08:55.044559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.414023+0000","last_change":"2024-07-27T03:12:33.414023+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.414023+0000","last_undegraded":"2024-07-27T03:12:33.414023+0000","last_fullsized":"2024-07-27T03:12:33.414023+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.412842+0000","last_change":"2024-07-27T03:12:32.412842+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.412842+0000","last_undegraded":"2024-07-27T03:12:32.412842+0000","last_fullsized":"2024-07-27T03:12:32.412842+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.411448+0000","last_change":"2024-07-27T03:12:33.411448+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.411448+0000","last_undegraded":"2024-07-27T03:12:33.411448+0000","last_fullsized":"2024-07-27T03:12:33.411448+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.419456+0000","last_change":"2024-07-27T03:12:33.416671+0000","last_active":"2024-07-27T03:12:33.419456+0000","last_peered":"2024-07-27T03:12:33.419456+0000","last_clean":"2024-07-27T03:12:33.419456+0000","last_became_active":"2024-07-27T03:12:33.416294+0000","last_became_peered":"2024-07-27T03:12:33.416294+0000","last_unstale":"2024-07-27T03:12:33.419456+0000","last_undegraded":"2024-07-27T03:12:33.419456+0000","last_fullsized":"2024-07-27T03:12:33.419456+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:38:23.470073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.418869+0000","last_change":"2024-07-27T03:12:33.418869+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.418869+0000","last_undegraded":"2024-07-27T03:12:33.418869+0000","last_fullsized":"2024-07-27T03:12:33.418869+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.424519+0000","last_change":"2024-07-27T03:12:33.420287+0000","last_active":"2024-07-27T03:12:33.424519+0000","last_peered":"2024-07-27T03:12:33.424519+0000","last_clean":"2024-07-27T03:12:33.424519+0000","last_became_active":"2024-07-27T03:12:33.419827+0000","last_became_peered":"2024-07-27T03:12:33.419827+0000","last_unstale":"2024-07-27T03:12:33.424519+0000","last_undegraded":"2024-07-27T03:12:33.424519+0000","last_fullsized":"2024-07-27T03:12:33.424519+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:16:03.070637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.417996+0000","last_change":"2024-07-27T03:12:33.417996+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.417996+0000","last_undegraded":"2024-07-27T03:12:33.417996+0000","last_fullsized":"2024-07-27T03:12:33.417996+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.418868+0000","last_change":"2024-07-27T03:12:33.417593+0000","last_active":"2024-07-27T03:12:33.418868+0000","last_peered":"2024-07-27T03:12:33.418868+0000","last_clean":"2024-07-27T03:12:33.418868+0000","last_became_active":"2024-07-27T03:12:33.417296+0000","last_became_peered":"2024-07-27T03:12:33.417296+0000","last_unstale":"2024-07-27T03:12:33.418868+0000","last_undegraded":"2024-07-27T03:12:33.418868+0000","last_fullsized":"2024-07-27T03:12:33.418868+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:33:28.551829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.415680+0000","last_change":"2024-07-27T03:12:33.415680+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.415680+0000","last_undegraded":"2024-07-27T03:12:33.415680+0000","last_fullsized":"2024-07-27T03:12:33.415680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.430291+0000","last_change":"2024-07-27T03:12:33.429228+0000","last_active":"2024-07-27T03:12:33.430291+0000","last_peered":"2024-07-27T03:12:33.430291+0000","last_clean":"2024-07-27T03:12:33.430291+0000","last_became_active":"2024-07-27T03:12:33.428909+0000","last_became_peered":"2024-07-27T03:12:33.428909+0000","last_unstale":"2024-07-27T03:12:33.430291+0000","last_undegraded":"2024-07-27T03:12:33.430291+0000","last_fullsized":"2024-07-27T03:12:33.430291+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:04:31.354626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.413220+0000","last_change":"2024-07-27T03:12:32.413220+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.413220+0000","last_undegraded":"2024-07-27T03:12:32.413220+0000","last_fullsized":"2024-07-27T03:12:32.413220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.410284+0000","last_change":"2024-07-27T03:12:32.410284+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.410284+0000","last_undegraded":"2024-07-27T03:12:32.410284+0000","last_fullsized":"2024-07-27T03:12:32.410284+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-07-27T03:12:33.405180+0000","last_change":"2024-07-27T03:12:33.405180+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.405180+0000","last_undegraded":"2024-07-27T03:12:33.405180+0000","last_fullsized":"2024-07-27T03:12:33.405180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.413540+0000","last_change":"2024-07-27T03:12:32.413540+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.413540+0000","last_undegraded":"2024-07-27T03:12:32.413540+0000","last_fullsized":"2024-07-27T03:12:32.413540+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-07-27T03:12:33.418437+0000","last_change":"2024-07-27T03:12:33.418437+0000","last_active":"2024-07-27T03:12:33.405180+0000","last_peered":"2024-07-27T03:12:33.405180+0000","last_clean":"2024-07-27T03:12:33.405180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:33.418437+0000","last_undegraded":"2024-07-27T03:12:33.418437+0000","last_fullsized":"2024-07-27T03:12:33.418437+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-07-27T03:12:32.413248+0000","last_change":"2024-07-27T03:12:32.413248+0000","last_active":"2024-07-27T03:12:32.403527+0000","last_peered":"2024-07-27T03:12:32.403527+0000","last_clean":"2024-07-27T03:12:32.403527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-27T03:12:32.413248+0000","last_undegraded":"2024-07-27T03:12:32.413248+0000","last_fullsized":"2024-07-27T03:12:32.413248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":192,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-07-27T03:12:33.420995+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:12:33.420995+0000","last_peered":"2024-07-27T03:12:33.420995+0000","last_clean":"2024-07-27T03:12:33.420995+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:12:33.420995+0000","last_undegraded":"2024-07-27T03:12:33.420995+0000","last_fullsized":"2024-07-27T03:12:33.420995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":5},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509492,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76952,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294888,"statfs":{"total":96636764160,"available":96557965312,"internally_reserved":0,"allocated":1388544,"data_stored":922069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45848,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325992,"statfs":{"total":96636764160,"available":96589815808,"internally_reserved":0,"allocated":794624,"data_stored":331701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50004,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321836,"statfs":{"total":96636764160,"available":96585560064,"internally_reserved":0,"allocated":794624,"data_stored":331701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40280,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331560,"statfs":{"total":96636764160,"available":96595517440,"internally_reserved":0,"allocated":794624,"data_stored":331701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54744,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317096,"statfs":{"total":96636764160,"available":96580706304,"internally_reserved":0,"allocated":1388544,"data_stored":922069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36116,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335724,"statfs":{"total":96636764160,"available":96599781376,"internally_reserved":0,"allocated":794624,"data_stored":331701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542197,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76376,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94295464,"statfs":{"total":96636764160,"available":96558555136,"internally_reserved":0,"allocated":782336,"data_stored":325884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36116,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335724,"statfs":{"total":96636764160,"available":96599781376,"internally_reserved":0,"allocated":794624,"data_stored":331701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:12:38.548 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:12:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.660+0000 7fd833bac640 1 -- 172.21.15.120:0/1043363615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd82c0cef00 msgr2=0x7fd82c0cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.660+0000 7fd833bac640 1 --2- 172.21.15.120:0/1043363615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd82c0cef00 0x7fd82c0cceb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd824005fd0 tx=0x7fd82402a820 comp rx=0 tx=0).stop 2024-07-27T03:12:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.660+0000 7fd833bac640 1 -- 172.21.15.120:0/1043363615 shutdown_connections 2024-07-27T03:12:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.660+0000 7fd833bac640 1 --2- 172.21.15.120:0/1043363615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd82c0cef00 0x7fd82c0cceb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.660+0000 7fd833bac640 1 --2- 172.21.15.120:0/1043363615 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd82c06e710 0x7fd82c0b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.660+0000 7fd833bac640 1 -- 172.21.15.120:0/1043363615 >> 172.21.15.120:0/1043363615 conn(0x7fd82c0b3920 msgr2=0x7fd82c0b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.660+0000 7fd833bac640 1 -- 172.21.15.120:0/1043363615 shutdown_connections 2024-07-27T03:12:38.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.660+0000 7fd833bac640 1 -- 172.21.15.120:0/1043363615 wait complete. 2024-07-27T03:12:38.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.662+0000 7fd833bac640 1 Processor -- start 2024-07-27T03:12:38.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.662+0000 7fd833bac640 1 -- start start 2024-07-27T03:12:38.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.663+0000 7fd833bac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd82c06e710 0x7fd82c0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:38.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.663+0000 7fd833bac640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd82c0b7440 0x7fd82c1f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:38.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.663+0000 7fd833bac640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd82c1f95c0 0x7fd82c14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:38.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.663+0000 7fd833bac640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c0cd8d0 con 0x7fd82c06e710 2024-07-27T03:12:38.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.663+0000 7fd833bac640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c0cd750 con 0x7fd82c1f95c0 2024-07-27T03:12:38.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.663+0000 7fd833bac640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fd82c0cda50 con 0x7fd82c0b7440 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.663+0000 7fd831948640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd82c06e710 0x7fd82c0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.663+0000 7fd831948640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd82c06e710 0x7fd82c0c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59134/0 (socket says 172.21.15.120:59134) 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.663+0000 7fd831948640 1 -- 172.21.15.120:0/1552725775 learned_addr learned my addr 172.21.15.120:0/1552725775 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.663+0000 7fd831147640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd82c0b7440 0x7fd82c1f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.663+0000 7fd832149640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd82c1f95c0 0x7fd82c14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.664+0000 7fd831948640 1 -- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd82c0b7440 msgr2=0x7fd82c1f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.664+0000 7fd831948640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd82c0b7440 0x7fd82c1f9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.664+0000 7fd831948640 1 -- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd82c1f95c0 msgr2=0x7fd82c14e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.664+0000 7fd831948640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd82c1f95c0 0x7fd82c14e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.664+0000 7fd831948640 1 -- 172.21.15.120:0/1552725775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82c1f9c70 con 0x7fd82c06e710 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.664+0000 7fd831948640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd82c06e710 0x7fd82c0c8f60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd82800e9c0 tx=0x7fd82800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.664+0000 7fd8227fc640 1 -- 172.21.15.120:0/1552725775 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82800cd80 con 0x7fd82c06e710 2024-07-27T03:12:38.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.664+0000 7fd8227fc640 1 -- 172.21.15.120:0/1552725775 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd828004020 con 0x7fd82c06e710 2024-07-27T03:12:38.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.664+0000 7fd8227fc640 1 -- 172.21.15.120:0/1552725775 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828004450 con 0x7fd82c06e710 2024-07-27T03:12:38.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.664+0000 7fd833bac640 1 -- 172.21.15.120:0/1552725775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd82c0c9ad0 con 0x7fd82c06e710 2024-07-27T03:12:38.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.664+0000 7fd833bac640 1 -- 172.21.15.120:0/1552725775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd82c0ca090 con 0x7fd82c06e710 2024-07-27T03:12:38.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.665+0000 7fd833bac640 1 -- 172.21.15.120:0/1552725775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd82c0cdf70 con 0x7fd82c06e710 2024-07-27T03:12:38.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.666+0000 7fd8227fc640 1 -- 172.21.15.120:0/1552725775 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd8280035f0 con 0x7fd82c06e710 2024-07-27T03:12:38.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.666+0000 7fd8227fc640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd810077040 0x7fd810079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:38.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.666+0000 7fd8227fc640 1 -- 172.21.15.120:0/1552725775 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fd8280990c0 con 0x7fd82c06e710 2024-07-27T03:12:38.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.666+0000 7fd831147640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd810077040 0x7fd810079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:38.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.667+0000 7fd831147640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd810077040 0x7fd810079550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd81c007fd0 tx=0x7fd81c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:38.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.670+0000 7fd8227fc640 1 -- 172.21.15.120:0/1552725775 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fd828061c70 con 0x7fd82c06e710 2024-07-27T03:12:38.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.849+0000 7fd833bac640 1 -- 172.21.15.120:0/1552725775 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd82c0b7220 con 0x7fd810077040 2024-07-27T03:12:38.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.854+0000 7fd8227fc640 1 -- 172.21.15.120:0/1552725775 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252058 (secure 0 0 0) 0x7fd82c0b7220 con 0x7fd810077040 2024-07-27T03:12:38.860 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:38.862 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:12:38.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 -- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd810077040 msgr2=0x7fd810079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd810077040 0x7fd810079550 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd81c007fd0 tx=0x7fd81c009040 comp rx=0 tx=0).stop 2024-07-27T03:12:38.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 -- 172.21.15.120:0/1552725775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd82c06e710 msgr2=0x7fd82c0c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd82c06e710 0x7fd82c0c8f60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd82800e9c0 tx=0x7fd82800ee80 comp rx=0 tx=0).stop 2024-07-27T03:12:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 -- 172.21.15.120:0/1552725775 shutdown_connections 2024-07-27T03:12:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fd810077040 0x7fd810079550 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd82c1f95c0 0x7fd82c14e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd82c0b7440 0x7fd82c1f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 --2- 172.21.15.120:0/1552725775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd82c06e710 0x7fd82c0c8f60 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 -- 172.21.15.120:0/1552725775 >> 172.21.15.120:0/1552725775 conn(0x7fd82c0b3920 msgr2=0x7fd82c0b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 -- 172.21.15.120:0/1552725775 shutdown_connections 2024-07-27T03:12:38.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:38.857+0000 7fd833bac640 1 -- 172.21.15.120:0/1552725775 wait complete. 2024-07-27T03:12:38.871 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-07-27T03:12:38.593999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":420972,"kb_used_data":7720,"kb_used_omap":12,"kb_used_meta":413107,"kb_avail":754553748,"statfs":{"total":773094113280,"available":772663037952,"internally_reserved":0,"allocated":7905280,"data_stored":3993964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":423022128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001434"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784665+0000","last_change":"2024-07-27T03:12:34.458427+0000","last_active":"2024-07-27T03:12:35.784665+0000","last_peered":"2024-07-27T03:12:35.784665+0000","last_clean":"2024-07-27T03:12:35.784665+0000","last_became_active":"2024-07-27T03:12:34.456467+0000","last_became_peered":"2024-07-27T03:12:34.456467+0000","last_unstale":"2024-07-27T03:12:35.784665+0000","last_undegraded":"2024-07-27T03:12:35.784665+0000","last_fullsized":"2024-07-27T03:12:35.784665+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:18.427472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.451287+0000","last_change":"2024-07-27T03:12:34.457669+0000","last_active":"2024-07-27T03:12:35.451287+0000","last_peered":"2024-07-27T03:12:35.451287+0000","last_clean":"2024-07-27T03:12:35.451287+0000","last_became_active":"2024-07-27T03:12:34.457075+0000","last_became_peered":"2024-07-27T03:12:34.457075+0000","last_unstale":"2024-07-27T03:12:35.451287+0000","last_undegraded":"2024-07-27T03:12:35.451287+0000","last_fullsized":"2024-07-27T03:12:35.451287+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:00:45.256387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185432+0000","last_change":"2024-07-27T03:12:34.451676+0000","last_active":"2024-07-27T03:12:36.185432+0000","last_peered":"2024-07-27T03:12:36.185432+0000","last_clean":"2024-07-27T03:12:36.185432+0000","last_became_active":"2024-07-27T03:12:34.451300+0000","last_became_peered":"2024-07-27T03:12:34.451300+0000","last_unstale":"2024-07-27T03:12:36.185432+0000","last_undegraded":"2024-07-27T03:12:36.185432+0000","last_fullsized":"2024-07-27T03:12:36.185432+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:52:46.422497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185873+0000","last_change":"2024-07-27T03:12:34.461519+0000","last_active":"2024-07-27T03:12:36.185873+0000","last_peered":"2024-07-27T03:12:36.185873+0000","last_clean":"2024-07-27T03:12:36.185873+0000","last_became_active":"2024-07-27T03:12:34.461077+0000","last_became_peered":"2024-07-27T03:12:34.461077+0000","last_unstale":"2024-07-27T03:12:36.185873+0000","last_undegraded":"2024-07-27T03:12:36.185873+0000","last_fullsized":"2024-07-27T03:12:36.185873+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:05:37.027070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446352+0000","last_change":"2024-07-27T03:12:34.458038+0000","last_active":"2024-07-27T03:12:35.446352+0000","last_peered":"2024-07-27T03:12:35.446352+0000","last_clean":"2024-07-27T03:12:35.446352+0000","last_became_active":"2024-07-27T03:12:34.457729+0000","last_became_peered":"2024-07-27T03:12:34.457729+0000","last_unstale":"2024-07-27T03:12:35.446352+0000","last_undegraded":"2024-07-27T03:12:35.446352+0000","last_fullsized":"2024-07-27T03:12:35.446352+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:59:26.477043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450907+0000","last_change":"2024-07-27T03:12:34.460960+0000","last_active":"2024-07-27T03:12:35.450907+0000","last_peered":"2024-07-27T03:12:35.450907+0000","last_clean":"2024-07-27T03:12:35.450907+0000","last_became_active":"2024-07-27T03:12:34.460608+0000","last_became_peered":"2024-07-27T03:12:34.460608+0000","last_unstale":"2024-07-27T03:12:35.450907+0000","last_undegraded":"2024-07-27T03:12:35.450907+0000","last_fullsized":"2024-07-27T03:12:35.450907+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:29:49.112938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185613+0000","last_change":"2024-07-27T03:12:34.444809+0000","last_active":"2024-07-27T03:12:36.185613+0000","last_peered":"2024-07-27T03:12:36.185613+0000","last_clean":"2024-07-27T03:12:36.185613+0000","last_became_active":"2024-07-27T03:12:34.444482+0000","last_became_peered":"2024-07-27T03:12:34.444482+0000","last_unstale":"2024-07-27T03:12:36.185613+0000","last_undegraded":"2024-07-27T03:12:36.185613+0000","last_fullsized":"2024-07-27T03:12:36.185613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:01:36.569999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.451106+0000","last_change":"2024-07-27T03:12:34.462406+0000","last_active":"2024-07-27T03:12:35.451106+0000","last_peered":"2024-07-27T03:12:35.451106+0000","last_clean":"2024-07-27T03:12:35.451106+0000","last_became_active":"2024-07-27T03:12:34.462093+0000","last_became_peered":"2024-07-27T03:12:34.462093+0000","last_unstale":"2024-07-27T03:12:35.451106+0000","last_undegraded":"2024-07-27T03:12:35.451106+0000","last_fullsized":"2024-07-27T03:12:35.451106+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:57:46.953751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446492+0000","last_change":"2024-07-27T03:12:34.444097+0000","last_active":"2024-07-27T03:12:35.446492+0000","last_peered":"2024-07-27T03:12:35.446492+0000","last_clean":"2024-07-27T03:12:35.446492+0000","last_became_active":"2024-07-27T03:12:34.443559+0000","last_became_peered":"2024-07-27T03:12:34.443559+0000","last_unstale":"2024-07-27T03:12:35.446492+0000","last_undegraded":"2024-07-27T03:12:35.446492+0000","last_fullsized":"2024-07-27T03:12:35.446492+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:07:51.483744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450052+0000","last_change":"2024-07-27T03:12:34.445999+0000","last_active":"2024-07-27T03:12:35.450052+0000","last_peered":"2024-07-27T03:12:35.450052+0000","last_clean":"2024-07-27T03:12:35.450052+0000","last_became_active":"2024-07-27T03:12:34.445278+0000","last_became_peered":"2024-07-27T03:12:34.445278+0000","last_unstale":"2024-07-27T03:12:35.450052+0000","last_undegraded":"2024-07-27T03:12:35.450052+0000","last_fullsized":"2024-07-27T03:12:35.450052+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:15:14.246768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784536+0000","last_change":"2024-07-27T03:12:34.451279+0000","last_active":"2024-07-27T03:12:35.784536+0000","last_peered":"2024-07-27T03:12:35.784536+0000","last_clean":"2024-07-27T03:12:35.784536+0000","last_became_active":"2024-07-27T03:12:34.448832+0000","last_became_peered":"2024-07-27T03:12:34.448832+0000","last_unstale":"2024-07-27T03:12:35.784536+0000","last_undegraded":"2024-07-27T03:12:35.784536+0000","last_fullsized":"2024-07-27T03:12:35.784536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:46:24.837857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185913+0000","last_change":"2024-07-27T03:12:34.441826+0000","last_active":"2024-07-27T03:12:36.185913+0000","last_peered":"2024-07-27T03:12:36.185913+0000","last_clean":"2024-07-27T03:12:36.185913+0000","last_became_active":"2024-07-27T03:12:34.441521+0000","last_became_peered":"2024-07-27T03:12:34.441521+0000","last_unstale":"2024-07-27T03:12:36.185913+0000","last_undegraded":"2024-07-27T03:12:36.185913+0000","last_fullsized":"2024-07-27T03:12:36.185913+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:17:01.967942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185105+0000","last_change":"2024-07-27T03:12:34.461559+0000","last_active":"2024-07-27T03:12:36.185105+0000","last_peered":"2024-07-27T03:12:36.185105+0000","last_clean":"2024-07-27T03:12:36.185105+0000","last_became_active":"2024-07-27T03:12:34.461239+0000","last_became_peered":"2024-07-27T03:12:34.461239+0000","last_unstale":"2024-07-27T03:12:36.185105+0000","last_undegraded":"2024-07-27T03:12:36.185105+0000","last_fullsized":"2024-07-27T03:12:36.185105+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:01:42.354020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446503+0000","last_change":"2024-07-27T03:12:34.446313+0000","last_active":"2024-07-27T03:12:35.446503+0000","last_peered":"2024-07-27T03:12:35.446503+0000","last_clean":"2024-07-27T03:12:35.446503+0000","last_became_active":"2024-07-27T03:12:34.446025+0000","last_became_peered":"2024-07-27T03:12:34.446025+0000","last_unstale":"2024-07-27T03:12:35.446503+0000","last_undegraded":"2024-07-27T03:12:35.446503+0000","last_fullsized":"2024-07-27T03:12:35.446503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:01:17.193689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185139+0000","last_change":"2024-07-27T03:12:34.453433+0000","last_active":"2024-07-27T03:12:36.185139+0000","last_peered":"2024-07-27T03:12:36.185139+0000","last_clean":"2024-07-27T03:12:36.185139+0000","last_became_active":"2024-07-27T03:12:34.453124+0000","last_became_peered":"2024-07-27T03:12:34.453124+0000","last_unstale":"2024-07-27T03:12:36.185139+0000","last_undegraded":"2024-07-27T03:12:36.185139+0000","last_fullsized":"2024-07-27T03:12:36.185139+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:17:37.456399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.449377+0000","last_change":"2024-07-27T03:12:34.462905+0000","last_active":"2024-07-27T03:12:35.449377+0000","last_peered":"2024-07-27T03:12:35.449377+0000","last_clean":"2024-07-27T03:12:35.449377+0000","last_became_active":"2024-07-27T03:12:34.462588+0000","last_became_peered":"2024-07-27T03:12:34.462588+0000","last_unstale":"2024-07-27T03:12:35.449377+0000","last_undegraded":"2024-07-27T03:12:35.449377+0000","last_fullsized":"2024-07-27T03:12:35.449377+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:33:34.095844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446594+0000","last_change":"2024-07-27T03:12:34.444185+0000","last_active":"2024-07-27T03:12:35.446594+0000","last_peered":"2024-07-27T03:12:35.446594+0000","last_clean":"2024-07-27T03:12:35.446594+0000","last_became_active":"2024-07-27T03:12:34.443909+0000","last_became_peered":"2024-07-27T03:12:34.443909+0000","last_unstale":"2024-07-27T03:12:35.446594+0000","last_undegraded":"2024-07-27T03:12:35.446594+0000","last_fullsized":"2024-07-27T03:12:35.446594+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:26:12.323609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.186263+0000","last_change":"2024-07-27T03:12:34.461749+0000","last_active":"2024-07-27T03:12:36.186263+0000","last_peered":"2024-07-27T03:12:36.186263+0000","last_clean":"2024-07-27T03:12:36.186263+0000","last_became_active":"2024-07-27T03:12:34.461201+0000","last_became_peered":"2024-07-27T03:12:34.461201+0000","last_unstale":"2024-07-27T03:12:36.186263+0000","last_undegraded":"2024-07-27T03:12:36.186263+0000","last_fullsized":"2024-07-27T03:12:36.186263+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:44:27.664165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450233+0000","last_change":"2024-07-27T03:12:34.457350+0000","last_active":"2024-07-27T03:12:35.450233+0000","last_peered":"2024-07-27T03:12:35.450233+0000","last_clean":"2024-07-27T03:12:35.450233+0000","last_became_active":"2024-07-27T03:12:34.456839+0000","last_became_peered":"2024-07-27T03:12:34.456839+0000","last_unstale":"2024-07-27T03:12:35.450233+0000","last_undegraded":"2024-07-27T03:12:35.450233+0000","last_fullsized":"2024-07-27T03:12:35.450233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:10:32.497251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185331+0000","last_change":"2024-07-27T03:12:34.448502+0000","last_active":"2024-07-27T03:12:36.185331+0000","last_peered":"2024-07-27T03:12:36.185331+0000","last_clean":"2024-07-27T03:12:36.185331+0000","last_became_active":"2024-07-27T03:12:34.448161+0000","last_became_peered":"2024-07-27T03:12:34.448161+0000","last_unstale":"2024-07-27T03:12:36.185331+0000","last_undegraded":"2024-07-27T03:12:36.185331+0000","last_fullsized":"2024-07-27T03:12:36.185331+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:24:12.874265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.449715+0000","last_change":"2024-07-27T03:12:34.447760+0000","last_active":"2024-07-27T03:12:35.449715+0000","last_peered":"2024-07-27T03:12:35.449715+0000","last_clean":"2024-07-27T03:12:35.449715+0000","last_became_active":"2024-07-27T03:12:34.447437+0000","last_became_peered":"2024-07-27T03:12:34.447437+0000","last_unstale":"2024-07-27T03:12:35.449715+0000","last_undegraded":"2024-07-27T03:12:35.449715+0000","last_fullsized":"2024-07-27T03:12:35.449715+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:56:32.291565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450540+0000","last_change":"2024-07-27T03:12:34.455280+0000","last_active":"2024-07-27T03:12:35.450540+0000","last_peered":"2024-07-27T03:12:35.450540+0000","last_clean":"2024-07-27T03:12:35.450540+0000","last_became_active":"2024-07-27T03:12:34.453714+0000","last_became_peered":"2024-07-27T03:12:34.453714+0000","last_unstale":"2024-07-27T03:12:35.450540+0000","last_undegraded":"2024-07-27T03:12:35.450540+0000","last_fullsized":"2024-07-27T03:12:35.450540+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:41:29.823042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784134+0000","last_change":"2024-07-27T03:12:34.452130+0000","last_active":"2024-07-27T03:12:35.784134+0000","last_peered":"2024-07-27T03:12:35.784134+0000","last_clean":"2024-07-27T03:12:35.784134+0000","last_became_active":"2024-07-27T03:12:34.451643+0000","last_became_peered":"2024-07-27T03:12:34.451643+0000","last_unstale":"2024-07-27T03:12:35.784134+0000","last_undegraded":"2024-07-27T03:12:35.784134+0000","last_fullsized":"2024-07-27T03:12:35.784134+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:49:04.958532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784054+0000","last_change":"2024-07-27T03:12:34.462282+0000","last_active":"2024-07-27T03:12:35.784054+0000","last_peered":"2024-07-27T03:12:35.784054+0000","last_clean":"2024-07-27T03:12:35.784054+0000","last_became_active":"2024-07-27T03:12:34.461980+0000","last_became_peered":"2024-07-27T03:12:34.461980+0000","last_unstale":"2024-07-27T03:12:35.784054+0000","last_undegraded":"2024-07-27T03:12:35.784054+0000","last_fullsized":"2024-07-27T03:12:35.784054+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:23:53.061366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450210+0000","last_change":"2024-07-27T03:12:34.447154+0000","last_active":"2024-07-27T03:12:35.450210+0000","last_peered":"2024-07-27T03:12:35.450210+0000","last_clean":"2024-07-27T03:12:35.450210+0000","last_became_active":"2024-07-27T03:12:34.446869+0000","last_became_peered":"2024-07-27T03:12:34.446869+0000","last_unstale":"2024-07-27T03:12:35.450210+0000","last_undegraded":"2024-07-27T03:12:35.450210+0000","last_fullsized":"2024-07-27T03:12:35.450210+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:02:29.958405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.186520+0000","last_change":"2024-07-27T03:12:34.460230+0000","last_active":"2024-07-27T03:12:36.186520+0000","last_peered":"2024-07-27T03:12:36.186520+0000","last_clean":"2024-07-27T03:12:36.186520+0000","last_became_active":"2024-07-27T03:12:34.459837+0000","last_became_peered":"2024-07-27T03:12:34.459837+0000","last_unstale":"2024-07-27T03:12:36.186520+0000","last_undegraded":"2024-07-27T03:12:36.186520+0000","last_fullsized":"2024-07-27T03:12:36.186520+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:45:34.213650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185533+0000","last_change":"2024-07-27T03:12:34.456675+0000","last_active":"2024-07-27T03:12:36.185533+0000","last_peered":"2024-07-27T03:12:36.185533+0000","last_clean":"2024-07-27T03:12:36.185533+0000","last_became_active":"2024-07-27T03:12:34.456399+0000","last_became_peered":"2024-07-27T03:12:34.456399+0000","last_unstale":"2024-07-27T03:12:36.185533+0000","last_undegraded":"2024-07-27T03:12:36.185533+0000","last_fullsized":"2024-07-27T03:12:36.185533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:37:59.268045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450145+0000","last_change":"2024-07-27T03:12:34.451605+0000","last_active":"2024-07-27T03:12:35.450145+0000","last_peered":"2024-07-27T03:12:35.450145+0000","last_clean":"2024-07-27T03:12:35.450145+0000","last_became_active":"2024-07-27T03:12:34.450612+0000","last_became_peered":"2024-07-27T03:12:34.450612+0000","last_unstale":"2024-07-27T03:12:35.450145+0000","last_undegraded":"2024-07-27T03:12:35.450145+0000","last_fullsized":"2024-07-27T03:12:35.450145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:18:06.607312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.186259+0000","last_change":"2024-07-27T03:12:34.448180+0000","last_active":"2024-07-27T03:12:36.186259+0000","last_peered":"2024-07-27T03:12:36.186259+0000","last_clean":"2024-07-27T03:12:36.186259+0000","last_became_active":"2024-07-27T03:12:34.447855+0000","last_became_peered":"2024-07-27T03:12:34.447855+0000","last_unstale":"2024-07-27T03:12:36.186259+0000","last_undegraded":"2024-07-27T03:12:36.186259+0000","last_fullsized":"2024-07-27T03:12:36.186259+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:10:51.237887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185679+0000","last_change":"2024-07-27T03:12:34.461774+0000","last_active":"2024-07-27T03:12:36.185679+0000","last_peered":"2024-07-27T03:12:36.185679+0000","last_clean":"2024-07-27T03:12:36.185679+0000","last_became_active":"2024-07-27T03:12:34.461459+0000","last_became_peered":"2024-07-27T03:12:34.461459+0000","last_unstale":"2024-07-27T03:12:36.185679+0000","last_undegraded":"2024-07-27T03:12:36.185679+0000","last_fullsized":"2024-07-27T03:12:36.185679+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:51:59.830929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185831+0000","last_change":"2024-07-27T03:12:34.446120+0000","last_active":"2024-07-27T03:12:36.185831+0000","last_peered":"2024-07-27T03:12:36.185831+0000","last_clean":"2024-07-27T03:12:36.185831+0000","last_became_active":"2024-07-27T03:12:34.445830+0000","last_became_peered":"2024-07-27T03:12:34.445830+0000","last_unstale":"2024-07-27T03:12:36.185831+0000","last_undegraded":"2024-07-27T03:12:36.185831+0000","last_fullsized":"2024-07-27T03:12:36.185831+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:51:56.928105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450907+0000","last_change":"2024-07-27T03:12:34.461306+0000","last_active":"2024-07-27T03:12:35.450907+0000","last_peered":"2024-07-27T03:12:35.450907+0000","last_clean":"2024-07-27T03:12:35.450907+0000","last_became_active":"2024-07-27T03:12:34.460933+0000","last_became_peered":"2024-07-27T03:12:34.460933+0000","last_unstale":"2024-07-27T03:12:35.450907+0000","last_undegraded":"2024-07-27T03:12:35.450907+0000","last_fullsized":"2024-07-27T03:12:35.450907+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:23:41.962432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784635+0000","last_change":"2024-07-27T03:12:34.460719+0000","last_active":"2024-07-27T03:12:35.784635+0000","last_peered":"2024-07-27T03:12:35.784635+0000","last_clean":"2024-07-27T03:12:35.784635+0000","last_became_active":"2024-07-27T03:12:34.459477+0000","last_became_peered":"2024-07-27T03:12:34.459477+0000","last_unstale":"2024-07-27T03:12:35.784635+0000","last_undegraded":"2024-07-27T03:12:35.784635+0000","last_fullsized":"2024-07-27T03:12:35.784635+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:39:46.327316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784878+0000","last_change":"2024-07-27T03:12:33.431797+0000","last_active":"2024-07-27T03:12:35.784878+0000","last_peered":"2024-07-27T03:12:35.784878+0000","last_clean":"2024-07-27T03:12:35.784878+0000","last_became_active":"2024-07-27T03:12:33.430788+0000","last_became_peered":"2024-07-27T03:12:33.430788+0000","last_unstale":"2024-07-27T03:12:35.784878+0000","last_undegraded":"2024-07-27T03:12:35.784878+0000","last_fullsized":"2024-07-27T03:12:35.784878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:22:33.962989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446590+0000","last_change":"2024-07-27T03:12:34.443847+0000","last_active":"2024-07-27T03:12:35.446590+0000","last_peered":"2024-07-27T03:12:35.446590+0000","last_clean":"2024-07-27T03:12:35.446590+0000","last_became_active":"2024-07-27T03:12:34.443489+0000","last_became_peered":"2024-07-27T03:12:34.443489+0000","last_unstale":"2024-07-27T03:12:35.446590+0000","last_undegraded":"2024-07-27T03:12:35.446590+0000","last_fullsized":"2024-07-27T03:12:35.446590+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:06:09.157396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185530+0000","last_change":"2024-07-27T03:12:33.422577+0000","last_active":"2024-07-27T03:12:36.185530+0000","last_peered":"2024-07-27T03:12:36.185530+0000","last_clean":"2024-07-27T03:12:36.185530+0000","last_became_active":"2024-07-27T03:12:33.422261+0000","last_became_peered":"2024-07-27T03:12:33.422261+0000","last_unstale":"2024-07-27T03:12:36.185530+0000","last_undegraded":"2024-07-27T03:12:36.185530+0000","last_fullsized":"2024-07-27T03:12:36.185530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:22:33.962989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.451198+0000","last_change":"2024-07-27T03:12:34.460480+0000","last_active":"2024-07-27T03:12:35.451198+0000","last_peered":"2024-07-27T03:12:35.451198+0000","last_clean":"2024-07-27T03:12:35.451198+0000","last_became_active":"2024-07-27T03:12:34.459263+0000","last_became_peered":"2024-07-27T03:12:34.459263+0000","last_unstale":"2024-07-27T03:12:35.451198+0000","last_undegraded":"2024-07-27T03:12:35.451198+0000","last_fullsized":"2024-07-27T03:12:35.451198+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:54:38.810532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.449650+0000","last_change":"2024-07-27T03:12:33.428062+0000","last_active":"2024-07-27T03:12:35.449650+0000","last_peered":"2024-07-27T03:12:35.449650+0000","last_clean":"2024-07-27T03:12:35.449650+0000","last_became_active":"2024-07-27T03:12:33.426382+0000","last_became_peered":"2024-07-27T03:12:33.426382+0000","last_unstale":"2024-07-27T03:12:35.449650+0000","last_undegraded":"2024-07-27T03:12:35.449650+0000","last_fullsized":"2024-07-27T03:12:35.449650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:46:01.216777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784621+0000","last_change":"2024-07-27T03:12:34.455023+0000","last_active":"2024-07-27T03:12:35.784621+0000","last_peered":"2024-07-27T03:12:35.784621+0000","last_clean":"2024-07-27T03:12:35.784621+0000","last_became_active":"2024-07-27T03:12:34.454649+0000","last_became_peered":"2024-07-27T03:12:34.454649+0000","last_unstale":"2024-07-27T03:12:35.784621+0000","last_undegraded":"2024-07-27T03:12:35.784621+0000","last_fullsized":"2024-07-27T03:12:35.784621+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:12:12.633172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.451272+0000","last_change":"2024-07-27T03:12:33.427313+0000","last_active":"2024-07-27T03:12:35.451272+0000","last_peered":"2024-07-27T03:12:35.451272+0000","last_clean":"2024-07-27T03:12:35.451272+0000","last_became_active":"2024-07-27T03:12:33.426887+0000","last_became_peered":"2024-07-27T03:12:33.426887+0000","last_unstale":"2024-07-27T03:12:35.451272+0000","last_undegraded":"2024-07-27T03:12:35.451272+0000","last_fullsized":"2024-07-27T03:12:35.451272+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:35:55.619257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185745+0000","last_change":"2024-07-27T03:12:34.443944+0000","last_active":"2024-07-27T03:12:36.185745+0000","last_peered":"2024-07-27T03:12:36.185745+0000","last_clean":"2024-07-27T03:12:36.185745+0000","last_became_active":"2024-07-27T03:12:34.443630+0000","last_became_peered":"2024-07-27T03:12:34.443630+0000","last_unstale":"2024-07-27T03:12:36.185745+0000","last_undegraded":"2024-07-27T03:12:36.185745+0000","last_fullsized":"2024-07-27T03:12:36.185745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:57:02.287828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.186401+0000","last_change":"2024-07-27T03:12:33.434820+0000","last_active":"2024-07-27T03:12:36.186401+0000","last_peered":"2024-07-27T03:12:36.186401+0000","last_clean":"2024-07-27T03:12:36.186401+0000","last_became_active":"2024-07-27T03:12:33.434578+0000","last_became_peered":"2024-07-27T03:12:33.434578+0000","last_unstale":"2024-07-27T03:12:36.186401+0000","last_undegraded":"2024-07-27T03:12:36.186401+0000","last_fullsized":"2024-07-27T03:12:36.186401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:19:00.001849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.449917+0000","last_change":"2024-07-27T03:12:34.446789+0000","last_active":"2024-07-27T03:12:35.449917+0000","last_peered":"2024-07-27T03:12:35.449917+0000","last_clean":"2024-07-27T03:12:35.449917+0000","last_became_active":"2024-07-27T03:12:34.446465+0000","last_became_peered":"2024-07-27T03:12:34.446465+0000","last_unstale":"2024-07-27T03:12:35.449917+0000","last_undegraded":"2024-07-27T03:12:35.449917+0000","last_fullsized":"2024-07-27T03:12:35.449917+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:48:42.967920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.451004+0000","last_change":"2024-07-27T03:12:33.427914+0000","last_active":"2024-07-27T03:12:35.451004+0000","last_peered":"2024-07-27T03:12:35.451004+0000","last_clean":"2024-07-27T03:12:35.451004+0000","last_became_active":"2024-07-27T03:12:33.427520+0000","last_became_peered":"2024-07-27T03:12:33.427520+0000","last_unstale":"2024-07-27T03:12:35.451004+0000","last_undegraded":"2024-07-27T03:12:35.451004+0000","last_fullsized":"2024-07-27T03:12:35.451004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:38:33.047517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446042+0000","last_change":"2024-07-27T03:12:34.448366+0000","last_active":"2024-07-27T03:12:35.446042+0000","last_peered":"2024-07-27T03:12:35.446042+0000","last_clean":"2024-07-27T03:12:35.446042+0000","last_became_active":"2024-07-27T03:12:34.448094+0000","last_became_peered":"2024-07-27T03:12:34.448094+0000","last_unstale":"2024-07-27T03:12:35.446042+0000","last_undegraded":"2024-07-27T03:12:35.446042+0000","last_fullsized":"2024-07-27T03:12:35.446042+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:29:57.396792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185794+0000","last_change":"2024-07-27T03:12:33.427260+0000","last_active":"2024-07-27T03:12:36.185794+0000","last_peered":"2024-07-27T03:12:36.185794+0000","last_clean":"2024-07-27T03:12:36.185794+0000","last_became_active":"2024-07-27T03:12:33.426942+0000","last_became_peered":"2024-07-27T03:12:33.426942+0000","last_unstale":"2024-07-27T03:12:36.185794+0000","last_undegraded":"2024-07-27T03:12:36.185794+0000","last_fullsized":"2024-07-27T03:12:36.185794+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:15:49.067785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185111+0000","last_change":"2024-07-27T03:12:34.454561+0000","last_active":"2024-07-27T03:12:36.185111+0000","last_peered":"2024-07-27T03:12:36.185111+0000","last_clean":"2024-07-27T03:12:36.185111+0000","last_became_active":"2024-07-27T03:12:34.454219+0000","last_became_peered":"2024-07-27T03:12:34.454219+0000","last_unstale":"2024-07-27T03:12:36.185111+0000","last_undegraded":"2024-07-27T03:12:36.185111+0000","last_fullsized":"2024-07-27T03:12:36.185111+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:51:56.928105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446040+0000","last_change":"2024-07-27T03:12:33.427013+0000","last_active":"2024-07-27T03:12:35.446040+0000","last_peered":"2024-07-27T03:12:35.446040+0000","last_clean":"2024-07-27T03:12:35.446040+0000","last_became_active":"2024-07-27T03:12:33.426637+0000","last_became_peered":"2024-07-27T03:12:33.426637+0000","last_unstale":"2024-07-27T03:12:35.446040+0000","last_undegraded":"2024-07-27T03:12:35.446040+0000","last_fullsized":"2024-07-27T03:12:35.446040+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:48:28.048656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.186050+0000","last_change":"2024-07-27T03:12:34.456074+0000","last_active":"2024-07-27T03:12:36.186050+0000","last_peered":"2024-07-27T03:12:36.186050+0000","last_clean":"2024-07-27T03:12:36.186050+0000","last_became_active":"2024-07-27T03:12:34.455770+0000","last_became_peered":"2024-07-27T03:12:34.455770+0000","last_unstale":"2024-07-27T03:12:36.186050+0000","last_undegraded":"2024-07-27T03:12:36.186050+0000","last_fullsized":"2024-07-27T03:12:36.186050+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:24:12.874265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450164+0000","last_change":"2024-07-27T03:12:33.427203+0000","last_active":"2024-07-27T03:12:35.450164+0000","last_peered":"2024-07-27T03:12:35.450164+0000","last_clean":"2024-07-27T03:12:35.450164+0000","last_became_active":"2024-07-27T03:12:33.425448+0000","last_became_peered":"2024-07-27T03:12:33.425448+0000","last_unstale":"2024-07-27T03:12:35.450164+0000","last_undegraded":"2024-07-27T03:12:35.450164+0000","last_fullsized":"2024-07-27T03:12:35.450164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T15:02:07.648960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784787+0000","last_change":"2024-07-27T03:12:34.460099+0000","last_active":"2024-07-27T03:12:35.784787+0000","last_peered":"2024-07-27T03:12:35.784787+0000","last_clean":"2024-07-27T03:12:35.784787+0000","last_became_active":"2024-07-27T03:12:34.458855+0000","last_became_peered":"2024-07-27T03:12:34.458855+0000","last_unstale":"2024-07-27T03:12:35.784787+0000","last_undegraded":"2024-07-27T03:12:35.784787+0000","last_fullsized":"2024-07-27T03:12:35.784787+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:38:03.699698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.451317+0000","last_change":"2024-07-27T03:12:33.428375+0000","last_active":"2024-07-27T03:12:35.451317+0000","last_peered":"2024-07-27T03:12:35.451317+0000","last_clean":"2024-07-27T03:12:35.451317+0000","last_became_active":"2024-07-27T03:12:33.428032+0000","last_became_peered":"2024-07-27T03:12:33.428032+0000","last_unstale":"2024-07-27T03:12:35.451317+0000","last_undegraded":"2024-07-27T03:12:35.451317+0000","last_fullsized":"2024-07-27T03:12:35.451317+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:26:19.394013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.451228+0000","last_change":"2024-07-27T03:12:34.459030+0000","last_active":"2024-07-27T03:12:35.451228+0000","last_peered":"2024-07-27T03:12:35.451228+0000","last_clean":"2024-07-27T03:12:35.451228+0000","last_became_active":"2024-07-27T03:12:34.458684+0000","last_became_peered":"2024-07-27T03:12:34.458684+0000","last_unstale":"2024-07-27T03:12:35.451228+0000","last_undegraded":"2024-07-27T03:12:35.451228+0000","last_fullsized":"2024-07-27T03:12:35.451228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:58:33.456334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185571+0000","last_change":"2024-07-27T03:12:33.423119+0000","last_active":"2024-07-27T03:12:36.185571+0000","last_peered":"2024-07-27T03:12:36.185571+0000","last_clean":"2024-07-27T03:12:36.185571+0000","last_became_active":"2024-07-27T03:12:33.422807+0000","last_became_peered":"2024-07-27T03:12:33.422807+0000","last_unstale":"2024-07-27T03:12:36.185571+0000","last_undegraded":"2024-07-27T03:12:36.185571+0000","last_fullsized":"2024-07-27T03:12:36.185571+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:09:24.103104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446170+0000","last_change":"2024-07-27T03:12:34.450188+0000","last_active":"2024-07-27T03:12:35.446170+0000","last_peered":"2024-07-27T03:12:35.446170+0000","last_clean":"2024-07-27T03:12:35.446170+0000","last_became_active":"2024-07-27T03:12:34.449885+0000","last_became_peered":"2024-07-27T03:12:34.449885+0000","last_unstale":"2024-07-27T03:12:35.446170+0000","last_undegraded":"2024-07-27T03:12:35.446170+0000","last_fullsized":"2024-07-27T03:12:35.446170+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:52:11.972275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185984+0000","last_change":"2024-07-27T03:12:33.425217+0000","last_active":"2024-07-27T03:12:36.185984+0000","last_peered":"2024-07-27T03:12:36.185984+0000","last_clean":"2024-07-27T03:12:36.185984+0000","last_became_active":"2024-07-27T03:12:33.424900+0000","last_became_peered":"2024-07-27T03:12:33.424900+0000","last_unstale":"2024-07-27T03:12:36.185984+0000","last_undegraded":"2024-07-27T03:12:36.185984+0000","last_fullsized":"2024-07-27T03:12:36.185984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:26:19.394013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784175+0000","last_change":"2024-07-27T03:12:34.453352+0000","last_active":"2024-07-27T03:12:35.784175+0000","last_peered":"2024-07-27T03:12:35.784175+0000","last_clean":"2024-07-27T03:12:35.784175+0000","last_became_active":"2024-07-27T03:12:34.453057+0000","last_became_peered":"2024-07-27T03:12:34.453057+0000","last_unstale":"2024-07-27T03:12:35.784175+0000","last_undegraded":"2024-07-27T03:12:35.784175+0000","last_fullsized":"2024-07-27T03:12:35.784175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:16:32.982079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.186215+0000","last_change":"2024-07-27T03:12:33.429043+0000","last_active":"2024-07-27T03:12:36.186215+0000","last_peered":"2024-07-27T03:12:36.186215+0000","last_clean":"2024-07-27T03:12:36.186215+0000","last_became_active":"2024-07-27T03:12:33.428727+0000","last_became_peered":"2024-07-27T03:12:33.428727+0000","last_unstale":"2024-07-27T03:12:36.186215+0000","last_undegraded":"2024-07-27T03:12:36.186215+0000","last_fullsized":"2024-07-27T03:12:36.186215+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:54:12.554452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185829+0000","last_change":"2024-07-27T03:12:34.439686+0000","last_active":"2024-07-27T03:12:36.185829+0000","last_peered":"2024-07-27T03:12:36.185829+0000","last_clean":"2024-07-27T03:12:36.185829+0000","last_became_active":"2024-07-27T03:12:34.439323+0000","last_became_peered":"2024-07-27T03:12:34.439323+0000","last_unstale":"2024-07-27T03:12:36.185829+0000","last_undegraded":"2024-07-27T03:12:36.185829+0000","last_fullsized":"2024-07-27T03:12:36.185829+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T11:01:42.354020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.451176+0000","last_change":"2024-07-27T03:12:33.428710+0000","last_active":"2024-07-27T03:12:35.451176+0000","last_peered":"2024-07-27T03:12:35.451176+0000","last_clean":"2024-07-27T03:12:35.451176+0000","last_became_active":"2024-07-27T03:12:33.428174+0000","last_became_peered":"2024-07-27T03:12:33.428174+0000","last_unstale":"2024-07-27T03:12:35.451176+0000","last_undegraded":"2024-07-27T03:12:35.451176+0000","last_fullsized":"2024-07-27T03:12:35.451176+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:13:17.106155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185656+0000","last_change":"2024-07-27T03:12:34.465170+0000","last_active":"2024-07-27T03:12:36.185656+0000","last_peered":"2024-07-27T03:12:36.185656+0000","last_clean":"2024-07-27T03:12:36.185656+0000","last_became_active":"2024-07-27T03:12:34.464828+0000","last_became_peered":"2024-07-27T03:12:34.464828+0000","last_unstale":"2024-07-27T03:12:36.185656+0000","last_undegraded":"2024-07-27T03:12:36.185656+0000","last_fullsized":"2024-07-27T03:12:36.185656+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:49:04.958532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185581+0000","last_change":"2024-07-27T03:12:33.418267+0000","last_active":"2024-07-27T03:12:36.185581+0000","last_peered":"2024-07-27T03:12:36.185581+0000","last_clean":"2024-07-27T03:12:36.185581+0000","last_became_active":"2024-07-27T03:12:33.417912+0000","last_became_peered":"2024-07-27T03:12:33.417912+0000","last_unstale":"2024-07-27T03:12:36.185581+0000","last_undegraded":"2024-07-27T03:12:36.185581+0000","last_fullsized":"2024-07-27T03:12:36.185581+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:57:56.829166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446180+0000","last_change":"2024-07-27T03:12:34.449340+0000","last_active":"2024-07-27T03:12:35.446180+0000","last_peered":"2024-07-27T03:12:35.446180+0000","last_clean":"2024-07-27T03:12:35.446180+0000","last_became_active":"2024-07-27T03:12:34.449032+0000","last_became_peered":"2024-07-27T03:12:34.449032+0000","last_unstale":"2024-07-27T03:12:35.446180+0000","last_undegraded":"2024-07-27T03:12:35.446180+0000","last_fullsized":"2024-07-27T03:12:35.446180+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:32:06.764272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.449323+0000","last_change":"2024-07-27T03:12:33.422242+0000","last_active":"2024-07-27T03:12:35.449323+0000","last_peered":"2024-07-27T03:12:35.449323+0000","last_clean":"2024-07-27T03:12:35.449323+0000","last_became_active":"2024-07-27T03:12:33.421885+0000","last_became_peered":"2024-07-27T03:12:33.421885+0000","last_unstale":"2024-07-27T03:12:35.449323+0000","last_undegraded":"2024-07-27T03:12:35.449323+0000","last_fullsized":"2024-07-27T03:12:35.449323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:33:31.019515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450245+0000","last_change":"2024-07-27T03:12:34.437254+0000","last_active":"2024-07-27T03:12:35.450245+0000","last_peered":"2024-07-27T03:12:35.450245+0000","last_clean":"2024-07-27T03:12:35.450245+0000","last_became_active":"2024-07-27T03:12:34.436923+0000","last_became_peered":"2024-07-27T03:12:34.436923+0000","last_unstale":"2024-07-27T03:12:35.450245+0000","last_undegraded":"2024-07-27T03:12:35.450245+0000","last_fullsized":"2024-07-27T03:12:35.450245+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:43:12.756596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450625+0000","last_change":"2024-07-27T03:12:33.429265+0000","last_active":"2024-07-27T03:12:35.450625+0000","last_peered":"2024-07-27T03:12:35.450625+0000","last_clean":"2024-07-27T03:12:35.450625+0000","last_became_active":"2024-07-27T03:12:33.428131+0000","last_became_peered":"2024-07-27T03:12:33.428131+0000","last_unstale":"2024-07-27T03:12:35.450625+0000","last_undegraded":"2024-07-27T03:12:35.450625+0000","last_fullsized":"2024-07-27T03:12:35.450625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:54:12.554452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784823+0000","last_change":"2024-07-27T03:12:34.451563+0000","last_active":"2024-07-27T03:12:35.784823+0000","last_peered":"2024-07-27T03:12:35.784823+0000","last_clean":"2024-07-27T03:12:35.784823+0000","last_became_active":"2024-07-27T03:12:34.450781+0000","last_became_peered":"2024-07-27T03:12:34.450781+0000","last_unstale":"2024-07-27T03:12:35.784823+0000","last_undegraded":"2024-07-27T03:12:35.784823+0000","last_fullsized":"2024-07-27T03:12:35.784823+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:13:50.584141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450233+0000","last_change":"2024-07-27T03:12:33.424218+0000","last_active":"2024-07-27T03:12:35.450233+0000","last_peered":"2024-07-27T03:12:35.450233+0000","last_clean":"2024-07-27T03:12:35.450233+0000","last_became_active":"2024-07-27T03:12:33.423680+0000","last_became_peered":"2024-07-27T03:12:33.423680+0000","last_unstale":"2024-07-27T03:12:35.450233+0000","last_undegraded":"2024-07-27T03:12:35.450233+0000","last_fullsized":"2024-07-27T03:12:35.450233+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:10:31.495598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.186076+0000","last_change":"2024-07-27T03:12:34.441262+0000","last_active":"2024-07-27T03:12:36.186076+0000","last_peered":"2024-07-27T03:12:36.186076+0000","last_clean":"2024-07-27T03:12:36.186076+0000","last_became_active":"2024-07-27T03:12:34.440757+0000","last_became_peered":"2024-07-27T03:12:34.440757+0000","last_unstale":"2024-07-27T03:12:36.186076+0000","last_undegraded":"2024-07-27T03:12:36.186076+0000","last_fullsized":"2024-07-27T03:12:36.186076+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:50:52.328368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450383+0000","last_change":"2024-07-27T03:12:33.426983+0000","last_active":"2024-07-27T03:12:35.450383+0000","last_peered":"2024-07-27T03:12:35.450383+0000","last_clean":"2024-07-27T03:12:35.450383+0000","last_became_active":"2024-07-27T03:12:33.426272+0000","last_became_peered":"2024-07-27T03:12:33.426272+0000","last_unstale":"2024-07-27T03:12:35.450383+0000","last_undegraded":"2024-07-27T03:12:35.450383+0000","last_fullsized":"2024-07-27T03:12:35.450383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:15:49.067785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446263+0000","last_change":"2024-07-27T03:12:34.455999+0000","last_active":"2024-07-27T03:12:35.446263+0000","last_peered":"2024-07-27T03:12:35.446263+0000","last_clean":"2024-07-27T03:12:35.446263+0000","last_became_active":"2024-07-27T03:12:34.454743+0000","last_became_peered":"2024-07-27T03:12:34.454743+0000","last_unstale":"2024-07-27T03:12:35.446263+0000","last_undegraded":"2024-07-27T03:12:35.446263+0000","last_fullsized":"2024-07-27T03:12:35.446263+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:42:31.890639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784421+0000","last_change":"2024-07-27T03:12:33.426178+0000","last_active":"2024-07-27T03:12:35.784421+0000","last_peered":"2024-07-27T03:12:35.784421+0000","last_clean":"2024-07-27T03:12:35.784421+0000","last_became_active":"2024-07-27T03:12:33.425817+0000","last_became_peered":"2024-07-27T03:12:33.425817+0000","last_unstale":"2024-07-27T03:12:35.784421+0000","last_undegraded":"2024-07-27T03:12:35.784421+0000","last_fullsized":"2024-07-27T03:12:35.784421+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:38:25.653225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.186370+0000","last_change":"2024-07-27T03:12:34.451070+0000","last_active":"2024-07-27T03:12:36.186370+0000","last_peered":"2024-07-27T03:12:36.186370+0000","last_clean":"2024-07-27T03:12:36.186370+0000","last_became_active":"2024-07-27T03:12:34.450723+0000","last_became_peered":"2024-07-27T03:12:34.450723+0000","last_unstale":"2024-07-27T03:12:36.186370+0000","last_undegraded":"2024-07-27T03:12:36.186370+0000","last_fullsized":"2024-07-27T03:12:36.186370+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:23:12.816637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.451289+0000","last_change":"2024-07-27T03:12:33.427590+0000","last_active":"2024-07-27T03:12:35.451289+0000","last_peered":"2024-07-27T03:12:35.451289+0000","last_clean":"2024-07-27T03:12:35.451289+0000","last_became_active":"2024-07-27T03:12:33.426523+0000","last_became_peered":"2024-07-27T03:12:33.426523+0000","last_unstale":"2024-07-27T03:12:35.451289+0000","last_undegraded":"2024-07-27T03:12:35.451289+0000","last_fullsized":"2024-07-27T03:12:35.451289+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:56:59.962097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185337+0000","last_change":"2024-07-27T03:12:34.463867+0000","last_active":"2024-07-27T03:12:36.185337+0000","last_peered":"2024-07-27T03:12:36.185337+0000","last_clean":"2024-07-27T03:12:36.185337+0000","last_became_active":"2024-07-27T03:12:34.463376+0000","last_became_peered":"2024-07-27T03:12:34.463376+0000","last_unstale":"2024-07-27T03:12:36.185337+0000","last_undegraded":"2024-07-27T03:12:36.185337+0000","last_fullsized":"2024-07-27T03:12:36.185337+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T14:19:11.933265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185944+0000","last_change":"2024-07-27T03:12:33.423345+0000","last_active":"2024-07-27T03:12:36.185944+0000","last_peered":"2024-07-27T03:12:36.185944+0000","last_clean":"2024-07-27T03:12:36.185944+0000","last_became_active":"2024-07-27T03:12:33.422991+0000","last_became_peered":"2024-07-27T03:12:33.422991+0000","last_unstale":"2024-07-27T03:12:36.185944+0000","last_undegraded":"2024-07-27T03:12:36.185944+0000","last_fullsized":"2024-07-27T03:12:36.185944+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T07:13:36.965995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185651+0000","last_change":"2024-07-27T03:12:34.459833+0000","last_active":"2024-07-27T03:12:36.185651+0000","last_peered":"2024-07-27T03:12:36.185651+0000","last_clean":"2024-07-27T03:12:36.185651+0000","last_became_active":"2024-07-27T03:12:34.459500+0000","last_became_peered":"2024-07-27T03:12:34.459500+0000","last_unstale":"2024-07-27T03:12:36.185651+0000","last_undegraded":"2024-07-27T03:12:36.185651+0000","last_fullsized":"2024-07-27T03:12:36.185651+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T05:30:20.490497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.184864+0000","last_change":"2024-07-27T03:12:33.424227+0000","last_active":"2024-07-27T03:12:36.184864+0000","last_peered":"2024-07-27T03:12:36.184864+0000","last_clean":"2024-07-27T03:12:36.184864+0000","last_became_active":"2024-07-27T03:12:33.423846+0000","last_became_peered":"2024-07-27T03:12:33.423846+0000","last_unstale":"2024-07-27T03:12:36.184864+0000","last_undegraded":"2024-07-27T03:12:36.184864+0000","last_fullsized":"2024-07-27T03:12:36.184864+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:56:14.591809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185404+0000","last_change":"2024-07-27T03:12:34.454194+0000","last_active":"2024-07-27T03:12:36.185404+0000","last_peered":"2024-07-27T03:12:36.185404+0000","last_clean":"2024-07-27T03:12:36.185404+0000","last_became_active":"2024-07-27T03:12:34.453910+0000","last_became_peered":"2024-07-27T03:12:34.453910+0000","last_unstale":"2024-07-27T03:12:36.185404+0000","last_undegraded":"2024-07-27T03:12:36.185404+0000","last_fullsized":"2024-07-27T03:12:36.185404+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:45:34.213650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450796+0000","last_change":"2024-07-27T03:12:33.428400+0000","last_active":"2024-07-27T03:12:35.450796+0000","last_peered":"2024-07-27T03:12:35.450796+0000","last_clean":"2024-07-27T03:12:35.450796+0000","last_became_active":"2024-07-27T03:12:33.427743+0000","last_became_peered":"2024-07-27T03:12:33.427743+0000","last_unstale":"2024-07-27T03:12:35.450796+0000","last_undegraded":"2024-07-27T03:12:35.450796+0000","last_fullsized":"2024-07-27T03:12:35.450796+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:34:06.719295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185946+0000","last_change":"2024-07-27T03:12:34.437206+0000","last_active":"2024-07-27T03:12:36.185946+0000","last_peered":"2024-07-27T03:12:36.185946+0000","last_clean":"2024-07-27T03:12:36.185946+0000","last_became_active":"2024-07-27T03:12:34.436846+0000","last_became_peered":"2024-07-27T03:12:34.436846+0000","last_unstale":"2024-07-27T03:12:36.185946+0000","last_undegraded":"2024-07-27T03:12:36.185946+0000","last_fullsized":"2024-07-27T03:12:36.185946+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:17:37.456399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"69'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.186251+0000","last_change":"2024-07-27T03:12:33.416671+0000","last_active":"2024-07-27T03:12:36.186251+0000","last_peered":"2024-07-27T03:12:36.186251+0000","last_clean":"2024-07-27T03:12:36.186251+0000","last_became_active":"2024-07-27T03:12:33.416294+0000","last_became_peered":"2024-07-27T03:12:33.416294+0000","last_unstale":"2024-07-27T03:12:36.186251+0000","last_undegraded":"2024-07-27T03:12:36.186251+0000","last_fullsized":"2024-07-27T03:12:36.186251+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:33:28.551829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784258+0000","last_change":"2024-07-27T03:12:34.459174+0000","last_active":"2024-07-27T03:12:35.784258+0000","last_peered":"2024-07-27T03:12:35.784258+0000","last_clean":"2024-07-27T03:12:35.784258+0000","last_became_active":"2024-07-27T03:12:34.458859+0000","last_became_peered":"2024-07-27T03:12:34.458859+0000","last_unstale":"2024-07-27T03:12:35.784258+0000","last_undegraded":"2024-07-27T03:12:35.784258+0000","last_fullsized":"2024-07-27T03:12:35.784258+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T04:32:53.865155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446372+0000","last_change":"2024-07-27T03:12:33.420287+0000","last_active":"2024-07-27T03:12:35.446372+0000","last_peered":"2024-07-27T03:12:35.446372+0000","last_clean":"2024-07-27T03:12:35.446372+0000","last_became_active":"2024-07-27T03:12:33.419827+0000","last_became_peered":"2024-07-27T03:12:33.419827+0000","last_unstale":"2024-07-27T03:12:35.446372+0000","last_undegraded":"2024-07-27T03:12:35.446372+0000","last_fullsized":"2024-07-27T03:12:35.446372+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T03:56:31.345582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784793+0000","last_change":"2024-07-27T03:12:34.449792+0000","last_active":"2024-07-27T03:12:35.784793+0000","last_peered":"2024-07-27T03:12:35.784793+0000","last_clean":"2024-07-27T03:12:35.784793+0000","last_became_active":"2024-07-27T03:12:34.449048+0000","last_became_peered":"2024-07-27T03:12:34.449048+0000","last_unstale":"2024-07-27T03:12:35.784793+0000","last_undegraded":"2024-07-27T03:12:35.784793+0000","last_fullsized":"2024-07-27T03:12:35.784793+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:10:52.404324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185380+0000","last_change":"2024-07-27T03:12:33.417593+0000","last_active":"2024-07-27T03:12:36.185380+0000","last_peered":"2024-07-27T03:12:36.185380+0000","last_clean":"2024-07-27T03:12:36.185380+0000","last_became_active":"2024-07-27T03:12:33.417296+0000","last_became_peered":"2024-07-27T03:12:33.417296+0000","last_unstale":"2024-07-27T03:12:36.185380+0000","last_undegraded":"2024-07-27T03:12:36.185380+0000","last_fullsized":"2024-07-27T03:12:36.185380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:38:25.653225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446674+0000","last_change":"2024-07-27T03:12:34.445526+0000","last_active":"2024-07-27T03:12:35.446674+0000","last_peered":"2024-07-27T03:12:35.446674+0000","last_clean":"2024-07-27T03:12:35.446674+0000","last_became_active":"2024-07-27T03:12:34.444582+0000","last_became_peered":"2024-07-27T03:12:34.444582+0000","last_unstale":"2024-07-27T03:12:35.446674+0000","last_undegraded":"2024-07-27T03:12:35.446674+0000","last_fullsized":"2024-07-27T03:12:35.446674+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:46:35.656669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.446241+0000","last_change":"2024-07-27T03:12:33.429228+0000","last_active":"2024-07-27T03:12:35.446241+0000","last_peered":"2024-07-27T03:12:35.446241+0000","last_clean":"2024-07-27T03:12:35.446241+0000","last_became_active":"2024-07-27T03:12:33.428909+0000","last_became_peered":"2024-07-27T03:12:33.428909+0000","last_unstale":"2024-07-27T03:12:35.446241+0000","last_undegraded":"2024-07-27T03:12:35.446241+0000","last_fullsized":"2024-07-27T03:12:35.446241+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:34:57.139751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450973+0000","last_change":"2024-07-27T03:12:34.462177+0000","last_active":"2024-07-27T03:12:35.450973+0000","last_peered":"2024-07-27T03:12:35.450973+0000","last_clean":"2024-07-27T03:12:35.450973+0000","last_became_active":"2024-07-27T03:12:34.461819+0000","last_became_peered":"2024-07-27T03:12:34.461819+0000","last_unstale":"2024-07-27T03:12:35.450973+0000","last_undegraded":"2024-07-27T03:12:35.450973+0000","last_fullsized":"2024-07-27T03:12:35.450973+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T09:30:38.220549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185028+0000","last_change":"2024-07-27T03:12:33.427306+0000","last_active":"2024-07-27T03:12:36.185028+0000","last_peered":"2024-07-27T03:12:36.185028+0000","last_clean":"2024-07-27T03:12:36.185028+0000","last_became_active":"2024-07-27T03:12:33.427001+0000","last_became_peered":"2024-07-27T03:12:33.427001+0000","last_unstale":"2024-07-27T03:12:36.185028+0000","last_undegraded":"2024-07-27T03:12:36.185028+0000","last_fullsized":"2024-07-27T03:12:36.185028+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:34:06.719295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.185377+0000","last_change":"2024-07-27T03:12:34.445224+0000","last_active":"2024-07-27T03:12:36.185377+0000","last_peered":"2024-07-27T03:12:36.185377+0000","last_clean":"2024-07-27T03:12:36.185377+0000","last_became_active":"2024-07-27T03:12:34.444910+0000","last_became_peered":"2024-07-27T03:12:34.444910+0000","last_unstale":"2024-07-27T03:12:36.185377+0000","last_undegraded":"2024-07-27T03:12:36.185377+0000","last_fullsized":"2024-07-27T03:12:36.185377+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T06:38:01.050711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.449328+0000","last_change":"2024-07-27T03:12:33.427533+0000","last_active":"2024-07-27T03:12:35.449328+0000","last_peered":"2024-07-27T03:12:35.449328+0000","last_clean":"2024-07-27T03:12:35.449328+0000","last_became_active":"2024-07-27T03:12:33.425661+0000","last_became_peered":"2024-07-27T03:12:33.425661+0000","last_unstale":"2024-07-27T03:12:35.449328+0000","last_undegraded":"2024-07-27T03:12:35.449328+0000","last_fullsized":"2024-07-27T03:12:35.449328+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:50:13.700371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450430+0000","last_change":"2024-07-27T03:12:34.460387+0000","last_active":"2024-07-27T03:12:35.450430+0000","last_peered":"2024-07-27T03:12:35.450430+0000","last_clean":"2024-07-27T03:12:35.450430+0000","last_became_active":"2024-07-27T03:12:34.458886+0000","last_became_peered":"2024-07-27T03:12:34.458886+0000","last_unstale":"2024-07-27T03:12:35.450430+0000","last_undegraded":"2024-07-27T03:12:35.450430+0000","last_fullsized":"2024-07-27T03:12:35.450430+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:36:43.268367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.451006+0000","last_change":"2024-07-27T03:12:33.431110+0000","last_active":"2024-07-27T03:12:35.451006+0000","last_peered":"2024-07-27T03:12:35.451006+0000","last_clean":"2024-07-27T03:12:35.451006+0000","last_became_active":"2024-07-27T03:12:33.430722+0000","last_became_peered":"2024-07-27T03:12:33.430722+0000","last_unstale":"2024-07-27T03:12:35.451006+0000","last_undegraded":"2024-07-27T03:12:35.451006+0000","last_fullsized":"2024-07-27T03:12:35.451006+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T10:05:36.025418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:36.186486+0000","last_change":"2024-07-27T03:12:34.463490+0000","last_active":"2024-07-27T03:12:36.186486+0000","last_peered":"2024-07-27T03:12:36.186486+0000","last_clean":"2024-07-27T03:12:36.186486+0000","last_became_active":"2024-07-27T03:12:34.463089+0000","last_became_peered":"2024-07-27T03:12:34.463089+0000","last_unstale":"2024-07-27T03:12:36.186486+0000","last_undegraded":"2024-07-27T03:12:36.186486+0000","last_fullsized":"2024-07-27T03:12:36.186486+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:33.405180+0000","last_clean_scrub_stamp":"2024-07-27T03:12:33.405180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T13:12:25.895869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.450785+0000","last_change":"2024-07-27T03:12:33.426523+0000","last_active":"2024-07-27T03:12:35.450785+0000","last_peered":"2024-07-27T03:12:35.450785+0000","last_clean":"2024-07-27T03:12:35.450785+0000","last_became_active":"2024-07-27T03:12:33.425623+0000","last_became_peered":"2024-07-27T03:12:33.425623+0000","last_unstale":"2024-07-27T03:12:35.450785+0000","last_undegraded":"2024-07-27T03:12:35.450785+0000","last_fullsized":"2024-07-27T03:12:35.450785+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:12:32.403527+0000","last_clean_scrub_stamp":"2024-07-27T03:12:32.403527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T08:40:30.913355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":196,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-07-27T03:12:35.784133+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:12:35.784133+0000","last_peered":"2024-07-27T03:12:35.784133+0000","last_clean":"2024-07-27T03:12:35.784133+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:12:35.784133+0000","last_undegraded":"2024-07-27T03:12:35.784133+0000","last_fullsized":"2024-07-27T03:12:35.784133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77000,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294840,"statfs":{"total":96636764160,"available":96557916160,"internally_reserved":0,"allocated":1433600,"data_stored":942035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45892,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325948,"statfs":{"total":96636764160,"available":96589770752,"internally_reserved":0,"allocated":835584,"data_stored":351141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50052,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321788,"statfs":{"total":96636764160,"available":96585510912,"internally_reserved":0,"allocated":839680,"data_stored":351163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40332,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331508,"statfs":{"total":96636764160,"available":96595464192,"internally_reserved":0,"allocated":843776,"data_stored":352663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509494,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54784,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317056,"statfs":{"total":96636764160,"available":96580665344,"internally_reserved":0,"allocated":1425408,"data_stored":941419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542198,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36160,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335680,"statfs":{"total":96636764160,"available":96599736320,"internally_reserved":0,"allocated":839680,"data_stored":351143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542198,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76416,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94295424,"statfs":{"total":96636764160,"available":96558514176,"internally_reserved":0,"allocated":835584,"data_stored":351121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40336,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331504,"statfs":{"total":96636764160,"available":96595460096,"internally_reserved":0,"allocated":851968,"data_stored":353279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:12:38.875 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-27T03:12:38.875 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-07-27T03:12:39.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.031+0000 7f6c5d976640 1 -- 172.21.15.120:0/955772583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c40004020 msgr2=0x7f6c40004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:39.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.031+0000 7f6c5d976640 1 --2- 172.21.15.120:0/955772583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c40004020 0x7f6c40004800 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c001eb0 tx=0x7f6c40005830 comp rx=0 tx=0).stop 2024-07-27T03:12:39.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.031+0000 7f6c577fe640 1 -- 172.21.15.120:0/955772583 reap_dead start 2024-07-27T03:12:39.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.031+0000 7f6c5d976640 1 -- 172.21.15.120:0/955772583 shutdown_connections 2024-07-27T03:12:39.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.031+0000 7f6c5d976640 1 -- 172.21.15.120:0/955772583 >> 172.21.15.120:0/955772583 conn(0x7f6c580d0df0 msgr2=0x7f6c580d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:39.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.031+0000 7f6c5d976640 1 -- 172.21.15.120:0/955772583 shutdown_connections 2024-07-27T03:12:39.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.031+0000 7f6c5d976640 1 -- 172.21.15.120:0/955772583 wait complete. 2024-07-27T03:12:39.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.033+0000 7f6c5d976640 1 Processor -- start 2024-07-27T03:12:39.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.033+0000 7f6c5d976640 1 -- start start 2024-07-27T03:12:39.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c5d976640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c40004020 0x7f6c580b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:39.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c5d976640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c58145f70 0x7f6c58146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:39.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c5d976640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c5814bfd0 0x7f6c5814c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:39.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c5d976640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6c580cee10 con 0x7f6c40004020 2024-07-27T03:12:39.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c5d976640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6c580cec90 con 0x7f6c58145f70 2024-07-27T03:12:39.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c5d976640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6c58156480 con 0x7f6c5814bfd0 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c56ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c40004020 0x7f6c580b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c56ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c40004020 0x7f6c580b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59158/0 (socket says 172.21.15.120:59158) 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c56ffd640 1 -- 172.21.15.120:0/4202227423 learned_addr learned my addr 172.21.15.120:0/4202227423 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c567fc640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c58145f70 0x7f6c58146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c577fe640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c5814bfd0 0x7f6c5814c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c56ffd640 1 -- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c5814bfd0 msgr2=0x7f6c5814c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c56ffd640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c5814bfd0 0x7f6c5814c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.034+0000 7f6c56ffd640 1 -- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c58145f70 msgr2=0x7f6c58146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.035+0000 7f6c56ffd640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c58145f70 0x7f6c58146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.035+0000 7f6c56ffd640 1 -- 172.21.15.120:0/4202227423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5814c920 con 0x7f6c40004020 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.035+0000 7f6c56ffd640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c40004020 0x7f6c580b52a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6c48011ae0 tx=0x7f6c48009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.035+0000 7f6c3ffff640 1 -- 172.21.15.120:0/4202227423 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800fcb0 con 0x7f6c40004020 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.035+0000 7f6c3ffff640 1 -- 172.21.15.120:0/4202227423 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c4800fe50 con 0x7f6c40004020 2024-07-27T03:12:39.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.035+0000 7f6c5d976640 1 -- 172.21.15.120:0/4202227423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c580b5bd0 con 0x7f6c40004020 2024-07-27T03:12:39.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.035+0000 7f6c3ffff640 1 -- 172.21.15.120:0/4202227423 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48004280 con 0x7f6c40004020 2024-07-27T03:12:39.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.035+0000 7f6c5d976640 1 -- 172.21.15.120:0/4202227423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c580b6190 con 0x7f6c40004020 2024-07-27T03:12:39.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.036+0000 7f6c5d976640 1 -- 172.21.15.120:0/4202227423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c58146ac0 con 0x7f6c40004020 2024-07-27T03:12:39.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.037+0000 7f6c3ffff640 1 -- 172.21.15.120:0/4202227423 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6c480035f0 con 0x7f6c40004020 2024-07-27T03:12:39.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.037+0000 7f6c3ffff640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c44077010 0x7f6c44079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:39.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.037+0000 7f6c3ffff640 1 -- 172.21.15.120:0/4202227423 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f6c480993f0 con 0x7f6c40004020 2024-07-27T03:12:39.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.038+0000 7f6c567fc640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c44077010 0x7f6c44079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:39.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.038+0000 7f6c567fc640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c44077010 0x7f6c44079520 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c033000 tx=0x7f6c4c02d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:39.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.042+0000 7f6c3ffff640 1 -- 172.21.15.120:0/4202227423 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6c480625f0 con 0x7f6c40004020 2024-07-27T03:12:39.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.293+0000 7f6c5d976640 1 -- 172.21.15.120:0/4202227423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6c5815d2a0 con 0x7f6c40004020 2024-07-27T03:12:39.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.296+0000 7f6c3ffff640 1 -- 172.21.15.120:0/4202227423 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f6c48061ef0 con 0x7f6c40004020 2024-07-27T03:12:39.299 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-07-27T03:12:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQB+ZKRmI8baMRAArCIL9NNNVlevij0JAWwGwg== 2024-07-27T03:12:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: caps mds = "allow" 2024-07-27T03:12:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: caps mon = "allow r" 2024-07-27T03:12:39.299 INFO:teuthology.orchestra.run.smithi120.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-07-27T03:12:39.299 INFO:teuthology.orchestra.run.smithi120.stderr:updated caps for client.0 2024-07-27T03:12:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 -- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c44077010 msgr2=0x7f6c44079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c44077010 0x7f6c44079520 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c033000 tx=0x7f6c4c02d000 comp rx=0 tx=0).stop 2024-07-27T03:12:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 -- 172.21.15.120:0/4202227423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c40004020 msgr2=0x7f6c580b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c40004020 0x7f6c580b52a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6c48011ae0 tx=0x7f6c48009f10 comp rx=0 tx=0).stop 2024-07-27T03:12:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 -- 172.21.15.120:0/4202227423 shutdown_connections 2024-07-27T03:12:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c44077010 0x7f6c44079520 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c5814bfd0 0x7f6c5814c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c58145f70 0x7f6c58146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 --2- 172.21.15.120:0/4202227423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c40004020 0x7f6c580b52a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 -- 172.21.15.120:0/4202227423 >> 172.21.15.120:0/4202227423 conn(0x7f6c580d0df0 msgr2=0x7f6c580c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:39.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 -- 172.21.15.120:0/4202227423 shutdown_connections 2024-07-27T03:12:39.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.298+0000 7f6c5d976640 1 -- 172.21.15.120:0/4202227423 wait complete. 2024-07-27T03:12:39.312 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:12:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.423+0000 7fb1dec91640 1 -- 172.21.15.120:0/733882130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1d80d27e0 msgr2=0x7fb1d80d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.423+0000 7fb1dec91640 1 --2- 172.21.15.120:0/733882130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1d80d27e0 0x7fb1d80d2bf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80b3b30 tx=0x7fb1c402a530 comp rx=0 tx=0).stop 2024-07-27T03:12:39.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.423+0000 7fb1dec91640 1 -- 172.21.15.120:0/733882130 shutdown_connections 2024-07-27T03:12:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.423+0000 7fb1dec91640 1 --2- 172.21.15.120:0/733882130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1d80d27e0 0x7fb1d80d2bf0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.423+0000 7fb1dec91640 1 --2- 172.21.15.120:0/733882130 >> v2:172.21.15.121:3300/0 conn(0x7fb1d80b4740 0x7fb1d80b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.423+0000 7fb1dec91640 1 -- 172.21.15.120:0/733882130 >> 172.21.15.120:0/733882130 conn(0x7fb1d808d690 msgr2=0x7fb1d809d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.423+0000 7fb1dec91640 1 -- 172.21.15.120:0/733882130 shutdown_connections 2024-07-27T03:12:39.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.423+0000 7fb1dec91640 1 -- 172.21.15.120:0/733882130 wait complete. 2024-07-27T03:12:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.425+0000 7fb1dec91640 1 Processor -- start 2024-07-27T03:12:39.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.425+0000 7fb1dec91640 1 -- start start 2024-07-27T03:12:39.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.426+0000 7fb1dec91640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1d80b4740 0x7fb1d815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:39.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.426+0000 7fb1dec91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1d80d09c0 0x7fb1d814a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:39.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.426+0000 7fb1dec91640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1d80d27e0 0x7fb1d814a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.426+0000 7fb1dec91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d80cef70 con 0x7fb1d80d09c0 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.426+0000 7fb1dec91640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d80cedf0 con 0x7fb1d80b4740 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.426+0000 7fb1dec91640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d80cf0f0 con 0x7fb1d80d27e0 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1d80d09c0 0x7fb1d814a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1d80d09c0 0x7fb1d814a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59186/0 (socket says 172.21.15.120:59186) 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d7fff640 1 -- 172.21.15.120:0/3727546366 learned_addr learned my addr 172.21.15.120:0/3727546366 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1dca2d640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1d80b4740 0x7fb1d815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1dd22e640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1d80d27e0 0x7fb1d814a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d7fff640 1 -- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1d80d27e0 msgr2=0x7fb1d814a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d7fff640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1d80d27e0 0x7fb1d814a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d7fff640 1 -- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1d80b4740 msgr2=0x7fb1d815c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d7fff640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1d80b4740 0x7fb1d815c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d7fff640 1 -- 172.21.15.120:0/3727546366 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d81f8bd0 con 0x7fb1d80d09c0 2024-07-27T03:12:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d7fff640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1d80d09c0 0x7fb1d814a380 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009780 tx=0x7fb1c4033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d57fa640 1 -- 172.21.15.120:0/3727546366 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4031d60 con 0x7fb1d80d09c0 2024-07-27T03:12:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d57fa640 1 -- 172.21.15.120:0/3727546366 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1c4005020 con 0x7fb1d80d09c0 2024-07-27T03:12:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1dec91640 1 -- 172.21.15.120:0/3727546366 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d81f8eb0 con 0x7fb1d80d09c0 2024-07-27T03:12:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1d57fa640 1 -- 172.21.15.120:0/3727546366 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4005470 con 0x7fb1d80d09c0 2024-07-27T03:12:39.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.427+0000 7fb1dec91640 1 -- 172.21.15.120:0/3727546366 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d81f9470 con 0x7fb1d80d09c0 2024-07-27T03:12:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.428+0000 7fb1dec91640 1 -- 172.21.15.120:0/3727546366 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d81f96b0 con 0x7fb1d80d09c0 2024-07-27T03:12:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.429+0000 7fb1d57fa640 1 -- 172.21.15.120:0/3727546366 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb1c40047a0 con 0x7fb1d80d09c0 2024-07-27T03:12:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.430+0000 7fb1d57fa640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb1bc077040 0x7fb1bc079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.430+0000 7fb1d57fa640 1 -- 172.21.15.120:0/3727546366 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fb1c40b9a40 con 0x7fb1d80d09c0 2024-07-27T03:12:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.430+0000 7fb1dca2d640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb1bc077040 0x7fb1bc079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.430+0000 7fb1dca2d640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb1bc077040 0x7fb1bc079550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00a490 tx=0x7fb1cc00a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:39.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.434+0000 7fb1d57fa640 1 -- 172.21.15.120:0/3727546366 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fb1c403f030 con 0x7fb1d80d09c0 2024-07-27T03:12:39.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.653+0000 7fb1dec91640 1 -- 172.21.15.120:0/3727546366 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1d80d2bf0 con 0x7fb1d80d09c0 2024-07-27T03:12:39.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.653+0000 7fb1d57fa640 1 -- 172.21.15.120:0/3727546366 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7fb1c40b9e20 con 0x7fb1d80d09c0 2024-07-27T03:12:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:39.657 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":66,"btime":"2024-07-27T03:12:37:453984+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2578460445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2578460445},{"type":"v1","addr":"172.21.15.120:6835","nonce":2578460445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":5489,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2998929726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2998929726},{"type":"v1","addr":"172.21.15.121:6836","nonce":2998929726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/3985484834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3985484834},{"type":"v1","addr":"172.21.15.120:6833","nonce":3985484834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:12:33.787428+0000","modified":"2024-07-27T03:12:36.823644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6159},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/7061533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":7061533},{"type":"v1","addr":"172.21.15.121:6837","nonce":7061533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6159,"qdb_cluster":[6159]},"id":5}]} 2024-07-27T03:12:39.657 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 66 2024-07-27T03:12:39.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 -- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb1bc077040 msgr2=0x7fb1bc079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:39.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb1bc077040 0x7fb1bc079550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00a490 tx=0x7fb1cc00a420 comp rx=0 tx=0).stop 2024-07-27T03:12:39.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 -- 172.21.15.120:0/3727546366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1d80d09c0 msgr2=0x7fb1d814a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:39.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1d80d09c0 0x7fb1d814a380 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009780 tx=0x7fb1c4033d60 comp rx=0 tx=0).stop 2024-07-27T03:12:39.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 -- 172.21.15.120:0/3727546366 shutdown_connections 2024-07-27T03:12:39.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fb1bc077040 0x7fb1bc079550 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1d80d09c0 0x7fb1d814a380 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1d80d27e0 0x7fb1d814a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 --2- 172.21.15.120:0/3727546366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1d80b4740 0x7fb1d815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:39.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 -- 172.21.15.120:0/3727546366 >> 172.21.15.120:0/3727546366 conn(0x7fb1d808d690 msgr2=0x7fb1d80cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:39.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 -- 172.21.15.120:0/3727546366 shutdown_connections 2024-07-27T03:12:39.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:39.656+0000 7fb1dec91640 1 -- 172.21.15.120:0/3727546366 wait complete. 2024-07-27T03:12:39.740 INFO:tasks.ceph.mds.b.smithi121.stderr:2024-07-27T03:12:39.738+0000 7ff1ae759640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-27T03:12:40.072 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:12:33.787428+0000', 'modified': '2024-07-27T03:12:36.823644+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6159}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6159': {'gid': 6159, 'name': 'b', 'rank': 0, 'incarnation': 62, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6837/7061533', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6835', 'nonce': 7061533}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 7061533}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6159, 'qdb_cluster': [6159]} 2024-07-27T03:12:40.072 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-27T03:12:40.072 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-07-27T03:12:40.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.190+0000 7f9d1f222640 1 -- 172.21.15.120:0/2465832803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18071cf0 msgr2=0x7f9d18074040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.190+0000 7f9d1f222640 1 --2- 172.21.15.120:0/2465832803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18071cf0 0x7f9d18074040 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9d08005fd0 tx=0x7f9d0802a540 comp rx=0 tx=0).stop 2024-07-27T03:12:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.190+0000 7f9d1f222640 1 -- 172.21.15.120:0/2465832803 shutdown_connections 2024-07-27T03:12:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.190+0000 7f9d1f222640 1 --2- 172.21.15.120:0/2465832803 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d180b4d30 0x7f9d18158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.190+0000 7f9d1f222640 1 --2- 172.21.15.120:0/2465832803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d18071cf0 0x7f9d18074040 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.190+0000 7f9d1f222640 1 -- 172.21.15.120:0/2465832803 >> 172.21.15.120:0/2465832803 conn(0x7f9d180d0f00 msgr2=0x7f9d180d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.190+0000 7f9d1f222640 1 -- 172.21.15.120:0/2465832803 shutdown_connections 2024-07-27T03:12:40.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.190+0000 7f9d1f222640 1 -- 172.21.15.120:0/2465832803 wait complete. 2024-07-27T03:12:40.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.192+0000 7f9d1f222640 1 Processor -- start 2024-07-27T03:12:40.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.192+0000 7f9d1f222640 1 -- start start 2024-07-27T03:12:40.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1f222640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d180b4d30 0x7f9d1814d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1f222640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d1815c500 0x7f9d18151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1f222640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d180c7280 0x7f9d18157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1f222640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9d180703e0 con 0x7f9d180c7280 2024-07-27T03:12:40.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1f222640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d18070260 con 0x7f9d1815c500 2024-07-27T03:12:40.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1f222640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9d18070560 con 0x7f9d180b4d30 2024-07-27T03:12:40.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1d7bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d180c7280 0x7f9d18157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1d7bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d180c7280 0x7f9d18157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59206/0 (socket says 172.21.15.120:59206) 2024-07-27T03:12:40.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1d7bf640 1 -- 172.21.15.120:0/693811016 learned_addr learned my addr 172.21.15.120:0/693811016 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:40.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d0ffff640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d1815c500 0x7f9d18151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d180b4d30 0x7f9d1814d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1d7bf640 1 -- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d180b4d30 msgr2=0x7f9d1814d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1d7bf640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d180b4d30 0x7f9d1814d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1d7bf640 1 -- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d1815c500 msgr2=0x7f9d18151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1d7bf640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d1815c500 0x7f9d18151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1d7bf640 1 -- 172.21.15.120:0/693811016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d180c61e0 con 0x7f9d180c7280 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1d7bf640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d180c7280 0x7f9d18157a10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000e990 tx=0x7f9d1000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d0d7fa640 1 -- 172.21.15.120:0/693811016 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10004d20 con 0x7f9d180c7280 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d0d7fa640 1 -- 172.21.15.120:0/693811016 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d1000cb00 con 0x7f9d180c7280 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d1f222640 1 -- 172.21.15.120:0/693811016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d180c64c0 con 0x7f9d180c7280 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.194+0000 7f9d0d7fa640 1 -- 172.21.15.120:0/693811016 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10005020 con 0x7f9d180c7280 2024-07-27T03:12:40.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.195+0000 7f9d1f222640 1 -- 172.21.15.120:0/693811016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d180c6a80 con 0x7f9d180c7280 2024-07-27T03:12:40.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.196+0000 7f9d0d7fa640 1 -- 172.21.15.120:0/693811016 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9d100051c0 con 0x7f9d180c7280 2024-07-27T03:12:40.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.197+0000 7f9d0d7fa640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9d04077040 0x7f9d04079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.197+0000 7f9d0d7fa640 1 -- 172.21.15.120:0/693811016 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f9d100990f0 con 0x7f9d180c7280 2024-07-27T03:12:40.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.197+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9d04077040 0x7f9d04079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.197+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9d04077040 0x7f9d04079550 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9d140015e0 tx=0x7f9d14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:40.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.197+0000 7f9d26212740 1 Processor -- start 2024-07-27T03:12:40.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.198+0000 7f9d26212740 1 -- start start 2024-07-27T03:12:40.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d26212740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a12679170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d26212740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a1265be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d26212740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1226b590 0x558a1265c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d26212740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558a125a4360 con 0x558a122633b0 2024-07-27T03:12:40.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d26212740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558a12593860 con 0x558a1228c270 2024-07-27T03:12:40.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d26212740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x558a125978a0 con 0x558a1226b590 2024-07-27T03:12:40.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a1265be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a1265be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59222/0 (socket says 172.21.15.120:59222) 2024-07-27T03:12:40.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d0ffff640 1 -- 172.21.15.120:0/3053384650 learned_addr learned my addr 172.21.15.120:0/3053384650 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:40.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d1d7bf640 1 --2- 172.21.15.120:0/3053384650 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1226b590 0x558a1265c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/3053384650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a12679170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d0ffff640 1 -- 172.21.15.120:0/3053384650 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1226b590 msgr2=0x558a1265c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d0ffff640 1 --2- 172.21.15.120:0/3053384650 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1226b590 0x558a1265c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d0ffff640 1 -- 172.21.15.120:0/3053384650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 msgr2=0x558a12679170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d0ffff640 1 --2- 172.21.15.120:0/3053384650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a12679170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d0ffff640 1 -- 172.21.15.120:0/3053384650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a12523360 con 0x558a122633b0 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.199+0000 7f9d0ffff640 1 --2- 172.21.15.120:0/3053384650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a1265be40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009230 tx=0x7f9d080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeaf8fb0d549dc8a server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9cfe7fc640 1 -- 172.21.15.120:0/3053384650 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08035040 con 0x558a122633b0 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9cfe7fc640 1 -- 172.21.15.120:0/3053384650 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d08004320 con 0x558a122633b0 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9cfe7fc640 1 -- 172.21.15.120:0/3053384650 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d080037f0 con 0x558a122633b0 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9d26212740 1 -- 172.21.15.120:0/3053384650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 msgr2=0x558a1265be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9d26212740 1 --2- 172.21.15.120:0/3053384650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a1265be40 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009230 tx=0x7f9d080046c0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9d26212740 1 -- 172.21.15.120:0/3053384650 shutdown_connections 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9d26212740 1 --2- 172.21.15.120:0/3053384650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a1265be40 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9d26212740 1 --2- 172.21.15.120:0/3053384650 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1226b590 0x558a1265c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9d26212740 1 --2- 172.21.15.120:0/3053384650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a12679170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9d26212740 1 -- 172.21.15.120:0/3053384650 >> 172.21.15.120:0/3053384650 conn(0x558a122803c0 msgr2=0x558a12632060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:40.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9d26212740 1 -- 172.21.15.120:0/3053384650 shutdown_connections 2024-07-27T03:12:40.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.200+0000 7f9d26212740 1 -- 172.21.15.120:0/3053384650 wait complete. 2024-07-27T03:12:40.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.201+0000 7f9d26212740 1 -- start start 2024-07-27T03:12:40.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.202+0000 7f9d26212740 1 Processor -- start 2024-07-27T03:12:40.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d26212740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a122633b0 0x558a12689f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d26212740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a1226b590 0x558a12685730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d26212740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a12685c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d26212740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558a12306620 con 0x558a1226b590 2024-07-27T03:12:40.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d26212740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558a1252f140 con 0x558a1228c270 2024-07-27T03:12:40.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d26212740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x558a12688970 con 0x558a122633b0 2024-07-27T03:12:40.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d26212740 10 client.0 _ll_register_callbacks cb 0x558a1258cc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:12:40.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a1226b590 0x558a12685730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a1226b590 0x558a12685730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59238/0 (socket says 172.21.15.120:59238) 2024-07-27T03:12:40.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d0ffff640 1 -- 172.21.15.120:0/1442440609 learned_addr learned my addr 172.21.15.120:0/1442440609 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:40.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a122633b0 0x558a12689f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d1d7bf640 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a12685c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d0ffff640 1 -- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a122633b0 msgr2=0x558a12689f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:40.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d0ffff640 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a122633b0 0x558a12689f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d0ffff640 1 -- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 msgr2=0x558a12685c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:40.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d0ffff640 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a12685c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d0ffff640 1 -- 172.21.15.120:0/1442440609 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a122f7850 con 0x558a1226b590 2024-07-27T03:12:40.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9d0ffff640 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a1226b590 0x558a12685730 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009230 tx=0x7f9d08004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0629a00d1847f7 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:40.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.203+0000 7f9cf77fe640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9cf77fe640 1 -- 172.21.15.120:0/1442440609 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08003a00 con 0x558a1226b590 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9cf77fe640 1 -- 172.21.15.120:0/1442440609 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f9d08003ba0 con 0x558a1226b590 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9d26212740 1 -- 172.21.15.120:0/1442440609 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d08004320 con 0x558a1226b590 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9cf77fe640 1 -- 172.21.15.120:0/1442440609 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f9d08058050 con 0x558a1226b590 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9d26212740 10 client.6279 fetch_fsmap learned FSMap version 66 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9d26212740 1 -- 172.21.15.120:0/1442440609 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x558a1236e6b0 con 0x558a1226b590 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9cf77fe640 1 -- 172.21.15.120:0/1442440609 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d08004320 con 0x558a1226b590 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9cf77fe640 1 -- 172.21.15.120:0/1442440609 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 66) ==== 3502+0+0 (secure 0 0 0) 0x7f9d0805b020 con 0x558a1226b590 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9d26212740 10 client.6279 fetch_fsmap finished waiting for FSMap version 66 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9d26212740 10 client.6279 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9d26212740 20 client.6279 populate_metadata read hostname 'smithi120' 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9d26212740 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x558a1224ae40 0x558a12687630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9d26212740 4 client.6279 mds_command: new command op to 6159 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9d26212740 1 -- 172.21.15.120:0/1442440609 --> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a125a62b0 con 0x558a1224ae40 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.204+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x558a1224ae40 0x558a12687630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.205+0000 7f9cf77fe640 10 client.6279 ms_handle_connect on v2:172.21.15.121:6835/7061533 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.205+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x558a1224ae40 0x558a12687630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4589ce831e8408cb server_cookie=83d7218bb25c679a in_seq=0 out_seq=0 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.205+0000 7f9cf77fe640 1 -- 172.21.15.120:0/1442440609 <== mds.0 v2:172.21.15.121:6835/7061533 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a125a62b0 con 0x558a1224ae40 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.205+0000 7f9cf77fe640 10 client.6279 handle_command_reply: tid=0 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 1 client.6279 shutdown 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 1 -- 172.21.15.120:0/1442440609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a1226b590 msgr2=0x558a12685730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a1226b590 0x558a12685730 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009230 tx=0x7f9d08004610 comp rx=0 tx=0).stop 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 1 -- 172.21.15.120:0/1442440609 shutdown_connections 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x558a1224ae40 0x558a12687630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a1226b590 0x558a12685730 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a12685c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9cf77fe640 0 client.6279 ms_handle_reset on v2:172.21.15.121:6835/7061533 2024-07-27T03:12:40.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 1 --2- 172.21.15.120:0/1442440609 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a122633b0 0x558a12689f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 1 -- 172.21.15.120:0/1442440609 >> 172.21.15.120:0/1442440609 conn(0x558a122803c0 msgr2=0x558a12677680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:40.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 1 -- 172.21.15.120:0/1442440609 shutdown_connections 2024-07-27T03:12:40.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 1 -- 172.21.15.120:0/1442440609 wait complete. 2024-07-27T03:12:40.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.206+0000 7f9d26212740 20 client.6279 trim_cache size 0 max 16384 2024-07-27T03:12:40.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.225+0000 7f9d26212740 1 Processor -- start 2024-07-27T03:12:40.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.225+0000 7f9d26212740 1 -- start start 2024-07-27T03:12:40.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d26212740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a12653a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d26212740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1226b590 0x558a12655030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d26212740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1228c270 0x558a1262b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d26212740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9d181feb30 con 0x558a122633b0 2024-07-27T03:12:40.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d26212740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d181f7310 con 0x558a1226b590 2024-07-27T03:12:40.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d26212740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9d18153e40 con 0x558a1228c270 2024-07-27T03:12:40.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d1cfbe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a12653a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d1cfbe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a12653a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59242/0 (socket says 172.21.15.120:59242) 2024-07-27T03:12:40.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d1cfbe640 1 -- 172.21.15.120:0/3338460310 learned_addr learned my addr 172.21.15.120:0/3338460310 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:40.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d1d7bf640 1 --2- 172.21.15.120:0/3338460310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1228c270 0x558a1262b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d1cfbe640 1 -- 172.21.15.120:0/3338460310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1228c270 msgr2=0x558a1262b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:40.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d0ffff640 1 --2- 172.21.15.120:0/3338460310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1226b590 0x558a12655030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/3338460310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1228c270 0x558a1262b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d1cfbe640 1 -- 172.21.15.120:0/3338460310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1226b590 msgr2=0x558a12655030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:40.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/3338460310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1226b590 0x558a12655030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.226+0000 7f9d1cfbe640 1 -- 172.21.15.120:0/3338460310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a12678480 con 0x558a122633b0 2024-07-27T03:12:40.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/3338460310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a12653a40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9d14005250 tx=0x7f9d14012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fde78630deb2033 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9cfdffb640 1 -- 172.21.15.120:0/3338460310 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400e4b0 con 0x558a122633b0 2024-07-27T03:12:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9cfdffb640 1 -- 172.21.15.120:0/3338460310 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d1400e740 con 0x558a122633b0 2024-07-27T03:12:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9cfdffb640 1 -- 172.21.15.120:0/3338460310 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400e950 con 0x558a122633b0 2024-07-27T03:12:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9d26212740 1 -- 172.21.15.120:0/3338460310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 msgr2=0x558a12653a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9d26212740 1 --2- 172.21.15.120:0/3338460310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a12653a40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9d14005250 tx=0x7f9d14012000 comp rx=0 tx=0).stop 2024-07-27T03:12:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9d26212740 1 -- 172.21.15.120:0/3338460310 shutdown_connections 2024-07-27T03:12:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9d26212740 1 --2- 172.21.15.120:0/3338460310 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1228c270 0x558a1262b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9d26212740 1 --2- 172.21.15.120:0/3338460310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1226b590 0x558a12655030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9d26212740 1 --2- 172.21.15.120:0/3338460310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a12653a40 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9d26212740 1 -- 172.21.15.120:0/3338460310 >> 172.21.15.120:0/3338460310 conn(0x558a122803c0 msgr2=0x558a1269a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:40.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9d26212740 1 -- 172.21.15.120:0/3338460310 shutdown_connections 2024-07-27T03:12:40.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.227+0000 7f9d26212740 1 -- 172.21.15.120:0/3338460310 wait complete. 2024-07-27T03:12:40.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.228+0000 7f9d26212740 1 -- start start 2024-07-27T03:12:40.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.229+0000 7f9d26212740 1 Processor -- start 2024-07-27T03:12:40.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d26212740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a126e9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d26212740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1226b590 0x558a126f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d26212740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a1268fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d26212740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558a12631ca0 con 0x558a122633b0 2024-07-27T03:12:40.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d26212740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558a12686e00 con 0x558a1228c270 2024-07-27T03:12:40.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d26212740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x558a12654170 con 0x558a1226b590 2024-07-27T03:12:40.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d26212740 10 client.0 _ll_register_callbacks cb 0x7f9d080053a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:12:40.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d1cfbe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a126e9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d1cfbe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a126e9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59258/0 (socket says 172.21.15.120:59258) 2024-07-27T03:12:40.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d1cfbe640 1 -- 172.21.15.120:0/3950303464 learned_addr learned my addr 172.21.15.120:0/3950303464 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d0ffff640 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1226b590 0x558a126f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d1d7bf640 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a1268fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d1cfbe640 1 -- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1226b590 msgr2=0x558a126f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1226b590 0x558a126f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d1cfbe640 1 -- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 msgr2=0x558a1268fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a1268fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d1cfbe640 1 -- 172.21.15.120:0/3950303464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a126796b0 con 0x558a122633b0 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9d1cfbe640 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a126e9ed0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9d14005540 tx=0x7f9d1400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b34ae5ad2ac848 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9cf77fe640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9cf77fe640 1 -- 172.21.15.120:0/3950303464 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400ed40 con 0x558a122633b0 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.230+0000 7f9cf77fe640 1 -- 172.21.15.120:0/3950303464 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f9d14010070 con 0x558a122633b0 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9d26212740 1 -- 172.21.15.120:0/3950303464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d1400e740 con 0x558a122633b0 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9cf77fe640 1 -- 172.21.15.120:0/3950303464 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f9d14025430 con 0x558a122633b0 2024-07-27T03:12:40.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9d26212740 10 client.6285 fetch_fsmap learned FSMap version 66 2024-07-27T03:12:40.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9d26212740 1 -- 172.21.15.120:0/3950303464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x558a126f6de0 con 0x558a122633b0 2024-07-27T03:12:40.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9cf77fe640 1 -- 172.21.15.120:0/3950303464 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d1400e740 con 0x558a122633b0 2024-07-27T03:12:40.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9cf77fe640 1 -- 172.21.15.120:0/3950303464 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 66) ==== 3502+0+0 (secure 0 0 0) 0x7f9d140255d0 con 0x558a122633b0 2024-07-27T03:12:40.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9d26212740 10 client.6285 fetch_fsmap finished waiting for FSMap version 66 2024-07-27T03:12:40.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9d26212740 10 client.6285 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-27T03:12:40.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9d26212740 20 client.6285 populate_metadata read hostname 'smithi120' 2024-07-27T03:12:40.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9d26212740 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x558a126873f0 0x558a12687800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9d26212740 4 client.6285 mds_command: new command op to 6159 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:12:40.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9d26212740 1 -- 172.21.15.120:0/3950303464 --> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] -- command(tid 0: {"prefix": "status"}) -- 0x558a125a1d50 con 0x558a126873f0 2024-07-27T03:12:40.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.231+0000 7f9d0ffff640 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x558a126873f0 0x558a12687800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d0ffff640 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x558a126873f0 0x558a12687800 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60cdadb53b5980dc server_cookie=ccbf0ef6f3e61ae8 in_seq=0 out_seq=0 2024-07-27T03:12:40.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9cf77fe640 10 client.6285 ms_handle_connect on v2:172.21.15.121:6835/7061533 2024-07-27T03:12:40.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9cf77fe640 1 -- 172.21.15.120:0/3950303464 <== mds.0 v2:172.21.15.121:6835/7061533 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558a125a1d50 con 0x558a126873f0 2024-07-27T03:12:40.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9cf77fe640 10 client.6285 handle_command_reply: tid=0 2024-07-27T03:12:40.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 1 client.6285 shutdown 2024-07-27T03:12:40.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 1 -- 172.21.15.120:0/3950303464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 msgr2=0x558a126e9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a126e9ed0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9d14005540 tx=0x7f9d1400e570 comp rx=0 tx=0).stop 2024-07-27T03:12:40.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 1 -- 172.21.15.120:0/3950303464 shutdown_connections 2024-07-27T03:12:40.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558a1228c270 0x558a1268fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x558a1226b590 0x558a126f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x558a126873f0 0x558a12687800 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 1 --2- 172.21.15.120:0/3950303464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558a122633b0 0x558a126e9ed0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9cf77fe640 0 client.6285 ms_handle_reset on v2:172.21.15.121:6835/7061533 2024-07-27T03:12:40.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 1 -- 172.21.15.120:0/3950303464 >> 172.21.15.120:0/3950303464 conn(0x558a122803c0 msgr2=0x558a12688d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:40.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 1 -- 172.21.15.120:0/3950303464 shutdown_connections 2024-07-27T03:12:40.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 1 -- 172.21.15.120:0/3950303464 wait complete. 2024-07-27T03:12:40.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.232+0000 7f9d26212740 20 client.6285 trim_cache size 0 max 16384 2024-07-27T03:12:40.249 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:12:40.249 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:12:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-07-27T03:12:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 6159, 2024-07-27T03:12:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:12:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:12:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:12:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 5.8041325349999999, 2024-07-27T03:12:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 66, 2024-07-27T03:12:40.250 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 69, 2024-07-27T03:12:40.251 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 69, 2024-07-27T03:12:40.251 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 11.107884500000001 2024-07-27T03:12:40.251 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:12:40.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 -- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9d04077040 msgr2=0x7f9d04079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9d04077040 0x7f9d04079550 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9d140015e0 tx=0x7f9d14009040 comp rx=0 tx=0).stop 2024-07-27T03:12:40.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 -- 172.21.15.120:0/693811016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d180c7280 msgr2=0x7f9d18157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d180c7280 0x7f9d18157a10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000e990 tx=0x7f9d1000ee50 comp rx=0 tx=0).stop 2024-07-27T03:12:40.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 -- 172.21.15.120:0/693811016 shutdown_connections 2024-07-27T03:12:40.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9d04077040 0x7f9d04079550 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d180c7280 0x7f9d18157a10 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d1815c500 0x7f9d18151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 --2- 172.21.15.120:0/693811016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d180b4d30 0x7f9d1814d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 -- 172.21.15.120:0/693811016 >> 172.21.15.120:0/693811016 conn(0x7f9d180d0f00 msgr2=0x7f9d1806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:40.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 -- 172.21.15.120:0/693811016 shutdown_connections 2024-07-27T03:12:40.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.233+0000 7f9d1f222640 1 -- 172.21.15.120:0/693811016 wait complete. 2024-07-27T03:12:40.255 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-27T03:12:40.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.366+0000 7f4d8c65a640 1 -- 172.21.15.120:0/716178334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d840b5cd0 msgr2=0x7f4d840b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.366+0000 7f4d8c65a640 1 --2- 172.21.15.120:0/716178334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d840b5cd0 0x7f4d840b60e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4d840727b0 tx=0x7f4d7402a560 comp rx=0 tx=0).stop 2024-07-27T03:12:40.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.367+0000 7f4d8c65a640 1 -- 172.21.15.120:0/716178334 shutdown_connections 2024-07-27T03:12:40.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.367+0000 7f4d8c65a640 1 --2- 172.21.15.120:0/716178334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d840b5cd0 0x7f4d840b60e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.367+0000 7f4d8c65a640 1 --2- 172.21.15.120:0/716178334 >> v2:172.21.15.121:3300/0 conn(0x7f4d8415c220 0x7f4d84152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.367+0000 7f4d8c65a640 1 -- 172.21.15.120:0/716178334 >> 172.21.15.120:0/716178334 conn(0x7f4d8406cba0 msgr2=0x7f4d8406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:40.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.367+0000 7f4d8c65a640 1 -- 172.21.15.120:0/716178334 shutdown_connections 2024-07-27T03:12:40.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.367+0000 7f4d8c65a640 1 -- 172.21.15.120:0/716178334 wait complete. 2024-07-27T03:12:40.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.368+0000 7f4d8c65a640 1 Processor -- start 2024-07-27T03:12:40.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.368+0000 7f4d8c65a640 1 -- start start 2024-07-27T03:12:40.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8c65a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d840b5cd0 0x7f4d84143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8c65a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d8415c220 0x7f4d841553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8c65a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d8415ec20 0x7f4d8414e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8c65a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4d840cdb10 con 0x7f4d8415ec20 2024-07-27T03:12:40.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8c65a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4d840cd990 con 0x7f4d8415c220 2024-07-27T03:12:40.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8c65a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f4d840cdc90 con 0x7f4d840b5cd0 2024-07-27T03:12:40.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8abf7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d8415ec20 0x7f4d8414e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8abf7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d8415ec20 0x7f4d8414e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59266/0 (socket says 172.21.15.120:59266) 2024-07-27T03:12:40.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8abf7640 1 -- 172.21.15.120:0/1794853174 learned_addr learned my addr 172.21.15.120:0/1794853174 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8a3f6640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d840b5cd0 0x7f4d84143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d89bf5640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d8415c220 0x7f4d841553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8abf7640 1 -- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d840b5cd0 msgr2=0x7f4d84143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8abf7640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d840b5cd0 0x7f4d84143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8abf7640 1 -- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d8415c220 msgr2=0x7f4d841553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8abf7640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d8415c220 0x7f4d841553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8abf7640 1 -- 172.21.15.120:0/1794853174 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8414c970 con 0x7f4d8415ec20 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8abf7640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d8415ec20 0x7f4d8414e5f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00c760 tx=0x7f4d7c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d7affd640 1 -- 172.21.15.120:0/1794853174 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c003b70 con 0x7f4d8415ec20 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d7affd640 1 -- 172.21.15.120:0/1794853174 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d7c003d10 con 0x7f4d8415ec20 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d8c65a640 1 -- 172.21.15.120:0/1794853174 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8414cc50 con 0x7f4d8415ec20 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.370+0000 7f4d7affd640 1 -- 172.21.15.120:0/1794853174 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c005330 con 0x7f4d8415ec20 2024-07-27T03:12:40.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.371+0000 7f4d8c65a640 1 -- 172.21.15.120:0/1794853174 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d841f6240 con 0x7f4d8415ec20 2024-07-27T03:12:40.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.371+0000 7f4d8c65a640 1 -- 172.21.15.120:0/1794853174 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d840ce1b0 con 0x7f4d8415ec20 2024-07-27T03:12:40.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.372+0000 7f4d7affd640 1 -- 172.21.15.120:0/1794853174 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4d7c0054d0 con 0x7f4d8415ec20 2024-07-27T03:12:40.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.373+0000 7f4d7affd640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4d68077010 0x7f4d68079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.373+0000 7f4d7affd640 1 -- 172.21.15.120:0/1794853174 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f4d7c098600 con 0x7f4d8415ec20 2024-07-27T03:12:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.373+0000 7f4d8a3f6640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4d68077010 0x7f4d68079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:40.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.373+0000 7f4d8a3f6640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4d68077010 0x7f4d68079520 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4d84159220 tx=0x7f4d8000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:40.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.377+0000 7f4d7affd640 1 -- 172.21.15.120:0/1794853174 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f4d840b6620 con 0x7f4d8415ec20 2024-07-27T03:12:40.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.598+0000 7f4d8c65a640 1 -- 172.21.15.120:0/1794853174 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4d84140a20 con 0x7f4d8415ec20 2024-07-27T03:12:40.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.598+0000 7f4d7affd640 1 -- 172.21.15.120:0/1794853174 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) ==== 53+0+73 (secure 0 0 0) 0x7f4d7c0611b0 con 0x7f4d8415ec20 2024-07-27T03:12:40.601 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-27T03:12:40.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 -- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4d68077010 msgr2=0x7f4d68079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4d68077010 0x7f4d68079520 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4d84159220 tx=0x7f4d8000b2e0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 -- 172.21.15.120:0/1794853174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d8415ec20 msgr2=0x7f4d8414e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:40.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d8415ec20 0x7f4d8414e5f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00c760 tx=0x7f4d7c00cb60 comp rx=0 tx=0).stop 2024-07-27T03:12:40.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 -- 172.21.15.120:0/1794853174 shutdown_connections 2024-07-27T03:12:40.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4d68077010 0x7f4d68079520 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4d8415ec20 0x7f4d8414e5f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d8415c220 0x7f4d841553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 --2- 172.21.15.120:0/1794853174 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4d840b5cd0 0x7f4d84143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:40.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 -- 172.21.15.120:0/1794853174 >> 172.21.15.120:0/1794853174 conn(0x7f4d8406cba0 msgr2=0x7f4d840b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:40.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 -- 172.21.15.120:0/1794853174 shutdown_connections 2024-07-27T03:12:40.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40.600+0000 7f4d8c65a640 1 -- 172.21.15.120:0/1794853174 wait complete. 2024-07-27T03:12:40.614 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-07-27T03:12:40.614 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-27T03:12:40.614 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-07-27T03:12:40.615 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-07-27T03:12:40.615 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-27T03:12:40.615 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-07-27T03:12:40.615 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-07-27T03:12:40.615 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-27T03:12:40.615 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:12:40.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:40.615 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-07-27T03:12:40.631 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-27T03:12:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-27T03:12:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-07-27T03:12:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:12:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-07-27T03:12:40.631 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-27T03:12:40.632 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42516sec preferred_lft 42516sec 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 1a:04:15:6c:cf:e1 brd ff:ff:ff:ff:ff:ff 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::d44a:78ff:feef:fe4e/64 scope link 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether d2:ac:2a:c4:e4:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::d0ac:2aff:fec4:e45e/64 scope link 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-27T03:12:40.633 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 1a:04:15:6c:cf:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-07-27T03:12:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::1804:15ff:fe6c:cfe1/64 scope link 2024-07-27T03:12:40.634 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-07-27T03:12:40.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:40.634 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-27T03:12:40.695 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-07-27T03:12:40.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:40.696 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-07-27T03:12:40.752 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-07-27T03:12:40.752 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-27T03:12:40.752 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-27T03:12:40.752 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-27T03:12:40.753 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-27T03:12:40.753 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-27T03:12:40.753 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-07-27T03:12:40.753 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-27T03:12:40.753 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-27T03:12:40.753 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-27T03:12:40.753 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-07-27T03:12:40.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-27T03:12:40.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:40.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:40.879 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-07-27T03:12:40.894 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-07-27T03:12:40.894 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-27T03:12:40.895 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:12:40.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:40.895 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-07-27T03:12:40.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:12:40.959 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-07-27T03:12:41.015 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-07-27T03:12:41.015 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-27T03:12:41.015 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-07-27T03:12:41.070 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-07-27T03:12:41.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:41.071 DEBUG:teuthology.orchestra.run.smithi120:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:12:41.106 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:12:41.113 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:12:41.165 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:12:41.165 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:12:41.175 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-07-27T03:12:41.175 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-07-27T03:12:41.175 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.121:3300,172.21.15.121:3301" 2024-07-27T03:12:41.175 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: trying mount with new device syntax: 0@81c6fc84-d59a-4d77-bf87-f698cf0d6963.cephfs=/ 2024-07-27T03:12:41.176 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.120:3300/172.21.15.121:3300/172.21.15.121:3301" will pass to kernel 2024-07-27T03:12:41.176 INFO:teuthology.orchestra.run.smithi120.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-07-27T03:12:41.176 INFO:teuthology.orchestra.run.smithi120.stdout: You just mounted a file system that supports labels which does not 2024-07-27T03:12:41.176 INFO:teuthology.orchestra.run.smithi120.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-27T03:12:41.176 INFO:teuthology.orchestra.run.smithi120.stdout: applications will generate AVC messages and not be allowed access to 2024-07-27T03:12:41.176 INFO:teuthology.orchestra.run.smithi120.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-27T03:12:41.176 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-27T03:12:41.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:41.177 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-07-27T03:12:41.241 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-27T03:12:41.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:12:41.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:41.344 INFO:teuthology.orchestra.run.smithi120.stdout:client6294 2024-07-27T03:12:41.344 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:12:41.344 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:12:41.360 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-07-27T03:12:41.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.515+0000 7f8d266eb640 1 -- 172.21.15.120:0/2473912335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d2015eb40 msgr2=0x7f8d2015ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:41.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.515+0000 7f8d266eb640 1 --2- 172.21.15.120:0/2473912335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d2015eb40 0x7f8d2015ef50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8d18005fd0 tx=0x7f8d1802a840 comp rx=0 tx=0).stop 2024-07-27T03:12:41.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.515+0000 7f8d266eb640 1 -- 172.21.15.120:0/2473912335 shutdown_connections 2024-07-27T03:12:41.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.515+0000 7f8d266eb640 1 --2- 172.21.15.120:0/2473912335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d2015eb40 0x7f8d2015ef50 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:41.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.515+0000 7f8d266eb640 1 --2- 172.21.15.120:0/2473912335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8d2006e270 0x7f8d201554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:41.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.515+0000 7f8d266eb640 1 -- 172.21.15.120:0/2473912335 >> 172.21.15.120:0/2473912335 conn(0x7f8d200b1a10 msgr2=0x7f8d200b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:41.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.515+0000 7f8d266eb640 1 -- 172.21.15.120:0/2473912335 shutdown_connections 2024-07-27T03:12:41.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.515+0000 7f8d266eb640 1 -- 172.21.15.120:0/2473912335 wait complete. 2024-07-27T03:12:41.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.517+0000 7f8d266eb640 1 Processor -- start 2024-07-27T03:12:41.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.517+0000 7f8d266eb640 1 -- start start 2024-07-27T03:12:41.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.518+0000 7f8d266eb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d2006e270 0x7f8d2013ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:41.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.518+0000 7f8d266eb640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8d20073710 0x7f8d20141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:41.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.518+0000 7f8d266eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d2015eb40 0x7f8d20141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:41.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.518+0000 7f8d266eb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2015f820 con 0x7f8d2015eb40 2024-07-27T03:12:41.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.518+0000 7f8d266eb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2015f6a0 con 0x7f8d2006e270 2024-07-27T03:12:41.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.518+0000 7f8d266eb640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8d200b4fa0 con 0x7f8d20073710 2024-07-27T03:12:41.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.518+0000 7f8d24c88640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d2015eb40 0x7f8d20141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.518+0000 7f8d24c88640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d2015eb40 0x7f8d20141f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59288/0 (socket says 172.21.15.120:59288) 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.518+0000 7f8d24c88640 1 -- 172.21.15.120:0/1380164106 learned_addr learned my addr 172.21.15.120:0/1380164106 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.518+0000 7f8d1ffff640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d2006e270 0x7f8d2013ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.518+0000 7f8d1f7fe640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8d20073710 0x7f8d20141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d24c88640 1 -- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8d20073710 msgr2=0x7f8d20141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d24c88640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8d20073710 0x7f8d20141a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d24c88640 1 -- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d2006e270 msgr2=0x7f8d2013ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d24c88640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d2006e270 0x7f8d2013ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d24c88640 1 -- 172.21.15.120:0/1380164106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2015b280 con 0x7f8d2015eb40 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d1f7fe640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8d20073710 0x7f8d20141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d1ffff640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d2006e270 0x7f8d2013ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d24c88640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d2015eb40 0x7f8d20141f70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8d18035040 tx=0x7f8d18032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:41.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d1cff9640 1 -- 172.21.15.120:0/1380164106 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18037050 con 0x7f8d2015eb40 2024-07-27T03:12:41.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d1cff9640 1 -- 172.21.15.120:0/1380164106 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d18043070 con 0x7f8d2015eb40 2024-07-27T03:12:41.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d266eb640 1 -- 172.21.15.120:0/1380164106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2013f8c0 con 0x7f8d2015eb40 2024-07-27T03:12:41.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d1cff9640 1 -- 172.21.15.120:0/1380164106 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d180045d0 con 0x7f8d2015eb40 2024-07-27T03:12:41.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.519+0000 7f8d266eb640 1 -- 172.21.15.120:0/1380164106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d2013fe80 con 0x7f8d2015eb40 2024-07-27T03:12:41.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.520+0000 7f8d266eb640 1 -- 172.21.15.120:0/1380164106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d20142550 con 0x7f8d2015eb40 2024-07-27T03:12:41.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.521+0000 7f8d1cff9640 1 -- 172.21.15.120:0/1380164106 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8d1803e450 con 0x7f8d2015eb40 2024-07-27T03:12:41.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.521+0000 7f8d1cff9640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8d0c077010 0x7f8d0c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:41.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.521+0000 7f8d1cff9640 1 -- 172.21.15.120:0/1380164106 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f8d180b9800 con 0x7f8d2015eb40 2024-07-27T03:12:41.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.521+0000 7f8d1ffff640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8d0c077010 0x7f8d0c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:41.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.522+0000 7f8d1ffff640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8d0c077010 0x7f8d0c079520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009ab0 tx=0x7f8d10005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:41.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.526+0000 7f8d1cff9640 1 -- 172.21.15.120:0/1380164106 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f8d18082a00 con 0x7f8d2015eb40 2024-07-27T03:12:41.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:41.746+0000 7f8d266eb640 1 -- 172.21.15.120:0/1380164106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f8d201554a0 con 0x7f8d2015eb40 2024-07-27T03:12:42.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.475+0000 7f8d1cff9640 1 -- 172.21.15.120:0/1380164106 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v67) ==== 105+0+0 (secure 0 0 0) 0x7f8d18082300 con 0x7f8d2015eb40 2024-07-27T03:12:42.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 -- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8d0c077010 msgr2=0x7f8d0c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:42.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8d0c077010 0x7f8d0c079520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009ab0 tx=0x7f8d10005f90 comp rx=0 tx=0).stop 2024-07-27T03:12:42.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 -- 172.21.15.120:0/1380164106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d2015eb40 msgr2=0x7f8d20141f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:42.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d2015eb40 0x7f8d20141f70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8d18035040 tx=0x7f8d18032bc0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 -- 172.21.15.120:0/1380164106 shutdown_connections 2024-07-27T03:12:42.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8d0c077010 0x7f8d0c079520 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d2015eb40 0x7f8d20141f70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8d20073710 0x7f8d20141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 --2- 172.21.15.120:0/1380164106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d2006e270 0x7f8d2013ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 -- 172.21.15.120:0/1380164106 >> 172.21.15.120:0/1380164106 conn(0x7f8d200b1a10 msgr2=0x7f8d20073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:42.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 -- 172.21.15.120:0/1380164106 shutdown_connections 2024-07-27T03:12:42.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.478+0000 7f8d266eb640 1 -- 172.21.15.120:0/1380164106 wait complete. 2024-07-27T03:12:42.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:12:42.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.607+0000 7f778988b640 1 -- 172.21.15.120:0/596383695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77841522e0 msgr2=0x7f778406e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:42.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.607+0000 7f778988b640 1 --2- 172.21.15.120:0/596383695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77841522e0 0x7f778406e270 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7774009830 tx=0x7f777402a530 comp rx=0 tx=0).stop 2024-07-27T03:12:42.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.607+0000 7f778988b640 1 -- 172.21.15.120:0/596383695 shutdown_connections 2024-07-27T03:12:42.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.607+0000 7f778988b640 1 --2- 172.21.15.120:0/596383695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77841522e0 0x7f778406e270 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.607+0000 7f778988b640 1 -- 172.21.15.120:0/596383695 >> 172.21.15.120:0/596383695 conn(0x7f77840b1a10 msgr2=0x7f77840b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:42.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.607+0000 7f778988b640 1 -- 172.21.15.120:0/596383695 shutdown_connections 2024-07-27T03:12:42.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.607+0000 7f778988b640 1 -- 172.21.15.120:0/596383695 wait complete. 2024-07-27T03:12:42.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.609+0000 7f778988b640 1 Processor -- start 2024-07-27T03:12:42.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.609+0000 7f778988b640 1 -- start start 2024-07-27T03:12:42.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.610+0000 7f778988b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77840733e0 0x7f7784146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:42.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f778988b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7784073f00 0x7f77841f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f778988b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77841522e0 0x7f77841f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f778988b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f778415f6b0 con 0x7f77840733e0 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f778988b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f778415f530 con 0x7f77841522e0 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f778988b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f778415f830 con 0x7f7784073f00 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7782ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77840733e0 0x7f7784146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7782ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77840733e0 0x7f7784146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44666/0 (socket says 172.21.15.120:44666) 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7782ffd640 1 -- 172.21.15.120:0/406884243 learned_addr learned my addr 172.21.15.120:0/406884243 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f77837fe640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77841522e0 0x7f77841f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f777a7fc640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7784073f00 0x7f77841f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7782ffd640 1 -- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7784073f00 msgr2=0x7f77841f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7782ffd640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7784073f00 0x7f77841f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7782ffd640 1 -- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77841522e0 msgr2=0x7f77841f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:42.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7782ffd640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77841522e0 0x7f77841f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7782ffd640 1 -- 172.21.15.120:0/406884243 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77841f7590 con 0x7f77840733e0 2024-07-27T03:12:42.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7782ffd640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77840733e0 0x7f7784146610 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7774000c00 tx=0x7f7774033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:42.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7780ff9640 1 -- 172.21.15.120:0/406884243 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7774031d60 con 0x7f77840733e0 2024-07-27T03:12:42.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f778988b640 1 -- 172.21.15.120:0/406884243 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77841f7870 con 0x7f77840733e0 2024-07-27T03:12:42.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7780ff9640 1 -- 172.21.15.120:0/406884243 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77740330d0 con 0x7f77840733e0 2024-07-27T03:12:42.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f7780ff9640 1 -- 172.21.15.120:0/406884243 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7774033520 con 0x7f77840733e0 2024-07-27T03:12:42.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.611+0000 7f778988b640 1 -- 172.21.15.120:0/406884243 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7784145e10 con 0x7f77840733e0 2024-07-27T03:12:42.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.613+0000 7f778988b640 1 -- 172.21.15.120:0/406884243 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f778406e270 con 0x7f77840733e0 2024-07-27T03:12:42.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.613+0000 7f7780ff9640 1 -- 172.21.15.120:0/406884243 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f77740035f0 con 0x7f77840733e0 2024-07-27T03:12:42.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.613+0000 7f7780ff9640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7764077010 0x7f7764079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:42.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.613+0000 7f7780ff9640 1 -- 172.21.15.120:0/406884243 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f77740b9e00 con 0x7f77840733e0 2024-07-27T03:12:42.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.614+0000 7f777a7fc640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7764077010 0x7f7764079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:42.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.614+0000 7f777a7fc640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7764077010 0x7f7764079520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f778414a1b0 tx=0x7f776c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:42.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.618+0000 7f7780ff9640 1 -- 172.21.15.120:0/406884243 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f777403f030 con 0x7f77840733e0 2024-07-27T03:12:42.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.835+0000 7f778988b640 1 -- 172.21.15.120:0/406884243 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77840d0a70 con 0x7f77840733e0 2024-07-27T03:12:42.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.836+0000 7f7780ff9640 1 -- 172.21.15.120:0/406884243 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5244 (secure 0 0 0) 0x7f777408b250 con 0x7f77840733e0 2024-07-27T03:12:42.838 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:42.839 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":68,"btime":"2024-07-27T03:12:42:478794+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2578460445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2578460445},{"type":"v1","addr":"172.21.15.120:6835","nonce":2578460445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":5489,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6836/2998929726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2998929726},{"type":"v1","addr":"172.21.15.121:6836","nonce":2998929726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:12:33.787428+0000","modified":"2024-07-27T03:12:42.478774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":6159,"mds_1":6144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6144":{"gid":6144,"name":"c","rank":1,"incarnation":68,"state":"up:creating","state_seq":1,"addr":"172.21.15.120:6833/3985484834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3985484834},{"type":"v1","addr":"172.21.15.120:6833","nonce":3985484834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/7061533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":7061533},{"type":"v1","addr":"172.21.15.121:6837","nonce":7061533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6159,"qdb_cluster":[6159]},"id":5}]} 2024-07-27T03:12:42.839 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 68 2024-07-27T03:12:42.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 -- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7764077010 msgr2=0x7f7764079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:42.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7764077010 0x7f7764079520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f778414a1b0 tx=0x7f776c009040 comp rx=0 tx=0).stop 2024-07-27T03:12:42.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 -- 172.21.15.120:0/406884243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77840733e0 msgr2=0x7f7784146610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:42.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77840733e0 0x7f7784146610 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7774000c00 tx=0x7f7774033d60 comp rx=0 tx=0).stop 2024-07-27T03:12:42.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 -- 172.21.15.120:0/406884243 shutdown_connections 2024-07-27T03:12:42.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f7764077010 0x7f7764079520 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77841522e0 0x7f77841f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7784073f00 0x7f77841f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 --2- 172.21.15.120:0/406884243 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77840733e0 0x7f7784146610 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:42.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 -- 172.21.15.120:0/406884243 >> 172.21.15.120:0/406884243 conn(0x7f77840b1a10 msgr2=0x7f778415def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:42.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 -- 172.21.15.120:0/406884243 shutdown_connections 2024-07-27T03:12:42.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:42.838+0000 7f778988b640 1 -- 172.21.15.120:0/406884243 wait complete. 2024-07-27T03:12:43.254 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:12:33.787428+0000', 'modified': '2024-07-27T03:12:42.478774+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 6159, 'mds_1': 6144}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6144': {'gid': 6144, 'name': 'c', 'rank': 1, 'incarnation': 68, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.120:6833/3985484834', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6832', 'nonce': 3985484834}, {'type': 'v1', 'addr': '172.21.15.120:6833', 'nonce': 3985484834}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6159': {'gid': 6159, 'name': 'b', 'rank': 0, 'incarnation': 62, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6837/7061533', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6835', 'nonce': 7061533}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 7061533}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6159, 'qdb_cluster': [6159]} 2024-07-27T03:12:43.255 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6144:up:creating 2024-07-27T03:12:44.256 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:12:44.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.380+0000 7ff77a842640 1 -- 172.21.15.120:0/731839977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff77415ec20 msgr2=0x7ff77415f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:44.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.380+0000 7ff77a842640 1 --2- 172.21.15.120:0/731839977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff77415ec20 0x7ff77415f030 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff7740727b0 tx=0x7ff76c02aa30 comp rx=0 tx=0).stop 2024-07-27T03:12:44.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.380+0000 7ff77a842640 1 -- 172.21.15.120:0/731839977 shutdown_connections 2024-07-27T03:12:44.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.380+0000 7ff77a842640 1 --2- 172.21.15.120:0/731839977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff77415ec20 0x7ff77415f030 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:44.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.380+0000 7ff77a842640 1 --2- 172.21.15.120:0/731839977 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7740b5cd0 0x7ff7740b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:44.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.380+0000 7ff77a842640 1 --2- 172.21.15.120:0/731839977 >> v2:172.21.15.121:3300/0 conn(0x7ff77415c220 0x7ff774152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:44.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.380+0000 7ff77a842640 1 -- 172.21.15.120:0/731839977 >> 172.21.15.120:0/731839977 conn(0x7ff77406cba0 msgr2=0x7ff77406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:44.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.380+0000 7ff77a842640 1 -- 172.21.15.120:0/731839977 shutdown_connections 2024-07-27T03:12:44.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.380+0000 7ff77a842640 1 -- 172.21.15.120:0/731839977 wait complete. 2024-07-27T03:12:44.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.382+0000 7ff77a842640 1 Processor -- start 2024-07-27T03:12:44.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.382+0000 7ff77a842640 1 -- start start 2024-07-27T03:12:44.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff77a842640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7740b5cd0 0x7ff77413d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:44.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff77a842640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff77415c220 0x7ff774140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:44.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff77a842640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff77415ec20 0x7ff774140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff77a842640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff7740cd920 con 0x7ff7740b5cd0 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff77a842640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff7740cd7a0 con 0x7ff77415c220 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff77a842640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff7740cdaa0 con 0x7ff77415ec20 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff773fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7740b5cd0 0x7ff77413d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff773fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7740b5cd0 0x7ff77413d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44686/0 (socket says 172.21.15.120:44686) 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff773fff640 1 -- 172.21.15.120:0/3947642087 learned_addr learned my addr 172.21.15.120:0/3947642087 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff7737fe640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff77415c220 0x7ff774140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff778ddf640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff77415ec20 0x7ff774140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff773fff640 1 -- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff77415ec20 msgr2=0x7ff774140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff773fff640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff77415ec20 0x7ff774140770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff773fff640 1 -- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff77415c220 msgr2=0x7ff774140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff773fff640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff77415c220 0x7ff774140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:44.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff773fff640 1 -- 172.21.15.120:0/3947642087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77413e240 con 0x7ff7740b5cd0 2024-07-27T03:12:44.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff773fff640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7740b5cd0 0x7ff77413d8f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff76400d700 tx=0x7ff76400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:44.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff770ff9640 1 -- 172.21.15.120:0/3947642087 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764017070 con 0x7ff7740b5cd0 2024-07-27T03:12:44.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff770ff9640 1 -- 172.21.15.120:0/3947642087 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff764004310 con 0x7ff7740b5cd0 2024-07-27T03:12:44.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff77a842640 1 -- 172.21.15.120:0/3947642087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77413e4b0 con 0x7ff7740b5cd0 2024-07-27T03:12:44.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff770ff9640 1 -- 172.21.15.120:0/3947642087 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764009a80 con 0x7ff7740b5cd0 2024-07-27T03:12:44.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.384+0000 7ff77a842640 1 -- 172.21.15.120:0/3947642087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77413ea70 con 0x7ff7740b5cd0 2024-07-27T03:12:44.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.385+0000 7ff77a842640 1 -- 172.21.15.120:0/3947642087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff77415f030 con 0x7ff7740b5cd0 2024-07-27T03:12:44.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.386+0000 7ff770ff9640 1 -- 172.21.15.120:0/3947642087 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff764009c20 con 0x7ff7740b5cd0 2024-07-27T03:12:44.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.386+0000 7ff770ff9640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff760077040 0x7ff760079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:44.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.387+0000 7ff770ff9640 1 -- 172.21.15.120:0/3947642087 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7ff7640988b0 con 0x7ff7740b5cd0 2024-07-27T03:12:44.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.387+0000 7ff7737fe640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff760077040 0x7ff760079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:44.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.387+0000 7ff7737fe640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff760077040 0x7ff760079550 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff774074170 tx=0x7ff768005d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:44.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.391+0000 7ff770ff9640 1 -- 172.21.15.120:0/3947642087 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff764061b40 con 0x7ff7740b5cd0 2024-07-27T03:12:44.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.612+0000 7ff77a842640 1 -- 172.21.15.120:0/3947642087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff774073110 con 0x7ff7740b5cd0 2024-07-27T03:12:44.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.612+0000 7ff770ff9640 1 -- 172.21.15.120:0/3947642087 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5266 (secure 0 0 0) 0x7ff764061440 con 0x7ff7740b5cd0 2024-07-27T03:12:44.638 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:44.638 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":71,"btime":"2024-07-27T03:12:44:498341+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2578460445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2578460445},{"type":"v1","addr":"172.21.15.120:6835","nonce":2578460445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:12:33.787428+0000","modified":"2024-07-27T03:12:44.498334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6159,"mds_1":6144,"mds_2":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"d","rank":2,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.121:6836/2998929726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2998929726},{"type":"v1","addr":"172.21.15.121:6836","nonce":2998929726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6144":{"gid":6144,"name":"c","rank":1,"incarnation":68,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6833/3985484834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3985484834},{"type":"v1","addr":"172.21.15.120:6833","nonce":3985484834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/7061533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":7061533},{"type":"v1","addr":"172.21.15.121:6837","nonce":7061533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6159,"qdb_cluster":[5489,6144,6159]},"id":5}]} 2024-07-27T03:12:44.641 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 71 2024-07-27T03:12:44.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 -- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff760077040 msgr2=0x7ff760079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:44.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff760077040 0x7ff760079550 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff774074170 tx=0x7ff768005d70 comp rx=0 tx=0).stop 2024-07-27T03:12:44.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 -- 172.21.15.120:0/3947642087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7740b5cd0 msgr2=0x7ff77413d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:44.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7740b5cd0 0x7ff77413d8f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff76400d700 tx=0x7ff76400dbc0 comp rx=0 tx=0).stop 2024-07-27T03:12:44.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 -- 172.21.15.120:0/3947642087 shutdown_connections 2024-07-27T03:12:44.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff760077040 0x7ff760079550 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:44.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff77415ec20 0x7ff774140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:44.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff77415c220 0x7ff774140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:44.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 --2- 172.21.15.120:0/3947642087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7740b5cd0 0x7ff77413d8f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:44.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 -- 172.21.15.120:0/3947642087 >> 172.21.15.120:0/3947642087 conn(0x7ff77406cba0 msgr2=0x7ff774154960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:44.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 -- 172.21.15.120:0/3947642087 shutdown_connections 2024-07-27T03:12:44.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:44.614+0000 7ff77a842640 1 -- 172.21.15.120:0/3947642087 wait complete. 2024-07-27T03:12:44.741 INFO:tasks.ceph.mds.b.smithi121.stderr:2024-07-27T03:12:44.738+0000 7ff1ae759640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-27T03:12:44.742 INFO:tasks.ceph.mds.b.smithi121.stderr:2024-07-27T03:12:44.738+0000 7ff1ae759640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-07-27T03:12:45.047 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-27T03:12:33.787428+0000', 'modified': '2024-07-27T03:12:44.498334+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 6159, 'mds_1': 6144, 'mds_2': 5489}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5489': {'gid': 5489, 'name': 'd', 'rank': 2, 'incarnation': 70, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.121:6836/2998929726', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 2998929726}, {'type': 'v1', 'addr': '172.21.15.121:6836', 'nonce': 2998929726}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6144': {'gid': 6144, 'name': 'c', 'rank': 1, 'incarnation': 68, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.120:6833/3985484834', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6832', 'nonce': 3985484834}, {'type': 'v1', 'addr': '172.21.15.120:6833', 'nonce': 3985484834}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6159': {'gid': 6159, 'name': 'b', 'rank': 0, 'incarnation': 62, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6837/7061533', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6835', 'nonce': 7061533}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 7061533}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6159, 'qdb_cluster': [5489, 6144, 6159]} 2024-07-27T03:12:45.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-07-27T03:12:45.048 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-07-27T03:12:45.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.164+0000 7fde66934640 1 -- 172.21.15.120:0/1803341245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde48003a50 msgr2=0x7fde48003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.164+0000 7fde66934640 1 --2- 172.21.15.120:0/1803341245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde48003a50 0x7fde48003ec0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fde50009b50 tx=0x7fde48005830 comp rx=0 tx=0).stop 2024-07-27T03:12:45.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.164+0000 7fde66934640 1 -- 172.21.15.120:0/1803341245 shutdown_connections 2024-07-27T03:12:45.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.164+0000 7fde66934640 1 --2- 172.21.15.120:0/1803341245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde48003a50 0x7fde48003ec0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.164+0000 7fde66934640 1 -- 172.21.15.120:0/1803341245 >> 172.21.15.120:0/1803341245 conn(0x7fde600b1a10 msgr2=0x7fde600b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.164+0000 7fde66934640 1 -- 172.21.15.120:0/1803341245 shutdown_connections 2024-07-27T03:12:45.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.164+0000 7fde66934640 1 -- 172.21.15.120:0/1803341245 wait complete. 2024-07-27T03:12:45.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.166+0000 7fde66934640 1 Processor -- start 2024-07-27T03:12:45.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.166+0000 7fde66934640 1 -- start start 2024-07-27T03:12:45.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.167+0000 7fde66934640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde48003a50 0x7fde601f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.167+0000 7fde66934640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde6014c0a0 0x7fde6014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.167+0000 7fde66934640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde6014e410 0x7fde60159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.167+0000 7fde66934640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fde60155830 con 0x7fde6014c0a0 2024-07-27T03:12:45.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.167+0000 7fde66934640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fde601556b0 con 0x7fde6014e410 2024-07-27T03:12:45.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.167+0000 7fde66934640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fde600b4f90 con 0x7fde48003a50 2024-07-27T03:12:45.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.167+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde6014c0a0 0x7fde6014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde6014c0a0 0x7fde6014ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44712/0 (socket says 172.21.15.120:44712) 2024-07-27T03:12:45.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5f7fe640 1 -- 172.21.15.120:0/2408912994 learned_addr learned my addr 172.21.15.120:0/2408912994 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde64ed1640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde6014e410 0x7fde60159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5ffff640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde48003a50 0x7fde601f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5f7fe640 1 -- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde48003a50 msgr2=0x7fde601f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5f7fe640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde48003a50 0x7fde601f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5f7fe640 1 -- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde6014e410 msgr2=0x7fde60159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5f7fe640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde6014e410 0x7fde60159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5f7fe640 1 -- 172.21.15.120:0/2408912994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6014d1a0 con 0x7fde6014c0a0 2024-07-27T03:12:45.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5f7fe640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde6014c0a0 0x7fde6014ded0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fde54006e60 tx=0x7fde540049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5cff9640 1 -- 172.21.15.120:0/2408912994 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde54015020 con 0x7fde6014c0a0 2024-07-27T03:12:45.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5cff9640 1 -- 172.21.15.120:0/2408912994 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde54010980 con 0x7fde6014c0a0 2024-07-27T03:12:45.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde66934640 1 -- 172.21.15.120:0/2408912994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde6014fb70 con 0x7fde6014c0a0 2024-07-27T03:12:45.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde5cff9640 1 -- 172.21.15.120:0/2408912994 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde54010db0 con 0x7fde6014c0a0 2024-07-27T03:12:45.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.168+0000 7fde66934640 1 -- 172.21.15.120:0/2408912994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde6014d9b0 con 0x7fde6014c0a0 2024-07-27T03:12:45.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.170+0000 7fde5cff9640 1 -- 172.21.15.120:0/2408912994 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fde54018020 con 0x7fde6014c0a0 2024-07-27T03:12:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.170+0000 7fde5cff9640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fde4c077010 0x7fde4c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.170+0000 7fde5cff9640 1 -- 172.21.15.120:0/2408912994 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fde540992c0 con 0x7fde6014c0a0 2024-07-27T03:12:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.171+0000 7fde5ffff640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fde4c077010 0x7fde4c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.171+0000 7fde5ffff640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fde4c077010 0x7fde4c079520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fde50035000 tx=0x7fde500046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.171+0000 7fde6d84a740 1 Processor -- start 2024-07-27T03:12:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.171+0000 7fde6d84a740 1 -- start start 2024-07-27T03:12:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a883c270 0x5589a8c29170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c0be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c0c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde6d84a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5589a8b54360 con 0x5589a881b590 2024-07-27T03:12:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde6d84a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5589a8b43860 con 0x5589a88133b0 2024-07-27T03:12:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde6d84a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5589a8b478a0 con 0x5589a883c270 2024-07-27T03:12:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde64ed1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c0c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde64ed1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c0c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44714/0 (socket says 172.21.15.120:44714) 2024-07-27T03:12:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde64ed1640 1 -- 172.21.15.120:0/2869892665 learned_addr learned my addr 172.21.15.120:0/2869892665 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde5f7fe640 1 --2- 172.21.15.120:0/2869892665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c0be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde5ffff640 1 --2- 172.21.15.120:0/2869892665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a883c270 0x5589a8c29170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde64ed1640 1 -- 172.21.15.120:0/2869892665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a883c270 msgr2=0x5589a8c29170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde64ed1640 1 --2- 172.21.15.120:0/2869892665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a883c270 0x5589a8c29170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde64ed1640 1 -- 172.21.15.120:0/2869892665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 msgr2=0x5589a8c0be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde64ed1640 1 --2- 172.21.15.120:0/2869892665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c0be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde64ed1640 1 -- 172.21.15.120:0/2869892665 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a8ad3360 con 0x5589a881b590 2024-07-27T03:12:45.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde5f7fe640 1 --2- 172.21.15.120:0/2869892665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c0be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:12:45.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde64ed1640 1 --2- 172.21.15.120:0/2869892665 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c0c380 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fde6006ea00 tx=0x7fde58006620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512b67252c55198d server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde45ffb640 1 -- 172.21.15.120:0/2869892665 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde58011b50 con 0x5589a881b590 2024-07-27T03:12:45.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde45ffb640 1 -- 172.21.15.120:0/2869892665 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde58011de0 con 0x5589a881b590 2024-07-27T03:12:45.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.173+0000 7fde45ffb640 1 -- 172.21.15.120:0/2869892665 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde580126a0 con 0x5589a881b590 2024-07-27T03:12:45.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.174+0000 7fde6d84a740 1 -- 172.21.15.120:0/2869892665 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 msgr2=0x5589a8c0c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.174+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2869892665 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c0c380 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fde6006ea00 tx=0x7fde58006620 comp rx=0 tx=0).stop 2024-07-27T03:12:45.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.174+0000 7fde6d84a740 1 -- 172.21.15.120:0/2869892665 shutdown_connections 2024-07-27T03:12:45.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.174+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2869892665 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c0c380 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.174+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2869892665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c0be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.174+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2869892665 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a883c270 0x5589a8c29170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.174+0000 7fde6d84a740 1 -- 172.21.15.120:0/2869892665 >> 172.21.15.120:0/2869892665 conn(0x5589a88303c0 msgr2=0x5589a8be2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.174+0000 7fde6d84a740 1 -- 172.21.15.120:0/2869892665 shutdown_connections 2024-07-27T03:12:45.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.174+0000 7fde6d84a740 1 -- 172.21.15.120:0/2869892665 wait complete. 2024-07-27T03:12:45.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.175+0000 7fde6d84a740 1 -- start start 2024-07-27T03:12:45.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.175+0000 7fde6d84a740 1 Processor -- start 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c20120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8bfa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a883c270 0x5589a8c35db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde6d84a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5589a88b6620 con 0x5589a881b590 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde6d84a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5589a8adf140 con 0x5589a88133b0 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde6d84a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5589a8c365e0 con 0x5589a883c270 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde6d84a740 10 client.0 _ll_register_callbacks cb 0x5589a8b3cc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8bfa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8bfa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44726/0 (socket says 172.21.15.120:44726) 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde5f7fe640 1 -- 172.21.15.120:0/3995522080 learned_addr learned my addr 172.21.15.120:0/3995522080 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde5ffff640 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c20120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde64ed1640 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a883c270 0x5589a8c35db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde5f7fe640 1 -- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a883c270 msgr2=0x5589a8c35db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde5f7fe640 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a883c270 0x5589a8c35db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde5f7fe640 1 -- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 msgr2=0x5589a8c20120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde5f7fe640 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c20120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde5f7fe640 1 -- 172.21.15.120:0/3995522080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a88a7850 con 0x5589a881b590 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde5f7fe640 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8bfa440 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fde54061c90 tx=0x7fde54061bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456170cf6ae6183f server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde3effd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde3effd640 1 -- 172.21.15.120:0/3995522080 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde54095060 con 0x5589a881b590 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde3effd640 1 -- 172.21.15.120:0/3995522080 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fde540613f0 con 0x5589a881b590 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.177+0000 7fde6d84a740 1 -- 172.21.15.120:0/3995522080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde58011de0 con 0x5589a881b590 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde3effd640 1 -- 172.21.15.120:0/3995522080 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fde54080050 con 0x5589a881b590 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde6d84a740 10 client.6330 fetch_fsmap learned FSMap version 71 2024-07-27T03:12:45.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde6d84a740 1 -- 172.21.15.120:0/3995522080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x5589a891e6b0 con 0x5589a881b590 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde3effd640 1 -- 172.21.15.120:0/3995522080 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde58011de0 con 0x5589a881b590 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde3effd640 1 -- 172.21.15.120:0/3995522080 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 71) ==== 3542+0+0 (secure 0 0 0) 0x7fde540972b0 con 0x5589a881b590 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde6d84a740 10 client.6330 fetch_fsmap finished waiting for FSMap version 71 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde6d84a740 10 client.6330 resolve_mds: resolved name 'd' to daemon mds.d 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde6d84a740 20 client.6330 populate_metadata read hostname 'smithi120' 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde6d84a740 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:6834/2998929726,v1:172.21.15.121:6836/2998929726] conn(0x5589a87fae40 0x5589a8c1d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde6d84a740 4 client.6330 mds_command: new command op to 5489 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde6d84a740 1 -- 172.21.15.120:0/3995522080 --> [v2:172.21.15.121:6834/2998929726,v1:172.21.15.121:6836/2998929726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589a8b562b0 con 0x5589a87fae40 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.178+0000 7fde5ffff640 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:6834/2998929726,v1:172.21.15.121:6836/2998929726] conn(0x5589a87fae40 0x5589a8c1d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.179+0000 7fde3effd640 10 client.6330 ms_handle_connect on v2:172.21.15.121:6834/2998929726 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.179+0000 7fde5ffff640 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:6834/2998929726,v1:172.21.15.121:6836/2998929726] conn(0x5589a87fae40 0x5589a8c1d870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df29b8935b864a89 server_cookie=f32d306e6ade644 in_seq=0 out_seq=0 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.179+0000 7fde3effd640 1 -- 172.21.15.120:0/3995522080 <== mds.2 v2:172.21.15.121:6834/2998929726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5589a8b562b0 con 0x5589a87fae40 2024-07-27T03:12:45.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.179+0000 7fde3effd640 10 client.6330 handle_command_reply: tid=0 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.179+0000 7fde6d84a740 1 client.6330 shutdown 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.179+0000 7fde6d84a740 1 -- 172.21.15.120:0/3995522080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 msgr2=0x5589a8bfa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.179+0000 7fde6d84a740 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8bfa440 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fde54061c90 tx=0x7fde54061bc0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.180+0000 7fde6d84a740 1 -- 172.21.15.120:0/3995522080 shutdown_connections 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.180+0000 7fde6d84a740 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:6834/2998929726,v1:172.21.15.121:6836/2998929726] conn(0x5589a87fae40 0x5589a8c1d870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.180+0000 7fde6d84a740 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8bfa440 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.180+0000 7fde3effd640 0 client.6330 ms_handle_reset on v2:172.21.15.121:6834/2998929726 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.180+0000 7fde6d84a740 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a883c270 0x5589a8c35db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.180+0000 7fde6d84a740 1 --2- 172.21.15.120:0/3995522080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c20120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.180+0000 7fde6d84a740 1 -- 172.21.15.120:0/3995522080 >> 172.21.15.120:0/3995522080 conn(0x5589a88303c0 msgr2=0x5589a8c0be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.180+0000 7fde6d84a740 1 -- 172.21.15.120:0/3995522080 shutdown_connections 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.180+0000 7fde6d84a740 1 -- 172.21.15.120:0/3995522080 wait complete. 2024-07-27T03:12:45.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.180+0000 7fde6d84a740 20 client.6330 trim_cache size 0 max 16384 2024-07-27T03:12:45.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.199+0000 7fde6d84a740 1 Processor -- start 2024-07-27T03:12:45.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.199+0000 7fde6d84a740 1 -- start start 2024-07-27T03:12:45.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a87fae40 0x5589a8be2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c234a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a881b590 0x5589a8c48690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde6d84a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fde602015d0 con 0x5589a87fae40 2024-07-27T03:12:45.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde6d84a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fde60201ca0 con 0x5589a88133b0 2024-07-27T03:12:45.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde6d84a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fde6006f410 con 0x5589a881b590 2024-07-27T03:12:45.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a87fae40 0x5589a8be2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde5ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a87fae40 0x5589a8be2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44742/0 (socket says 172.21.15.120:44742) 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde5ffff640 1 -- 172.21.15.120:0/2757606918 learned_addr learned my addr 172.21.15.120:0/2757606918 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde5f7fe640 1 --2- 172.21.15.120:0/2757606918 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde64ed1640 1 --2- 172.21.15.120:0/2757606918 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a881b590 0x5589a8c48690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde5ffff640 1 -- 172.21.15.120:0/2757606918 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a881b590 msgr2=0x5589a8c48690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde5ffff640 1 --2- 172.21.15.120:0/2757606918 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a881b590 0x5589a8c48690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde5ffff640 1 -- 172.21.15.120:0/2757606918 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 msgr2=0x5589a8c234a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde5ffff640 1 --2- 172.21.15.120:0/2757606918 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c234a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde5ffff640 1 -- 172.21.15.120:0/2757606918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a8bdee50 con 0x5589a87fae40 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde64ed1640 1 --2- 172.21.15.120:0/2757606918 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a881b590 0x5589a8c48690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.200+0000 7fde5ffff640 1 --2- 172.21.15.120:0/2757606918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a87fae40 0x5589a8be2240 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fde50009c70 tx=0x7fde5003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cc5ddfe1202e8b server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde457fa640 1 -- 172.21.15.120:0/2757606918 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50058070 con 0x5589a87fae40 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde457fa640 1 -- 172.21.15.120:0/2757606918 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde50033a80 con 0x5589a87fae40 2024-07-27T03:12:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde457fa640 1 -- 172.21.15.120:0/2757606918 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50038040 con 0x5589a87fae40 2024-07-27T03:12:45.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde6d84a740 1 -- 172.21.15.120:0/2757606918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a87fae40 msgr2=0x5589a8be2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2757606918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a87fae40 0x5589a8be2240 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fde50009c70 tx=0x7fde5003b000 comp rx=0 tx=0).stop 2024-07-27T03:12:45.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde6d84a740 1 -- 172.21.15.120:0/2757606918 shutdown_connections 2024-07-27T03:12:45.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2757606918 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a881b590 0x5589a8c48690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2757606918 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c234a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2757606918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a87fae40 0x5589a8be2240 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde6d84a740 1 -- 172.21.15.120:0/2757606918 >> 172.21.15.120:0/2757606918 conn(0x5589a88303c0 msgr2=0x5589a8bf9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde6d84a740 1 -- 172.21.15.120:0/2757606918 shutdown_connections 2024-07-27T03:12:45.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.201+0000 7fde6d84a740 1 -- 172.21.15.120:0/2757606918 wait complete. 2024-07-27T03:12:45.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.202+0000 7fde6d84a740 1 -- start start 2024-07-27T03:12:45.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.202+0000 7fde6d84a740 1 Processor -- start 2024-07-27T03:12:45.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a87fae40 0x5589a8be20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c1f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde6d84a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c1fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde6d84a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5589a8c09240 con 0x5589a881b590 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde6d84a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5589a8c362f0 con 0x5589a88133b0 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde6d84a740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x5589a8c23040 con 0x5589a87fae40 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde6d84a740 10 client.0 _ll_register_callbacks cb 0x7fde54001d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde64ed1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c1fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde64ed1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c1fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44750/0 (socket says 172.21.15.120:44750) 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde64ed1640 1 -- 172.21.15.120:0/2542981562 learned_addr learned my addr 172.21.15.120:0/2542981562 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde5f7fe640 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c1f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde5ffff640 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a87fae40 0x5589a8be20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde64ed1640 1 -- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a87fae40 msgr2=0x5589a8be20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde64ed1640 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a87fae40 0x5589a8be20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde64ed1640 1 -- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 msgr2=0x5589a8c1f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde64ed1640 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c1f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde64ed1640 1 -- 172.21.15.120:0/2542981562 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a8bdffb0 con 0x5589a881b590 2024-07-27T03:12:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde5ffff640 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a87fae40 0x5589a8be20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde64ed1640 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c1fe50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fde6006ff50 tx=0x7fde58011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7f58db7349b76f server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde3effd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.204+0000 7fde3effd640 1 -- 172.21.15.120:0/2542981562 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5802c060 con 0x5589a881b590 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde3effd640 1 -- 172.21.15.120:0/2542981562 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fde58011ad0 con 0x5589a881b590 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde6d84a740 1 -- 172.21.15.120:0/2542981562 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde50033a80 con 0x5589a881b590 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde3effd640 1 -- 172.21.15.120:0/2542981562 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fde58032050 con 0x5589a881b590 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde6d84a740 10 client.6336 fetch_fsmap learned FSMap version 71 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde6d84a740 1 -- 172.21.15.120:0/2542981562 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x5589a8c20390 con 0x5589a881b590 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde3effd640 1 -- 172.21.15.120:0/2542981562 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde50033a80 con 0x5589a881b590 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde3effd640 1 -- 172.21.15.120:0/2542981562 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 71) ==== 3542+0+0 (secure 0 0 0) 0x7fde58035020 con 0x5589a881b590 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde6d84a740 10 client.6336 fetch_fsmap finished waiting for FSMap version 71 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde6d84a740 10 client.6336 resolve_mds: resolved name 'd' to daemon mds.d 2024-07-27T03:12:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde6d84a740 20 client.6336 populate_metadata read hostname 'smithi120' 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:6834/2998929726,v1:172.21.15.121:6836/2998929726] conn(0x5589a87d0280 0x5589a8ca3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde6d84a740 4 client.6336 mds_command: new command op to 5489 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde6d84a740 1 -- 172.21.15.120:0/2542981562 --> [v2:172.21.15.121:6834/2998929726,v1:172.21.15.121:6836/2998929726] -- command(tid 0: {"prefix": "status"}) -- 0x5589a8b51d50 con 0x5589a87d0280 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.205+0000 7fde5ffff640 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:6834/2998929726,v1:172.21.15.121:6836/2998929726] conn(0x5589a87d0280 0x5589a8ca3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde3effd640 10 client.6336 ms_handle_connect on v2:172.21.15.121:6834/2998929726 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde5ffff640 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:6834/2998929726,v1:172.21.15.121:6836/2998929726] conn(0x5589a87d0280 0x5589a8ca3810 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67a2fde8dd0d1141 server_cookie=7731eda6810ca823 in_seq=0 out_seq=0 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde3effd640 1 -- 172.21.15.120:0/2542981562 <== mds.2 v2:172.21.15.121:6834/2998929726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5589a8b51d50 con 0x5589a87d0280 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde3effd640 10 client.6336 handle_command_reply: tid=0 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 1 client.6336 shutdown 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 1 -- 172.21.15.120:0/2542981562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 msgr2=0x5589a8c1fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c1fe50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fde6006ff50 tx=0x7fde58011de0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 1 -- 172.21.15.120:0/2542981562 shutdown_connections 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:6834/2998929726,v1:172.21.15.121:6836/2998929726] conn(0x5589a87d0280 0x5589a8ca3810 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5589a881b590 0x5589a8c1fe50 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5589a88133b0 0x5589a8c1f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 1 --2- 172.21.15.120:0/2542981562 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5589a87fae40 0x5589a8be20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde3effd640 0 client.6336 ms_handle_reset on v2:172.21.15.121:6834/2998929726 2024-07-27T03:12:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 1 -- 172.21.15.120:0/2542981562 >> 172.21.15.120:0/2542981562 conn(0x5589a88303c0 msgr2=0x5589a8c1e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 1 -- 172.21.15.120:0/2542981562 shutdown_connections 2024-07-27T03:12:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 1 -- 172.21.15.120:0/2542981562 wait complete. 2024-07-27T03:12:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.206+0000 7fde6d84a740 20 client.6336 trim_cache size 0 max 16384 2024-07-27T03:12:45.214 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:12:45.214 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:12:45.215 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 2, 2024-07-27T03:12:45.215 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5489, 2024-07-27T03:12:45.215 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:12:45.215 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:12:45.215 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:12:45.215 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 1.7075877070000001, 2024-07-27T03:12:45.215 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 71, 2024-07-27T03:12:45.215 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 69, 2024-07-27T03:12:45.215 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 69, 2024-07-27T03:12:45.215 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 16.082186946 2024-07-27T03:12:45.215 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:12:45.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 -- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fde4c077010 msgr2=0x7fde4c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fde4c077010 0x7fde4c079520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fde50035000 tx=0x7fde500046c0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 -- 172.21.15.120:0/2408912994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde6014c0a0 msgr2=0x7fde6014ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde6014c0a0 0x7fde6014ded0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fde54006e60 tx=0x7fde540049d0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 -- 172.21.15.120:0/2408912994 shutdown_connections 2024-07-27T03:12:45.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fde4c077010 0x7fde4c079520 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde6014c0a0 0x7fde6014ded0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde6014e410 0x7fde60159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 --2- 172.21.15.120:0/2408912994 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fde48003a50 0x7fde601f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 -- 172.21.15.120:0/2408912994 >> 172.21.15.120:0/2408912994 conn(0x7fde600b1a10 msgr2=0x7fde60072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 -- 172.21.15.120:0/2408912994 shutdown_connections 2024-07-27T03:12:45.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.207+0000 7fde66934640 1 -- 172.21.15.120:0/2408912994 wait complete. 2024-07-27T03:12:45.221 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-07-27T03:12:45.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.336+0000 7f5962740640 1 -- 172.21.15.120:0/3470518146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f595c0d10d0 msgr2=0x7f595c0d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.336+0000 7f5962740640 1 --2- 172.21.15.120:0/3470518146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f595c0d10d0 0x7f595c0d2bf0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f595c0b3b30 tx=0x7f595402a8b0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.336+0000 7f5962740640 1 -- 172.21.15.120:0/3470518146 shutdown_connections 2024-07-27T03:12:45.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.336+0000 7f5962740640 1 --2- 172.21.15.120:0/3470518146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f595c0d10d0 0x7f595c0d2bf0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.336+0000 7f5962740640 1 --2- 172.21.15.120:0/3470518146 >> v2:172.21.15.121:3300/0 conn(0x7f595c0b4740 0x7f595c0b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.336+0000 7f5962740640 1 -- 172.21.15.120:0/3470518146 >> 172.21.15.120:0/3470518146 conn(0x7f595c08d690 msgr2=0x7f595c09d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.336+0000 7f5962740640 1 -- 172.21.15.120:0/3470518146 shutdown_connections 2024-07-27T03:12:45.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.336+0000 7f5962740640 1 -- 172.21.15.120:0/3470518146 wait complete. 2024-07-27T03:12:45.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.338+0000 7f5962740640 1 Processor -- start 2024-07-27T03:12:45.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.338+0000 7f5962740640 1 -- start start 2024-07-27T03:12:45.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f5962740640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f595c0b4740 0x7f595c14d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f5962740640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f595c0d27e0 0x7f595c14dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f5962740640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f595c1f8710 0x7f595c1f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f5962740640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f595c0cef70 con 0x7f595c0b4740 2024-07-27T03:12:45.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f5962740640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f595c0cedf0 con 0x7f595c0d27e0 2024-07-27T03:12:45.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f5962740640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f595c0cf0f0 con 0x7f595c1f8710 2024-07-27T03:12:45.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f595bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f595c0b4740 0x7f595c14d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f595bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f595c0b4740 0x7f595c14d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44772/0 (socket says 172.21.15.120:44772) 2024-07-27T03:12:45.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f595bfff640 1 -- 172.21.15.120:0/1342657036 learned_addr learned my addr 172.21.15.120:0/1342657036 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f5960cdd640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f595c1f8710 0x7f595c1f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f595b7fe640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f595c0d27e0 0x7f595c14dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f595bfff640 1 -- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f595c1f8710 msgr2=0x7f595c1f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f595bfff640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f595c1f8710 0x7f595c1f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f595bfff640 1 -- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f595c0d27e0 msgr2=0x7f595c14dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f595bfff640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f595c0d27e0 0x7f595c14dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f595bfff640 1 -- 172.21.15.120:0/1342657036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c0cd270 con 0x7f595c0b4740 2024-07-27T03:12:45.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f595b7fe640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f595c0d27e0 0x7f595c14dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:45.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f595bfff640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f595c0b4740 0x7f595c14d590 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f594c00d770 tx=0x7f594c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f5958ff9640 1 -- 172.21.15.120:0/1342657036 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c017070 con 0x7f595c0b4740 2024-07-27T03:12:45.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.340+0000 7f5958ff9640 1 -- 172.21.15.120:0/1342657036 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f594c009d20 con 0x7f595c0b4740 2024-07-27T03:12:45.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.341+0000 7f5962740640 1 -- 172.21.15.120:0/1342657036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595c0cd550 con 0x7f595c0b4740 2024-07-27T03:12:45.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.341+0000 7f5958ff9640 1 -- 172.21.15.120:0/1342657036 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c0106c0 con 0x7f595c0b4740 2024-07-27T03:12:45.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.341+0000 7f5962740640 1 -- 172.21.15.120:0/1342657036 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595c0ca7d0 con 0x7f595c0b4740 2024-07-27T03:12:45.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.342+0000 7f5958ff9640 1 -- 172.21.15.120:0/1342657036 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f594c01a070 con 0x7f595c0b4740 2024-07-27T03:12:45.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.343+0000 7f5958ff9640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5948077040 0x7f5948079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.343+0000 7f5958ff9640 1 -- 172.21.15.120:0/1342657036 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f594c0989a0 con 0x7f595c0b4740 2024-07-27T03:12:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.343+0000 7f595b7fe640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5948077040 0x7f5948079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.344+0000 7f595b7fe640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5948077040 0x7f5948079550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f595c1f8490 tx=0x7f5950009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.344+0000 7f5969657740 1 Processor -- start 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.344+0000 7f5969657740 1 -- start start 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.345+0000 7f5969657740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc3a270 0x55bbfc027170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.345+0000 7f5969657740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc113b0 0x55bbfc009e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.345+0000 7f5969657740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc19590 0x55bbfc00a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.345+0000 7f5969657740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bbfbf52360 con 0x55bbfbc113b0 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.345+0000 7f5969657740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bbfbf41860 con 0x55bbfbc3a270 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.345+0000 7f5969657740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55bbfbf458a0 con 0x55bbfbc19590 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.345+0000 7f595b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc113b0 0x55bbfc009e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.345+0000 7f595b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc113b0 0x55bbfc009e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44784/0 (socket says 172.21.15.120:44784) 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.345+0000 7f595b7fe640 1 -- 172.21.15.120:0/626539925 learned_addr learned my addr 172.21.15.120:0/626539925 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.345+0000 7f595bfff640 1 --2- 172.21.15.120:0/626539925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc3a270 0x55bbfc027170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.345+0000 7f5960cdd640 1 --2- 172.21.15.120:0/626539925 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc19590 0x55bbfc00a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.346+0000 7f595b7fe640 1 -- 172.21.15.120:0/626539925 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc19590 msgr2=0x55bbfc00a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.346+0000 7f595b7fe640 1 --2- 172.21.15.120:0/626539925 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc19590 0x55bbfc00a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.346+0000 7f595b7fe640 1 -- 172.21.15.120:0/626539925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc3a270 msgr2=0x55bbfc027170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.346+0000 7f595b7fe640 1 --2- 172.21.15.120:0/626539925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc3a270 0x55bbfc027170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.346+0000 7f595b7fe640 1 -- 172.21.15.120:0/626539925 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbfbed1360 con 0x55bbfbc113b0 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.346+0000 7f5960cdd640 1 --2- 172.21.15.120:0/626539925 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc19590 0x55bbfc00a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.346+0000 7f595b7fe640 1 --2- 172.21.15.120:0/626539925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc113b0 0x55bbfc009e40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f5950005110 tx=0x7f5950011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215d41145d42b14d server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.346+0000 7f5941ffb640 1 -- 172.21.15.120:0/626539925 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595000ea30 con 0x55bbfbc113b0 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.346+0000 7f5941ffb640 1 -- 172.21.15.120:0/626539925 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f595000ebd0 con 0x55bbfbc113b0 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.346+0000 7f5941ffb640 1 -- 172.21.15.120:0/626539925 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595000eda0 con 0x55bbfbc113b0 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.347+0000 7f5969657740 1 -- 172.21.15.120:0/626539925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc113b0 msgr2=0x55bbfc009e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.347+0000 7f5969657740 1 --2- 172.21.15.120:0/626539925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc113b0 0x55bbfc009e40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f5950005110 tx=0x7f5950011000 comp rx=0 tx=0).stop 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.347+0000 7f5969657740 1 -- 172.21.15.120:0/626539925 shutdown_connections 2024-07-27T03:12:45.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.347+0000 7f5969657740 1 --2- 172.21.15.120:0/626539925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc113b0 0x55bbfc009e40 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.347+0000 7f5969657740 1 --2- 172.21.15.120:0/626539925 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc19590 0x55bbfc00a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.347+0000 7f5969657740 1 --2- 172.21.15.120:0/626539925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc3a270 0x55bbfc027170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.347+0000 7f5969657740 1 -- 172.21.15.120:0/626539925 >> 172.21.15.120:0/626539925 conn(0x55bbfbc2e3c0 msgr2=0x55bbfbfe0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.347+0000 7f5969657740 1 -- 172.21.15.120:0/626539925 shutdown_connections 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.347+0000 7f5969657740 1 -- 172.21.15.120:0/626539925 wait complete. 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.348+0000 7f5969657740 1 -- start start 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.348+0000 7f5969657740 1 Processor -- start 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.349+0000 7f5969657740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc01e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.349+0000 7f5969657740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfc0370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.349+0000 7f5969657740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfbfd9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.349+0000 7f5969657740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bbfbcb4620 con 0x55bbfbc3a270 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.349+0000 7f5969657740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bbfbedd140 con 0x55bbfbc19590 2024-07-27T03:12:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.349+0000 7f5969657740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55bbfc035b60 con 0x55bbfbc113b0 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.349+0000 7f5969657740 10 client.0 _ll_register_callbacks cb 0x55bbfbf3ac90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.349+0000 7f5960cdd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfbfd9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.349+0000 7f5960cdd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfbfd9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44788/0 (socket says 172.21.15.120:44788) 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.349+0000 7f5960cdd640 1 -- 172.21.15.120:0/3087889203 learned_addr learned my addr 172.21.15.120:0/3087889203 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f595b7fe640 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfc0370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f595bfff640 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc01e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5960cdd640 1 -- 172.21.15.120:0/3087889203 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 msgr2=0x55bbfc01e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5960cdd640 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc01e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5960cdd640 1 -- 172.21.15.120:0/3087889203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 msgr2=0x55bbfc0370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5960cdd640 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfc0370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5960cdd640 1 -- 172.21.15.120:0/3087889203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbfbca5850 con 0x55bbfbc3a270 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f595b7fe640 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfc0370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:45.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5960cdd640 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfbfd9760 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5954009ca0 tx=0x7f5954003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2880be10967a0f1d server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f593affd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f593affd640 1 -- 172.21.15.120:0/3087889203 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954004390 con 0x55bbfbc3a270 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f593affd640 1 -- 172.21.15.120:0/3087889203 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f5954004530 con 0x55bbfbc3a270 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5969657740 1 -- 172.21.15.120:0/3087889203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f595000ebd0 con 0x55bbfbc3a270 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f593affd640 1 -- 172.21.15.120:0/3087889203 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f5954004730 con 0x55bbfbc3a270 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5969657740 10 client.6351 fetch_fsmap learned FSMap version 71 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5969657740 1 -- 172.21.15.120:0/3087889203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x55bbfbd1c6b0 con 0x55bbfbc3a270 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f593affd640 1 -- 172.21.15.120:0/3087889203 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f595000ebd0 con 0x55bbfbc3a270 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f593affd640 1 -- 172.21.15.120:0/3087889203 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 71) ==== 3542+0+0 (secure 0 0 0) 0x7f595404e050 con 0x55bbfbc3a270 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5969657740 10 client.6351 fetch_fsmap finished waiting for FSMap version 71 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5969657740 10 client.6351 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5969657740 20 client.6351 populate_metadata read hostname 'smithi120' 2024-07-27T03:12:45.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.350+0000 7f5969657740 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.120:6832/3985484834,v1:172.21.15.120:6833/3985484834] conn(0x55bbfbbf8e40 0x55bbfc002170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.351+0000 7f5969657740 4 client.6351 mds_command: new command op to 6144 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.351+0000 7f5969657740 1 -- 172.21.15.120:0/3087889203 --> [v2:172.21.15.120:6832/3985484834,v1:172.21.15.120:6833/3985484834] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbfbf542b0 con 0x55bbfbbf8e40 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.351+0000 7f595bfff640 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.120:6832/3985484834,v1:172.21.15.120:6833/3985484834] conn(0x55bbfbbf8e40 0x55bbfc002170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.351+0000 7f593affd640 10 client.6351 ms_handle_connect on v2:172.21.15.120:6832/3985484834 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.351+0000 7f595bfff640 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.120:6832/3985484834,v1:172.21.15.120:6833/3985484834] conn(0x55bbfbbf8e40 0x55bbfc002170 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=469b902903bdf5e0 server_cookie=f3627875be1effe6 in_seq=0 out_seq=0 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f593affd640 1 -- 172.21.15.120:0/3087889203 <== mds.1 v2:172.21.15.120:6832/3985484834 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bbfbf542b0 con 0x55bbfbbf8e40 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f593affd640 10 client.6351 handle_command_reply: tid=0 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 1 client.6351 shutdown 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 1 -- 172.21.15.120:0/3087889203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 msgr2=0x55bbfbfd9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfbfd9760 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5954009ca0 tx=0x7f5954003ef0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 1 -- 172.21.15.120:0/3087889203 shutdown_connections 2024-07-27T03:12:45.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.120:6832/3985484834,v1:172.21.15.120:6833/3985484834] conn(0x55bbfbbf8e40 0x55bbfc002170 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfbfd9760 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfc0370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f593affd640 0 client.6351 ms_handle_reset on v2:172.21.15.120:6832/3985484834 2024-07-27T03:12:45.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 1 --2- 172.21.15.120:0/3087889203 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc01e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 1 -- 172.21.15.120:0/3087889203 >> 172.21.15.120:0/3087889203 conn(0x55bbfbc2e3c0 msgr2=0x55bbfc0276d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 1 -- 172.21.15.120:0/3087889203 shutdown_connections 2024-07-27T03:12:45.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 1 -- 172.21.15.120:0/3087889203 wait complete. 2024-07-27T03:12:45.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.352+0000 7f5969657740 20 client.6351 trim_cache size 0 max 16384 2024-07-27T03:12:45.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.371+0000 7f5969657740 1 Processor -- start 2024-07-27T03:12:45.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.371+0000 7f5969657740 1 -- start start 2024-07-27T03:12:45.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.372+0000 7f5969657740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc037010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.372+0000 7f5969657740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfbfe0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.372+0000 7f5969657740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc032170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.372+0000 7f5969657740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f595c200f50 con 0x55bbfbc3a270 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.372+0000 7f5969657740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f595c201620 con 0x55bbfbc19590 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.372+0000 7f5969657740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f595c0b14b0 con 0x55bbfbc113b0 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f5960cdd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc032170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f5960cdd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc032170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44792/0 (socket says 172.21.15.120:44792) 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f5960cdd640 1 -- 172.21.15.120:0/2390059278 learned_addr learned my addr 172.21.15.120:0/2390059278 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f5960cdd640 1 -- 172.21.15.120:0/2390059278 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 msgr2=0x55bbfc037010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f595bfff640 1 --2- 172.21.15.120:0/2390059278 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc037010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f5960cdd640 1 --2- 172.21.15.120:0/2390059278 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc037010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f5960cdd640 1 -- 172.21.15.120:0/2390059278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 msgr2=0x55bbfbfe0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f595b7fe640 1 --2- 172.21.15.120:0/2390059278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfbfe0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f5960cdd640 1 --2- 172.21.15.120:0/2390059278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfbfe0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f5960cdd640 1 -- 172.21.15.120:0/2390059278 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbfbfd9ad0 con 0x55bbfbc3a270 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f5960cdd640 1 --2- 172.21.15.120:0/2390059278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc032170 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5954004920 tx=0x7f5954004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd430842829d3a0c server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f59417fa640 1 -- 172.21.15.120:0/2390059278 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595403f020 con 0x55bbfbc3a270 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f59417fa640 1 -- 172.21.15.120:0/2390059278 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5954004390 con 0x55bbfbc3a270 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.373+0000 7f59417fa640 1 -- 172.21.15.120:0/2390059278 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954050a40 con 0x55bbfbc3a270 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.374+0000 7f5969657740 1 -- 172.21.15.120:0/2390059278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 msgr2=0x55bbfc032170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.374+0000 7f5969657740 1 --2- 172.21.15.120:0/2390059278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc032170 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5954004920 tx=0x7f5954004950 comp rx=0 tx=0).stop 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.374+0000 7f5969657740 1 -- 172.21.15.120:0/2390059278 shutdown_connections 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.374+0000 7f5969657740 1 --2- 172.21.15.120:0/2390059278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc032170 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.374+0000 7f5969657740 1 --2- 172.21.15.120:0/2390059278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfbfe0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.374+0000 7f5969657740 1 --2- 172.21.15.120:0/2390059278 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc037010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.374+0000 7f5969657740 1 -- 172.21.15.120:0/2390059278 >> 172.21.15.120:0/2390059278 conn(0x55bbfbc2e3c0 msgr2=0x55bbfbfd5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.374+0000 7f5969657740 1 -- 172.21.15.120:0/2390059278 shutdown_connections 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.374+0000 7f5969657740 1 -- 172.21.15.120:0/2390059278 wait complete. 2024-07-27T03:12:45.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.375+0000 7f5969657740 1 -- start start 2024-07-27T03:12:45.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.375+0000 7f5969657740 1 Processor -- start 2024-07-27T03:12:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.376+0000 7f5969657740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc0a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.376+0000 7f5969657740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfc046590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.376+0000 7f5969657740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc046ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.376+0000 7f5969657740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bbfbfd9ca0 con 0x55bbfbc3a270 2024-07-27T03:12:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.376+0000 7f5969657740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bbfc034800 con 0x55bbfbc19590 2024-07-27T03:12:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.376+0000 7f5969657740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55bbfc034cb0 con 0x55bbfbc113b0 2024-07-27T03:12:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.376+0000 7f5969657740 10 client.0 _ll_register_callbacks cb 0x7f59540093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:12:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.376+0000 7f5960cdd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc046ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.376+0000 7f5960cdd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc046ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44794/0 (socket says 172.21.15.120:44794) 2024-07-27T03:12:45.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f5960cdd640 1 -- 172.21.15.120:0/3865202555 learned_addr learned my addr 172.21.15.120:0/3865202555 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f595bfff640 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc0a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f595b7fe640 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfc046590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f5960cdd640 1 -- 172.21.15.120:0/3865202555 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 msgr2=0x55bbfc0a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f5960cdd640 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc0a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f5960cdd640 1 -- 172.21.15.120:0/3865202555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 msgr2=0x55bbfc046590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f5960cdd640 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfc046590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f5960cdd640 1 -- 172.21.15.120:0/3865202555 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbfc025c90 con 0x55bbfbc3a270 2024-07-27T03:12:45.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f5960cdd640 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc046ad0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5954003970 tx=0x7f5954050ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdb6d206047fbce server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f593affd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:12:45.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f593affd640 1 -- 172.21.15.120:0/3865202555 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595403f070 con 0x55bbfbc3a270 2024-07-27T03:12:45.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f593affd640 1 -- 172.21.15.120:0/3865202555 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f5954031650 con 0x55bbfbc3a270 2024-07-27T03:12:45.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f5969657740 1 -- 172.21.15.120:0/3865202555 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5954004390 con 0x55bbfbc3a270 2024-07-27T03:12:45.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f593affd640 1 -- 172.21.15.120:0/3865202555 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f595405f050 con 0x55bbfbc3a270 2024-07-27T03:12:45.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f5969657740 10 client.6357 fetch_fsmap learned FSMap version 71 2024-07-27T03:12:45.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f5969657740 1 -- 172.21.15.120:0/3865202555 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x55bbfbff7e90 con 0x55bbfbc3a270 2024-07-27T03:12:45.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.377+0000 7f593affd640 1 -- 172.21.15.120:0/3865202555 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5954004390 con 0x55bbfbc3a270 2024-07-27T03:12:45.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f593affd640 1 -- 172.21.15.120:0/3865202555 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 71) ==== 3542+0+0 (secure 0 0 0) 0x7f5954062020 con 0x55bbfbc3a270 2024-07-27T03:12:45.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f5969657740 10 client.6357 fetch_fsmap finished waiting for FSMap version 71 2024-07-27T03:12:45.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f5969657740 10 client.6357 resolve_mds: resolved name 'c' to daemon mds.c 2024-07-27T03:12:45.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f5969657740 20 client.6357 populate_metadata read hostname 'smithi120' 2024-07-27T03:12:45.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f5969657740 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.120:6832/3985484834,v1:172.21.15.120:6833/3985484834] conn(0x55bbfc0a54c0 0x55bbfbff6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f5969657740 4 client.6357 mds_command: new command op to 6144 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f5969657740 1 -- 172.21.15.120:0/3865202555 --> [v2:172.21.15.120:6832/3985484834,v1:172.21.15.120:6833/3985484834] -- command(tid 0: {"prefix": "status"}) -- 0x55bbfbf4fd50 con 0x55bbfc0a54c0 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f595bfff640 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.120:6832/3985484834,v1:172.21.15.120:6833/3985484834] conn(0x55bbfc0a54c0 0x55bbfbff6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f593affd640 10 client.6357 ms_handle_connect on v2:172.21.15.120:6832/3985484834 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f595bfff640 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.120:6832/3985484834,v1:172.21.15.120:6833/3985484834] conn(0x55bbfc0a54c0 0x55bbfbff6d90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8e7042ca9ee0d75 server_cookie=9b6fcfd4a5ae7d8e in_seq=0 out_seq=0 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f593affd640 1 -- 172.21.15.120:0/3865202555 <== mds.1 v2:172.21.15.120:6832/3985484834 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55bbfbf4fd50 con 0x55bbfc0a54c0 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f593affd640 10 client.6357 handle_command_reply: tid=0 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.378+0000 7f5969657740 1 client.6357 shutdown 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5969657740 1 -- 172.21.15.120:0/3865202555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 msgr2=0x55bbfc046ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5969657740 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc046ad0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5954003970 tx=0x7f5954050ef0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5969657740 1 -- 172.21.15.120:0/3865202555 shutdown_connections 2024-07-27T03:12:45.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5969657740 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.120:6832/3985484834,v1:172.21.15.120:6833/3985484834] conn(0x55bbfc0a54c0 0x55bbfbff6d90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5969657740 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bbfbc3a270 0x55bbfc046ad0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5969657740 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbfbc19590 0x55bbfc046590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f593affd640 0 client.6357 ms_handle_reset on v2:172.21.15.120:6832/3985484834 2024-07-27T03:12:45.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5969657740 1 --2- 172.21.15.120:0/3865202555 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55bbfbc113b0 0x55bbfc0a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5969657740 1 -- 172.21.15.120:0/3865202555 >> 172.21.15.120:0/3865202555 conn(0x55bbfbc2e3c0 msgr2=0x55bbfc006cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5969657740 1 -- 172.21.15.120:0/3865202555 shutdown_connections 2024-07-27T03:12:45.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5969657740 1 -- 172.21.15.120:0/3865202555 wait complete. 2024-07-27T03:12:45.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5969657740 20 client.6357 trim_cache size 0 max 16384 2024-07-27T03:12:45.388 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:12:45.389 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:12:45.389 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 1, 2024-07-27T03:12:45.389 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 6144, 2024-07-27T03:12:45.389 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:12:45.389 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:12:45.389 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:12:45.389 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 2.893483067, 2024-07-27T03:12:45.390 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 71, 2024-07-27T03:12:45.390 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 69, 2024-07-27T03:12:45.390 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 69, 2024-07-27T03:12:45.390 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 16.270663244000001 2024-07-27T03:12:45.390 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:12:45.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5962740640 1 -- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5948077040 msgr2=0x7f5948079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5962740640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5948077040 0x7f5948079550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f595c1f8490 tx=0x7f5950009040 comp rx=0 tx=0).stop 2024-07-27T03:12:45.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5962740640 1 -- 172.21.15.120:0/1342657036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f595c0b4740 msgr2=0x7f595c14d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5962740640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f595c0b4740 0x7f595c14d590 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f594c00d770 tx=0x7f594c00dc30 comp rx=0 tx=0).stop 2024-07-27T03:12:45.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5962740640 1 -- 172.21.15.120:0/1342657036 shutdown_connections 2024-07-27T03:12:45.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5962740640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5948077040 0x7f5948079550 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5962740640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f595c1f8710 0x7f595c1f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5962740640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f595c0d27e0 0x7f595c14dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5962740640 1 --2- 172.21.15.120:0/1342657036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f595c0b4740 0x7f595c14d590 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5962740640 1 -- 172.21.15.120:0/1342657036 >> 172.21.15.120:0/1342657036 conn(0x7f595c08d690 msgr2=0x7f595c0d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.379+0000 7f5962740640 1 -- 172.21.15.120:0/1342657036 shutdown_connections 2024-07-27T03:12:45.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.380+0000 7f5962740640 1 -- 172.21.15.120:0/1342657036 wait complete. 2024-07-27T03:12:45.393 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-07-27T03:12:45.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.507+0000 7fc43cc4a640 1 -- 172.21.15.120:0/2937111100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4380733c0 msgr2=0x7fc4380737d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.507+0000 7fc43cc4a640 1 --2- 172.21.15.120:0/2937111100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4380733c0 0x7fc4380737d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc43809f0c0 tx=0x7fc43002a9a0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.507+0000 7fc43cc4a640 1 -- 172.21.15.120:0/2937111100 shutdown_connections 2024-07-27T03:12:45.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.507+0000 7fc43cc4a640 1 --2- 172.21.15.120:0/2937111100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4380733c0 0x7fc4380737d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.507+0000 7fc43cc4a640 1 --2- 172.21.15.120:0/2937111100 >> v2:172.21.15.121:3300/0 conn(0x7fc43815f6c0 0x7fc4380718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.507+0000 7fc43cc4a640 1 -- 172.21.15.120:0/2937111100 >> 172.21.15.120:0/2937111100 conn(0x7fc4380d0df0 msgr2=0x7fc4380d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.507+0000 7fc43cc4a640 1 -- 172.21.15.120:0/2937111100 shutdown_connections 2024-07-27T03:12:45.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.507+0000 7fc43cc4a640 1 -- 172.21.15.120:0/2937111100 wait complete. 2024-07-27T03:12:45.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.509+0000 7fc43cc4a640 1 Processor -- start 2024-07-27T03:12:45.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.509+0000 7fc43cc4a640 1 -- start start 2024-07-27T03:12:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.510+0000 7fc43cc4a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4380733c0 0x7fc438148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.510+0000 7fc43cc4a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4380d0450 0x7fc4380aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.510+0000 7fc43cc4a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc43815f6c0 0x7fc4380af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.510+0000 7fc43cc4a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc43815bbb0 con 0x7fc4380733c0 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.510+0000 7fc43cc4a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc43815ba30 con 0x7fc43815f6c0 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.510+0000 7fc43cc4a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc43815bd30 con 0x7fc4380d0450 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.510+0000 7fc43659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4380733c0 0x7fc438148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.510+0000 7fc43659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4380733c0 0x7fc438148fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44816/0 (socket says 172.21.15.120:44816) 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.510+0000 7fc43659c640 1 -- 172.21.15.120:0/1560039314 learned_addr learned my addr 172.21.15.120:0/1560039314 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.510+0000 7fc436d9d640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc43815f6c0 0x7fc4380af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.510+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4380d0450 0x7fc4380aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.511+0000 7fc43659c640 1 -- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4380d0450 msgr2=0x7fc4380aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.511+0000 7fc43659c640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4380d0450 0x7fc4380aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.511+0000 7fc43659c640 1 -- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc43815f6c0 msgr2=0x7fc4380af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.511+0000 7fc43659c640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc43815f6c0 0x7fc4380af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.511+0000 7fc43659c640 1 -- 172.21.15.120:0/1560039314 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4380add70 con 0x7fc4380733c0 2024-07-27T03:12:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.511+0000 7fc43659c640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4380733c0 0x7fc438148fa0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc42800c3a0 tx=0x7fc42800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.511+0000 7fc42effd640 1 -- 172.21.15.120:0/1560039314 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428017070 con 0x7fc4380733c0 2024-07-27T03:12:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.511+0000 7fc42effd640 1 -- 172.21.15.120:0/1560039314 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4280053c0 con 0x7fc4380733c0 2024-07-27T03:12:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.511+0000 7fc43cc4a640 1 -- 172.21.15.120:0/1560039314 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4380b6ac0 con 0x7fc4380733c0 2024-07-27T03:12:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.511+0000 7fc42effd640 1 -- 172.21.15.120:0/1560039314 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428003850 con 0x7fc4380733c0 2024-07-27T03:12:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.511+0000 7fc43cc4a640 1 -- 172.21.15.120:0/1560039314 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4380ae310 con 0x7fc4380733c0 2024-07-27T03:12:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.513+0000 7fc42effd640 1 -- 172.21.15.120:0/1560039314 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc42801a070 con 0x7fc4380733c0 2024-07-27T03:12:45.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.513+0000 7fc42effd640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc418077010 0x7fc418079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.513+0000 7fc42effd640 1 -- 172.21.15.120:0/1560039314 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fc428097d00 con 0x7fc4380733c0 2024-07-27T03:12:45.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.514+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc418077010 0x7fc418079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.514+0000 7fc443b6f740 1 Processor -- start 2024-07-27T03:12:45.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.514+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc418077010 0x7fc418079520 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc438071330 tx=0x7fc420005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.514+0000 7fc443b6f740 1 -- start start 2024-07-27T03:12:45.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843be09270 0x55843c1c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde03b0 0x55843c1f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843bde8590 0x55843c1d5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc443b6f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55843c121360 con 0x55843bde03b0 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc443b6f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55843c110860 con 0x55843be09270 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc443b6f740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55843c1148a0 con 0x55843bde8590 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc42ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde03b0 0x55843c1f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc42ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde03b0 0x55843c1f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44828/0 (socket says 172.21.15.120:44828) 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc42ffff640 1 -- 172.21.15.120:0/1239699249 learned_addr learned my addr 172.21.15.120:0/1239699249 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc43659c640 1 --2- 172.21.15.120:0/1239699249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843be09270 0x55843c1c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc436d9d640 1 --2- 172.21.15.120:0/1239699249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843bde8590 0x55843c1d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc42ffff640 1 -- 172.21.15.120:0/1239699249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843bde8590 msgr2=0x55843c1d5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1239699249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843bde8590 0x55843c1d5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc42ffff640 1 -- 172.21.15.120:0/1239699249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843be09270 msgr2=0x55843c1c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1239699249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843be09270 0x55843c1c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc42ffff640 1 -- 172.21.15.120:0/1239699249 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55843c0a0360 con 0x55843bde03b0 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc436d9d640 1 --2- 172.21.15.120:0/1239699249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843bde8590 0x55843c1d5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1239699249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde03b0 0x55843c1f4d10 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc420010d70 tx=0x7fc420013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a331d6832d2fbf74 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc417fff640 1 -- 172.21.15.120:0/1239699249 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420023070 con 0x55843bde03b0 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc417fff640 1 -- 172.21.15.120:0/1239699249 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc42001f450 con 0x55843bde03b0 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.516+0000 7fc417fff640 1 -- 172.21.15.120:0/1239699249 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42001f840 con 0x55843bde03b0 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.517+0000 7fc443b6f740 1 -- 172.21.15.120:0/1239699249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde03b0 msgr2=0x55843c1f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.517+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1239699249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde03b0 0x55843c1f4d10 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc420010d70 tx=0x7fc420013000 comp rx=0 tx=0).stop 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.517+0000 7fc443b6f740 1 -- 172.21.15.120:0/1239699249 shutdown_connections 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.517+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1239699249 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde03b0 0x55843c1f4d10 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.517+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1239699249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843bde8590 0x55843c1d5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.517+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1239699249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843be09270 0x55843c1c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.517+0000 7fc443b6f740 1 -- 172.21.15.120:0/1239699249 >> 172.21.15.120:0/1239699249 conn(0x55843bdfd3c0 msgr2=0x55843c1af060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.517+0000 7fc443b6f740 1 -- 172.21.15.120:0/1239699249 shutdown_connections 2024-07-27T03:12:45.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.517+0000 7fc443b6f740 1 -- 172.21.15.120:0/1239699249 wait complete. 2024-07-27T03:12:45.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.518+0000 7fc443b6f740 1 -- start start 2024-07-27T03:12:45.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.518+0000 7fc443b6f740 1 Processor -- start 2024-07-27T03:12:45.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843bde03b0 0x55843c20b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843be09270 0x55843c1eac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc443b6f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55843be83620 con 0x55843bde8590 2024-07-27T03:12:45.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc443b6f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55843c0ac140 con 0x55843be09270 2024-07-27T03:12:45.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc443b6f740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55843c1c8420 con 0x55843bde03b0 2024-07-27T03:12:45.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc443b6f740 10 client.0 _ll_register_callbacks cb 0x55843c109c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:12:45.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc42ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc42ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44834/0 (socket says 172.21.15.120:44834) 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc42ffff640 1 -- 172.21.15.120:0/4100689827 learned_addr learned my addr 172.21.15.120:0/4100689827 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc43659c640 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843bde03b0 0x55843c20b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc42ffff640 1 -- 172.21.15.120:0/4100689827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843bde03b0 msgr2=0x55843c20b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc42ffff640 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843bde03b0 0x55843c20b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc42ffff640 1 -- 172.21.15.120:0/4100689827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843be09270 msgr2=0x55843c1eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc42ffff640 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843be09270 0x55843c1eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc42ffff640 1 -- 172.21.15.120:0/4100689827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55843be74850 con 0x55843bde8590 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc42ffff640 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1c7660 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc420010740 tx=0x7fc420010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8433aaf8a7d162 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc4157fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.520+0000 7fc4157fa640 1 -- 172.21.15.120:0/4100689827 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420023040 con 0x55843bde8590 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc4157fa640 1 -- 172.21.15.120:0/4100689827 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fc420020be0 con 0x55843bde8590 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc443b6f740 1 -- 172.21.15.120:0/4100689827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc42001f450 con 0x55843bde8590 2024-07-27T03:12:45.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc4157fa640 1 -- 172.21.15.120:0/4100689827 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fc420039050 con 0x55843bde8590 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc443b6f740 10 client.6369 fetch_fsmap learned FSMap version 71 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc443b6f740 1 -- 172.21.15.120:0/4100689827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x55843beeb6b0 con 0x55843bde8590 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc4157fa640 1 -- 172.21.15.120:0/4100689827 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc42001f450 con 0x55843bde8590 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc4157fa640 1 -- 172.21.15.120:0/4100689827 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 71) ==== 3542+0+0 (secure 0 0 0) 0x7fc42003c020 con 0x55843bde8590 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc443b6f740 10 client.6369 fetch_fsmap finished waiting for FSMap version 71 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc443b6f740 10 client.6369 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc443b6f740 20 client.6369 populate_metadata read hostname 'smithi120' 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc443b6f740 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x55843bdc7e40 0x55843c207450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc443b6f740 4 client.6369 mds_command: new command op to 6159 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc443b6f740 1 -- 172.21.15.120:0/4100689827 --> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55843c1232b0 con 0x55843bdc7e40 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.521+0000 7fc43659c640 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x55843bdc7e40 0x55843c207450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.522+0000 7fc43659c640 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x55843bdc7e40 0x55843c207450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=836b4f76e6b0ee19 server_cookie=3ec30f0ff5184e4d in_seq=0 out_seq=0 2024-07-27T03:12:45.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.522+0000 7fc4157fa640 10 client.6369 ms_handle_connect on v2:172.21.15.121:6835/7061533 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.522+0000 7fc4157fa640 1 -- 172.21.15.120:0/4100689827 <== mds.0 v2:172.21.15.121:6835/7061533 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55843c1232b0 con 0x55843bdc7e40 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.522+0000 7fc4157fa640 10 client.6369 handle_command_reply: tid=0 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.522+0000 7fc443b6f740 1 client.6369 shutdown 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc443b6f740 1 -- 172.21.15.120:0/4100689827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 msgr2=0x55843c1c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc443b6f740 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1c7660 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc420010740 tx=0x7fc420010fd0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc443b6f740 1 -- 172.21.15.120:0/4100689827 shutdown_connections 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc443b6f740 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x55843bdc7e40 0x55843c207450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc443b6f740 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1c7660 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc443b6f740 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843be09270 0x55843c1eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc443b6f740 1 --2- 172.21.15.120:0/4100689827 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843bde03b0 0x55843c20b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc4157fa640 0 client.6369 ms_handle_reset on v2:172.21.15.121:6835/7061533 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc443b6f740 1 -- 172.21.15.120:0/4100689827 >> 172.21.15.120:0/4100689827 conn(0x55843bdfd3c0 msgr2=0x55843c1c8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc443b6f740 1 -- 172.21.15.120:0/4100689827 shutdown_connections 2024-07-27T03:12:45.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc443b6f740 1 -- 172.21.15.120:0/4100689827 wait complete. 2024-07-27T03:12:45.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.523+0000 7fc443b6f740 20 client.6369 trim_cache size 0 max 16384 2024-07-27T03:12:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.542+0000 7fc443b6f740 1 Processor -- start 2024-07-27T03:12:45.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.542+0000 7fc443b6f740 1 -- start start 2024-07-27T03:12:45.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843bde03b0 0x55843c1c8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843be09270 0x55843c1a8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc443b6f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc43814bcc0 con 0x55843bde8590 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc443b6f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc43814c390 con 0x55843bde03b0 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc443b6f740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc43806d540 con 0x55843be09270 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc42ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc42ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44836/0 (socket says 172.21.15.120:44836) 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc42ffff640 1 -- 172.21.15.120:0/1423766227 learned_addr learned my addr 172.21.15.120:0/1423766227 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc42ffff640 1 -- 172.21.15.120:0/1423766227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843be09270 msgr2=0x55843c1a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1423766227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843be09270 0x55843c1a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc42ffff640 1 -- 172.21.15.120:0/1423766227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843bde03b0 msgr2=0x55843c1c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1423766227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843bde03b0 0x55843c1c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.543+0000 7fc42ffff640 1 -- 172.21.15.120:0/1423766227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55843c1a4250 con 0x55843bde8590 2024-07-27T03:12:45.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.544+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1423766227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1af030 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc420012d30 tx=0x7fc4200050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fbf6a3920ba420 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.544+0000 7fc4177fe640 1 -- 172.21.15.120:0/1423766227 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420016070 con 0x55843bde8590 2024-07-27T03:12:45.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.544+0000 7fc4177fe640 1 -- 172.21.15.120:0/1423766227 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4200055d0 con 0x55843bde8590 2024-07-27T03:12:45.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.544+0000 7fc4177fe640 1 -- 172.21.15.120:0/1423766227 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420023040 con 0x55843bde8590 2024-07-27T03:12:45.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.544+0000 7fc443b6f740 1 -- 172.21.15.120:0/1423766227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 msgr2=0x55843c1af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.544+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1423766227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1af030 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc420012d30 tx=0x7fc4200050d0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.545+0000 7fc443b6f740 1 -- 172.21.15.120:0/1423766227 shutdown_connections 2024-07-27T03:12:45.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.545+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1423766227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c1af030 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.545+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1423766227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843be09270 0x55843c1a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.545+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1423766227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843bde03b0 0x55843c1c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.545+0000 7fc443b6f740 1 -- 172.21.15.120:0/1423766227 >> 172.21.15.120:0/1423766227 conn(0x55843bdfd3c0 msgr2=0x55843c1d8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.545+0000 7fc443b6f740 1 -- 172.21.15.120:0/1423766227 shutdown_connections 2024-07-27T03:12:45.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.545+0000 7fc443b6f740 1 -- 172.21.15.120:0/1423766227 wait complete. 2024-07-27T03:12:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.545+0000 7fc443b6f740 1 -- start start 2024-07-27T03:12:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.546+0000 7fc443b6f740 1 Processor -- start 2024-07-27T03:12:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843bde03b0 0x55843c277660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c273ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc443b6f740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843be09270 0x55843c2075a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc443b6f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55843c1dc5a0 con 0x55843bde8590 2024-07-27T03:12:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc443b6f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55843c1dabf0 con 0x55843bde03b0 2024-07-27T03:12:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc443b6f740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x55843c1ed390 con 0x55843be09270 2024-07-27T03:12:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc443b6f740 10 client.0 _ll_register_callbacks cb 0x7fc42805ce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-27T03:12:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc42ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c273ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc42ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c273ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44848/0 (socket says 172.21.15.120:44848) 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc42ffff640 1 -- 172.21.15.120:0/1329502420 learned_addr learned my addr 172.21.15.120:0/1329502420 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc436d9d640 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843be09270 0x55843c2075a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc43659c640 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843bde03b0 0x55843c277660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc42ffff640 1 -- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843be09270 msgr2=0x55843c2075a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843be09270 0x55843c2075a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc42ffff640 1 -- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843bde03b0 msgr2=0x55843c277660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843bde03b0 0x55843c277660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc42ffff640 1 -- 172.21.15.120:0/1329502420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55843c1d08f0 con 0x55843bde8590 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc436d9d640 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843be09270 0x55843c2075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.547+0000 7fc43659c640 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843bde03b0 0x55843c277660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc42ffff640 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c273ae0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc420035040 tx=0x7fc420009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebed23030b7a6c01 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc4157fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc4157fa640 1 -- 172.21.15.120:0/1329502420 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420016040 con 0x55843bde8590 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc4157fa640 1 -- 172.21.15.120:0/1329502420 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fc420004020 con 0x55843bde8590 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc443b6f740 1 -- 172.21.15.120:0/1329502420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4200055d0 con 0x55843bde8590 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc4157fa640 1 -- 172.21.15.120:0/1329502420 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fc42004f050 con 0x55843bde8590 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc443b6f740 10 client.6375 fetch_fsmap learned FSMap version 71 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc443b6f740 1 -- 172.21.15.120:0/1329502420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x55843c277c60 con 0x55843bde8590 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc4157fa640 1 -- 172.21.15.120:0/1329502420 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4200055d0 con 0x55843bde8590 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc4157fa640 1 -- 172.21.15.120:0/1329502420 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 71) ==== 3542+0+0 (secure 0 0 0) 0x7fc420052020 con 0x55843bde8590 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc443b6f740 10 client.6375 fetch_fsmap finished waiting for FSMap version 71 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc443b6f740 10 client.6375 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc443b6f740 20 client.6375 populate_metadata read hostname 'smithi120' 2024-07-27T03:12:45.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x55843c1a87e0 0x55843c1a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc443b6f740 4 client.6375 mds_command: new command op to 6159 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-27T03:12:45.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc443b6f740 1 -- 172.21.15.120:0/1329502420 --> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] -- command(tid 0: {"prefix": "status"}) -- 0x55843c11ed50 con 0x55843c1a87e0 2024-07-27T03:12:45.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.548+0000 7fc43659c640 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x55843c1a87e0 0x55843c1a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc43659c640 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x55843c1a87e0 0x55843c1a8bf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2df66e1863cecf2 server_cookie=5683ce46f4a954dd in_seq=0 out_seq=0 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc4157fa640 10 client.6375 ms_handle_connect on v2:172.21.15.121:6835/7061533 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc4157fa640 1 -- 172.21.15.120:0/1329502420 <== mds.0 v2:172.21.15.121:6835/7061533 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55843c11ed50 con 0x55843c1a87e0 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc4157fa640 10 client.6375 handle_command_reply: tid=0 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc443b6f740 1 client.6375 shutdown 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc443b6f740 1 -- 172.21.15.120:0/1329502420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 msgr2=0x55843c273ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c273ae0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc420035040 tx=0x7fc420009750 comp rx=0 tx=0).stop 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc443b6f740 1 -- 172.21.15.120:0/1329502420 shutdown_connections 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:6835/7061533,v1:172.21.15.121:6837/7061533] conn(0x55843c1a87e0 0x55843c1a8bf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55843bde8590 0x55843c273ae0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc4157fa640 0 client.6375 ms_handle_reset on v2:172.21.15.121:6835/7061533 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55843be09270 0x55843c2075a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc443b6f740 1 --2- 172.21.15.120:0/1329502420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55843bde03b0 0x55843c277660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc443b6f740 1 -- 172.21.15.120:0/1329502420 >> 172.21.15.120:0/1329502420 conn(0x55843bdfd3c0 msgr2=0x55843c1d8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc443b6f740 1 -- 172.21.15.120:0/1329502420 shutdown_connections 2024-07-27T03:12:45.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.549+0000 7fc443b6f740 1 -- 172.21.15.120:0/1329502420 wait complete. 2024-07-27T03:12:45.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc443b6f740 20 client.6375 trim_cache size 0 max 16384 2024-07-27T03:12:45.560 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:12:45.560 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "81c6fc84-d59a-4d77-bf87-f698cf0d6963", 2024-07-27T03:12:45.560 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-07-27T03:12:45.560 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 6159, 2024-07-27T03:12:45.561 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-07-27T03:12:45.561 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-07-27T03:12:45.561 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-07-27T03:12:45.561 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 11.121206670999999, 2024-07-27T03:12:45.561 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 71, 2024-07-27T03:12:45.561 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 69, 2024-07-27T03:12:45.561 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 69, 2024-07-27T03:12:45.561 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 16.424963861999998 2024-07-27T03:12:45.561 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:12:45.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 -- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc418077010 msgr2=0x7fc418079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc418077010 0x7fc418079520 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc438071330 tx=0x7fc420005f30 comp rx=0 tx=0).stop 2024-07-27T03:12:45.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 -- 172.21.15.120:0/1560039314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4380733c0 msgr2=0x7fc438148fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4380733c0 0x7fc438148fa0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc42800c3a0 tx=0x7fc42800c860 comp rx=0 tx=0).stop 2024-07-27T03:12:45.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 -- 172.21.15.120:0/1560039314 shutdown_connections 2024-07-27T03:12:45.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc418077010 0x7fc418079520 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc43815f6c0 0x7fc4380af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc4380d0450 0x7fc4380aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 --2- 172.21.15.120:0/1560039314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc4380733c0 0x7fc438148fa0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 -- 172.21.15.120:0/1560039314 >> 172.21.15.120:0/1560039314 conn(0x7fc4380d0df0 msgr2=0x7fc4380ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 -- 172.21.15.120:0/1560039314 shutdown_connections 2024-07-27T03:12:45.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.550+0000 7fc43cc4a640 1 -- 172.21.15.120:0/1560039314 wait complete. 2024-07-27T03:12:45.564 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:12:45.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.675+0000 7f290b700640 1 -- 172.21.15.120:0/367568334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29041585d0 msgr2=0x7f290415dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.675+0000 7f290b700640 1 --2- 172.21.15.120:0/367568334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29041585d0 0x7f290415dc10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f290406fcd0 tx=0x7f290002aac0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.675+0000 7f290b700640 1 -- 172.21.15.120:0/367568334 shutdown_connections 2024-07-27T03:12:45.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.675+0000 7f290b700640 1 --2- 172.21.15.120:0/367568334 >> v2:172.21.15.121:3300/0 conn(0x7f290406f210 0x7f290415c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.675+0000 7f290b700640 1 --2- 172.21.15.120:0/367568334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29041585d0 0x7f290415dc10 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.675+0000 7f290b700640 1 -- 172.21.15.120:0/367568334 >> 172.21.15.120:0/367568334 conn(0x7f29040b1a10 msgr2=0x7f29040b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.675+0000 7f290b700640 1 -- 172.21.15.120:0/367568334 shutdown_connections 2024-07-27T03:12:45.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.675+0000 7f290b700640 1 -- 172.21.15.120:0/367568334 wait complete. 2024-07-27T03:12:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.677+0000 7f290b700640 1 Processor -- start 2024-07-27T03:12:45.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.677+0000 7f290b700640 1 -- start start 2024-07-27T03:12:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290b700640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29041585d0 0x7f2904072fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290b700640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f290415c000 0x7f290409b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290b700640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2904073510 0x7f290409baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290b700640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f290406e600 con 0x7f29041585d0 2024-07-27T03:12:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290b700640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f290406e480 con 0x7f2904073510 2024-07-27T03:12:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290b700640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f290406e780 con 0x7f290415c000 2024-07-27T03:12:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290949c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29041585d0 0x7f2904072fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290949c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29041585d0 0x7f2904072fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44868/0 (socket says 172.21.15.120:44868) 2024-07-27T03:12:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290949c640 1 -- 172.21.15.120:0/3999231053 learned_addr learned my addr 172.21.15.120:0/3999231053 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290949c640 1 -- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f290415c000 msgr2=0x7f290409b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290949c640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f290415c000 0x7f290409b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290949c640 1 -- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2904073510 msgr2=0x7f290409baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f2909c9d640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2904073510 0x7f290409baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290949c640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2904073510 0x7f290409baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.678+0000 7f290949c640 1 -- 172.21.15.120:0/3999231053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290409ce80 con 0x7f29041585d0 2024-07-27T03:12:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.679+0000 7f290949c640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29041585d0 0x7f2904072fd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2900000f80 tx=0x7f2900003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.679+0000 7f28f9ffb640 1 -- 172.21.15.120:0/3999231053 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900044070 con 0x7f29041585d0 2024-07-27T03:12:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.679+0000 7f28f9ffb640 1 -- 172.21.15.120:0/3999231053 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2900004250 con 0x7f29041585d0 2024-07-27T03:12:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.679+0000 7f290b700640 1 -- 172.21.15.120:0/3999231053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290409d160 con 0x7f29041585d0 2024-07-27T03:12:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.679+0000 7f28f9ffb640 1 -- 172.21.15.120:0/3999231053 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900004680 con 0x7f29041585d0 2024-07-27T03:12:45.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.679+0000 7f290b700640 1 -- 172.21.15.120:0/3999231053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f290409adb0 con 0x7f29041585d0 2024-07-27T03:12:45.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.680+0000 7f290b700640 1 -- 172.21.15.120:0/3999231053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f290415c410 con 0x7f29041585d0 2024-07-27T03:12:45.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.681+0000 7f28f9ffb640 1 -- 172.21.15.120:0/3999231053 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2900036400 con 0x7f29041585d0 2024-07-27T03:12:45.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.681+0000 7f28f9ffb640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f28e8077040 0x7f28e8079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:45.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.681+0000 7f28f9ffb640 1 -- 172.21.15.120:0/3999231053 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f29000b9070 con 0x7f29041585d0 2024-07-27T03:12:45.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.681+0000 7f2908c9b640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f28e8077040 0x7f28e8079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:45.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.682+0000 7f2908c9b640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f28e8077040 0x7f28e8079550 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28f4000f60 tx=0x7f28f40079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:45.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.685+0000 7f28f9ffb640 1 -- 172.21.15.120:0/3999231053 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f2900032030 con 0x7f29041585d0 2024-07-27T03:12:45.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.903+0000 7f290b700640 1 -- 172.21.15.120:0/3999231053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f290415b410 con 0x7f29041585d0 2024-07-27T03:12:45.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.903+0000 7f28f9ffb640 1 -- 172.21.15.120:0/3999231053 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5266 (secure 0 0 0) 0x7f2900004820 con 0x7f29041585d0 2024-07-27T03:12:45.906 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:12:45.906 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":71,"btime":"2024-07-27T03:12:44:498341+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2578460445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2578460445},{"type":"v1","addr":"172.21.15.120:6835","nonce":2578460445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:12:33.787428+0000","modified":"2024-07-27T03:12:44.498334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6159,"mds_1":6144,"mds_2":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"d","rank":2,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.121:6836/2998929726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2998929726},{"type":"v1","addr":"172.21.15.121:6836","nonce":2998929726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6144":{"gid":6144,"name":"c","rank":1,"incarnation":68,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6833/3985484834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3985484834},{"type":"v1","addr":"172.21.15.120:6833","nonce":3985484834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/7061533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":7061533},{"type":"v1","addr":"172.21.15.121:6837","nonce":7061533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6159,"qdb_cluster":[5489,6144,6159]},"id":5}]} 2024-07-27T03:12:45.906 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 71 2024-07-27T03:12:45.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.905+0000 7f290b700640 1 -- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f28e8077040 msgr2=0x7f28e8079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.905+0000 7f290b700640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f28e8077040 0x7f28e8079550 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f28f4000f60 tx=0x7f28f40079b0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.905+0000 7f290b700640 1 -- 172.21.15.120:0/3999231053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29041585d0 msgr2=0x7f2904072fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:45.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.905+0000 7f290b700640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29041585d0 0x7f2904072fd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2900000f80 tx=0x7f2900003f10 comp rx=0 tx=0).stop 2024-07-27T03:12:45.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.906+0000 7f290b700640 1 -- 172.21.15.120:0/3999231053 shutdown_connections 2024-07-27T03:12:45.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.906+0000 7f290b700640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f28e8077040 0x7f28e8079550 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.906+0000 7f290b700640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2904073510 0x7f290409baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.906+0000 7f290b700640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f290415c000 0x7f290409b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.906+0000 7f290b700640 1 --2- 172.21.15.120:0/3999231053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29041585d0 0x7f2904072fd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:45.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.906+0000 7f290b700640 1 -- 172.21.15.120:0/3999231053 >> 172.21.15.120:0/3999231053 conn(0x7f29040b1a10 msgr2=0x7f29040b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:45.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.906+0000 7f290b700640 1 -- 172.21.15.120:0/3999231053 shutdown_connections 2024-07-27T03:12:45.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:45.906+0000 7f290b700640 1 -- 172.21.15.120:0/3999231053 wait complete. 2024-07-27T03:12:45.920 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs balance_automate true 2024-07-27T03:12:46.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.034+0000 7f4433796640 1 -- 172.21.15.120:0/2436698866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f442c160a50 msgr2=0x7f442c06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:46.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.034+0000 7f4433796640 1 --2- 172.21.15.120:0/2436698866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f442c160a50 0x7f442c06cff0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f442c0b07a0 tx=0x7f442802a540 comp rx=0 tx=0).stop 2024-07-27T03:12:46.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.034+0000 7f4433796640 1 -- 172.21.15.120:0/2436698866 shutdown_connections 2024-07-27T03:12:46.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.034+0000 7f4433796640 1 --2- 172.21.15.120:0/2436698866 >> v2:172.21.15.121:3300/0 conn(0x7f442c0ce120 0x7f442c142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:46.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.034+0000 7f4433796640 1 --2- 172.21.15.120:0/2436698866 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f442c0cb3c0 0x7f442c0cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:46.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.034+0000 7f4433796640 1 --2- 172.21.15.120:0/2436698866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f442c160a50 0x7f442c06cff0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:46.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.034+0000 7f4433796640 1 -- 172.21.15.120:0/2436698866 >> 172.21.15.120:0/2436698866 conn(0x7f442c0b2ca0 msgr2=0x7f442c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:46.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.034+0000 7f4433796640 1 -- 172.21.15.120:0/2436698866 shutdown_connections 2024-07-27T03:12:46.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.034+0000 7f4433796640 1 -- 172.21.15.120:0/2436698866 wait complete. 2024-07-27T03:12:46.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.036+0000 7f4433796640 1 Processor -- start 2024-07-27T03:12:46.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.036+0000 7f4433796640 1 -- start start 2024-07-27T03:12:46.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4433796640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442c0cb3c0 0x7f442c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:46.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4433796640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f442c0ce120 0x7f442c152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:46.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4433796640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f442c160a50 0x7f442c0c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:46.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4433796640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f442c143270 con 0x7f442c160a50 2024-07-27T03:12:46.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4433796640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f442c06d5b0 con 0x7f442c0cb3c0 2024-07-27T03:12:46.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4433796640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f442c1433f0 con 0x7f442c0ce120 2024-07-27T03:12:46.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4431d33640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f442c160a50 0x7f442c0c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:46.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4431d33640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f442c160a50 0x7f442c0c48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44890/0 (socket says 172.21.15.120:44890) 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4431d33640 1 -- 172.21.15.120:0/3107333335 learned_addr learned my addr 172.21.15.120:0/3107333335 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4431532640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442c0cb3c0 0x7f442c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4430d31640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f442c0ce120 0x7f442c152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4431d33640 1 -- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f442c0ce120 msgr2=0x7f442c152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4431d33640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f442c0ce120 0x7f442c152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4431d33640 1 -- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442c0cb3c0 msgr2=0x7f442c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4431d33640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442c0cb3c0 0x7f442c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.037+0000 7f4431d33640 1 -- 172.21.15.120:0/3107333335 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c152bc0 con 0x7f442c160a50 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.038+0000 7f4431d33640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f442c160a50 0x7f442c0c48a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f442400d9e0 tx=0x7f442400dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.038+0000 7f4421ffb640 1 -- 172.21.15.120:0/3107333335 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424017070 con 0x7f442c160a50 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.038+0000 7f4421ffb640 1 -- 172.21.15.120:0/3107333335 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f442400be30 con 0x7f442c160a50 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.038+0000 7f4433796640 1 -- 172.21.15.120:0/3107333335 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c1f8f30 con 0x7f442c160a50 2024-07-27T03:12:46.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.038+0000 7f4421ffb640 1 -- 172.21.15.120:0/3107333335 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424003bb0 con 0x7f442c160a50 2024-07-27T03:12:46.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.038+0000 7f4433796640 1 -- 172.21.15.120:0/3107333335 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c1f94f0 con 0x7f442c160a50 2024-07-27T03:12:46.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.039+0000 7f4433796640 1 -- 172.21.15.120:0/3107333335 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442c143870 con 0x7f442c160a50 2024-07-27T03:12:46.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.040+0000 7f4421ffb640 1 -- 172.21.15.120:0/3107333335 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4424010460 con 0x7f442c160a50 2024-07-27T03:12:46.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.040+0000 7f4421ffb640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4410077010 0x7f4410079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:12:46.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.040+0000 7f4421ffb640 1 -- 172.21.15.120:0/3107333335 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f4424098c40 con 0x7f442c160a50 2024-07-27T03:12:46.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.040+0000 7f4431532640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4410077010 0x7f4410079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:12:46.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.040+0000 7f4431532640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4410077010 0x7f4410079520 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4428034000 tx=0x7f4428004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:12:46.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.044+0000 7f4421ffb640 1 -- 172.21.15.120:0/3107333335 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f4424061880 con 0x7f442c160a50 2024-07-27T03:12:46.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.261+0000 7f4433796640 1 -- 172.21.15.120:0/3107333335 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f442c0d0930 con 0x7f442c160a50 2024-07-27T03:12:46.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.508+0000 7f4421ffb640 1 -- 172.21.15.120:0/3107333335 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v72) ==== 117+0+0 (secure 0 0 0) 0x7f4424065dd0 con 0x7f442c160a50 2024-07-27T03:12:46.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 -- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4410077010 msgr2=0x7f4410079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:46.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4410077010 0x7f4410079520 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4428034000 tx=0x7f4428004730 comp rx=0 tx=0).stop 2024-07-27T03:12:46.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 -- 172.21.15.120:0/3107333335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f442c160a50 msgr2=0x7f442c0c48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:12:46.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f442c160a50 0x7f442c0c48a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f442400d9e0 tx=0x7f442400dea0 comp rx=0 tx=0).stop 2024-07-27T03:12:46.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 -- 172.21.15.120:0/3107333335 shutdown_connections 2024-07-27T03:12:46.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4410077010 0x7f4410079520 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:46.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f442c160a50 0x7f442c0c48a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:46.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f442c0ce120 0x7f442c152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:46.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 --2- 172.21.15.120:0/3107333335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f442c0cb3c0 0x7f442c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:12:46.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 -- 172.21.15.120:0/3107333335 >> 172.21.15.120:0/3107333335 conn(0x7f442c0b2ca0 msgr2=0x7f442c06fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:12:46.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 -- 172.21.15.120:0/3107333335 shutdown_connections 2024-07-27T03:12:46.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46.510+0000 7f4433796640 1 -- 172.21.15.120:0/3107333335 wait complete. 2024-07-27T03:12:46.526 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p 1/a') 2024-07-27T03:12:46.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-27T03:12:46.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:12:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-27T03:12:46.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:46.589 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.bal.mask -v 2 1) 2024-07-27T03:12:46.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:46.606 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:12:46.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:12:46.662 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:12:51.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:51.663 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:12:51.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:12:51.683 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:12:56.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:12:56.684 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:12:56.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:12:56.706 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:01.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:01.707 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:01.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:01.729 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:06.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:06.731 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:06.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:06.751 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:11.236 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:13:11.239 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:13:11.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:11.753 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:11.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:11.773 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:16.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:16.774 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:16.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:16.794 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:21.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:21.795 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:21.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:21.816 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:26.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:26.817 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:26.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:26.838 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:31.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:31.839 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:31.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:31.859 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:36.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:36.860 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:36.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:36.880 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:41.314 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:13:41.317 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:13:41.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:41.882 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:41.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:41.902 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:46.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:46.904 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:46.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:46.924 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:51.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:51.926 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:51.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:51.946 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:13:56.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:13:56.948 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:13:56.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:13:56.970 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:14:01.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:01.971 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:14:01.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:14:01.992 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:14:06.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:06.994 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:14:07.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:14:07.014 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:14:11.476 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:14:11.480 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:14:12.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:12.016 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:14:12.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:14:12.038 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:14:17.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:17.040 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:14:17.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:14:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:14:22.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:22.079 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.bal.mask 1) 2024-07-27T03:14:22.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:14:22.100 INFO:teuthology.orchestra.run.smithi120.stderr:1: ceph.dir.bal.mask: No such attribute 2024-07-27T03:14:22.101 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-07-27T03:14:22.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:14:22.188 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-27T03:14:22.242 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-07-27T03:14:22.242 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:14:22.243 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:14:22.243 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:14:22.261 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:14:22.261 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:14:22.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-27T03:14:22.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.481+0000 7f67567ac640 1 -- 172.21.15.120:0/2151075756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67500b2c40 msgr2=0x7f67500d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:22.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.481+0000 7f67567ac640 1 --2- 172.21.15.120:0/2151075756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67500b2c40 0x7f67500d09c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f67500d24d0 tx=0x7f674402a5f0 comp rx=0 tx=0).stop 2024-07-27T03:14:22.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.481+0000 7f67567ac640 1 -- 172.21.15.120:0/2151075756 shutdown_connections 2024-07-27T03:14:22.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.481+0000 7f67567ac640 1 --2- 172.21.15.120:0/2151075756 >> v2:172.21.15.121:3300/0 conn(0x7f67500d0f00 0x7f67500cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:22.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.481+0000 7f67567ac640 1 --2- 172.21.15.120:0/2151075756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67500b2c40 0x7f67500d09c0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:22.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.481+0000 7f67567ac640 1 -- 172.21.15.120:0/2151075756 >> 172.21.15.120:0/2151075756 conn(0x7f675008d690 msgr2=0x7f675009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:22.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.481+0000 7f67567ac640 1 -- 172.21.15.120:0/2151075756 shutdown_connections 2024-07-27T03:14:22.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.481+0000 7f67567ac640 1 -- 172.21.15.120:0/2151075756 wait complete. 2024-07-27T03:14:22.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.483+0000 7f67567ac640 1 Processor -- start 2024-07-27T03:14:22.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.483+0000 7f67567ac640 1 -- start start 2024-07-27T03:14:22.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.484+0000 7f67567ac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67500b2c40 0x7f67501f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:22.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.484+0000 7f67567ac640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67500b4740 0x7f67501f9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:22.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.484+0000 7f67567ac640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67500d0f00 0x7f67500c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.484+0000 7f67567ac640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f67500b33c0 con 0x7f67500b2c40 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.484+0000 7f67567ac640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f67500d3100 con 0x7f67500b4740 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.484+0000 7f67567ac640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f67500cf120 con 0x7f67500d0f00 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.484+0000 7f674ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67500b2c40 0x7f67501f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.484+0000 7f674ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67500b2c40 0x7f67501f8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50898/0 (socket says 172.21.15.120:50898) 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.484+0000 7f674ffff640 1 -- 172.21.15.120:0/2934850239 learned_addr learned my addr 172.21.15.120:0/2934850239 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f6754d49640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67500d0f00 0x7f67500c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f674ffff640 1 -- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67500d0f00 msgr2=0x7f67500c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f674f7fe640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67500b4740 0x7f67501f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f674ffff640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67500d0f00 0x7f67500c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f674ffff640 1 -- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67500b4740 msgr2=0x7f67501f9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f674ffff640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67500b4740 0x7f67501f9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:22.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f674ffff640 1 -- 172.21.15.120:0/2934850239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67500ca490 con 0x7f67500b2c40 2024-07-27T03:14:22.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f6754d49640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67500d0f00 0x7f67500c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:14:22.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f674ffff640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67500b2c40 0x7f67501f8bd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f674000c3d0 tx=0x7f674000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:22.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f674cff9640 1 -- 172.21.15.120:0/2934850239 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740017070 con 0x7f67500b2c40 2024-07-27T03:14:22.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f674cff9640 1 -- 172.21.15.120:0/2934850239 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67400053c0 con 0x7f67500b2c40 2024-07-27T03:14:22.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f67567ac640 1 -- 172.21.15.120:0/2934850239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67500b7290 con 0x7f67500b2c40 2024-07-27T03:14:22.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f674cff9640 1 -- 172.21.15.120:0/2934850239 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740003850 con 0x7f67500b2c40 2024-07-27T03:14:22.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.485+0000 7f67567ac640 1 -- 172.21.15.120:0/2934850239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67500b7850 con 0x7f67500b2c40 2024-07-27T03:14:22.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.486+0000 7f67567ac640 1 -- 172.21.15.120:0/2934850239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67500d09c0 con 0x7f67500b2c40 2024-07-27T03:14:22.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.487+0000 7f674cff9640 1 -- 172.21.15.120:0/2934850239 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f674001a070 con 0x7f67500b2c40 2024-07-27T03:14:22.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.487+0000 7f674cff9640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f673c077010 0x7f673c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:22.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.487+0000 7f674cff9640 1 -- 172.21.15.120:0/2934850239 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f6740097da0 con 0x7f67500b2c40 2024-07-27T03:14:22.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.487+0000 7f674f7fe640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f673c077010 0x7f673c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:22.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.488+0000 7f674f7fe640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f673c077010 0x7f673c079520 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6744033000 tx=0x7f6744004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:22.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.492+0000 7f674cff9640 1 -- 172.21.15.120:0/2934850239 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f67500d1310 con 0x7f67500b2c40 2024-07-27T03:14:22.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.685+0000 7f67567ac640 1 -- 172.21.15.120:0/2934850239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f67500b5c90 con 0x7f67500b2c40 2024-07-27T03:14:22.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.685+0000 7f674cff9640 1 -- 172.21.15.120:0/2934850239 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) ==== 80+0+0 (secure 0 0 0) 0x7f6740060f60 con 0x7f67500b2c40 2024-07-27T03:14:22.689 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-07-27T03:14:22.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 -- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f673c077010 msgr2=0x7f673c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:22.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f673c077010 0x7f673c079520 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6744033000 tx=0x7f6744004730 comp rx=0 tx=0).stop 2024-07-27T03:14:22.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 -- 172.21.15.120:0/2934850239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67500b2c40 msgr2=0x7f67501f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67500b2c40 0x7f67501f8bd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f674000c3d0 tx=0x7f674000c890 comp rx=0 tx=0).stop 2024-07-27T03:14:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 -- 172.21.15.120:0/2934850239 shutdown_connections 2024-07-27T03:14:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f673c077010 0x7f673c079520 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67500d0f00 0x7f67500c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67500b4740 0x7f67501f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 --2- 172.21.15.120:0/2934850239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67500b2c40 0x7f67501f8bd0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 -- 172.21.15.120:0/2934850239 >> 172.21.15.120:0/2934850239 conn(0x7f675008d690 msgr2=0x7f6750075750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 -- 172.21.15.120:0/2934850239 shutdown_connections 2024-07-27T03:14:22.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.687+0000 7f67567ac640 1 -- 172.21.15.120:0/2934850239 wait complete. 2024-07-27T03:14:22.702 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-07-27T03:14:22.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:22.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-07-27T03:14:22.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:14:22.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:22.732 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-07-27T03:14:22.787 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:14:22.788 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:14:22.788 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:14:22.808 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:14:22.808 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:14:22.808 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:14:22.808 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:14:22.844 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:14:22.844 INFO:tasks.cephfs.mount:Terminating background process 2024-07-27T03:14:22.844 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:14:22.844 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:14:22.866 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:14:22.867 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:14:22.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.993+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2019769376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce406eb00 msgr2=0x7f2ce406ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:22.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.993+0000 7f2ce8b6b640 1 --2- 172.21.15.120:0/2019769376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce406eb00 0x7f2ce406ef10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc005fd0 tx=0x7f2cdc02aaa0 comp rx=0 tx=0).stop 2024-07-27T03:14:22.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.994+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2019769376 shutdown_connections 2024-07-27T03:14:22.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.994+0000 7f2ce8b6b640 1 --2- 172.21.15.120:0/2019769376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce406eb00 0x7f2ce406ef10 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:22.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.994+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2019769376 >> 172.21.15.120:0/2019769376 conn(0x7f2ce40b1a10 msgr2=0x7f2ce40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:22.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.994+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2019769376 shutdown_connections 2024-07-27T03:14:22.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.994+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2019769376 wait complete. 2024-07-27T03:14:22.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.996+0000 7f2ce8b6b640 1 Processor -- start 2024-07-27T03:14:22.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.996+0000 7f2ce8b6b640 1 -- start start 2024-07-27T03:14:23.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce8b6b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce406eb00 0x7f2ce414e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce8b6b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce4072b60 0x7f2ce40cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce8b6b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2ce415a8b0 0x7f2ce40ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce8b6b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce406e600 con 0x7f2ce406eb00 2024-07-27T03:14:23.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce8b6b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce406e480 con 0x7f2ce4072b60 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce8b6b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce406e780 con 0x7f2ce415a8b0 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce406eb00 0x7f2ce414e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce406eb00 0x7f2ce414e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50914/0 (socket says 172.21.15.120:50914) 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce259c640 1 -- 172.21.15.120:0/2001133118 learned_addr learned my addr 172.21.15.120:0/2001133118 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2cd9d9b640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce4072b60 0x7f2ce40cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce2d9d640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2ce415a8b0 0x7f2ce40ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce259c640 1 -- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2ce415a8b0 msgr2=0x7f2ce40ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce259c640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2ce415a8b0 0x7f2ce40ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce259c640 1 -- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce4072b60 msgr2=0x7f2ce40cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce259c640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce4072b60 0x7f2ce40cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce259c640 1 -- 172.21.15.120:0/2001133118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce414eba0 con 0x7f2ce406eb00 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2cd9d9b640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce4072b60 0x7f2ce40cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:14:23.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.997+0000 7f2ce259c640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce406eb00 0x7f2ce414e2e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4001eb0 tx=0x7f2cd400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:23.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.998+0000 7f2cdb7fe640 1 -- 172.21.15.120:0/2001133118 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4017070 con 0x7f2ce406eb00 2024-07-27T03:14:23.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.998+0000 7f2cdb7fe640 1 -- 172.21.15.120:0/2001133118 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cd40053c0 con 0x7f2ce406eb00 2024-07-27T03:14:23.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.998+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2001133118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce414ee80 con 0x7f2ce406eb00 2024-07-27T03:14:23.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.998+0000 7f2cdb7fe640 1 -- 172.21.15.120:0/2001133118 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4003830 con 0x7f2ce406eb00 2024-07-27T03:14:23.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.998+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2001133118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce414f440 con 0x7f2ce406eb00 2024-07-27T03:14:23.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:22.999+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2001133118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce406ef10 con 0x7f2ce406eb00 2024-07-27T03:14:23.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.000+0000 7f2cdb7fe640 1 -- 172.21.15.120:0/2001133118 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2cd401a070 con 0x7f2ce406eb00 2024-07-27T03:14:23.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.000+0000 7f2cdb7fe640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2cc4077010 0x7f2cc4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.000+0000 7f2cdb7fe640 1 -- 172.21.15.120:0/2001133118 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f2cd4097de0 con 0x7f2ce406eb00 2024-07-27T03:14:23.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.000+0000 7f2cd9d9b640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2cc4077010 0x7f2cc4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.001+0000 7f2cd9d9b640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2cc4077010 0x7f2cc4079520 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4150290 tx=0x7f2ccc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:23.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.004+0000 7f2cdb7fe640 1 -- 172.21.15.120:0/2001133118 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f2cd4060fa0 con 0x7f2ce406eb00 2024-07-27T03:14:23.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.222+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2001133118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ce40b4ac0 con 0x7f2ce406eb00 2024-07-27T03:14:23.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.222+0000 7f2cdb7fe640 1 -- 172.21.15.120:0/2001133118 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5267 (secure 0 0 0) 0x7f2cd4069270 con 0x7f2ce406eb00 2024-07-27T03:14:23.226 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:23.226 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":73,"btime":"2024-07-27T03:12:54:659642+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2578460445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2578460445},{"type":"v1","addr":"172.21.15.120:6835","nonce":2578460445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":73,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:12:33.787428+0000","modified":"2024-07-27T03:12:54.128072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6159,"mds_1":6144,"mds_2":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"d","rank":2,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.121:6836/2998929726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2998929726},{"type":"v1","addr":"172.21.15.121:6836","nonce":2998929726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6144":{"gid":6144,"name":"c","rank":1,"incarnation":68,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6833/3985484834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3985484834},{"type":"v1","addr":"172.21.15.120:6833","nonce":3985484834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/7061533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":7061533},{"type":"v1","addr":"172.21.15.121:6837","nonce":7061533}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6159,"qdb_cluster":[5489,6144,6159]},"id":5}]} 2024-07-27T03:14:23.226 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 73 2024-07-27T03:14:23.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2cc4077010 msgr2=0x7f2cc4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2cc4077010 0x7f2cc4079520 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4150290 tx=0x7f2ccc009040 comp rx=0 tx=0).stop 2024-07-27T03:14:23.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2001133118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce406eb00 msgr2=0x7f2ce414e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce406eb00 0x7f2ce414e2e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4001eb0 tx=0x7f2cd400c890 comp rx=0 tx=0).stop 2024-07-27T03:14:23.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2001133118 shutdown_connections 2024-07-27T03:14:23.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2cc4077010 0x7f2cc4079520 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2ce415a8b0 0x7f2ce40ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce4072b60 0x7f2ce40cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 --2- 172.21.15.120:0/2001133118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ce406eb00 0x7f2ce414e2e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2001133118 >> 172.21.15.120:0/2001133118 conn(0x7f2ce40b1a10 msgr2=0x7f2ce4153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:23.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2001133118 shutdown_connections 2024-07-27T03:14:23.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.224+0000 7f2ce8b6b640 1 -- 172.21.15.120:0/2001133118 wait complete. 2024-07-27T03:14:23.240 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:14:23.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.351+0000 7f504f388640 1 -- 172.21.15.120:0/3034215837 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5048162990 msgr2=0x7f50480b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.351+0000 7f504f388640 1 --2- 172.21.15.120:0/3034215837 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5048162990 0x7f50480b5cd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5038005fd0 tx=0x7f503802a5d0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.351+0000 7f504f388640 1 -- 172.21.15.120:0/3034215837 shutdown_connections 2024-07-27T03:14:23.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.351+0000 7f504f388640 1 --2- 172.21.15.120:0/3034215837 >> v2:172.21.15.121:3300/0 conn(0x7f50480b6210 0x7f50480cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.351+0000 7f504f388640 1 --2- 172.21.15.120:0/3034215837 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5048162990 0x7f50480b5cd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.351+0000 7f504f388640 1 -- 172.21.15.120:0/3034215837 >> 172.21.15.120:0/3034215837 conn(0x7f504806cba0 msgr2=0x7f504806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:23.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.351+0000 7f504f388640 1 -- 172.21.15.120:0/3034215837 shutdown_connections 2024-07-27T03:14:23.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.351+0000 7f504f388640 1 -- 172.21.15.120:0/3034215837 wait complete. 2024-07-27T03:14:23.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.353+0000 7f504f388640 1 Processor -- start 2024-07-27T03:14:23.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.353+0000 7f504f388640 1 -- start start 2024-07-27T03:14:23.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.354+0000 7f504f388640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f504806f2c0 0x7f504815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.354+0000 7f504f388640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50480b6210 0x7f50481540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.354+0000 7f504f388640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5048162990 0x7f50481573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.354+0000 7f504f388640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f50480cdea0 con 0x7f5048162990 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.354+0000 7f504f388640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f50480cdd20 con 0x7f50480b6210 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.354+0000 7f504f388640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f50480ce020 con 0x7f504806f2c0 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.354+0000 7f504d925640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5048162990 0x7f50481573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.354+0000 7f504d925640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5048162990 0x7f50481573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50930/0 (socket says 172.21.15.120:50930) 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.354+0000 7f504d925640 1 -- 172.21.15.120:0/3991831641 learned_addr learned my addr 172.21.15.120:0/3991831641 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f504c923640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50480b6210 0x7f50481540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f504d124640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f504806f2c0 0x7f504815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f504d925640 1 -- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f504806f2c0 msgr2=0x7f504815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f504d925640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f504806f2c0 0x7f504815bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f504d925640 1 -- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50480b6210 msgr2=0x7f50481540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f504d925640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50480b6210 0x7f50481540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f504d925640 1 -- 172.21.15.120:0/3991831641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50481f55e0 con 0x7f5048162990 2024-07-27T03:14:23.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f504d925640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5048162990 0x7f50481573b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f504000e6d0 tx=0x7f504000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:23.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f503dffb640 1 -- 172.21.15.120:0/3991831641 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5040005220 con 0x7f5048162990 2024-07-27T03:14:23.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f503dffb640 1 -- 172.21.15.120:0/3991831641 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50400053c0 con 0x7f5048162990 2024-07-27T03:14:23.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f503dffb640 1 -- 172.21.15.120:0/3991831641 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504000c850 con 0x7f5048162990 2024-07-27T03:14:23.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f504f388640 1 -- 172.21.15.120:0/3991831641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50481f58c0 con 0x7f5048162990 2024-07-27T03:14:23.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.355+0000 7f504f388640 1 -- 172.21.15.120:0/3991831641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50481f5e80 con 0x7f5048162990 2024-07-27T03:14:23.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.356+0000 7f504f388640 1 -- 172.21.15.120:0/3991831641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50481f61f0 con 0x7f5048162990 2024-07-27T03:14:23.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.357+0000 7f503dffb640 1 -- 172.21.15.120:0/3991831641 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f504000c9f0 con 0x7f5048162990 2024-07-27T03:14:23.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.357+0000 7f503dffb640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f502c077010 0x7f502c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.357+0000 7f503dffb640 1 -- 172.21.15.120:0/3991831641 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f5040099020 con 0x7f5048162990 2024-07-27T03:14:23.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.358+0000 7f504d124640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f502c077010 0x7f502c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.358+0000 7f504d124640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f502c077010 0x7f502c079520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5044001e20 tx=0x7f5044009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:23.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.362+0000 7f503dffb640 1 -- 172.21.15.120:0/3991831641 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5040061ba0 con 0x7f5048162990 2024-07-27T03:14:23.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.579+0000 7f504f388640 1 -- 172.21.15.120:0/3991831641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50480ce540 con 0x7f5048162990 2024-07-27T03:14:23.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.580+0000 7f503dffb640 1 -- 172.21.15.120:0/3991831641 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5267 (secure 0 0 0) 0x7f5040062e20 con 0x7f5048162990 2024-07-27T03:14:23.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:23.584 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":73,"btime":"2024-07-27T03:12:54:659642+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2578460445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2578460445},{"type":"v1","addr":"172.21.15.120:6835","nonce":2578460445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":73,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:12:33.787428+0000","modified":"2024-07-27T03:12:54.128072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6159,"mds_1":6144,"mds_2":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"d","rank":2,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.121:6836/2998929726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2998929726},{"type":"v1","addr":"172.21.15.121:6836","nonce":2998929726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6144":{"gid":6144,"name":"c","rank":1,"incarnation":68,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6833/3985484834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3985484834},{"type":"v1","addr":"172.21.15.120:6833","nonce":3985484834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/7061533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":7061533},{"type":"v1","addr":"172.21.15.121:6837","nonce":7061533}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6159,"qdb_cluster":[5489,6144,6159]},"id":5}]} 2024-07-27T03:14:23.584 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 73 2024-07-27T03:14:23.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 -- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f502c077010 msgr2=0x7f502c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f502c077010 0x7f502c079520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5044001e20 tx=0x7f5044009040 comp rx=0 tx=0).stop 2024-07-27T03:14:23.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 -- 172.21.15.120:0/3991831641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5048162990 msgr2=0x7f50481573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5048162990 0x7f50481573b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f504000e6d0 tx=0x7f504000eb90 comp rx=0 tx=0).stop 2024-07-27T03:14:23.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 -- 172.21.15.120:0/3991831641 shutdown_connections 2024-07-27T03:14:23.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f502c077010 0x7f502c079520 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5048162990 0x7f50481573b0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50480b6210 0x7f50481540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 --2- 172.21.15.120:0/3991831641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f504806f2c0 0x7f504815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 -- 172.21.15.120:0/3991831641 >> 172.21.15.120:0/3991831641 conn(0x7f504806cba0 msgr2=0x7f50480ca5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:23.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 -- 172.21.15.120:0/3991831641 shutdown_connections 2024-07-27T03:14:23.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.582+0000 7f504f388640 1 -- 172.21.15.120:0/3991831641 wait complete. 2024-07-27T03:14:23.597 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:14:23.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.707+0000 7f74da831640 1 -- 172.21.15.120:0/4196373761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74bc003a30 msgr2=0x7f74bc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.708+0000 7f74da831640 1 --2- 172.21.15.120:0/4196373761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74bc003a30 0x7f74bc003ea0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f74c400bb10 tx=0x7f74bc005830 comp rx=0 tx=0).stop 2024-07-27T03:14:23.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.708+0000 7f74d8dce640 1 -- 172.21.15.120:0/4196373761 reap_dead start 2024-07-27T03:14:23.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.708+0000 7f74da831640 1 -- 172.21.15.120:0/4196373761 shutdown_connections 2024-07-27T03:14:23.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.708+0000 7f74da831640 1 -- 172.21.15.120:0/4196373761 >> 172.21.15.120:0/4196373761 conn(0x7f74d40d20a0 msgr2=0x7f74d40d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:23.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.708+0000 7f74da831640 1 -- 172.21.15.120:0/4196373761 shutdown_connections 2024-07-27T03:14:23.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.708+0000 7f74da831640 1 -- 172.21.15.120:0/4196373761 wait complete. 2024-07-27T03:14:23.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.709+0000 7f74da831640 1 Processor -- start 2024-07-27T03:14:23.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.710+0000 7f74da831640 1 -- start start 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74da831640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74bc003a30 0x7f74d415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74da831640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74d415a090 0x7f74d41f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74da831640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74d41f6e30 0x7f74d41f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74da831640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f74d40b5780 con 0x7f74d41f6e30 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74da831640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f74d40b5600 con 0x7f74d415a090 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74da831640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f74d40b5900 con 0x7f74bc003a30 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d8dce640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74d41f6e30 0x7f74d41f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d8dce640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74d41f6e30 0x7f74d41f44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50954/0 (socket says 172.21.15.120:50954) 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d8dce640 1 -- 172.21.15.120:0/1425766997 learned_addr learned my addr 172.21.15.120:0/1425766997 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d3fff640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74bc003a30 0x7f74d415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d37fe640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74d415a090 0x7f74d41f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d8dce640 1 -- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74bc003a30 msgr2=0x7f74d415b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d8dce640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74bc003a30 0x7f74d415b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d8dce640 1 -- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74d415a090 msgr2=0x7f74d41f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d8dce640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74d415a090 0x7f74d41f68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d8dce640 1 -- 172.21.15.120:0/1425766997 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d41f7240 con 0x7f74d41f6e30 2024-07-27T03:14:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d3fff640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74bc003a30 0x7f74d415b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:14:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.711+0000 7f74d8dce640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74d41f6e30 0x7f74d41f44c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f74d40d2d50 tx=0x7f74cc0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.712+0000 7f74d0ff9640 1 -- 172.21.15.120:0/1425766997 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc011870 con 0x7f74d41f6e30 2024-07-27T03:14:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.712+0000 7f74d0ff9640 1 -- 172.21.15.120:0/1425766997 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74cc017070 con 0x7f74d41f6e30 2024-07-27T03:14:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.712+0000 7f74da831640 1 -- 172.21.15.120:0/1425766997 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d415c210 con 0x7f74d41f6e30 2024-07-27T03:14:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.712+0000 7f74d0ff9640 1 -- 172.21.15.120:0/1425766997 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc011da0 con 0x7f74d41f6e30 2024-07-27T03:14:23.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.712+0000 7f74da831640 1 -- 172.21.15.120:0/1425766997 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d415c7d0 con 0x7f74d41f6e30 2024-07-27T03:14:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.713+0000 7f74da831640 1 -- 172.21.15.120:0/1425766997 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d40b5e30 con 0x7f74d41f6e30 2024-07-27T03:14:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.713+0000 7f74d0ff9640 1 -- 172.21.15.120:0/1425766997 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f74cc01c460 con 0x7f74d41f6e30 2024-07-27T03:14:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.714+0000 7f74d0ff9640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f74c0077010 0x7f74c0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.714+0000 7f74d0ff9640 1 -- 172.21.15.120:0/1425766997 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f74cc099070 con 0x7f74d41f6e30 2024-07-27T03:14:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.714+0000 7f74d3fff640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f74c0077010 0x7f74c0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.715+0000 7f74d3fff640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f74c0077010 0x7f74c0079520 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f74c4036000 tx=0x7f74c40046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:23.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.718+0000 7f74d0ff9640 1 -- 172.21.15.120:0/1425766997 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f74d41f7240 con 0x7f74d41f6e30 2024-07-27T03:14:23.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.901+0000 7f74da831640 1 -- 172.21.15.120:0/1425766997 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74d415bf60 con 0x7f74d41f6e30 2024-07-27T03:14:23.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.902+0000 7f74d0ff9640 1 -- 172.21.15.120:0/1425766997 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16790 (secure 0 0 0) 0x7f74cc0622c0 con 0x7f74d41f6e30 2024-07-27T03:14:23.906 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:23.906 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":71,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:13:22.714030+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:12:31.463339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-07-27T03:12:32.742612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:14:23.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 -- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f74c0077010 msgr2=0x7f74c0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f74c0077010 0x7f74c0079520 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f74c4036000 tx=0x7f74c40046c0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 -- 172.21.15.120:0/1425766997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74d41f6e30 msgr2=0x7f74d41f44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:23.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74d41f6e30 0x7f74d41f44c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f74d40d2d50 tx=0x7f74cc0019b0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 -- 172.21.15.120:0/1425766997 shutdown_connections 2024-07-27T03:14:23.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f74c0077010 0x7f74c0079520 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74d41f6e30 0x7f74d41f44c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74d415a090 0x7f74d41f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 --2- 172.21.15.120:0/1425766997 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f74bc003a30 0x7f74d415b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:23.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 -- 172.21.15.120:0/1425766997 >> 172.21.15.120:0/1425766997 conn(0x7f74d40d20a0 msgr2=0x7f74d40b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:23.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 -- 172.21.15.120:0/1425766997 shutdown_connections 2024-07-27T03:14:23.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:23.904+0000 7f74da831640 1 -- 172.21.15.120:0/1425766997 wait complete. 2024-07-27T03:14:23.920 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-07-27T03:14:23.921 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:14:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.030+0000 7ff8d4b50640 1 -- 172.21.15.120:0/2930099342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8d015ec10 msgr2=0x7ff8d015f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.030+0000 7ff8d4b50640 1 --2- 172.21.15.120:0/2930099342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8d015ec10 0x7ff8d015f020 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00cfc50 tx=0x7ff8c802a980 comp rx=0 tx=0).stop 2024-07-27T03:14:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.030+0000 7ff8d4b50640 1 -- 172.21.15.120:0/2930099342 shutdown_connections 2024-07-27T03:14:24.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.030+0000 7ff8d4b50640 1 --2- 172.21.15.120:0/2930099342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8d015ec10 0x7ff8d015f020 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.030+0000 7ff8d4b50640 1 --2- 172.21.15.120:0/2930099342 >> v2:172.21.15.121:3300/0 conn(0x7ff8d006e270 0x7ff8d0073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.030+0000 7ff8d4b50640 1 -- 172.21.15.120:0/2930099342 >> 172.21.15.120:0/2930099342 conn(0x7ff8d00b1a10 msgr2=0x7ff8d00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.030+0000 7ff8d4b50640 1 -- 172.21.15.120:0/2930099342 shutdown_connections 2024-07-27T03:14:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.030+0000 7ff8d4b50640 1 -- 172.21.15.120:0/2930099342 wait complete. 2024-07-27T03:14:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.032+0000 7ff8d4b50640 1 Processor -- start 2024-07-27T03:14:24.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.032+0000 7ff8d4b50640 1 -- start start 2024-07-27T03:14:24.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.033+0000 7ff8d4b50640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8d006e270 0x7ff8d0156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.033+0000 7ff8d4b50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8d01522e0 0x7ff8d0154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.033+0000 7ff8d4b50640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8d015ec10 0x7ff8d006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.033+0000 7ff8d4b50640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d015f8f0 con 0x7ff8d01522e0 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.033+0000 7ff8d4b50640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d015f770 con 0x7ff8d015ec10 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.033+0000 7ff8d4b50640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d015fa70 con 0x7ff8d006e270 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.033+0000 7ff8cdd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8d01522e0 0x7ff8d0154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.033+0000 7ff8cdd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8d01522e0 0x7ff8d0154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50982/0 (socket says 172.21.15.120:50982) 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.033+0000 7ff8cdd9b640 1 -- 172.21.15.120:0/1759458343 learned_addr learned my addr 172.21.15.120:0/1759458343 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.033+0000 7ff8ced9d640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8d015ec10 0x7ff8d006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.033+0000 7ff8ce59c640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8d006e270 0x7ff8d0156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.034+0000 7ff8cdd9b640 1 -- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8d006e270 msgr2=0x7ff8d0156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.034+0000 7ff8cdd9b640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8d006e270 0x7ff8d0156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.034+0000 7ff8cdd9b640 1 -- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8d015ec10 msgr2=0x7ff8d006eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.034+0000 7ff8cdd9b640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8d015ec10 0x7ff8d006eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.034+0000 7ff8cdd9b640 1 -- 172.21.15.120:0/1759458343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d0155610 con 0x7ff8d01522e0 2024-07-27T03:14:24.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.034+0000 7ff8cdd9b640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8d01522e0 0x7ff8d0154950 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400b410 tx=0x7ff8c400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:24.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.034+0000 7ff8beffd640 1 -- 172.21.15.120:0/1759458343 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4015020 con 0x7ff8d01522e0 2024-07-27T03:14:24.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.034+0000 7ff8beffd640 1 -- 172.21.15.120:0/1759458343 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8c4011940 con 0x7ff8d01522e0 2024-07-27T03:14:24.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.034+0000 7ff8beffd640 1 -- 172.21.15.120:0/1759458343 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4011d90 con 0x7ff8d01522e0 2024-07-27T03:14:24.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.034+0000 7ff8d4b50640 1 -- 172.21.15.120:0/1759458343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d01449c0 con 0x7ff8d01522e0 2024-07-27T03:14:24.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.034+0000 7ff8d4b50640 1 -- 172.21.15.120:0/1759458343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d0144f80 con 0x7ff8d01522e0 2024-07-27T03:14:24.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.035+0000 7ff8d4b50640 1 -- 172.21.15.120:0/1759458343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d0155380 con 0x7ff8d01522e0 2024-07-27T03:14:24.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.036+0000 7ff8beffd640 1 -- 172.21.15.120:0/1759458343 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff8c4018020 con 0x7ff8d01522e0 2024-07-27T03:14:24.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.036+0000 7ff8beffd640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff8b0077010 0x7ff8b0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.036+0000 7ff8beffd640 1 -- 172.21.15.120:0/1759458343 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7ff8c40988f0 con 0x7ff8d01522e0 2024-07-27T03:14:24.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.036+0000 7ff8ce59c640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff8b0077010 0x7ff8b0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.037+0000 7ff8ce59c640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff8b0077010 0x7ff8b0079520 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0006fd0 tx=0x7ff8c0009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:24.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.041+0000 7ff8beffd640 1 -- 172.21.15.120:0/1759458343 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff8c401f020 con 0x7ff8d01522e0 2024-07-27T03:14:24.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.261+0000 7ff8d4b50640 1 -- 172.21.15.120:0/1759458343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8d015f020 con 0x7ff8d01522e0 2024-07-27T03:14:24.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.261+0000 7ff8beffd640 1 -- 172.21.15.120:0/1759458343 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5267 (secure 0 0 0) 0x7ff8c4061460 con 0x7ff8d01522e0 2024-07-27T03:14:24.265 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:24.265 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":73,"btime":"2024-07-27T03:12:54:659642+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2578460445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2578460445},{"type":"v1","addr":"172.21.15.120:6835","nonce":2578460445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":73,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:12:33.787428+0000","modified":"2024-07-27T03:12:54.128072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6159,"mds_1":6144,"mds_2":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"d","rank":2,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.121:6836/2998929726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2998929726},{"type":"v1","addr":"172.21.15.121:6836","nonce":2998929726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6144":{"gid":6144,"name":"c","rank":1,"incarnation":68,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6833/3985484834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3985484834},{"type":"v1","addr":"172.21.15.120:6833","nonce":3985484834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/7061533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":7061533},{"type":"v1","addr":"172.21.15.121:6837","nonce":7061533}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6159,"qdb_cluster":[5489,6144,6159]},"id":5}]} 2024-07-27T03:14:24.266 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 73 2024-07-27T03:14:24.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.263+0000 7ff8d4b50640 1 -- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff8b0077010 msgr2=0x7ff8b0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.263+0000 7ff8d4b50640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff8b0077010 0x7ff8b0079520 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0006fd0 tx=0x7ff8c0009060 comp rx=0 tx=0).stop 2024-07-27T03:14:24.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.263+0000 7ff8d4b50640 1 -- 172.21.15.120:0/1759458343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8d01522e0 msgr2=0x7ff8d0154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.263+0000 7ff8d4b50640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8d01522e0 0x7ff8d0154950 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400b410 tx=0x7ff8c400b8d0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.263+0000 7ff8d4b50640 1 -- 172.21.15.120:0/1759458343 shutdown_connections 2024-07-27T03:14:24.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.263+0000 7ff8d4b50640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff8b0077010 0x7ff8b0079520 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.263+0000 7ff8d4b50640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8d01522e0 0x7ff8d0154950 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.263+0000 7ff8d4b50640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8d015ec10 0x7ff8d006eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.263+0000 7ff8d4b50640 1 --2- 172.21.15.120:0/1759458343 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff8d006e270 0x7ff8d0156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.264+0000 7ff8d4b50640 1 -- 172.21.15.120:0/1759458343 >> 172.21.15.120:0/1759458343 conn(0x7ff8d00b1a10 msgr2=0x7ff8d015d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:24.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.264+0000 7ff8d4b50640 1 -- 172.21.15.120:0/1759458343 shutdown_connections 2024-07-27T03:14:24.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.264+0000 7ff8d4b50640 1 -- 172.21.15.120:0/1759458343 wait complete. 2024-07-27T03:14:24.279 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:14:24.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.388+0000 7f183bfdd640 1 -- 172.21.15.120:0/217397360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18340b4740 msgr2=0x7f18340b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.388+0000 7f183bfdd640 1 --2- 172.21.15.120:0/217397360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18340b4740 0x7f18340b2c40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f18340ce600 tx=0x7f183002a5f0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.388+0000 7f183bfdd640 1 -- 172.21.15.120:0/217397360 shutdown_connections 2024-07-27T03:14:24.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.388+0000 7f183bfdd640 1 --2- 172.21.15.120:0/217397360 >> v2:172.21.15.121:3300/0 conn(0x7f18340d10d0 0x7f18340d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.388+0000 7f183bfdd640 1 --2- 172.21.15.120:0/217397360 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18340b4740 0x7f18340b2c40 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.388+0000 7f183bfdd640 1 -- 172.21.15.120:0/217397360 >> 172.21.15.120:0/217397360 conn(0x7f183408d690 msgr2=0x7f183409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:24.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.388+0000 7f183bfdd640 1 -- 172.21.15.120:0/217397360 shutdown_connections 2024-07-27T03:14:24.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.388+0000 7f183bfdd640 1 -- 172.21.15.120:0/217397360 wait complete. 2024-07-27T03:14:24.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.390+0000 7f183bfdd640 1 Processor -- start 2024-07-27T03:14:24.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.390+0000 7f183bfdd640 1 -- start start 2024-07-27T03:14:24.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.391+0000 7f183bfdd640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18340b4740 0x7f18341f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.391+0000 7f183bfdd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18340d27e0 0x7f18340b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.391+0000 7f183bfdd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183414d7b0 0x7f18340b8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.391+0000 7f183bfdd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f18340cef70 con 0x7f18340d27e0 2024-07-27T03:14:24.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.391+0000 7f183bfdd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f18340cedf0 con 0x7f183414d7b0 2024-07-27T03:14:24.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.391+0000 7f183bfdd640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f18340cf0f0 con 0x7f18340b4740 2024-07-27T03:14:24.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f1839578640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18340d27e0 0x7f18340b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f1839578640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18340d27e0 0x7f18340b83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50998/0 (socket says 172.21.15.120:50998) 2024-07-27T03:14:24.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f1839578640 1 -- 172.21.15.120:0/911135308 learned_addr learned my addr 172.21.15.120:0/911135308 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:24.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f1839d79640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18340b4740 0x7f18341f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f183a57a640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183414d7b0 0x7f18340b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f1839578640 1 -- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18340b4740 msgr2=0x7f18341f92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f1839578640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18340b4740 0x7f18341f92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f1839578640 1 -- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183414d7b0 msgr2=0x7f18340b8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f1839578640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183414d7b0 0x7f18340b8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f1839578640 1 -- 172.21.15.120:0/911135308 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18341f97e0 con 0x7f18340d27e0 2024-07-27T03:14:24.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f1839d79640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18340b4740 0x7f18341f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:14:24.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f1839578640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18340d27e0 0x7f18340b83d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f182400c3f0 tx=0x7f182400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:24.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f182a7fc640 1 -- 172.21.15.120:0/911135308 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1824017070 con 0x7f18340d27e0 2024-07-27T03:14:24.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f182a7fc640 1 -- 172.21.15.120:0/911135308 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18240035f0 con 0x7f18340d27e0 2024-07-27T03:14:24.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f183bfdd640 1 -- 172.21.15.120:0/911135308 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18341612d0 con 0x7f18340d27e0 2024-07-27T03:14:24.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f182a7fc640 1 -- 172.21.15.120:0/911135308 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1824003a40 con 0x7f18340d27e0 2024-07-27T03:14:24.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.392+0000 7f183bfdd640 1 -- 172.21.15.120:0/911135308 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18341f5a40 con 0x7f18340d27e0 2024-07-27T03:14:24.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.393+0000 7f183bfdd640 1 -- 172.21.15.120:0/911135308 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18340d2bf0 con 0x7f18340d27e0 2024-07-27T03:14:24.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.394+0000 7f182a7fc640 1 -- 172.21.15.120:0/911135308 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f182401a070 con 0x7f18340d27e0 2024-07-27T03:14:24.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.395+0000 7f182a7fc640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1818077040 0x7f1818079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.395+0000 7f182a7fc640 1 -- 172.21.15.120:0/911135308 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f1824097c90 con 0x7f18340d27e0 2024-07-27T03:14:24.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.395+0000 7f1839d79640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1818077040 0x7f1818079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.395+0000 7f1839d79640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1818077040 0x7f1818079550 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1830033000 tx=0x7f1830004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:24.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.400+0000 7f182a7fc640 1 -- 172.21.15.120:0/911135308 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f18341f97e0 con 0x7f18340d27e0 2024-07-27T03:14:24.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.618+0000 7f183bfdd640 1 -- 172.21.15.120:0/911135308 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18341f54f0 con 0x7f18340d27e0 2024-07-27T03:14:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.618+0000 7f182a7fc640 1 -- 172.21.15.120:0/911135308 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5267 (secure 0 0 0) 0x7f1824060e50 con 0x7f18340d27e0 2024-07-27T03:14:24.622 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:24.622 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":73,"btime":"2024-07-27T03:12:54:659642+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2578460445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2578460445},{"type":"v1","addr":"172.21.15.120:6835","nonce":2578460445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":73,"flags":274,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-27T03:12:33.787428+0000","modified":"2024-07-27T03:12:54.128072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6159,"mds_1":6144,"mds_2":5489},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5489":{"gid":5489,"name":"d","rank":2,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.121:6836/2998929726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2998929726},{"type":"v1","addr":"172.21.15.121:6836","nonce":2998929726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6144":{"gid":6144,"name":"c","rank":1,"incarnation":68,"state":"up:active","state_seq":5,"addr":"172.21.15.120:6833/3985484834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3985484834},{"type":"v1","addr":"172.21.15.120:6833","nonce":3985484834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6159":{"gid":6159,"name":"b","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6837/7061533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6835","nonce":7061533},{"type":"v1","addr":"172.21.15.121:6837","nonce":7061533}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6159,"qdb_cluster":[5489,6144,6159]},"id":5}]} 2024-07-27T03:14:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 73 2024-07-27T03:14:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 -- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1818077040 msgr2=0x7f1818079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1818077040 0x7f1818079550 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1830033000 tx=0x7f1830004730 comp rx=0 tx=0).stop 2024-07-27T03:14:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 -- 172.21.15.120:0/911135308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18340d27e0 msgr2=0x7f18340b83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18340d27e0 0x7f18340b83d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f182400c3f0 tx=0x7f182400c8b0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 -- 172.21.15.120:0/911135308 shutdown_connections 2024-07-27T03:14:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1818077040 0x7f1818079550 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18340d27e0 0x7f18340b83d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f183414d7b0 0x7f18340b8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 --2- 172.21.15.120:0/911135308 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f18340b4740 0x7f18341f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 -- 172.21.15.120:0/911135308 >> 172.21.15.120:0/911135308 conn(0x7f183408d690 msgr2=0x7f183415d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 -- 172.21.15.120:0/911135308 shutdown_connections 2024-07-27T03:14:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.620+0000 7f183bfdd640 1 -- 172.21.15.120:0/911135308 wait complete. 2024-07-27T03:14:24.636 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:14:24.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.745+0000 7f98bfd2d640 1 -- 172.21.15.120:0/827688339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98b815c220 msgr2=0x7f98b8152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.745+0000 7f98bfd2d640 1 --2- 172.21.15.120:0/827688339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98b815c220 0x7f98b8152160 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f98b815b630 tx=0x7f98b402a560 comp rx=0 tx=0).stop 2024-07-27T03:14:24.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.746+0000 7f98bfd2d640 1 -- 172.21.15.120:0/827688339 shutdown_connections 2024-07-27T03:14:24.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.746+0000 7f98bfd2d640 1 --2- 172.21.15.120:0/827688339 >> v2:172.21.15.121:3300/0 conn(0x7f98b815ec20 0x7f98b815f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.746+0000 7f98bfd2d640 1 --2- 172.21.15.120:0/827688339 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98b80b5cd0 0x7f98b80b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.746+0000 7f98bfd2d640 1 --2- 172.21.15.120:0/827688339 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98b815c220 0x7f98b8152160 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.746+0000 7f98bfd2d640 1 -- 172.21.15.120:0/827688339 >> 172.21.15.120:0/827688339 conn(0x7f98b806cba0 msgr2=0x7f98b806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:24.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.746+0000 7f98bfd2d640 1 -- 172.21.15.120:0/827688339 shutdown_connections 2024-07-27T03:14:24.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.746+0000 7f98bfd2d640 1 -- 172.21.15.120:0/827688339 wait complete. 2024-07-27T03:14:24.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.747+0000 7f98bfd2d640 1 Processor -- start 2024-07-27T03:14:24.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.747+0000 7f98bfd2d640 1 -- start start 2024-07-27T03:14:24.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bfd2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98b80b5cd0 0x7f98b814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bfd2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98b815c220 0x7f98b814b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bfd2d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98b815ec20 0x7f98b8155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bfd2d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f98b80cd920 con 0x7f98b815c220 2024-07-27T03:14:24.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bfd2d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f98b80cd7a0 con 0x7f98b80b5cd0 2024-07-27T03:14:24.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bfd2d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f98b80cdaa0 con 0x7f98b815ec20 2024-07-27T03:14:24.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bd2c8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98b815c220 0x7f98b814b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bd2c8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98b815c220 0x7f98b814b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51008/0 (socket says 172.21.15.120:51008) 2024-07-27T03:14:24.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bd2c8640 1 -- 172.21.15.120:0/1574292468 learned_addr learned my addr 172.21.15.120:0/1574292468 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:24.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bdac9640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98b80b5cd0 0x7f98b814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98be2ca640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98b815ec20 0x7f98b8155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bd2c8640 1 -- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98b815ec20 msgr2=0x7f98b8155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bd2c8640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98b815ec20 0x7f98b8155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bd2c8640 1 -- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98b80b5cd0 msgr2=0x7f98b814f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bd2c8640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98b80b5cd0 0x7f98b814f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bd2c8640 1 -- 172.21.15.120:0/1574292468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b815a710 con 0x7f98b815c220 2024-07-27T03:14:24.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bdac9640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98b80b5cd0 0x7f98b814f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:14:24.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98be2ca640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98b815ec20 0x7f98b8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:14:24.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bd2c8640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98b815c220 0x7f98b814b7a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f98a80058c0 tx=0x7f98a800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:24.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98ae7fc640 1 -- 172.21.15.120:0/1574292468 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8017070 con 0x7f98b815c220 2024-07-27T03:14:24.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98ae7fc640 1 -- 172.21.15.120:0/1574292468 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98a8005330 con 0x7f98b815c220 2024-07-27T03:14:24.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.749+0000 7f98bfd2d640 1 -- 172.21.15.120:0/1574292468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b815a9f0 con 0x7f98b815c220 2024-07-27T03:14:24.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.750+0000 7f98ae7fc640 1 -- 172.21.15.120:0/1574292468 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a80047a0 con 0x7f98b815c220 2024-07-27T03:14:24.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.750+0000 7f98bfd2d640 1 -- 172.21.15.120:0/1574292468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b8156f10 con 0x7f98b815c220 2024-07-27T03:14:24.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.751+0000 7f98bfd2d640 1 -- 172.21.15.120:0/1574292468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b815afe0 con 0x7f98b815c220 2024-07-27T03:14:24.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.751+0000 7f98ae7fc640 1 -- 172.21.15.120:0/1574292468 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f98a8004940 con 0x7f98b815c220 2024-07-27T03:14:24.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.752+0000 7f98ae7fc640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f989c077010 0x7f989c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:24.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.752+0000 7f98ae7fc640 1 -- 172.21.15.120:0/1574292468 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f98a8098910 con 0x7f98b815c220 2024-07-27T03:14:24.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.752+0000 7f98bdac9640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f989c077010 0x7f989c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:24.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.753+0000 7f98bdac9640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f989c077010 0x7f989c079520 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f98b4033000 tx=0x7f98b4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:24.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.756+0000 7f98ae7fc640 1 -- 172.21.15.120:0/1574292468 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f98b815afe0 con 0x7f98b815c220 2024-07-27T03:14:24.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.944+0000 7f98bfd2d640 1 -- 172.21.15.120:0/1574292468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98b814f7a0 con 0x7f98b815c220 2024-07-27T03:14:24.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.945+0000 7f98ae7fc640 1 -- 172.21.15.120:0/1574292468 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16790 (secure 0 0 0) 0x7f98a8061b60 con 0x7f98b815c220 2024-07-27T03:14:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:24.948 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":71,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:13:22.714030+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-07-27T03:12:31.463339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-07-27T03:12:32.742612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:14:24.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 -- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f989c077010 msgr2=0x7f989c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f989c077010 0x7f989c079520 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f98b4033000 tx=0x7f98b4004730 comp rx=0 tx=0).stop 2024-07-27T03:14:24.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 -- 172.21.15.120:0/1574292468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98b815c220 msgr2=0x7f98b814b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:24.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98b815c220 0x7f98b814b7a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f98a80058c0 tx=0x7f98a800dae0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 -- 172.21.15.120:0/1574292468 shutdown_connections 2024-07-27T03:14:24.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f989c077010 0x7f989c079520 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98b815c220 0x7f98b814b7a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f98b815ec20 0x7f98b8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 --2- 172.21.15.120:0/1574292468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98b80b5cd0 0x7f98b814f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:24.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 -- 172.21.15.120:0/1574292468 >> 172.21.15.120:0/1574292468 conn(0x7f98b806cba0 msgr2=0x7f98b80b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:24.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 -- 172.21.15.120:0/1574292468 shutdown_connections 2024-07-27T03:14:24.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:24.947+0000 7f98bfd2d640 1 -- 172.21.15.120:0/1574292468 wait complete. 2024-07-27T03:14:24.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-07-27T03:14:25.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.073+0000 7f538448b640 1 -- 172.21.15.120:0/1431189843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f537c071cf0 msgr2=0x7f537c158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:25.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.073+0000 7f538448b640 1 --2- 172.21.15.120:0/1431189843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f537c071cf0 0x7f537c158da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5374005fd0 tx=0x7f537402aa10 comp rx=0 tx=0).stop 2024-07-27T03:14:25.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.073+0000 7f538448b640 1 -- 172.21.15.120:0/1431189843 shutdown_connections 2024-07-27T03:14:25.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.073+0000 7f538448b640 1 --2- 172.21.15.120:0/1431189843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f537c071cf0 0x7f537c158da0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.073+0000 7f538448b640 1 --2- 172.21.15.120:0/1431189843 >> v2:172.21.15.121:3300/0 conn(0x7f537c15c500 0x7f537c074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.073+0000 7f538448b640 1 -- 172.21.15.120:0/1431189843 >> 172.21.15.120:0/1431189843 conn(0x7f537c0d0f00 msgr2=0x7f537c0d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:25.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.073+0000 7f538448b640 1 -- 172.21.15.120:0/1431189843 shutdown_connections 2024-07-27T03:14:25.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.073+0000 7f538448b640 1 -- 172.21.15.120:0/1431189843 wait complete. 2024-07-27T03:14:25.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.075+0000 7f538448b640 1 Processor -- start 2024-07-27T03:14:25.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.075+0000 7f538448b640 1 -- start start 2024-07-27T03:14:25.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.076+0000 7f538448b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f537c0b4d30 0x7f537c1f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:25.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.076+0000 7f538448b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f537c15c500 0x7f537c145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:25.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.076+0000 7f538448b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f537c1455c0 0x7f537c06c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:25.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.076+0000 7f538448b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f537c0703e0 con 0x7f537c15c500 2024-07-27T03:14:25.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.076+0000 7f538448b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f537c070260 con 0x7f537c0b4d30 2024-07-27T03:14:25.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.076+0000 7f538448b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f537c070560 con 0x7f537c1455c0 2024-07-27T03:14:25.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.076+0000 7f5381a26640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f537c15c500 0x7f537c145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:25.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.076+0000 7f5381a26640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f537c15c500 0x7f537c145080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51014/0 (socket says 172.21.15.120:51014) 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.076+0000 7f5381a26640 1 -- 172.21.15.120:0/2524276949 learned_addr learned my addr 172.21.15.120:0/2524276949 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f5382a28640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f537c1455c0 0x7f537c06c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f5382227640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f537c0b4d30 0x7f537c1f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f5381a26640 1 -- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f537c1455c0 msgr2=0x7f537c06c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f5381a26640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f537c1455c0 0x7f537c06c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f5381a26640 1 -- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f537c0b4d30 msgr2=0x7f537c1f6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f5381a26640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f537c0b4d30 0x7f537c1f6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f5381a26640 1 -- 172.21.15.120:0/2524276949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c1f34a0 con 0x7f537c15c500 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f5381a26640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f537c15c500 0x7f537c145080 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f536c00c730 tx=0x7f536c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f5372ffd640 1 -- 172.21.15.120:0/2524276949 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c0050d0 con 0x7f537c15c500 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f538448b640 1 -- 172.21.15.120:0/2524276949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537c1f3780 con 0x7f537c15c500 2024-07-27T03:14:25.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f5372ffd640 1 -- 172.21.15.120:0/2524276949 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f536c005290 con 0x7f537c15c500 2024-07-27T03:14:25.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f5372ffd640 1 -- 172.21.15.120:0/2524276949 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c00a8a0 con 0x7f537c15c500 2024-07-27T03:14:25.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.077+0000 7f538448b640 1 -- 172.21.15.120:0/2524276949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f537c1f3d40 con 0x7f537c15c500 2024-07-27T03:14:25.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.078+0000 7f538448b640 1 -- 172.21.15.120:0/2524276949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f537c070a80 con 0x7f537c15c500 2024-07-27T03:14:25.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.079+0000 7f5372ffd640 1 -- 172.21.15.120:0/2524276949 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f536c00aa40 con 0x7f537c15c500 2024-07-27T03:14:25.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.079+0000 7f5372ffd640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5360077010 0x7f5360079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:25.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.080+0000 7f5372ffd640 1 -- 172.21.15.120:0/2524276949 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f536c098da0 con 0x7f537c15c500 2024-07-27T03:14:25.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.080+0000 7f5382227640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5360077010 0x7f5360079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:25.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.080+0000 7f5382227640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5360077010 0x7f5360079520 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f53780095f0 tx=0x7f5378005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:25.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.083+0000 7f5372ffd640 1 -- 172.21.15.120:0/2524276949 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f537c0b41a0 con 0x7f537c15c500 2024-07-27T03:14:25.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.302+0000 7f538448b640 1 -- 172.21.15.120:0/2524276949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f537c0cf940 con 0x7f537c15c500 2024-07-27T03:14:25.306 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-07-27T03:14:25.303+0000 7fd09694b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-27T03:14:25.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.306+0000 7f5372ffd640 1 -- 172.21.15.120:0/2524276949 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v74) ==== 161+0+0 (secure 0 0 0) 0x7f536c0619a0 con 0x7f537c15c500 2024-07-27T03:14:25.309 INFO:teuthology.orchestra.run.smithi120.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-07-27T03:14:25.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.308+0000 7f538448b640 1 -- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5360077010 msgr2=0x7f5360079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:25.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.309+0000 7f538448b640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5360077010 0x7f5360079520 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f53780095f0 tx=0x7f5378005f90 comp rx=0 tx=0).stop 2024-07-27T03:14:25.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.309+0000 7f538448b640 1 -- 172.21.15.120:0/2524276949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f537c15c500 msgr2=0x7f537c145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.309+0000 7f538448b640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f537c15c500 0x7f537c145080 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f536c00c730 tx=0x7f536c00cbf0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.309+0000 7f538448b640 1 -- 172.21.15.120:0/2524276949 shutdown_connections 2024-07-27T03:14:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.309+0000 7f538448b640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5360077010 0x7f5360079520 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.309+0000 7f538448b640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f537c15c500 0x7f537c145080 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.309+0000 7f538448b640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f537c1455c0 0x7f537c06c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.309+0000 7f538448b640 1 --2- 172.21.15.120:0/2524276949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f537c0b4d30 0x7f537c1f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.309+0000 7f538448b640 1 -- 172.21.15.120:0/2524276949 >> 172.21.15.120:0/2524276949 conn(0x7f537c0d0f00 msgr2=0x7f537c0713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.309+0000 7f538448b640 1 -- 172.21.15.120:0/2524276949 shutdown_connections 2024-07-27T03:14:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.309+0000 7f538448b640 1 -- 172.21.15.120:0/2524276949 wait complete. 2024-07-27T03:14:25.316 INFO:tasks.ceph.mds.b.smithi121.stderr: -9538> 2024-07-27T03:12:39.738+0000 7ff1ae759640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-27T03:14:25.318 INFO:tasks.ceph.mds.b.smithi121.stderr: -7692> 2024-07-27T03:12:44.738+0000 7ff1ae759640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-07-27T03:14:25.318 INFO:tasks.ceph.mds.b.smithi121.stderr: -7690> 2024-07-27T03:12:44.738+0000 7ff1ae759640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-07-27T03:14:25.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-07-27T03:14:25.366 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-07-27T03:14:25.374 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-07-27T03:14:25.379 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-07-27T03:14:25.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.443+0000 7fe757d76640 1 -- 172.21.15.120:0/2145346447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7500b75b0 msgr2=0x7fe7500d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:25.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.443+0000 7fe757d76640 1 --2- 172.21.15.120:0/2145346447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7500b75b0 0x7fe7500d0790 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe750070070 tx=0x7fe74c02a4d0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.443+0000 7fe757d76640 1 -- 172.21.15.120:0/2145346447 shutdown_connections 2024-07-27T03:14:25.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.443+0000 7fe757d76640 1 --2- 172.21.15.120:0/2145346447 >> v2:172.21.15.121:3300/0 conn(0x7fe7500ced80 0x7fe7500b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.443+0000 7fe757d76640 1 --2- 172.21.15.120:0/2145346447 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7500d28f0 0x7fe7500ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.443+0000 7fe757d76640 1 --2- 172.21.15.120:0/2145346447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7500b75b0 0x7fe7500d0790 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.443+0000 7fe757d76640 1 -- 172.21.15.120:0/2145346447 >> 172.21.15.120:0/2145346447 conn(0x7fe7500d1dd0 msgr2=0x7fe7500d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:25.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.443+0000 7fe757d76640 1 -- 172.21.15.120:0/2145346447 shutdown_connections 2024-07-27T03:14:25.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.443+0000 7fe757d76640 1 -- 172.21.15.120:0/2145346447 wait complete. 2024-07-27T03:14:25.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.444+0000 7fe757d76640 1 Processor -- start 2024-07-27T03:14:25.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.445+0000 7fe757d76640 1 -- start start 2024-07-27T03:14:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe757d76640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7500b75b0 0x7fe7500711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe757d76640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7500ced80 0x7fe7500716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe757d76640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7500d28f0 0x7fe7501cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe757d76640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe7500ccab0 con 0x7fe7500d28f0 2024-07-27T03:14:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe757d76640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe7500cc930 con 0x7fe7500ced80 2024-07-27T03:14:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe757d76640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fe7500ccc30 con 0x7fe7500b75b0 2024-07-27T03:14:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe756313640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7500d28f0 0x7fe7501cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe756313640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7500d28f0 0x7fe7501cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51034/0 (socket says 172.21.15.120:51034) 2024-07-27T03:14:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe756313640 1 -- 172.21.15.120:0/2134053790 learned_addr learned my addr 172.21.15.120:0/2134053790 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:25.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe755b12640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7500b75b0 0x7fe7500711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe755311640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7500ced80 0x7fe7500716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe756313640 1 -- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7500b75b0 msgr2=0x7fe7500711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe756313640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7500b75b0 0x7fe7500711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe756313640 1 -- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7500ced80 msgr2=0x7fe7500716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe756313640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7500ced80 0x7fe7500716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe756313640 1 -- 172.21.15.120:0/2134053790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7501cf730 con 0x7fe7500d28f0 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.446+0000 7fe756313640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7500d28f0 0x7fe7501cea40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe74800e9d0 tx=0x7fe74800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.447+0000 7fe7467fc640 1 -- 172.21.15.120:0/2134053790 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748004d20 con 0x7fe7500d28f0 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.447+0000 7fe7467fc640 1 -- 172.21.15.120:0/2134053790 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe74800cb20 con 0x7fe7500d28f0 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.447+0000 7fe757d76640 1 -- 172.21.15.120:0/2134053790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7501ccb30 con 0x7fe7500d28f0 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.447+0000 7fe7467fc640 1 -- 172.21.15.120:0/2134053790 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748005020 con 0x7fe7500d28f0 2024-07-27T03:14:25.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.447+0000 7fe757d76640 1 -- 172.21.15.120:0/2134053790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501ce690 con 0x7fe7500d28f0 2024-07-27T03:14:25.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.448+0000 7fe757d76640 1 -- 172.21.15.120:0/2134053790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe75009c960 con 0x7fe7500d28f0 2024-07-27T03:14:25.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.448+0000 7fe7467fc640 1 -- 172.21.15.120:0/2134053790 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe7480051c0 con 0x7fe7500d28f0 2024-07-27T03:14:25.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.449+0000 7fe7467fc640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe734077040 0x7fe734079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:25.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.449+0000 7fe7467fc640 1 -- 172.21.15.120:0/2134053790 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6025+0+0 (secure 0 0 0) 0x7fe748099460 con 0x7fe7500d28f0 2024-07-27T03:14:25.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.449+0000 7fe755b12640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe734077040 0x7fe734079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:25.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.450+0000 7fe755b12640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe734077040 0x7fe734079550 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe74c033000 tx=0x7fe74c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.453+0000 7fe7467fc640 1 -- 172.21.15.120:0/2134053790 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fe7480625b0 con 0x7fe7500d28f0 2024-07-27T03:14:25.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:25.674+0000 7fe757d76640 1 -- 172.21.15.120:0/2134053790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe7500cf760 con 0x7fe7500d28f0 2024-07-27T03:14:26.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.308+0000 7fe7467fc640 1 -- 172.21.15.120:0/2134053790 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v75) ==== 104+0+0 (secure 0 0 0) 0x7fe748061eb0 con 0x7fe7500d28f0 2024-07-27T03:14:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 -- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe734077040 msgr2=0x7fe734079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe734077040 0x7fe734079550 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe74c033000 tx=0x7fe74c004730 comp rx=0 tx=0).stop 2024-07-27T03:14:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 -- 172.21.15.120:0/2134053790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7500d28f0 msgr2=0x7fe7501cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7500d28f0 0x7fe7501cea40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe74800e9d0 tx=0x7fe74800ee90 comp rx=0 tx=0).stop 2024-07-27T03:14:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 -- 172.21.15.120:0/2134053790 shutdown_connections 2024-07-27T03:14:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fe734077040 0x7fe734079550 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7500d28f0 0x7fe7501cea40 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7500ced80 0x7fe7500716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 --2- 172.21.15.120:0/2134053790 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7500b75b0 0x7fe7500711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 -- 172.21.15.120:0/2134053790 >> 172.21.15.120:0/2134053790 conn(0x7fe7500d1dd0 msgr2=0x7fe7501e4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:26.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 -- 172.21.15.120:0/2134053790 shutdown_connections 2024-07-27T03:14:26.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.310+0000 7fe757d76640 1 -- 172.21.15.120:0/2134053790 wait complete. 2024-07-27T03:14:26.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-07-27T03:14:26.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.488+0000 7f53b0d6f640 1 -- 172.21.15.120:0/793855523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53ac073970 msgr2=0x7f53ac15ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:26.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.488+0000 7f53b0d6f640 1 --2- 172.21.15.120:0/793855523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53ac073970 0x7f53ac15ba30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f53a0009830 tx=0x7f53a002a510 comp rx=0 tx=0).stop 2024-07-27T03:14:26.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.488+0000 7f53b0d6f640 1 -- 172.21.15.120:0/793855523 shutdown_connections 2024-07-27T03:14:26.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.488+0000 7f53b0d6f640 1 --2- 172.21.15.120:0/793855523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53ac073970 0x7f53ac15ba30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:26.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.488+0000 7f53b0d6f640 1 --2- 172.21.15.120:0/793855523 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53ac152060 0x7f53ac073430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:26.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.488+0000 7f53b0d6f640 1 -- 172.21.15.120:0/793855523 >> 172.21.15.120:0/793855523 conn(0x7f53ac06dec0 msgr2=0x7f53ac0b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:26.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.488+0000 7f53b0d6f640 1 -- 172.21.15.120:0/793855523 shutdown_connections 2024-07-27T03:14:26.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.488+0000 7f53b0d6f640 1 -- 172.21.15.120:0/793855523 wait complete. 2024-07-27T03:14:26.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.490+0000 7f53b0d6f640 1 Processor -- start 2024-07-27T03:14:26.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.490+0000 7f53b0d6f640 1 -- start start 2024-07-27T03:14:26.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53b0d6f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ac073970 0x7f53ac13e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:26.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53b0d6f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53ac152060 0x7f53ac1481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:26.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53b0d6f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53ac15bf70 0x7f53ac148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:26.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53b0d6f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac152680 con 0x7f53ac073970 2024-07-27T03:14:26.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53b0d6f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac15f420 con 0x7f53ac15bf70 2024-07-27T03:14:26.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53b0d6f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f53ac14c580 con 0x7f53ac152060 2024-07-27T03:14:26.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53aa59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ac073970 0x7f53ac13e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:26.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53aa59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ac073970 0x7f53ac13e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51044/0 (socket says 172.21.15.120:51044) 2024-07-27T03:14:26.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53aa59c640 1 -- 172.21.15.120:0/3080267737 learned_addr learned my addr 172.21.15.120:0/3080267737 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53a9d9b640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53ac152060 0x7f53ac1481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53aad9d640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53ac15bf70 0x7f53ac148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53aa59c640 1 -- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53ac152060 msgr2=0x7f53ac1481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53aa59c640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53ac152060 0x7f53ac1481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53aa59c640 1 -- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53ac15bf70 msgr2=0x7f53ac148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53aa59c640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53ac15bf70 0x7f53ac148700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53aa59c640 1 -- 172.21.15.120:0/3080267737 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac1556d0 con 0x7f53ac073970 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53aa59c640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ac073970 0x7f53ac13e780 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f539c00ea20 tx=0x7f539c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f539affd640 1 -- 172.21.15.120:0/3080267737 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c00ce40 con 0x7f53ac073970 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f539affd640 1 -- 172.21.15.120:0/3080267737 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f539c004020 con 0x7f53ac073970 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f53b0d6f640 1 -- 172.21.15.120:0/3080267737 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ac14b030 con 0x7f53ac073970 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.492+0000 7f539affd640 1 -- 172.21.15.120:0/3080267737 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c004470 con 0x7f53ac073970 2024-07-27T03:14:26.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.493+0000 7f53b0d6f640 1 -- 172.21.15.120:0/3080267737 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ac153e50 con 0x7f53ac073970 2024-07-27T03:14:26.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.493+0000 7f53b0d6f640 1 -- 172.21.15.120:0/3080267737 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ac14b550 con 0x7f53ac073970 2024-07-27T03:14:26.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.494+0000 7f539affd640 1 -- 172.21.15.120:0/3080267737 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f539c0035f0 con 0x7f53ac073970 2024-07-27T03:14:26.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.495+0000 7f539affd640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f538c077010 0x7f538c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:26.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.495+0000 7f539affd640 1 -- 172.21.15.120:0/3080267737 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6025+0+0 (secure 0 0 0) 0x7f539c099210 con 0x7f53ac073970 2024-07-27T03:14:26.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.495+0000 7f53a9d9b640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f538c077010 0x7f538c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:26.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.495+0000 7f53a9d9b640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f538c077010 0x7f538c079520 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f53a0034000 tx=0x7f53a0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:26.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.499+0000 7f539affd640 1 -- 172.21.15.120:0/3080267737 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f539c061c80 con 0x7f53ac073970 2024-07-27T03:14:26.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:26.683+0000 7f53b0d6f640 1 -- 172.21.15.120:0/3080267737 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f53ac06a0f0 con 0x7f53ac073970 2024-07-27T03:14:27.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.313+0000 7f539affd640 1 -- 172.21.15.120:0/3080267737 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) ==== 181+0+0 (secure 0 0 0) 0x7f53ac06a0f0 con 0x7f53ac073970 2024-07-27T03:14:27.316 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' removed 2024-07-27T03:14:27.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 -- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f538c077010 msgr2=0x7f538c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:27.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f538c077010 0x7f538c079520 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f53a0034000 tx=0x7f53a0004730 comp rx=0 tx=0).stop 2024-07-27T03:14:27.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 -- 172.21.15.120:0/3080267737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ac073970 msgr2=0x7f53ac13e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:27.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ac073970 0x7f53ac13e780 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f539c00ea20 tx=0x7f539c00eee0 comp rx=0 tx=0).stop 2024-07-27T03:14:27.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 -- 172.21.15.120:0/3080267737 shutdown_connections 2024-07-27T03:14:27.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f538c077010 0x7f538c079520 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:27.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53ac15bf70 0x7f53ac148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:27.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53ac152060 0x7f53ac1481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:27.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 --2- 172.21.15.120:0/3080267737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ac073970 0x7f53ac13e780 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:27.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 -- 172.21.15.120:0/3080267737 >> 172.21.15.120:0/3080267737 conn(0x7f53ac06dec0 msgr2=0x7f53ac15c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:27.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 -- 172.21.15.120:0/3080267737 shutdown_connections 2024-07-27T03:14:27.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.317+0000 7f53b0d6f640 1 -- 172.21.15.120:0/3080267737 wait complete. 2024-07-27T03:14:27.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-07-27T03:14:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.453+0000 7fc81b8f9640 1 -- 172.21.15.120:0/3418594511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc800003a00 msgr2=0x7fc800003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.453+0000 7fc81b8f9640 1 --2- 172.21.15.120:0/3418594511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc800003a00 0x7fc800003e70 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc810009b50 tx=0x7fc800005830 comp rx=0 tx=0).stop 2024-07-27T03:14:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.453+0000 7fc819e96640 1 -- 172.21.15.120:0/3418594511 reap_dead start 2024-07-27T03:14:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.453+0000 7fc81b8f9640 1 -- 172.21.15.120:0/3418594511 shutdown_connections 2024-07-27T03:14:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.453+0000 7fc81b8f9640 1 -- 172.21.15.120:0/3418594511 >> 172.21.15.120:0/3418594511 conn(0x7fc81406dec0 msgr2=0x7fc8140b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.453+0000 7fc81b8f9640 1 -- 172.21.15.120:0/3418594511 shutdown_connections 2024-07-27T03:14:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.453+0000 7fc81b8f9640 1 -- 172.21.15.120:0/3418594511 wait complete. 2024-07-27T03:14:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.454+0000 7fc81b8f9640 1 Processor -- start 2024-07-27T03:14:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.455+0000 7fc81b8f9640 1 -- start start 2024-07-27T03:14:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc81b8f9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc800003a00 0x7fc81414c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc81b8f9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc81414ccc0 0x7fc8141f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc81b8f9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc814157630 0x7fc814157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc81b8f9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc81406c780 con 0x7fc800003a00 2024-07-27T03:14:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc81b8f9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8140706b0 con 0x7fc814157630 2024-07-27T03:14:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc81b8f9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc81406c900 con 0x7fc81414ccc0 2024-07-27T03:14:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc819695640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc800003a00 0x7fc81414c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc819695640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc800003a00 0x7fc81414c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51076/0 (socket says 172.21.15.120:51076) 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc819695640 1 -- 172.21.15.120:0/917225536 learned_addr learned my addr 172.21.15.120:0/917225536 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc818e94640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc81414ccc0 0x7fc8141f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc819e96640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc814157630 0x7fc814157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc819695640 1 -- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc81414ccc0 msgr2=0x7fc8141f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc819695640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc81414ccc0 0x7fc8141f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc819695640 1 -- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc814157630 msgr2=0x7fc814157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc819695640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc814157630 0x7fc814157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc819695640 1 -- 172.21.15.120:0/917225536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8141f7080 con 0x7fc800003a00 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc818e94640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc81414ccc0 0x7fc8141f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc819e96640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc814157630 0x7fc814157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:14:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.456+0000 7fc819695640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc800003a00 0x7fc81414c5c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc810036040 tx=0x7fc810033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.457+0000 7fc809ffb640 1 -- 172.21.15.120:0/917225536 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810038040 con 0x7fc800003a00 2024-07-27T03:14:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.457+0000 7fc809ffb640 1 -- 172.21.15.120:0/917225536 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc810004020 con 0x7fc800003a00 2024-07-27T03:14:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.457+0000 7fc81b8f9640 1 -- 172.21.15.120:0/917225536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc814157f80 con 0x7fc800003a00 2024-07-27T03:14:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.457+0000 7fc809ffb640 1 -- 172.21.15.120:0/917225536 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810004470 con 0x7fc800003a00 2024-07-27T03:14:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.457+0000 7fc81b8f9640 1 -- 172.21.15.120:0/917225536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81414b800 con 0x7fc800003a00 2024-07-27T03:14:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.458+0000 7fc81b8f9640 1 -- 172.21.15.120:0/917225536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8140afc30 con 0x7fc800003a00 2024-07-27T03:14:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.458+0000 7fc809ffb640 1 -- 172.21.15.120:0/917225536 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc810045020 con 0x7fc800003a00 2024-07-27T03:14:27.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.459+0000 7fc809ffb640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7f8077040 0x7fc7f8079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:27.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.459+0000 7fc809ffb640 1 -- 172.21.15.120:0/917225536 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5587+0+0 (secure 0 0 0) 0x7fc8100b93f0 con 0x7fc800003a00 2024-07-27T03:14:27.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.459+0000 7fc818e94640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7f8077040 0x7fc7f8079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:27.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.460+0000 7fc818e94640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7f8077040 0x7fc7f8079550 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc804005eb0 tx=0x7fc804005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:27.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.463+0000 7fc809ffb640 1 -- 172.21.15.120:0/917225536 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc814157f80 con 0x7fc800003a00 2024-07-27T03:14:27.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:27.645+0000 7fc81b8f9640 1 -- 172.21.15.120:0/917225536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc814156ac0 con 0x7fc800003a00 2024-07-27T03:14:28.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.315+0000 7fc809ffb640 1 -- 172.21.15.120:0/917225536 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) ==== 169+0+0 (secure 0 0 0) 0x7fc8141f7080 con 0x7fc800003a00 2024-07-27T03:14:28.318 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' removed 2024-07-27T03:14:28.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 -- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7f8077040 msgr2=0x7fc7f8079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:28.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7f8077040 0x7fc7f8079550 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc804005eb0 tx=0x7fc804005f90 comp rx=0 tx=0).stop 2024-07-27T03:14:28.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 -- 172.21.15.120:0/917225536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc800003a00 msgr2=0x7fc81414c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:28.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc800003a00 0x7fc81414c5c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc810036040 tx=0x7fc810033670 comp rx=0 tx=0).stop 2024-07-27T03:14:28.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 -- 172.21.15.120:0/917225536 shutdown_connections 2024-07-27T03:14:28.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7f8077040 0x7fc7f8079550 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc814157630 0x7fc814157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc81414ccc0 0x7fc8141f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 --2- 172.21.15.120:0/917225536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc800003a00 0x7fc81414c5c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 -- 172.21.15.120:0/917225536 >> 172.21.15.120:0/917225536 conn(0x7fc81406dec0 msgr2=0x7fc81414e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:28.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 -- 172.21.15.120:0/917225536 shutdown_connections 2024-07-27T03:14:28.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.318+0000 7fc81b8f9640 1 -- 172.21.15.120:0/917225536 wait complete. 2024-07-27T03:14:28.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-07-27T03:14:28.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.447+0000 7f55ef3f0640 1 -- 172.21.15.120:0/334018163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55d4004800 msgr2=0x7f55d4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:28.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.447+0000 7f55ef3f0640 1 --2- 172.21.15.120:0/334018163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55d4004800 0x7f55d4004c10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f55e806f810 tx=0x7f55d4005830 comp rx=0 tx=0).stop 2024-07-27T03:14:28.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.447+0000 7f55ed98d640 1 -- 172.21.15.120:0/334018163 reap_dead start 2024-07-27T03:14:28.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.447+0000 7f55ef3f0640 1 -- 172.21.15.120:0/334018163 shutdown_connections 2024-07-27T03:14:28.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.447+0000 7f55ef3f0640 1 -- 172.21.15.120:0/334018163 >> 172.21.15.120:0/334018163 conn(0x7f55e80d20a0 msgr2=0x7f55e80d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:28.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.447+0000 7f55ef3f0640 1 -- 172.21.15.120:0/334018163 shutdown_connections 2024-07-27T03:14:28.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.447+0000 7f55ef3f0640 1 -- 172.21.15.120:0/334018163 wait complete. 2024-07-27T03:14:28.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.449+0000 7f55ef3f0640 1 Processor -- start 2024-07-27T03:14:28.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.449+0000 7f55ef3f0640 1 -- start start 2024-07-27T03:14:28.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.450+0000 7f55ef3f0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55d4004800 0x7f55e80aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:28.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.450+0000 7f55ef3f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e80b2950 0x7f55e80b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:28.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.450+0000 7f55ef3f0640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55e814a4c0 0x7f55e814a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:28.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.450+0000 7f55ef3f0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f55e8162c60 con 0x7f55d4004800 2024-07-27T03:14:28.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.450+0000 7f55ef3f0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55e8162ae0 con 0x7f55e80b2950 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.450+0000 7f55ef3f0640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f55e8162de0 con 0x7f55e814a4c0 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.450+0000 7f55ed18c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55d4004800 0x7f55e80aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.450+0000 7f55ed18c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55d4004800 0x7f55e80aed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51086/0 (socket says 172.21.15.120:51086) 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.450+0000 7f55ed18c640 1 -- 172.21.15.120:0/250299760 learned_addr learned my addr 172.21.15.120:0/250299760 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ed98d640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55e814a4c0 0x7f55e814a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ec98b640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e80b2950 0x7f55e80b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ed18c640 1 -- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55e814a4c0 msgr2=0x7f55e814a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ed18c640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55e814a4c0 0x7f55e814a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ed18c640 1 -- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e80b2950 msgr2=0x7f55e80b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ed18c640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e80b2950 0x7f55e80b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ed18c640 1 -- 172.21.15.120:0/250299760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e80b32a0 con 0x7f55d4004800 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ed18c640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55d4004800 0x7f55e80aed80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f55e4005f00 tx=0x7f55e4011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:28.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ddffb640 1 -- 172.21.15.120:0/250299760 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e400fc70 con 0x7f55d4004800 2024-07-27T03:14:28.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ddffb640 1 -- 172.21.15.120:0/250299760 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55e400fe10 con 0x7f55d4004800 2024-07-27T03:14:28.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ddffb640 1 -- 172.21.15.120:0/250299760 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4004290 con 0x7f55d4004800 2024-07-27T03:14:28.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ef3f0640 1 -- 172.21.15.120:0/250299760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e814ae10 con 0x7f55d4004800 2024-07-27T03:14:28.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.451+0000 7f55ef3f0640 1 -- 172.21.15.120:0/250299760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e81f8b70 con 0x7f55d4004800 2024-07-27T03:14:28.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.452+0000 7f55ef3f0640 1 -- 172.21.15.120:0/250299760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e80b7260 con 0x7f55d4004800 2024-07-27T03:14:28.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.453+0000 7f55ddffb640 1 -- 172.21.15.120:0/250299760 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f55e40035f0 con 0x7f55d4004800 2024-07-27T03:14:28.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.453+0000 7f55ddffb640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 0x7f55cc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:28.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.454+0000 7f55ddffb640 1 -- 172.21.15.120:0/250299760 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f55e4098fa0 con 0x7f55d4004800 2024-07-27T03:14:28.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.454+0000 7f55ec98b640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 0x7f55cc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:28.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.454+0000 7f55ec98b640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 0x7f55cc079520 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f55e806f810 tx=0x7f55d802d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:28.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.458+0000 7f55ddffb640 1 -- 172.21.15.120:0/250299760 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f55e80b7260 con 0x7f55d4004800 2024-07-27T03:14:28.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.642+0000 7f55ef3f0640 1 -- 172.21.15.120:0/250299760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f55e809aa30 con 0x7f55d4004800 2024-07-27T03:14:28.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.646+0000 7f55ddffb640 1 -- 172.21.15.120:0/250299760 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v38) ==== 71+0+0 (secure 0 0 0) 0x7f55e80b32a0 con 0x7f55d4004800 2024-07-27T03:14:28.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 -- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 msgr2=0x7f55cc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:28.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 0x7f55cc079520 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f55e806f810 tx=0x7f55d802d000 comp rx=0 tx=0).stop 2024-07-27T03:14:28.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 -- 172.21.15.120:0/250299760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55d4004800 msgr2=0x7f55e80aed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:28.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55d4004800 0x7f55e80aed80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f55e4005f00 tx=0x7f55e4011f40 comp rx=0 tx=0).stop 2024-07-27T03:14:28.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 -- 172.21.15.120:0/250299760 shutdown_connections 2024-07-27T03:14:28.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f55cc077010 0x7f55cc079520 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55e814a4c0 0x7f55e814a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e80b2950 0x7f55e80b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 --2- 172.21.15.120:0/250299760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f55d4004800 0x7f55e80aed80 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 -- 172.21.15.120:0/250299760 >> 172.21.15.120:0/250299760 conn(0x7f55e80d20a0 msgr2=0x7f55e80cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:28.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 -- 172.21.15.120:0/250299760 shutdown_connections 2024-07-27T03:14:28.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.648+0000 7f55ef3f0640 1 -- 172.21.15.120:0/250299760 wait complete. 2024-07-27T03:14:28.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_exports.TestBalMask.test_mds_failover' 2024-07-27T03:14:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.776+0000 7f5c460d2640 1 -- 172.21.15.120:0/3112010017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c40160940 msgr2=0x7f5c40153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.776+0000 7f5c460d2640 1 --2- 172.21.15.120:0/3112010017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c40160940 0x7f5c40153200 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009830 tx=0x7f5c3002a480 comp rx=0 tx=0).stop 2024-07-27T03:14:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.776+0000 7f5c460d2640 1 -- 172.21.15.120:0/3112010017 shutdown_connections 2024-07-27T03:14:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.776+0000 7f5c460d2640 1 --2- 172.21.15.120:0/3112010017 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c400b63e0 0x7f5c4015c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.776+0000 7f5c460d2640 1 --2- 172.21.15.120:0/3112010017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c40160940 0x7f5c40153200 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.776+0000 7f5c460d2640 1 -- 172.21.15.120:0/3112010017 >> 172.21.15.120:0/3112010017 conn(0x7f5c4006cba0 msgr2=0x7f5c4006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.776+0000 7f5c460d2640 1 -- 172.21.15.120:0/3112010017 shutdown_connections 2024-07-27T03:14:28.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.776+0000 7f5c460d2640 1 -- 172.21.15.120:0/3112010017 wait complete. 2024-07-27T03:14:28.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.777+0000 7f5c460d2640 1 Processor -- start 2024-07-27T03:14:28.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.778+0000 7f5c460d2640 1 -- start start 2024-07-27T03:14:28.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c460d2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c400739c0 0x7f5c401f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:28.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c460d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c40160940 0x7f5c401f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:28.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c460d2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c4015da90 0x7f5c400ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:28.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c460d2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4015ce00 con 0x7f5c4015da90 2024-07-27T03:14:28.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c460d2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4015cc80 con 0x7f5c40160940 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c460d2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5c4015cf80 con 0x7f5c400739c0 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c3ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c4015da90 0x7f5c400ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c3ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c4015da90 0x7f5c400ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51094/0 (socket says 172.21.15.120:51094) 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c3ffff640 1 -- 172.21.15.120:0/1775361481 learned_addr learned my addr 172.21.15.120:0/1775361481 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c3f7fe640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c400739c0 0x7f5c401f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c3effd640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c40160940 0x7f5c401f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c3ffff640 1 -- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c400739c0 msgr2=0x7f5c401f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c3ffff640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c400739c0 0x7f5c401f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c3ffff640 1 -- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c40160940 msgr2=0x7f5c401f8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c3ffff640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c40160940 0x7f5c401f8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.779+0000 7f5c3ffff640 1 -- 172.21.15.120:0/1775361481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c400cf1b0 con 0x7f5c4015da90 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.780+0000 7f5c3ffff640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c4015da90 0x7f5c400ce800 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800c3a0 tx=0x7f5c3800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:28.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.780+0000 7f5c27fff640 1 -- 172.21.15.120:0/1775361481 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38003970 con 0x7f5c4015da90 2024-07-27T03:14:28.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.780+0000 7f5c27fff640 1 -- 172.21.15.120:0/1775361481 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c38003c00 con 0x7f5c4015da90 2024-07-27T03:14:28.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.780+0000 7f5c460d2640 1 -- 172.21.15.120:0/1775361481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4015dfa0 con 0x7f5c4015da90 2024-07-27T03:14:28.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.780+0000 7f5c27fff640 1 -- 172.21.15.120:0/1775361481 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38004020 con 0x7f5c4015da90 2024-07-27T03:14:28.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.780+0000 7f5c460d2640 1 -- 172.21.15.120:0/1775361481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c401f5130 con 0x7f5c4015da90 2024-07-27T03:14:28.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.781+0000 7f5c460d2640 1 -- 172.21.15.120:0/1775361481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4015d470 con 0x7f5c4015da90 2024-07-27T03:14:28.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.781+0000 7f5c27fff640 1 -- 172.21.15.120:0/1775361481 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5c3801d020 con 0x7f5c4015da90 2024-07-27T03:14:28.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.782+0000 7f5c27fff640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c2c077010 0x7f5c2c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:28.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.782+0000 7f5c27fff640 1 -- 172.21.15.120:0/1775361481 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f5c38098ba0 con 0x7f5c4015da90 2024-07-27T03:14:28.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.782+0000 7f5c3f7fe640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c2c077010 0x7f5c2c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:28.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.783+0000 7f5c3f7fe640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c2c077010 0x7f5c2c079520 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5c30034000 tx=0x7f5c30004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:28.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:28.786+0000 7f5c27fff640 1 -- 172.21.15.120:0/1775361481 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5c380619b0 con 0x7f5c4015da90 2024-07-27T03:14:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.035+0000 7f5c460d2640 1 -- 172.21.15.120:0/1775361481 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_exports.TestBalMask.test_mds_failover"]} v 0) -- 0x7f5c400b3150 con 0x7f5c4015da90 2024-07-27T03:14:29.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.320+0000 7f5c27fff640 1 -- 172.21.15.120:0/1775361481 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_exports.TestBalMask.test_mds_failover"]}]=0 v268) ==== 134+0+0 (secure 0 0 0) 0x7f5c38065f00 con 0x7f5c4015da90 2024-07-27T03:14:29.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 -- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c2c077010 msgr2=0x7f5c2c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:29.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c2c077010 0x7f5c2c079520 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5c30034000 tx=0x7f5c30004730 comp rx=0 tx=0).stop 2024-07-27T03:14:29.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 -- 172.21.15.120:0/1775361481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c4015da90 msgr2=0x7f5c400ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:29.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c4015da90 0x7f5c400ce800 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800c3a0 tx=0x7f5c3800c860 comp rx=0 tx=0).stop 2024-07-27T03:14:29.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 -- 172.21.15.120:0/1775361481 shutdown_connections 2024-07-27T03:14:29.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5c2c077010 0x7f5c2c079520 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:29.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c4015da90 0x7f5c400ce800 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:29.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c40160940 0x7f5c401f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:29.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 --2- 172.21.15.120:0/1775361481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c400739c0 0x7f5c401f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:29.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 -- 172.21.15.120:0/1775361481 >> 172.21.15.120:0/1775361481 conn(0x7f5c4006cba0 msgr2=0x7f5c4006fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:29.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 -- 172.21.15.120:0/1775361481 shutdown_connections 2024-07-27T03:14:29.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:29.322+0000 7f5c460d2640 1 -- 172.21.15.120:0/1775361481 wait complete. 2024-07-27T03:14:29.338 INFO:tasks.cephfs_test_runner:That MDS failover does not affect the ceph.dir.bal.mask. ... ERROR 2024-07-27T03:14:29.339 INFO:tasks.cephfs_test_runner: 2024-07-27T03:14:29.339 INFO:tasks.cephfs_test_runner:====================================================================== 2024-07-27T03:14:29.339 INFO:tasks.cephfs_test_runner:ERROR: test_mds_failover (tasks.cephfs.test_exports.TestBalMask) 2024-07-27T03:14:29.339 INFO:tasks.cephfs_test_runner:That MDS failover does not affect the ceph.dir.bal.mask. 2024-07-27T03:14:29.339 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-07-27T03:14:29.339 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-07-27T03:14:29.339 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa/tasks/cephfs/cephfs_test_case.py", line 436, in _wait_xattrs 2024-07-27T03:14:29.339 INFO:tasks.cephfs_test_runner: while proceed(): 2024-07-27T03:14:29.339 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/contextutil.py", line 134, in __call__ 2024-07-27T03:14:29.339 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2024-07-27T03:14:29.339 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: reached maximum tries (21) after waiting for 100 seconds 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner: 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner:The above exception was the direct cause of the following exception: 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner: 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa/tasks/cephfs/test_exports.py", line 932, in test_mds_failover 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner: self._wait_xattrs(self.mount_a, "1", "ceph.dir.bal.mask", "2") 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa/tasks/cephfs/cephfs_test_case.py", line 441, in _wait_xattrs 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner: raise RuntimeError("client failed to get desired value with key {0}".format(key)) from e 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner:RuntimeError: client failed to get desired value with key ceph.dir.bal.mask 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner: 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner:Ran 4 tests in 332.885s 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner: 2024-07-27T03:14:29.340 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner: 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner:====================================================================== 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner:ERROR: test_mds_failover (tasks.cephfs.test_exports.TestBalMask) 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner:That MDS failover does not affect the ceph.dir.bal.mask. 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa/tasks/cephfs/cephfs_test_case.py", line 436, in _wait_xattrs 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner: while proceed(): 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/contextutil.py", line 134, in __call__ 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: reached maximum tries (21) after waiting for 100 seconds 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner: 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner:The above exception was the direct cause of the following exception: 2024-07-27T03:14:29.341 INFO:tasks.cephfs_test_runner: 2024-07-27T03:14:29.342 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-07-27T03:14:29.342 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa/tasks/cephfs/test_exports.py", line 932, in test_mds_failover 2024-07-27T03:14:29.342 INFO:tasks.cephfs_test_runner: self._wait_xattrs(self.mount_a, "1", "ceph.dir.bal.mask", "2") 2024-07-27T03:14:29.342 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa/tasks/cephfs/cephfs_test_case.py", line 441, in _wait_xattrs 2024-07-27T03:14:29.342 INFO:tasks.cephfs_test_runner: raise RuntimeError("client failed to get desired value with key {0}".format(key)) from e 2024-07-27T03:14:29.342 INFO:tasks.cephfs_test_runner:RuntimeError: client failed to get desired value with key ceph.dir.bal.mask 2024-07-27T03:14:29.342 INFO:tasks.cephfs_test_runner: 2024-07-27T03:14:29.343 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_mds_failover (tasks.cephfs.test_exports.TestBalMask) 2024-07-27T03:14:29.523 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9c90534c874d408da3f3a8ceb4f8b6e6 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_af8fdbf079811fe158ce62927bd145c35b74d4b8/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_mds_failover (tasks.cephfs.test_exports.TestBalMask) 2024-07-27T03:14:29.525 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-07-27T03:14:29.535 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-07-27T03:14:29.576 INFO:tasks.kclient:Unmounting kernel clients... 2024-07-27T03:14:29.576 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:14:29.576 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:14:29.596 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:14:29.596 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-07-27T03:14:29.596 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:14:29.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056059,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1768 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-27T03:14:29.653 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:14:29.653 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:14:29.672 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:14:29.673 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-07-27T03:14:29.673 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-27T03:14:29.730 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056030,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=263 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248704k,nr_inodes=812176,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497416k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-27T03:14:29.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:29.731 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-07-27T03:14:29.747 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-07-27T03:14:29.747 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-27T03:14:29.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:29.748 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-07-27T03:14:29.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:29.813 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-27T03:14:29.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:29.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-07-27T03:14:29.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:29.977 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-07-27T03:14:29.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:29.992 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-07-27T03:14:30.061 INFO:teuthology.orchestra.run.smithi120.stderr:Cannot find device "ceph-brx" 2024-07-27T03:14:30.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:14:30.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:30.064 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-07-27T03:14:30.082 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-07-27T03:14:30.083 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-07-27T03:14:30.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:30.083 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-07-27T03:14:30.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:30.152 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-07-27T03:14:30.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:30.220 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-07-27T03:14:30.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:30.336 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-07-27T03:14:30.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-27T03:14:30.354 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-07-27T03:14:30.422 INFO:teuthology.orchestra.run.smithi121.stderr:Cannot find device "ceph-brx" 2024-07-27T03:14:30.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:14:30.424 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-07-27T03:14:30.433 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-27T03:14:30.434 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:14:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.547+0000 7fcb20bac640 1 -- 172.21.15.120:0/4077957442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c1522e0 msgr2=0x7fcb1c06e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.547+0000 7fcb20bac640 1 --2- 172.21.15.120:0/4077957442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c1522e0 0x7fcb1c06e270 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0cfc50 tx=0x7fcb0c02a560 comp rx=0 tx=0).stop 2024-07-27T03:14:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.547+0000 7fcb20bac640 1 -- 172.21.15.120:0/4077957442 shutdown_connections 2024-07-27T03:14:30.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.547+0000 7fcb20bac640 1 --2- 172.21.15.120:0/4077957442 >> v2:172.21.15.121:3300/0 conn(0x7fcb1c0733e0 0x7fcb1c0737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.547+0000 7fcb20bac640 1 --2- 172.21.15.120:0/4077957442 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c1522e0 0x7fcb1c06e270 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.547+0000 7fcb20bac640 1 -- 172.21.15.120:0/4077957442 >> 172.21.15.120:0/4077957442 conn(0x7fcb1c0b1a10 msgr2=0x7fcb1c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.547+0000 7fcb20bac640 1 -- 172.21.15.120:0/4077957442 shutdown_connections 2024-07-27T03:14:30.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.547+0000 7fcb20bac640 1 -- 172.21.15.120:0/4077957442 wait complete. 2024-07-27T03:14:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.549+0000 7fcb20bac640 1 Processor -- start 2024-07-27T03:14:30.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.549+0000 7fcb20bac640 1 -- start start 2024-07-27T03:14:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.550+0000 7fcb20bac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0733e0 0x7fcb1c14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.550+0000 7fcb20bac640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb1c073d30 0x7fcb1c06eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.550+0000 7fcb20bac640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb1c1522e0 0x7fcb1c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.550+0000 7fcb20bac640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c15c220 con 0x7fcb1c0733e0 2024-07-27T03:14:30.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.550+0000 7fcb20bac640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c15c0a0 con 0x7fcb1c073d30 2024-07-27T03:14:30.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.550+0000 7fcb20bac640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fcb1c15c3a0 con 0x7fcb1c1522e0 2024-07-27T03:14:30.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.550+0000 7fcb1a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0733e0 0x7fcb1c14f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:30.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.550+0000 7fcb1a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0733e0 0x7fcb1c14f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51112/0 (socket says 172.21.15.120:51112) 2024-07-27T03:14:30.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.550+0000 7fcb1a59c640 1 -- 172.21.15.120:0/3276982080 learned_addr learned my addr 172.21.15.120:0/3276982080 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:30.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.550+0000 7fcb19d9b640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb1c073d30 0x7fcb1c06eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:30.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.550+0000 7fcb1ad9d640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb1c1522e0 0x7fcb1c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:30.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.551+0000 7fcb1a59c640 1 -- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb1c1522e0 msgr2=0x7fcb1c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:30.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.551+0000 7fcb1a59c640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb1c1522e0 0x7fcb1c06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.551+0000 7fcb1a59c640 1 -- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb1c073d30 msgr2=0x7fcb1c06eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:30.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.551+0000 7fcb1a59c640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb1c073d30 0x7fcb1c06eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.551+0000 7fcb1a59c640 1 -- 172.21.15.120:0/3276982080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c14f7f0 con 0x7fcb1c0733e0 2024-07-27T03:14:30.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.551+0000 7fcb1a59c640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0733e0 0x7fcb1c14f2b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0099c0 tx=0x7fcb0c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:30.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.551+0000 7fcb0affd640 1 -- 172.21.15.120:0/3276982080 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c03e030 con 0x7fcb1c0733e0 2024-07-27T03:14:30.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.551+0000 7fcb0affd640 1 -- 172.21.15.120:0/3276982080 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb0c0047a0 con 0x7fcb1c0733e0 2024-07-27T03:14:30.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.551+0000 7fcb20bac640 1 -- 172.21.15.120:0/3276982080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1c1536c0 con 0x7fcb1c0733e0 2024-07-27T03:14:30.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.551+0000 7fcb0affd640 1 -- 172.21.15.120:0/3276982080 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c035040 con 0x7fcb1c0733e0 2024-07-27T03:14:30.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.551+0000 7fcb20bac640 1 -- 172.21.15.120:0/3276982080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb1c1f6a20 con 0x7fcb1c0733e0 2024-07-27T03:14:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.552+0000 7fcb20bac640 1 -- 172.21.15.120:0/3276982080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb1c0737f0 con 0x7fcb1c0733e0 2024-07-27T03:14:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.553+0000 7fcb0affd640 1 -- 172.21.15.120:0/3276982080 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fcb0c041030 con 0x7fcb1c0733e0 2024-07-27T03:14:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.553+0000 7fcb0affd640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcafc077040 0x7fcafc079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.553+0000 7fcb0affd640 1 -- 172.21.15.120:0/3276982080 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fcb0c0b8d90 con 0x7fcb1c0733e0 2024-07-27T03:14:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.553+0000 7fcb19d9b640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcafc077040 0x7fcafc079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:30.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.554+0000 7fcb19d9b640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcafc077040 0x7fcafc079550 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0b1650 tx=0x7fcb1000a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:30.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.558+0000 7fcb0affd640 1 -- 172.21.15.120:0/3276982080 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fcb0c081c20 con 0x7fcb1c0733e0 2024-07-27T03:14:30.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.738+0000 7fcb20bac640 1 -- 172.21.15.120:0/3276982080 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb1c0b4b80 con 0x7fcafc077040 2024-07-27T03:14:30.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.738+0000 7fcb0affd640 1 -- 172.21.15.120:0/3276982080 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13440 (secure 0 0 0) 0x7fcb1c0b4b80 con 0x7fcafc077040 2024-07-27T03:14:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:30.742 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:14:30.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.740+0000 7fcb20bac640 1 -- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcafc077040 msgr2=0x7fcafc079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:30.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.740+0000 7fcb20bac640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcafc077040 0x7fcafc079550 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0b1650 tx=0x7fcb1000a250 comp rx=0 tx=0).stop 2024-07-27T03:14:30.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.740+0000 7fcb20bac640 1 -- 172.21.15.120:0/3276982080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0733e0 msgr2=0x7fcb1c14f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:30.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.740+0000 7fcb20bac640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0733e0 0x7fcb1c14f2b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0099c0 tx=0x7fcb0c0039e0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.741+0000 7fcb20bac640 1 -- 172.21.15.120:0/3276982080 shutdown_connections 2024-07-27T03:14:30.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.741+0000 7fcb20bac640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fcafc077040 0x7fcafc079550 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.741+0000 7fcb20bac640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb1c1522e0 0x7fcb1c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.741+0000 7fcb20bac640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb1c073d30 0x7fcb1c06eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.741+0000 7fcb20bac640 1 --2- 172.21.15.120:0/3276982080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcb1c0733e0 0x7fcb1c14f2b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.741+0000 7fcb20bac640 1 -- 172.21.15.120:0/3276982080 >> 172.21.15.120:0/3276982080 conn(0x7fcb1c0b1a10 msgr2=0x7fcb1c0af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:30.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.741+0000 7fcb20bac640 1 -- 172.21.15.120:0/3276982080 shutdown_connections 2024-07-27T03:14:30.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.741+0000 7fcb20bac640 1 -- 172.21.15.120:0/3276982080 wait complete. 2024-07-27T03:14:30.754 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-07-27T03:14:30.625218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":425492,"kb_used_data":8104,"kb_used_omap":12,"kb_used_meta":417267,"kb_avail":754549228,"statfs":{"total":773094113280,"available":772658409472,"internally_reserved":0,"allocated":8298496,"data_stored":4177006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":427281968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18022,"num_objects":-60,"num_object_clones":0,"num_object_copies":-120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-148,"num_write_kb":-63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001240"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":204,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-07-27T03:14:27.802085+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:14:27.802085+0000","last_peered":"2024-07-27T03:14:27.802085+0000","last_clean":"2024-07-27T03:14:27.802085+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:14:27.802085+0000","last_undegraded":"2024-07-27T03:14:27.802085+0000","last_fullsized":"2024-07-27T03:14:27.802085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77044,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294796,"statfs":{"total":96636764160,"available":96557871104,"internally_reserved":0,"allocated":1478656,"data_stored":966143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509516,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50096,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321744,"statfs":{"total":96636764160,"available":96585465856,"internally_reserved":0,"allocated":884736,"data_stored":375775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509517,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50100,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321740,"statfs":{"total":96636764160,"available":96585461760,"internally_reserved":0,"allocated":892928,"data_stored":370948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40380,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331460,"statfs":{"total":96636764160,"available":96595415040,"internally_reserved":0,"allocated":901120,"data_stored":381480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54836,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317004,"statfs":{"total":96636764160,"available":96580612096,"internally_reserved":0,"allocated":1478656,"data_stored":966143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542220,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":876544,"data_stored":369634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542220,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76476,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94295364,"statfs":{"total":96636764160,"available":96558452736,"internally_reserved":0,"allocated":901120,"data_stored":371108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542219,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40364,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331476,"statfs":{"total":96636764160,"available":96595431424,"internally_reserved":0,"allocated":884736,"data_stored":375775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:14:30.755 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:14:30.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.865+0000 7f9d051cf640 1 -- 172.21.15.120:0/144548392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d000d0500 msgr2=0x7f9d000d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:30.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.865+0000 7f9d051cf640 1 --2- 172.21.15.120:0/144548392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d000d0500 0x7f9d000d0910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4005fd0 tx=0x7f9cf402a540 comp rx=0 tx=0).stop 2024-07-27T03:14:30.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.865+0000 7f9d051cf640 1 -- 172.21.15.120:0/144548392 shutdown_connections 2024-07-27T03:14:30.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.865+0000 7f9d051cf640 1 --2- 172.21.15.120:0/144548392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d000d0500 0x7f9d000d0910 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.865+0000 7f9d051cf640 1 --2- 172.21.15.120:0/144548392 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d000b2110 0x7f9d000b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.865+0000 7f9d051cf640 1 -- 172.21.15.120:0/144548392 >> 172.21.15.120:0/144548392 conn(0x7f9d000b3920 msgr2=0x7f9d000b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:30.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.865+0000 7f9d051cf640 1 -- 172.21.15.120:0/144548392 shutdown_connections 2024-07-27T03:14:30.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.865+0000 7f9d051cf640 1 -- 172.21.15.120:0/144548392 wait complete. 2024-07-27T03:14:30.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.867+0000 7f9d051cf640 1 Processor -- start 2024-07-27T03:14:30.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.867+0000 7f9d051cf640 1 -- start start 2024-07-27T03:14:30.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.868+0000 7f9d051cf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d000b2110 0x7f9d001f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:30.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9d051cf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d000b4fd0 0x7f9d0009ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:30.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9d051cf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d000d0500 0x7f9d00150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:30.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9d051cf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000b5af0 con 0x7f9d000d0500 2024-07-27T03:14:30.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9d051cf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0015fd80 con 0x7f9d000b4fd0 2024-07-27T03:14:30.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9d051cf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f9d000b5c70 con 0x7f9d000b2110 2024-07-27T03:14:30.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cff59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d000d0500 0x7f9d00150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:30.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cfed9d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d000b2110 0x7f9d001f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:30.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cff59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d000d0500 0x7f9d00150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51118/0 (socket says 172.21.15.120:51118) 2024-07-27T03:14:30.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cff59e640 1 -- 172.21.15.120:0/886216747 learned_addr learned my addr 172.21.15.120:0/886216747 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:30.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cfe59c640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d000b4fd0 0x7f9d0009ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:30.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cfed9d640 1 -- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d000b4fd0 msgr2=0x7f9d0009ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:30.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cfed9d640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d000b4fd0 0x7f9d0009ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cfed9d640 1 -- 172.21.15.120:0/886216747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d000d0500 msgr2=0x7f9d00150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:30.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cfed9d640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d000d0500 0x7f9d00150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:30.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cfed9d640 1 -- 172.21.15.120:0/886216747 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d000aec00 con 0x7f9d000b2110 2024-07-27T03:14:30.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cfe59c640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d000b4fd0 0x7f9d0009ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:14:30.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cff59e640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d000d0500 0x7f9d00150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-27T03:14:30.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.869+0000 7f9cfed9d640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d000b2110 0x7f9d001f73b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000e9f0 tx=0x7f9cf000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:30.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.870+0000 7f9ce77fe640 1 -- 172.21.15.120:0/886216747 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000ccc0 con 0x7f9d000b2110 2024-07-27T03:14:30.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.870+0000 7f9ce77fe640 1 -- 172.21.15.120:0/886216747 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cf0004020 con 0x7f9d000b2110 2024-07-27T03:14:30.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.870+0000 7f9d051cf640 1 -- 172.21.15.120:0/886216747 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d000b1ac0 con 0x7f9d000b2110 2024-07-27T03:14:30.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.870+0000 7f9ce77fe640 1 -- 172.21.15.120:0/886216747 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000ce60 con 0x7f9d000b2110 2024-07-27T03:14:30.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.870+0000 7f9d051cf640 1 -- 172.21.15.120:0/886216747 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0009bc80 con 0x7f9d000b2110 2024-07-27T03:14:30.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.871+0000 7f9d051cf640 1 -- 172.21.15.120:0/886216747 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d000b6190 con 0x7f9d000b2110 2024-07-27T03:14:30.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.871+0000 7f9ce77fe640 1 -- 172.21.15.120:0/886216747 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9cf00035f0 con 0x7f9d000b2110 2024-07-27T03:14:30.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.872+0000 7f9ce77fe640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9cec077010 0x7f9cec079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:30.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.872+0000 7f9ce77fe640 1 -- 172.21.15.120:0/886216747 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f9cf0098e50 con 0x7f9d000b2110 2024-07-27T03:14:30.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.872+0000 7f9cfe59c640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9cec077010 0x7f9cec079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:30.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.872+0000 7f9cfe59c640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9cec077010 0x7f9cec079520 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4033000 tx=0x7f9cf4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:30.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:30.877+0000 7f9ce77fe640 1 -- 172.21.15.120:0/886216747 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f9cf0061bd0 con 0x7f9d000b2110 2024-07-27T03:14:31.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.053+0000 7f9d051cf640 1 -- 172.21.15.120:0/886216747 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d0015b7d0 con 0x7f9cec077010 2024-07-27T03:14:31.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.054+0000 7f9ce77fe640 1 -- 172.21.15.120:0/886216747 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13440 (secure 0 0 0) 0x7f9d0015b7d0 con 0x7f9cec077010 2024-07-27T03:14:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:31.058 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:14:31.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.056+0000 7f9d051cf640 1 -- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9cec077010 msgr2=0x7f9cec079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.056+0000 7f9d051cf640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9cec077010 0x7f9cec079520 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4033000 tx=0x7f9cf4004730 comp rx=0 tx=0).stop 2024-07-27T03:14:31.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.056+0000 7f9d051cf640 1 -- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d000b2110 msgr2=0x7f9d001f73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.056+0000 7f9d051cf640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d000b2110 0x7f9d001f73b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000e9f0 tx=0x7f9cf000eeb0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.056+0000 7f9d051cf640 1 -- 172.21.15.120:0/886216747 shutdown_connections 2024-07-27T03:14:31.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.056+0000 7f9d051cf640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9cec077010 0x7f9cec079520 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.056+0000 7f9d051cf640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9d000d0500 0x7f9d00150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.056+0000 7f9d051cf640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d000b4fd0 0x7f9d0009ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.056+0000 7f9d051cf640 1 --2- 172.21.15.120:0/886216747 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9d000b2110 0x7f9d001f73b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.056+0000 7f9d051cf640 1 -- 172.21.15.120:0/886216747 >> 172.21.15.120:0/886216747 conn(0x7f9d000b3920 msgr2=0x7f9d0015c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:31.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.057+0000 7f9d051cf640 1 -- 172.21.15.120:0/886216747 shutdown_connections 2024-07-27T03:14:31.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.057+0000 7f9d051cf640 1 -- 172.21.15.120:0/886216747 wait complete. 2024-07-27T03:14:31.070 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-07-27T03:14:30.625218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":425492,"kb_used_data":8104,"kb_used_omap":12,"kb_used_meta":417267,"kb_avail":754549228,"statfs":{"total":773094113280,"available":772658409472,"internally_reserved":0,"allocated":8298496,"data_stored":4177006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":427281968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18022,"num_objects":-60,"num_object_clones":0,"num_object_copies":-120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-148,"num_write_kb":-63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001240"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":204,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-07-27T03:14:27.802085+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:14:27.802085+0000","last_peered":"2024-07-27T03:14:27.802085+0000","last_clean":"2024-07-27T03:14:27.802085+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:14:27.802085+0000","last_undegraded":"2024-07-27T03:14:27.802085+0000","last_fullsized":"2024-07-27T03:14:27.802085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77044,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294796,"statfs":{"total":96636764160,"available":96557871104,"internally_reserved":0,"allocated":1478656,"data_stored":966143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509516,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50096,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321744,"statfs":{"total":96636764160,"available":96585465856,"internally_reserved":0,"allocated":884736,"data_stored":375775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509517,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50100,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321740,"statfs":{"total":96636764160,"available":96585461760,"internally_reserved":0,"allocated":892928,"data_stored":370948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40380,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331460,"statfs":{"total":96636764160,"available":96595415040,"internally_reserved":0,"allocated":901120,"data_stored":381480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54836,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317004,"statfs":{"total":96636764160,"available":96580612096,"internally_reserved":0,"allocated":1478656,"data_stored":966143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542220,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":876544,"data_stored":369634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542220,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76476,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94295364,"statfs":{"total":96636764160,"available":96558452736,"internally_reserved":0,"allocated":901120,"data_stored":371108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542219,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40364,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331476,"statfs":{"total":96636764160,"available":96595431424,"internally_reserved":0,"allocated":884736,"data_stored":375775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:14:31.071 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-27T03:14:31.071 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:14:31.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.184+0000 7ff7c4e61640 1 -- 172.21.15.120:0/2969258618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c015ad30 msgr2=0x7ff7c006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.184+0000 7ff7c4e61640 1 --2- 172.21.15.120:0/2969258618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c015ad30 0x7ff7c006eb00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009830 tx=0x7ff7b002a510 comp rx=0 tx=0).stop 2024-07-27T03:14:31.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.184+0000 7ff7c4e61640 1 -- 172.21.15.120:0/2969258618 shutdown_connections 2024-07-27T03:14:31.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.184+0000 7ff7c4e61640 1 --2- 172.21.15.120:0/2969258618 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c015ee40 0x7ff7c0150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.184+0000 7ff7c4e61640 1 --2- 172.21.15.120:0/2969258618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c015ad30 0x7ff7c006eb00 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.184+0000 7ff7c4e61640 1 -- 172.21.15.120:0/2969258618 >> 172.21.15.120:0/2969258618 conn(0x7ff7c00b1a10 msgr2=0x7ff7c00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:31.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.184+0000 7ff7c4e61640 1 -- 172.21.15.120:0/2969258618 shutdown_connections 2024-07-27T03:14:31.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.184+0000 7ff7c4e61640 1 -- 172.21.15.120:0/2969258618 wait complete. 2024-07-27T03:14:31.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.186+0000 7ff7c4e61640 1 Processor -- start 2024-07-27T03:14:31.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.186+0000 7ff7c4e61640 1 -- start start 2024-07-27T03:14:31.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7c4e61640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c006f040 0x7ff7c0153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:31.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7c4e61640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c015ad30 0x7ff7c01f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:31.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7c4e61640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c015ee40 0x7ff7c01f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:31.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7c4e61640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c0151930 con 0x7ff7c015ee40 2024-07-27T03:14:31.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7c4e61640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c01517b0 con 0x7ff7c015ad30 2024-07-27T03:14:31.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7c4e61640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c0151ab0 con 0x7ff7c006f040 2024-07-27T03:14:31.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7bed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c015ee40 0x7ff7c01f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:31.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7bed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c015ee40 0x7ff7c01f5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51140/0 (socket says 172.21.15.120:51140) 2024-07-27T03:14:31.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7bed9d640 1 -- 172.21.15.120:0/3006883527 learned_addr learned my addr 172.21.15.120:0/3006883527 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:31.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7be59c640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c006f040 0x7ff7c0153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:31.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7bdd9b640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c015ad30 0x7ff7c01f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:31.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7bed9d640 1 -- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c006f040 msgr2=0x7ff7c0153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7bed9d640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c006f040 0x7ff7c0153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7bed9d640 1 -- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c015ad30 msgr2=0x7ff7c01f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7bed9d640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c015ad30 0x7ff7c01f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7bed9d640 1 -- 172.21.15.120:0/3006883527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c0155dd0 con 0x7ff7c015ee40 2024-07-27T03:14:31.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7bdd9b640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c015ad30 0x7ff7c01f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-27T03:14:31.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7bed9d640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c015ee40 0x7ff7c01f5ca0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800d9e0 tx=0x7ff7b800dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:31.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7b6ffd640 1 -- 172.21.15.120:0/3006883527 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8017070 con 0x7ff7c015ee40 2024-07-27T03:14:31.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7b6ffd640 1 -- 172.21.15.120:0/3006883527 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7b800be50 con 0x7ff7c015ee40 2024-07-27T03:14:31.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7c4e61640 1 -- 172.21.15.120:0/3006883527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c0156300 con 0x7ff7c015ee40 2024-07-27T03:14:31.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7b6ffd640 1 -- 172.21.15.120:0/3006883527 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b80106c0 con 0x7ff7c015ee40 2024-07-27T03:14:31.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.188+0000 7ff7c4e61640 1 -- 172.21.15.120:0/3006883527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c01568c0 con 0x7ff7c015ee40 2024-07-27T03:14:31.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.189+0000 7ff7c4e61640 1 -- 172.21.15.120:0/3006883527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c0156070 con 0x7ff7c015ee40 2024-07-27T03:14:31.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.190+0000 7ff7b6ffd640 1 -- 172.21.15.120:0/3006883527 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff7b801a070 con 0x7ff7c015ee40 2024-07-27T03:14:31.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.191+0000 7ff7b6ffd640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7a0077010 0x7ff7a0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:31.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.191+0000 7ff7b6ffd640 1 -- 172.21.15.120:0/3006883527 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7ff7b8098e70 con 0x7ff7c015ee40 2024-07-27T03:14:31.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.191+0000 7ff7be59c640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7a0077010 0x7ff7a0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:31.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.192+0000 7ff7be59c640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7a0077010 0x7ff7a0079520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0034000 tx=0x7ff7b0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:31.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.195+0000 7ff7b6ffd640 1 -- 172.21.15.120:0/3006883527 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7ff7b80623a0 con 0x7ff7c015ee40 2024-07-27T03:14:31.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.385+0000 7ff7c4e61640 1 -- 172.21.15.120:0/3006883527 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7c00cf1e0 con 0x7ff7a0077010 2024-07-27T03:14:31.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.386+0000 7ff7b6ffd640 1 -- 172.21.15.120:0/3006883527 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13440 (secure 0 0 0) 0x7ff7c00cf1e0 con 0x7ff7a0077010 2024-07-27T03:14:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:31.389 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:14:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 -- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7a0077010 msgr2=0x7ff7a0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7a0077010 0x7ff7a0079520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0034000 tx=0x7ff7b0004730 comp rx=0 tx=0).stop 2024-07-27T03:14:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 -- 172.21.15.120:0/3006883527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c015ee40 msgr2=0x7ff7c01f5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c015ee40 0x7ff7c01f5ca0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800d9e0 tx=0x7ff7b800dea0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 -- 172.21.15.120:0/3006883527 shutdown_connections 2024-07-27T03:14:31.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7ff7a0077010 0x7ff7a0079520 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c015ee40 0x7ff7c01f5ca0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c015ad30 0x7ff7c01f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 --2- 172.21.15.120:0/3006883527 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c006f040 0x7ff7c0153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 -- 172.21.15.120:0/3006883527 >> 172.21.15.120:0/3006883527 conn(0x7ff7c00b1a10 msgr2=0x7ff7c00b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 -- 172.21.15.120:0/3006883527 shutdown_connections 2024-07-27T03:14:31.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.388+0000 7ff7c4e61640 1 -- 172.21.15.120:0/3006883527 wait complete. 2024-07-27T03:14:31.402 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-07-27T03:14:30.625218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":425492,"kb_used_data":8104,"kb_used_omap":12,"kb_used_meta":417267,"kb_avail":754549228,"statfs":{"total":773094113280,"available":772658409472,"internally_reserved":0,"allocated":8298496,"data_stored":4177006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":427281968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18022,"num_objects":-60,"num_object_clones":0,"num_object_copies":-120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-148,"num_write_kb":-63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001240"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":204,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-07-27T03:14:27.802085+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:14:27.802085+0000","last_peered":"2024-07-27T03:14:27.802085+0000","last_clean":"2024-07-27T03:14:27.802085+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:14:27.802085+0000","last_undegraded":"2024-07-27T03:14:27.802085+0000","last_fullsized":"2024-07-27T03:14:27.802085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77044,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294796,"statfs":{"total":96636764160,"available":96557871104,"internally_reserved":0,"allocated":1478656,"data_stored":966143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509516,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50096,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321744,"statfs":{"total":96636764160,"available":96585465856,"internally_reserved":0,"allocated":884736,"data_stored":375775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509517,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50100,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321740,"statfs":{"total":96636764160,"available":96585461760,"internally_reserved":0,"allocated":892928,"data_stored":370948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40380,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331460,"statfs":{"total":96636764160,"available":96595415040,"internally_reserved":0,"allocated":901120,"data_stored":381480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54836,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317004,"statfs":{"total":96636764160,"available":96580612096,"internally_reserved":0,"allocated":1478656,"data_stored":966143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542220,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":876544,"data_stored":369634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542220,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76476,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94295364,"statfs":{"total":96636764160,"available":96558452736,"internally_reserved":0,"allocated":901120,"data_stored":371108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542219,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40364,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331476,"statfs":{"total":96636764160,"available":96595431424,"internally_reserved":0,"allocated":884736,"data_stored":375775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:14:31.403 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-27T03:14:31.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.521+0000 7fc7c5d07640 1 -- 172.21.15.120:0/478669478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7c00b2c40 msgr2=0x7fc7c00d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.521+0000 7fc7c5d07640 1 --2- 172.21.15.120:0/478669478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7c00b2c40 0x7fc7c00d09c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4005fd0 tx=0x7fc7b402a5d0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.521+0000 7fc7c5d07640 1 -- 172.21.15.120:0/478669478 shutdown_connections 2024-07-27T03:14:31.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.521+0000 7fc7c5d07640 1 --2- 172.21.15.120:0/478669478 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7c00d0f00 0x7fc7c00cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.521+0000 7fc7c5d07640 1 --2- 172.21.15.120:0/478669478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7c00b2c40 0x7fc7c00d09c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.521+0000 7fc7c5d07640 1 -- 172.21.15.120:0/478669478 >> 172.21.15.120:0/478669478 conn(0x7fc7c008d690 msgr2=0x7fc7c009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:31.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.521+0000 7fc7c5d07640 1 -- 172.21.15.120:0/478669478 shutdown_connections 2024-07-27T03:14:31.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.521+0000 7fc7c5d07640 1 -- 172.21.15.120:0/478669478 wait complete. 2024-07-27T03:14:31.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.523+0000 7fc7c5d07640 1 Processor -- start 2024-07-27T03:14:31.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.523+0000 7fc7c5d07640 1 -- start start 2024-07-27T03:14:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.524+0000 7fc7c5d07640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7c00b2c40 0x7fc7c01f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.524+0000 7fc7c5d07640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7c00b4740 0x7fc7c00c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.524+0000 7fc7c5d07640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7c00d0f00 0x7fc7c00b8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:31.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.524+0000 7fc7c5d07640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c00b3410 con 0x7fc7c00d0f00 2024-07-27T03:14:31.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.524+0000 7fc7c5d07640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c00d3100 con 0x7fc7c00b4740 2024-07-27T03:14:31.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.524+0000 7fc7c5d07640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c00cf120 con 0x7fc7c00b2c40 2024-07-27T03:14:31.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.524+0000 7fc7bffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7c00d0f00 0x7fc7c00b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:31.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.524+0000 7fc7bffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7c00d0f00 0x7fc7c00b8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51152/0 (socket says 172.21.15.120:51152) 2024-07-27T03:14:31.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.524+0000 7fc7bffff640 1 -- 172.21.15.120:0/3372932009 learned_addr learned my addr 172.21.15.120:0/3372932009 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:31.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.524+0000 7fc7bf7fe640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7c00b2c40 0x7fc7c01f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:31.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.524+0000 7fc7beffd640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7c00b4740 0x7fc7c00c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:31.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.525+0000 7fc7bffff640 1 -- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7c00b2c40 msgr2=0x7fc7c01f6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.525+0000 7fc7bffff640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7c00b2c40 0x7fc7c01f6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.525+0000 7fc7bffff640 1 -- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7c00b4740 msgr2=0x7fc7c00c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.525+0000 7fc7bffff640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7c00b4740 0x7fc7c00c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.525+0000 7fc7bffff640 1 -- 172.21.15.120:0/3372932009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c01f5960 con 0x7fc7c00d0f00 2024-07-27T03:14:31.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.525+0000 7fc7bffff640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7c00d0f00 0x7fc7c00b8010 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800e6d0 tx=0x7fc7b800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:31.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.525+0000 7fc7a7fff640 1 -- 172.21.15.120:0/3372932009 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8005220 con 0x7fc7c00d0f00 2024-07-27T03:14:31.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.525+0000 7fc7a7fff640 1 -- 172.21.15.120:0/3372932009 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7b80053c0 con 0x7fc7c00d0f00 2024-07-27T03:14:31.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.525+0000 7fc7c5d07640 1 -- 172.21.15.120:0/3372932009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c00c8430 con 0x7fc7c00d0f00 2024-07-27T03:14:31.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.525+0000 7fc7a7fff640 1 -- 172.21.15.120:0/3372932009 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800c850 con 0x7fc7c00d0f00 2024-07-27T03:14:31.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.525+0000 7fc7c5d07640 1 -- 172.21.15.120:0/3372932009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c01f5c20 con 0x7fc7c00d0f00 2024-07-27T03:14:31.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.526+0000 7fc7c5d07640 1 -- 172.21.15.120:0/3372932009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c00c81a0 con 0x7fc7c00d0f00 2024-07-27T03:14:31.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.527+0000 7fc7a7fff640 1 -- 172.21.15.120:0/3372932009 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc7b800c9f0 con 0x7fc7c00d0f00 2024-07-27T03:14:31.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.527+0000 7fc7a7fff640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7ac077010 0x7fc7ac079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:31.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.528+0000 7fc7a7fff640 1 -- 172.21.15.120:0/3372932009 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fc7b8098e40 con 0x7fc7c00d0f00 2024-07-27T03:14:31.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.528+0000 7fc7bf7fe640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7ac077010 0x7fc7ac079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:31.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.528+0000 7fc7bf7fe640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7ac077010 0x7fc7ac079520 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0001ce0 tx=0x7fc7b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:31.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.532+0000 7fc7a7fff640 1 -- 172.21.15.120:0/3372932009 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fc7b8062320 con 0x7fc7c00d0f00 2024-07-27T03:14:31.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.723+0000 7fc7c5d07640 1 -- 172.21.15.120:0/3372932009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7c00d09c0 con 0x7fc7c00d0f00 2024-07-27T03:14:31.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.724+0000 7fc7a7fff640 1 -- 172.21.15.120:0/3372932009 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+13305 (secure 0 0 0) 0x7fc7b8061c20 con 0x7fc7c00d0f00 2024-07-27T03:14:31.727 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:31.727 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":74,"fsid":"81c6fc84-d59a-4d77-bf87-f698cf0d6963","created":"2024-07-27T03:08:16.129309+0000","modified":"2024-07-27T03:14:28.314401+0000","last_up_change":"2024-07-27T03:08:27.696473+0000","last_in_change":"2024-07-27T03:08:19.380103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-27T03:08:28.548271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77e44dfb-d125-400d-8e7b-f42652ccad24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6825","nonce":505581380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6827","nonce":505581380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6831","nonce":505581380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":505581380},{"type":"v1","addr":"172.21.15.120:6829","nonce":505581380}]},"public_addr":"172.21.15.120:6825/505581380","cluster_addr":"172.21.15.120:6827/505581380","heartbeat_back_addr":"172.21.15.120:6831/505581380","heartbeat_front_addr":"172.21.15.120:6829/505581380","state":["exists","up"]},{"osd":1,"uuid":"91adc03f-7cad-4b11-a450-aa2c0f804e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6801","nonce":1875902283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6803","nonce":1875902283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6807","nonce":1875902283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1875902283},{"type":"v1","addr":"172.21.15.120:6805","nonce":1875902283}]},"public_addr":"172.21.15.120:6801/1875902283","cluster_addr":"172.21.15.120:6803/1875902283","heartbeat_back_addr":"172.21.15.120:6807/1875902283","heartbeat_front_addr":"172.21.15.120:6805/1875902283","state":["exists","up"]},{"osd":2,"uuid":"1519e899-7647-4e13-b547-abc8d361b9bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6809","nonce":1765193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6811","nonce":1765193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6815","nonce":1765193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1765193874},{"type":"v1","addr":"172.21.15.120:6813","nonce":1765193874}]},"public_addr":"172.21.15.120:6809/1765193874","cluster_addr":"172.21.15.120:6811/1765193874","heartbeat_back_addr":"172.21.15.120:6815/1765193874","heartbeat_front_addr":"172.21.15.120:6813/1765193874","state":["exists","up"]},{"osd":3,"uuid":"5eca6d77-c3cb-4415-8e16-500bf4479ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6817","nonce":253357243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6819","nonce":253357243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6823","nonce":253357243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":253357243},{"type":"v1","addr":"172.21.15.120:6821","nonce":253357243}]},"public_addr":"172.21.15.120:6817/253357243","cluster_addr":"172.21.15.120:6819/253357243","heartbeat_back_addr":"172.21.15.120:6823/253357243","heartbeat_front_addr":"172.21.15.120:6821/253357243","state":["exists","up"]},{"osd":4,"uuid":"9f7b3b35-a1d4-40bc-8d7d-f9abacc967e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6809","nonce":3344380023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6811","nonce":3344380023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6815","nonce":3344380023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3344380023},{"type":"v1","addr":"172.21.15.121:6813","nonce":3344380023}]},"public_addr":"172.21.15.121:6809/3344380023","cluster_addr":"172.21.15.121:6811/3344380023","heartbeat_back_addr":"172.21.15.121:6815/3344380023","heartbeat_front_addr":"172.21.15.121:6813/3344380023","state":["exists","up"]},{"osd":5,"uuid":"fe14efe2-13ba-45c3-b096-330e49ac7950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6825","nonce":3272535131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6827","nonce":3272535131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6831","nonce":3272535131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3272535131},{"type":"v1","addr":"172.21.15.121:6829","nonce":3272535131}]},"public_addr":"172.21.15.121:6825/3272535131","cluster_addr":"172.21.15.121:6827/3272535131","heartbeat_back_addr":"172.21.15.121:6831/3272535131","heartbeat_front_addr":"172.21.15.121:6829/3272535131","state":["exists","up"]},{"osd":6,"uuid":"74b6f60a-8a61-4558-b09d-1360c4b7cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6801","nonce":375857749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6803","nonce":375857749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6807","nonce":375857749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":375857749},{"type":"v1","addr":"172.21.15.121:6805","nonce":375857749}]},"public_addr":"172.21.15.121:6801/375857749","cluster_addr":"172.21.15.121:6803/375857749","heartbeat_back_addr":"172.21.15.121:6807/375857749","heartbeat_front_addr":"172.21.15.121:6805/375857749","state":["exists","up"]},{"osd":7,"uuid":"59f4d249-06e4-4b49-9b6b-2898a308e0d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6817","nonce":2396581528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6819","nonce":2396581528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6823","nonce":2396581528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2396581528},{"type":"v1","addr":"172.21.15.121:6821","nonce":2396581528}]},"public_addr":"172.21.15.121:6817/2396581528","cluster_addr":"172.21.15.121:6819/2396581528","heartbeat_back_addr":"172.21.15.121:6823/2396581528","heartbeat_front_addr":"172.21.15.121:6821/2396581528","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.579377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.453878+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.544972+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.537850+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.482059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.577321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.430078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-27T03:08:24.528355+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6836/2998929726":"2024-07-28T03:14:25.303883+0000","172.21.15.121:6834/2998929726":"2024-07-28T03:14:25.303883+0000","172.21.15.120:6833/3985484834":"2024-07-28T03:14:25.303901+0000","172.21.15.120:6832/3985484834":"2024-07-28T03:14:25.303901+0000","172.21.15.121:6837/7061533":"2024-07-28T03:14:25.303906+0000","172.21.15.121:6835/7061533":"2024-07-28T03:14:25.303906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-27T03:14:31.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.726+0000 7fc7c5d07640 1 -- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7ac077010 msgr2=0x7fc7ac079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.726+0000 7fc7c5d07640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7ac077010 0x7fc7ac079520 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0001ce0 tx=0x7fc7b0009040 comp rx=0 tx=0).stop 2024-07-27T03:14:31.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.726+0000 7fc7c5d07640 1 -- 172.21.15.120:0/3372932009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7c00d0f00 msgr2=0x7fc7c00b8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:31.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.726+0000 7fc7c5d07640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7c00d0f00 0x7fc7c00b8010 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800e6d0 tx=0x7fc7b800eb90 comp rx=0 tx=0).stop 2024-07-27T03:14:31.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.726+0000 7fc7c5d07640 1 -- 172.21.15.120:0/3372932009 shutdown_connections 2024-07-27T03:14:31.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.726+0000 7fc7c5d07640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fc7ac077010 0x7fc7ac079520 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.726+0000 7fc7c5d07640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc7c00d0f00 0x7fc7c00b8010 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.726+0000 7fc7c5d07640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7c00b4740 0x7fc7c00c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.726+0000 7fc7c5d07640 1 --2- 172.21.15.120:0/3372932009 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7c00b2c40 0x7fc7c01f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:31.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.726+0000 7fc7c5d07640 1 -- 172.21.15.120:0/3372932009 >> 172.21.15.120:0/3372932009 conn(0x7fc7c008d690 msgr2=0x7fc7c006e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:31.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.727+0000 7fc7c5d07640 1 -- 172.21.15.120:0/3372932009 shutdown_connections 2024-07-27T03:14:31.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:31.727+0000 7fc7c5d07640 1 -- 172.21.15.120:0/3372932009 wait complete. 2024-07-27T03:14:32.742 INFO:tasks.ceph:Scrubbing osd.0 2024-07-27T03:14:32.743 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-07-27T03:14:32.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.860+0000 7f995340c640 1 -- 172.21.15.120:0/3902411792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9938003a00 msgr2=0x7f9938003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:32.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.860+0000 7f995340c640 1 --2- 172.21.15.120:0/3902411792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9938003a00 0x7f9938003e70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9948009b40 tx=0x7f9938005830 comp rx=0 tx=0).stop 2024-07-27T03:14:32.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.860+0000 7f99519a9640 1 -- 172.21.15.120:0/3902411792 reap_dead start 2024-07-27T03:14:32.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.860+0000 7f995340c640 1 -- 172.21.15.120:0/3902411792 shutdown_connections 2024-07-27T03:14:32.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.860+0000 7f995340c640 1 -- 172.21.15.120:0/3902411792 >> 172.21.15.120:0/3902411792 conn(0x7f994c08d8f0 msgr2=0x7f994c09d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.860+0000 7f995340c640 1 -- 172.21.15.120:0/3902411792 shutdown_connections 2024-07-27T03:14:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.860+0000 7f995340c640 1 -- 172.21.15.120:0/3902411792 wait complete. 2024-07-27T03:14:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.862+0000 7f995340c640 1 Processor -- start 2024-07-27T03:14:32.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.862+0000 7f995340c640 1 -- start start 2024-07-27T03:14:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f995340c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9938003a00 0x7f994c159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f995340c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c1598d0 0x7f994c1f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f995340c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f994c1f8bf0 0x7f994c1f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f995340c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f994c0d1060 con 0x7f994c1598d0 2024-07-27T03:14:32.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f995340c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f994c0d0ee0 con 0x7f9938003a00 2024-07-27T03:14:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f995340c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f994c0d11e0 con 0x7f994c1f8bf0 2024-07-27T03:14:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f99509a7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c1598d0 0x7f994c1f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f99509a7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c1598d0 0x7f994c1f86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52624/0 (socket says 172.21.15.120:52624) 2024-07-27T03:14:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f99509a7640 1 -- 172.21.15.120:0/309746463 learned_addr learned my addr 172.21.15.120:0/309746463 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f99519a9640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f994c1f8bf0 0x7f994c1f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f99511a8640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9938003a00 0x7f994c159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:32.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f99509a7640 1 -- 172.21.15.120:0/309746463 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f994c1f8bf0 msgr2=0x7f994c1f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f99509a7640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f994c1f8bf0 0x7f994c1f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f99509a7640 1 -- 172.21.15.120:0/309746463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9938003a00 msgr2=0x7f994c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f99509a7640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9938003a00 0x7f994c159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f99509a7640 1 -- 172.21.15.120:0/309746463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c0c9760 con 0x7f994c1598d0 2024-07-27T03:14:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.863+0000 7f99509a7640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c1598d0 0x7f994c1f86b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f993c0066e0 tx=0x7f993c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.864+0000 7f9941ffb640 1 -- 172.21.15.120:0/309746463 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c015070 con 0x7f994c1598d0 2024-07-27T03:14:32.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.864+0000 7f9941ffb640 1 -- 172.21.15.120:0/309746463 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f993c011920 con 0x7f994c1598d0 2024-07-27T03:14:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.864+0000 7f995340c640 1 -- 172.21.15.120:0/309746463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994c0c86e0 con 0x7f994c1598d0 2024-07-27T03:14:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.864+0000 7f9941ffb640 1 -- 172.21.15.120:0/309746463 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c011d70 con 0x7f994c1598d0 2024-07-27T03:14:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.864+0000 7f995340c640 1 -- 172.21.15.120:0/309746463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994c0c8c80 con 0x7f994c1598d0 2024-07-27T03:14:32.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.865+0000 7f995340c640 1 -- 172.21.15.120:0/309746463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f994c0cef20 con 0x7f994c1598d0 2024-07-27T03:14:32.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.865+0000 7f9941ffb640 1 -- 172.21.15.120:0/309746463 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f993c018070 con 0x7f994c1598d0 2024-07-27T03:14:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.866+0000 7f9941ffb640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9930077010 0x7f9930079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.866+0000 7f9941ffb640 1 -- 172.21.15.120:0/309746463 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f993c099440 con 0x7f994c1598d0 2024-07-27T03:14:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.866+0000 7f9941ffb640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] conn(0x7f993007d060 0x7f993007f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.866+0000 7f9941ffb640 1 -- 172.21.15.120:0/309746463 --> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f993007fb80 con 0x7f993007d060 2024-07-27T03:14:32.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.866+0000 7f9941ffb640 1 -- 172.21.15.120:0/309746463 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f993c0a0050 con 0x7f994c1598d0 2024-07-27T03:14:32.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.866+0000 7f99519a9640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] conn(0x7f993007d060 0x7f993007f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:32.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.866+0000 7f99511a8640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9930077010 0x7f9930079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:32.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.867+0000 7f99519a9640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] conn(0x7f993007d060 0x7f993007f4b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:32.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.867+0000 7f99511a8640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9930077010 0x7f9930079520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9948035000 tx=0x7f994802d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:32.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.867+0000 7f9941ffb640 1 -- 172.21.15.120:0/309746463 <== osd.0 v2:172.21.15.120:6824/505581380 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f993007fb80 con 0x7f993007d060 2024-07-27T03:14:32.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.880+0000 7f995340c640 1 -- 172.21.15.120:0/309746463 --> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f994c1f9570 con 0x7f993007d060 2024-07-27T03:14:32.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.880+0000 7f9941ffb640 1 -- 172.21.15.120:0/309746463 <== osd.0 v2:172.21.15.120:6824/505581380 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f994c1f9570 con 0x7f993007d060 2024-07-27T03:14:32.883 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:14:32.884 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-27T03:14:32.884 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:14:32.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.880+0000 7f995340c640 1 -- 172.21.15.120:0/309746463 >> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] conn(0x7f993007d060 msgr2=0x7f993007f4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:32.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.881+0000 7f995340c640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.120:6824/505581380,v1:172.21.15.120:6825/505581380] conn(0x7f993007d060 0x7f993007f4b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:32.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.881+0000 7f995340c640 1 -- 172.21.15.120:0/309746463 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9930077010 msgr2=0x7f9930079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:32.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.881+0000 7f995340c640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f9930077010 0x7f9930079520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9948035000 tx=0x7f994802d040 comp rx=0 tx=0).stop 2024-07-27T03:14:32.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.881+0000 7f995340c640 1 -- 172.21.15.120:0/309746463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c1598d0 msgr2=0x7f994c1f86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:32.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.881+0000 7f995340c640 1 --2- 172.21.15.120:0/309746463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c1598d0 0x7f994c1f86b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f993c0066e0 tx=0x7f993c0039c0 comp rx=0 tx=0).stop 2024-07-27T03:14:32.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.881+0000 7f99519a9640 1 -- 172.21.15.120:0/309746463 reap_dead start 2024-07-27T03:14:32.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.881+0000 7f995340c640 1 -- 172.21.15.120:0/309746463 shutdown_connections 2024-07-27T03:14:32.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.881+0000 7f995340c640 1 -- 172.21.15.120:0/309746463 >> 172.21.15.120:0/309746463 conn(0x7f994c08d8f0 msgr2=0x7f994c0b9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:32.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.881+0000 7f995340c640 1 -- 172.21.15.120:0/309746463 shutdown_connections 2024-07-27T03:14:32.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:32.881+0000 7f995340c640 1 -- 172.21.15.120:0/309746463 wait complete. 2024-07-27T03:14:32.894 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-07-27T03:14:33.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.005+0000 7fec6349a640 1 -- 172.21.15.120:0/3813323522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c15ad30 msgr2=0x7fec5c06eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.005+0000 7fec6349a640 1 --2- 172.21.15.120:0/3813323522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c15ad30 0x7fec5c06eb00 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0721d0 tx=0x7fec5802a5f0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.005+0000 7fec6349a640 1 -- 172.21.15.120:0/3813323522 shutdown_connections 2024-07-27T03:14:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.005+0000 7fec6349a640 1 --2- 172.21.15.120:0/3813323522 >> v2:172.21.15.121:3300/0 conn(0x7fec5c15ee40 0x7fec5c150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.005+0000 7fec6349a640 1 --2- 172.21.15.120:0/3813323522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c15ad30 0x7fec5c06eb00 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.005+0000 7fec6349a640 1 -- 172.21.15.120:0/3813323522 >> 172.21.15.120:0/3813323522 conn(0x7fec5c0b1a10 msgr2=0x7fec5c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.006+0000 7fec6349a640 1 -- 172.21.15.120:0/3813323522 shutdown_connections 2024-07-27T03:14:33.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.006+0000 7fec6349a640 1 -- 172.21.15.120:0/3813323522 wait complete. 2024-07-27T03:14:33.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.007+0000 7fec6349a640 1 Processor -- start 2024-07-27T03:14:33.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.007+0000 7fec6349a640 1 -- start start 2024-07-27T03:14:33.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.008+0000 7fec6349a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c06f040 0x7fec5c1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.008+0000 7fec6349a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec5c15ad30 0x7fec5c155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.008+0000 7fec6349a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec5c15ee40 0x7fec5c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.008+0000 7fec6349a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c06e6b0 con 0x7fec5c06f040 2024-07-27T03:14:33.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.008+0000 7fec6349a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c06e530 con 0x7fec5c15ee40 2024-07-27T03:14:33.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.008+0000 7fec6349a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fec5c06e830 con 0x7fec5c15ad30 2024-07-27T03:14:33.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec61236640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c06f040 0x7fec5c1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec61236640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c06f040 0x7fec5c1553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52638/0 (socket says 172.21.15.120:52638) 2024-07-27T03:14:33.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec61236640 1 -- 172.21.15.120:0/2974315809 learned_addr learned my addr 172.21.15.120:0/2974315809 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:33.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec61a37640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec5c15ee40 0x7fec5c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec60a35640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec5c15ad30 0x7fec5c155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec61236640 1 -- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec5c15ad30 msgr2=0x7fec5c155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec61236640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec5c15ad30 0x7fec5c155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec61236640 1 -- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec5c15ee40 msgr2=0x7fec5c155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec61236640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec5c15ee40 0x7fec5c155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec61236640 1 -- 172.21.15.120:0/2974315809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c150070 con 0x7fec5c06f040 2024-07-27T03:14:33.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec60a35640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec5c15ad30 0x7fec5c155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:14:33.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec61236640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c06f040 0x7fec5c1553f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fec58034040 tx=0x7fec58003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec51ffb640 1 -- 172.21.15.120:0/2974315809 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58035040 con 0x7fec5c06f040 2024-07-27T03:14:33.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec51ffb640 1 -- 172.21.15.120:0/2974315809 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec58003e20 con 0x7fec5c06f040 2024-07-27T03:14:33.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec51ffb640 1 -- 172.21.15.120:0/2974315809 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec580049c0 con 0x7fec5c06f040 2024-07-27T03:14:33.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.009+0000 7fec6349a640 1 -- 172.21.15.120:0/2974315809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5c1582d0 con 0x7fec5c06f040 2024-07-27T03:14:33.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.010+0000 7fec6349a640 1 -- 172.21.15.120:0/2974315809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5c09adb0 con 0x7fec5c06f040 2024-07-27T03:14:33.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.011+0000 7fec6349a640 1 -- 172.21.15.120:0/2974315809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5c150ec0 con 0x7fec5c06f040 2024-07-27T03:14:33.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.011+0000 7fec51ffb640 1 -- 172.21.15.120:0/2974315809 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fec58004b60 con 0x7fec5c06f040 2024-07-27T03:14:33.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.012+0000 7fec51ffb640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fec40077010 0x7fec40079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.012+0000 7fec51ffb640 1 -- 172.21.15.120:0/2974315809 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fec580baf30 con 0x7fec5c06f040 2024-07-27T03:14:33.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.012+0000 7fec60a35640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fec40077010 0x7fec40079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.012+0000 7fec60a35640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fec40077010 0x7fec40079520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0af720 tx=0x7fec4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.016+0000 7fec51ffb640 1 -- 172.21.15.120:0/2974315809 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fec5c150070 con 0x7fec5c06f040 2024-07-27T03:14:33.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.197+0000 7fec6349a640 1 -- 172.21.15.120:0/2974315809 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fec5c073800 con 0x7fec40077010 2024-07-27T03:14:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.197+0000 7fec51ffb640 1 -- 172.21.15.120:0/2974315809 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fec5c073800 con 0x7fec40077010 2024-07-27T03:14:33.200 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 0 to deep-scrub 2024-07-27T03:14:33.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.199+0000 7fec6349a640 1 -- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fec40077010 msgr2=0x7fec40079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.199+0000 7fec6349a640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fec40077010 0x7fec40079520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0af720 tx=0x7fec4c009040 comp rx=0 tx=0).stop 2024-07-27T03:14:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.199+0000 7fec6349a640 1 -- 172.21.15.120:0/2974315809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c06f040 msgr2=0x7fec5c1553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.199+0000 7fec6349a640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c06f040 0x7fec5c1553f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fec58034040 tx=0x7fec58003820 comp rx=0 tx=0).stop 2024-07-27T03:14:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.199+0000 7fec6349a640 1 -- 172.21.15.120:0/2974315809 shutdown_connections 2024-07-27T03:14:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.199+0000 7fec6349a640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fec40077010 0x7fec40079520 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.199+0000 7fec6349a640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec5c15ee40 0x7fec5c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.199+0000 7fec6349a640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fec5c15ad30 0x7fec5c155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.199+0000 7fec6349a640 1 --2- 172.21.15.120:0/2974315809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec5c06f040 0x7fec5c1553f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.199+0000 7fec6349a640 1 -- 172.21.15.120:0/2974315809 >> 172.21.15.120:0/2974315809 conn(0x7fec5c0b1a10 msgr2=0x7fec5c15e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.199+0000 7fec6349a640 1 -- 172.21.15.120:0/2974315809 shutdown_connections 2024-07-27T03:14:33.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.200+0000 7fec6349a640 1 -- 172.21.15.120:0/2974315809 wait complete. 2024-07-27T03:14:33.213 INFO:tasks.ceph:Scrubbing osd.1 2024-07-27T03:14:33.213 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-07-27T03:14:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.329+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/2621735838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcbc0cb410 msgr2=0x7fdcbc151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.329+0000 7fdcc3d0d640 1 --2- 172.21.15.120:0/2621735838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcbc0cb410 0x7fdcbc151930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8005fd0 tx=0x7fdcb802a540 comp rx=0 tx=0).stop 2024-07-27T03:14:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.329+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/2621735838 shutdown_connections 2024-07-27T03:14:33.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.329+0000 7fdcc3d0d640 1 --2- 172.21.15.120:0/2621735838 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdcbc06f360 0x7fdcbc073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.329+0000 7fdcc3d0d640 1 --2- 172.21.15.120:0/2621735838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcbc0cb410 0x7fdcbc151930 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.329+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/2621735838 >> 172.21.15.120:0/2621735838 conn(0x7fdcbc0cfd60 msgr2=0x7fdcbc0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.329+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/2621735838 shutdown_connections 2024-07-27T03:14:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.329+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/2621735838 wait complete. 2024-07-27T03:14:33.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.331+0000 7fdcc3d0d640 1 Processor -- start 2024-07-27T03:14:33.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.331+0000 7fdcc3d0d640 1 -- start start 2024-07-27T03:14:33.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc3d0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcbc073310 0x7fdcbc1f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc3d0d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcbc0cb410 0x7fdcbc1f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc3d0d640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdcbc1464c0 0x7fdcbc0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc3d0d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc06e750 con 0x7fdcbc073310 2024-07-27T03:14:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc3d0d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc06e5d0 con 0x7fdcbc0cb410 2024-07-27T03:14:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc3d0d640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fdcbc06e8d0 con 0x7fdcbc1464c0 2024-07-27T03:14:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc1aa9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcbc073310 0x7fdcbc1f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc1aa9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcbc073310 0x7fdcbc1f6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52650/0 (socket says 172.21.15.120:52650) 2024-07-27T03:14:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc1aa9640 1 -- 172.21.15.120:0/677401115 learned_addr learned my addr 172.21.15.120:0/677401115 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc22aa640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdcbc1464c0 0x7fdcbc0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc12a8640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcbc0cb410 0x7fdcbc1f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.332+0000 7fdcc1aa9640 1 -- 172.21.15.120:0/677401115 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdcbc1464c0 msgr2=0x7fdcbc0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.333+0000 7fdcc1aa9640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdcbc1464c0 0x7fdcbc0c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.333+0000 7fdcc1aa9640 1 -- 172.21.15.120:0/677401115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcbc0cb410 msgr2=0x7fdcbc1f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.333+0000 7fdcc1aa9640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdcbc0cb410 0x7fdcbc1f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.333+0000 7fdcc1aa9640 1 -- 172.21.15.120:0/677401115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc145f70 con 0x7fdcbc073310 2024-07-27T03:14:33.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.333+0000 7fdcc1aa9640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcbc073310 0x7fdcbc1f6790 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8034040 tx=0x7fdcb80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.334+0000 7fdcb27fc640 1 -- 172.21.15.120:0/677401115 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb803e030 con 0x7fdcbc073310 2024-07-27T03:14:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.334+0000 7fdcb27fc640 1 -- 172.21.15.120:0/677401115 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcb8003db0 con 0x7fdcbc073310 2024-07-27T03:14:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.334+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/677401115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcbc14a6f0 con 0x7fdcbc073310 2024-07-27T03:14:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.334+0000 7fdcb27fc640 1 -- 172.21.15.120:0/677401115 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8035040 con 0x7fdcbc073310 2024-07-27T03:14:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.334+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/677401115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcbc150bb0 con 0x7fdcbc073310 2024-07-27T03:14:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.335+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/677401115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdcbc073720 con 0x7fdcbc073310 2024-07-27T03:14:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.336+0000 7fdcb27fc640 1 -- 172.21.15.120:0/677401115 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fdcb8041030 con 0x7fdcbc073310 2024-07-27T03:14:33.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.336+0000 7fdcb27fc640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdca0077010 0x7fdca0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.336+0000 7fdcb27fc640 1 -- 172.21.15.120:0/677401115 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fdcb80b8cf0 con 0x7fdcbc073310 2024-07-27T03:14:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.336+0000 7fdcc12a8640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdca0077010 0x7fdca0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.337+0000 7fdcb27fc640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] conn(0x7fdca007d060 0x7fdca007f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.337+0000 7fdcb27fc640 1 -- 172.21.15.120:0/677401115 --> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcb8034e90 con 0x7fdca007d060 2024-07-27T03:14:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.337+0000 7fdcb27fc640 1 -- 172.21.15.120:0/677401115 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fdcb80bb3f0 con 0x7fdcbc073310 2024-07-27T03:14:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.337+0000 7fdcc22aa640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] conn(0x7fdca007d060 0x7fdca007f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.337+0000 7fdcc12a8640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdca0077010 0x7fdca0079520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc1f7870 tx=0x7fdcac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.337+0000 7fdcc22aa640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] conn(0x7fdca007d060 0x7fdca007f4b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.338+0000 7fdcb27fc640 1 -- 172.21.15.120:0/677401115 <== osd.1 v2:172.21.15.120:6800/1875902283 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdcb8034e90 con 0x7fdca007d060 2024-07-27T03:14:33.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.351+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/677401115 --> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdcbc0757f0 con 0x7fdca007d060 2024-07-27T03:14:33.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.351+0000 7fdcb27fc640 1 -- 172.21.15.120:0/677401115 <== osd.1 v2:172.21.15.120:6800/1875902283 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdcbc0757f0 con 0x7fdca007d060 2024-07-27T03:14:33.354 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:14:33.355 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-27T03:14:33.355 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:14:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.351+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/677401115 >> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] conn(0x7fdca007d060 msgr2=0x7fdca007f4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.351+0000 7fdcc3d0d640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.120:6800/1875902283,v1:172.21.15.120:6801/1875902283] conn(0x7fdca007d060 0x7fdca007f4b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.351+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/677401115 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdca0077010 msgr2=0x7fdca0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.351+0000 7fdcc3d0d640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fdca0077010 0x7fdca0079520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc1f7870 tx=0x7fdcac009040 comp rx=0 tx=0).stop 2024-07-27T03:14:33.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.351+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/677401115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcbc073310 msgr2=0x7fdcbc1f6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.351+0000 7fdcc3d0d640 1 --2- 172.21.15.120:0/677401115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcbc073310 0x7fdcbc1f6790 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8034040 tx=0x7fdcb80038a0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.351+0000 7fdcc22aa640 1 -- 172.21.15.120:0/677401115 reap_dead start 2024-07-27T03:14:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.351+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/677401115 shutdown_connections 2024-07-27T03:14:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.351+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/677401115 >> 172.21.15.120:0/677401115 conn(0x7fdcbc0cfd60 msgr2=0x7fdcbc15e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.352+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/677401115 shutdown_connections 2024-07-27T03:14:33.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.352+0000 7fdcc3d0d640 1 -- 172.21.15.120:0/677401115 wait complete. 2024-07-27T03:14:33.365 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-07-27T03:14:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.477+0000 7f5d4208b640 1 -- 172.21.15.120:0/284341342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3c15c8f0 msgr2=0x7f5d3c145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.477+0000 7f5d4208b640 1 --2- 172.21.15.120:0/284341342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3c15c8f0 0x7f5d3c145c70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0cd2e0 tx=0x7f5d2c02a560 comp rx=0 tx=0).stop 2024-07-27T03:14:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.477+0000 7f5d4208b640 1 -- 172.21.15.120:0/284341342 shutdown_connections 2024-07-27T03:14:33.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.477+0000 7f5d4208b640 1 --2- 172.21.15.120:0/284341342 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c06c780 0x7f5d3c06cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.477+0000 7f5d4208b640 1 --2- 172.21.15.120:0/284341342 >> v2:172.21.15.121:3300/0 conn(0x7f5d3c073680 0x7f5d3c0745a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.477+0000 7f5d4208b640 1 --2- 172.21.15.120:0/284341342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3c15c8f0 0x7f5d3c145c70 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.477+0000 7f5d4208b640 1 -- 172.21.15.120:0/284341342 >> 172.21.15.120:0/284341342 conn(0x7f5d3c0d0f00 msgr2=0x7f5d3c0d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.477+0000 7f5d4208b640 1 -- 172.21.15.120:0/284341342 shutdown_connections 2024-07-27T03:14:33.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.477+0000 7f5d4208b640 1 -- 172.21.15.120:0/284341342 wait complete. 2024-07-27T03:14:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.478+0000 7f5d4208b640 1 Processor -- start 2024-07-27T03:14:33.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.479+0000 7f5d4208b640 1 -- start start 2024-07-27T03:14:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d4208b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d3c06c780 0x7f5d3c1429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d4208b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3c073680 0x7f5d3c1f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d4208b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c15c8f0 0x7f5d3c0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d4208b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0713b0 con 0x7f5d3c073680 2024-07-27T03:14:33.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d4208b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c071230 con 0x7f5d3c06c780 2024-07-27T03:14:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d4208b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c071530 con 0x7f5d3c15c8f0 2024-07-27T03:14:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d3affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3c073680 0x7f5d3c1f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d3affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3c073680 0x7f5d3c1f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52654/0 (socket says 172.21.15.120:52654) 2024-07-27T03:14:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d3affd640 1 -- 172.21.15.120:0/1196688538 learned_addr learned my addr 172.21.15.120:0/1196688538 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d3b7fe640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d3c06c780 0x7f5d3c1429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d3bfff640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c15c8f0 0x7f5d3c0b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d3affd640 1 -- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c15c8f0 msgr2=0x7f5d3c0b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d3affd640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c15c8f0 0x7f5d3c0b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d3affd640 1 -- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d3c06c780 msgr2=0x7f5d3c1429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d3affd640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d3c06c780 0x7f5d3c1429c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.480+0000 7f5d3affd640 1 -- 172.21.15.120:0/1196688538 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c1f6520 con 0x7f5d3c073680 2024-07-27T03:14:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.481+0000 7f5d3affd640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3c073680 0x7f5d3c1f5750 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000c940 tx=0x7f5d3000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.481+0000 7f5d23fff640 1 -- 172.21.15.120:0/1196688538 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30004230 con 0x7f5d3c073680 2024-07-27T03:14:33.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.481+0000 7f5d23fff640 1 -- 172.21.15.120:0/1196688538 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d300079b0 con 0x7f5d3c073680 2024-07-27T03:14:33.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.481+0000 7f5d23fff640 1 -- 172.21.15.120:0/1196688538 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d300044c0 con 0x7f5d3c073680 2024-07-27T03:14:33.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.481+0000 7f5d4208b640 1 -- 172.21.15.120:0/1196688538 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c1421c0 con 0x7f5d3c073680 2024-07-27T03:14:33.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.481+0000 7f5d4208b640 1 -- 172.21.15.120:0/1196688538 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c140920 con 0x7f5d3c073680 2024-07-27T03:14:33.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.482+0000 7f5d4208b640 1 -- 172.21.15.120:0/1196688538 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c0745a0 con 0x7f5d3c073680 2024-07-27T03:14:33.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.483+0000 7f5d23fff640 1 -- 172.21.15.120:0/1196688538 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5d300035f0 con 0x7f5d3c073680 2024-07-27T03:14:33.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.483+0000 7f5d23fff640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d28077010 0x7f5d28079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.483+0000 7f5d23fff640 1 -- 172.21.15.120:0/1196688538 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f5d30098a70 con 0x7f5d3c073680 2024-07-27T03:14:33.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.483+0000 7f5d3b7fe640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d28077010 0x7f5d28079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.484+0000 7f5d3b7fe640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d28077010 0x7f5d28079520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c033000 tx=0x7f5d2c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.487+0000 7f5d23fff640 1 -- 172.21.15.120:0/1196688538 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5d30014070 con 0x7f5d3c073680 2024-07-27T03:14:33.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.669+0000 7f5d4208b640 1 -- 172.21.15.120:0/1196688538 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f5d3c0ce3e0 con 0x7f5d28077010 2024-07-27T03:14:33.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.670+0000 7f5d23fff640 1 -- 172.21.15.120:0/1196688538 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5d3c0ce3e0 con 0x7f5d28077010 2024-07-27T03:14:33.673 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 1 to deep-scrub 2024-07-27T03:14:33.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 -- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d28077010 msgr2=0x7f5d28079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d28077010 0x7f5d28079520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c033000 tx=0x7f5d2c004730 comp rx=0 tx=0).stop 2024-07-27T03:14:33.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 -- 172.21.15.120:0/1196688538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3c073680 msgr2=0x7f5d3c1f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3c073680 0x7f5d3c1f5750 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000c940 tx=0x7f5d3000ce00 comp rx=0 tx=0).stop 2024-07-27T03:14:33.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 -- 172.21.15.120:0/1196688538 shutdown_connections 2024-07-27T03:14:33.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5d28077010 0x7f5d28079520 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d3c073680 0x7f5d3c1f5750 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5d3c15c8f0 0x7f5d3c0b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 --2- 172.21.15.120:0/1196688538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d3c06c780 0x7f5d3c1429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 -- 172.21.15.120:0/1196688538 >> 172.21.15.120:0/1196688538 conn(0x7f5d3c0d0f00 msgr2=0x7f5d3c0b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:33.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 -- 172.21.15.120:0/1196688538 shutdown_connections 2024-07-27T03:14:33.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.672+0000 7f5d4208b640 1 -- 172.21.15.120:0/1196688538 wait complete. 2024-07-27T03:14:33.686 INFO:tasks.ceph:Scrubbing osd.2 2024-07-27T03:14:33.686 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-07-27T03:14:33.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.801+0000 7f9790e9a640 1 -- 172.21.15.120:0/3797312023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9774003a00 msgr2=0x7f9774003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.801+0000 7f9790e9a640 1 --2- 172.21.15.120:0/3797312023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9774003a00 0x7f9774003e70 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f977c009b50 tx=0x7f9774005830 comp rx=0 tx=0).stop 2024-07-27T03:14:33.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.801+0000 7f978ad9d640 1 -- 172.21.15.120:0/3797312023 reap_dead start 2024-07-27T03:14:33.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.801+0000 7f9790e9a640 1 -- 172.21.15.120:0/3797312023 shutdown_connections 2024-07-27T03:14:33.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.801+0000 7f9790e9a640 1 -- 172.21.15.120:0/3797312023 >> 172.21.15.120:0/3797312023 conn(0x7f978c06dec0 msgr2=0x7f978c0b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:33.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.801+0000 7f9790e9a640 1 -- 172.21.15.120:0/3797312023 shutdown_connections 2024-07-27T03:14:33.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.801+0000 7f9790e9a640 1 -- 172.21.15.120:0/3797312023 wait complete. 2024-07-27T03:14:33.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.803+0000 7f9790e9a640 1 Processor -- start 2024-07-27T03:14:33.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.803+0000 7f9790e9a640 1 -- start start 2024-07-27T03:14:33.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f9790e9a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9774003a00 0x7f978c155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f9790e9a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f978c1f4dd0 0x7f978c1480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f9790e9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f978c14e3c0 0x7f978c154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f9790e9a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f978c15c540 con 0x7f978c14e3c0 2024-07-27T03:14:33.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f9790e9a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f978c152680 con 0x7f9774003a00 2024-07-27T03:14:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f9790e9a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f978c073430 con 0x7f978c1f4dd0 2024-07-27T03:14:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f978ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f978c14e3c0 0x7f978c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f978ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f978c14e3c0 0x7f978c154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52668/0 (socket says 172.21.15.120:52668) 2024-07-27T03:14:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f978ad9d640 1 -- 172.21.15.120:0/745547185 learned_addr learned my addr 172.21.15.120:0/745547185 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f9789d9b640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f978c1f4dd0 0x7f978c1480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f978a59c640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9774003a00 0x7f978c155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f978ad9d640 1 -- 172.21.15.120:0/745547185 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f978c1f4dd0 msgr2=0x7f978c1480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f978ad9d640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f978c1f4dd0 0x7f978c1480e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f978ad9d640 1 -- 172.21.15.120:0/745547185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9774003a00 msgr2=0x7f978c155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f978ad9d640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9774003a00 0x7f978c155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f978ad9d640 1 -- 172.21.15.120:0/745547185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978c1f51e0 con 0x7f978c14e3c0 2024-07-27T03:14:33.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f978ad9d640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f978c14e3c0 0x7f978c154370 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f978c15b760 tx=0x7f9784006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f977affd640 1 -- 172.21.15.120:0/745547185 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978400fc10 con 0x7f978c14e3c0 2024-07-27T03:14:33.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f977affd640 1 -- 172.21.15.120:0/745547185 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9784019070 con 0x7f978c14e3c0 2024-07-27T03:14:33.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f977affd640 1 -- 172.21.15.120:0/745547185 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784011430 con 0x7f978c14e3c0 2024-07-27T03:14:33.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.805+0000 7f9790e9a640 1 -- 172.21.15.120:0/745547185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978c1f5660 con 0x7f978c14e3c0 2024-07-27T03:14:33.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.806+0000 7f9790e9a640 1 -- 172.21.15.120:0/745547185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f978c1f5c20 con 0x7f978c14e3c0 2024-07-27T03:14:33.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.806+0000 7f9790e9a640 1 -- 172.21.15.120:0/745547185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f978c15ba30 con 0x7f978c14e3c0 2024-07-27T03:14:33.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.807+0000 7f977affd640 1 -- 172.21.15.120:0/745547185 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f97840115d0 con 0x7f978c14e3c0 2024-07-27T03:14:33.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.808+0000 7f977affd640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f976c077000 0x7f976c079510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.808+0000 7f977affd640 1 -- 172.21.15.120:0/745547185 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f97840998e0 con 0x7f978c14e3c0 2024-07-27T03:14:33.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.808+0000 7f978a59c640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f976c077000 0x7f976c079510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.808+0000 7f977affd640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] conn(0x7f976c07d050 0x7f976c07f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.808+0000 7f977affd640 1 -- 172.21.15.120:0/745547185 --> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9784015ec0 con 0x7f976c07d050 2024-07-27T03:14:33.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.808+0000 7f977affd640 1 -- 172.21.15.120:0/745547185 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f9784099d70 con 0x7f978c14e3c0 2024-07-27T03:14:33.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.808+0000 7f9789d9b640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] conn(0x7f976c07d050 0x7f976c07f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.808+0000 7f9789d9b640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] conn(0x7f976c07d050 0x7f976c07f4a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.808+0000 7f978a59c640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f976c077000 0x7f976c079510 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f977c035000 tx=0x7f977c02d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.809+0000 7f977affd640 1 -- 172.21.15.120:0/745547185 <== osd.2 v2:172.21.15.120:6808/1765193874 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9784015ec0 con 0x7f976c07d050 2024-07-27T03:14:33.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.822+0000 7f9790e9a640 1 -- 172.21.15.120:0/745547185 --> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f978c1f5410 con 0x7f976c07d050 2024-07-27T03:14:33.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.822+0000 7f977affd640 1 -- 172.21.15.120:0/745547185 <== osd.2 v2:172.21.15.120:6808/1765193874 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f978c1f5410 con 0x7f976c07d050 2024-07-27T03:14:33.825 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:14:33.826 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-27T03:14:33.826 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:14:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.823+0000 7f9790e9a640 1 -- 172.21.15.120:0/745547185 >> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] conn(0x7f976c07d050 msgr2=0x7f976c07f4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.823+0000 7f9790e9a640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.120:6808/1765193874,v1:172.21.15.120:6809/1765193874] conn(0x7f976c07d050 0x7f976c07f4a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.823+0000 7f9790e9a640 1 -- 172.21.15.120:0/745547185 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f976c077000 msgr2=0x7f976c079510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.823+0000 7f9790e9a640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f976c077000 0x7f976c079510 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f977c035000 tx=0x7f977c02d040 comp rx=0 tx=0).stop 2024-07-27T03:14:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.823+0000 7f9790e9a640 1 -- 172.21.15.120:0/745547185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f978c14e3c0 msgr2=0x7f978c154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.823+0000 7f9790e9a640 1 --2- 172.21.15.120:0/745547185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f978c14e3c0 0x7f978c154370 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f978c15b760 tx=0x7f9784006720 comp rx=0 tx=0).stop 2024-07-27T03:14:33.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.823+0000 7f978ad9d640 1 -- 172.21.15.120:0/745547185 reap_dead start 2024-07-27T03:14:33.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.823+0000 7f9790e9a640 1 -- 172.21.15.120:0/745547185 shutdown_connections 2024-07-27T03:14:33.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.823+0000 7f9790e9a640 1 -- 172.21.15.120:0/745547185 >> 172.21.15.120:0/745547185 conn(0x7f978c06dec0 msgr2=0x7f978c06f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:33.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.823+0000 7f9790e9a640 1 -- 172.21.15.120:0/745547185 shutdown_connections 2024-07-27T03:14:33.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.823+0000 7f9790e9a640 1 -- 172.21.15.120:0/745547185 wait complete. 2024-07-27T03:14:33.836 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-07-27T03:14:33.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.947+0000 7f2d78f6f640 1 -- 172.21.15.120:0/1098711506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d740cf480 msgr2=0x7f2d740735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.947+0000 7f2d78f6f640 1 --2- 172.21.15.120:0/1098711506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d740cf480 0x7f2d740735f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2d74071ba0 tx=0x7f2d5c02a560 comp rx=0 tx=0).stop 2024-07-27T03:14:33.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.947+0000 7f2d78f6f640 1 -- 172.21.15.120:0/1098711506 shutdown_connections 2024-07-27T03:14:33.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.947+0000 7f2d78f6f640 1 --2- 172.21.15.120:0/1098711506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d74073b30 0x7f2d74154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.947+0000 7f2d78f6f640 1 --2- 172.21.15.120:0/1098711506 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d740cf480 0x7f2d740735f0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.947+0000 7f2d78f6f640 1 --2- 172.21.15.120:0/1098711506 >> v2:172.21.15.121:3300/0 conn(0x7f2d7415f760 0x7f2d7406e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.947+0000 7f2d78f6f640 1 -- 172.21.15.120:0/1098711506 >> 172.21.15.120:0/1098711506 conn(0x7f2d740b1a10 msgr2=0x7f2d740b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:33.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.947+0000 7f2d78f6f640 1 -- 172.21.15.120:0/1098711506 shutdown_connections 2024-07-27T03:14:33.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.947+0000 7f2d78f6f640 1 -- 172.21.15.120:0/1098711506 wait complete. 2024-07-27T03:14:33.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.949+0000 7f2d78f6f640 1 Processor -- start 2024-07-27T03:14:33.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.949+0000 7f2d78f6f640 1 -- start start 2024-07-27T03:14:33.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.950+0000 7f2d78f6f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d74073b30 0x7f2d7413e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.950+0000 7f2d78f6f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d740cf480 0x7f2d741f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.950+0000 7f2d78f6f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d7415f760 0x7f2d7409be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.950+0000 7f2d78f6f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741555c0 con 0x7f2d7415f760 2024-07-27T03:14:33.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.950+0000 7f2d78f6f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74155440 con 0x7f2d74073b30 2024-07-27T03:14:33.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.950+0000 7f2d78f6f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f2d74155740 con 0x7f2d740cf480 2024-07-27T03:14:33.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.950+0000 7f2d72d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d7415f760 0x7f2d7409be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.950+0000 7f2d72d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d7415f760 0x7f2d7409be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52686/0 (socket says 172.21.15.120:52686) 2024-07-27T03:14:33.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.950+0000 7f2d72d9d640 1 -- 172.21.15.120:0/2531586095 learned_addr learned my addr 172.21.15.120:0/2531586095 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:33.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.950+0000 7f2d71d9b640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d740cf480 0x7f2d741f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.950+0000 7f2d7259c640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d74073b30 0x7f2d7413e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.951+0000 7f2d72d9d640 1 -- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d740cf480 msgr2=0x7f2d741f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.951+0000 7f2d72d9d640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d740cf480 0x7f2d741f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.951+0000 7f2d72d9d640 1 -- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d74073b30 msgr2=0x7f2d7413e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:33.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.951+0000 7f2d72d9d640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d74073b30 0x7f2d7413e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:33.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.951+0000 7f2d72d9d640 1 -- 172.21.15.120:0/2531586095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7413eba0 con 0x7f2d7415f760 2024-07-27T03:14:33.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.951+0000 7f2d72d9d640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d7415f760 0x7f2d7409be00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00d680 tx=0x7f2d6c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.951+0000 7f2d6affd640 1 -- 172.21.15.120:0/2531586095 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c017070 con 0x7f2d7415f760 2024-07-27T03:14:33.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.951+0000 7f2d6affd640 1 -- 172.21.15.120:0/2531586095 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d6c005310 con 0x7f2d7415f760 2024-07-27T03:14:33.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.951+0000 7f2d78f6f640 1 -- 172.21.15.120:0/2531586095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7409ad60 con 0x7f2d7415f760 2024-07-27T03:14:33.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.951+0000 7f2d6affd640 1 -- 172.21.15.120:0/2531586095 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c009820 con 0x7f2d7415f760 2024-07-27T03:14:33.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.951+0000 7f2d78f6f640 1 -- 172.21.15.120:0/2531586095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7409b320 con 0x7f2d7415f760 2024-07-27T03:14:33.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.952+0000 7f2d78f6f640 1 -- 172.21.15.120:0/2531586095 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d740735f0 con 0x7f2d7415f760 2024-07-27T03:14:33.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.953+0000 7f2d6affd640 1 -- 172.21.15.120:0/2531586095 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2d6c0099c0 con 0x7f2d7415f760 2024-07-27T03:14:33.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.953+0000 7f2d6affd640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d54077010 0x7f2d54079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:33.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.953+0000 7f2d6affd640 1 -- 172.21.15.120:0/2531586095 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f2d6c0985e0 con 0x7f2d7415f760 2024-07-27T03:14:33.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.953+0000 7f2d7259c640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d54077010 0x7f2d54079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:33.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.954+0000 7f2d7259c640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d54077010 0x7f2d54079520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2d740703b0 tx=0x7f2d640095d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:33.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:33.958+0000 7f2d6affd640 1 -- 172.21.15.120:0/2531586095 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f2d6c0613e0 con 0x7f2d7415f760 2024-07-27T03:14:34.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.137+0000 7f2d78f6f640 1 -- 172.21.15.120:0/2531586095 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f2d7409de90 con 0x7f2d54077010 2024-07-27T03:14:34.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.138+0000 7f2d6affd640 1 -- 172.21.15.120:0/2531586095 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2d7409de90 con 0x7f2d54077010 2024-07-27T03:14:34.141 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 2 to deep-scrub 2024-07-27T03:14:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 -- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d54077010 msgr2=0x7f2d54079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d54077010 0x7f2d54079520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2d740703b0 tx=0x7f2d640095d0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 -- 172.21.15.120:0/2531586095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d7415f760 msgr2=0x7f2d7409be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d7415f760 0x7f2d7409be00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00d680 tx=0x7f2d6c00db40 comp rx=0 tx=0).stop 2024-07-27T03:14:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 -- 172.21.15.120:0/2531586095 shutdown_connections 2024-07-27T03:14:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2d54077010 0x7f2d54079520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d7415f760 0x7f2d7409be00 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2d740cf480 0x7f2d741f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 --2- 172.21.15.120:0/2531586095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d74073b30 0x7f2d7413e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 -- 172.21.15.120:0/2531586095 >> 172.21.15.120:0/2531586095 conn(0x7f2d740b1a10 msgr2=0x7f2d740b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 -- 172.21.15.120:0/2531586095 shutdown_connections 2024-07-27T03:14:34.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.141+0000 7f2d78f6f640 1 -- 172.21.15.120:0/2531586095 wait complete. 2024-07-27T03:14:34.154 INFO:tasks.ceph:Scrubbing osd.3 2024-07-27T03:14:34.154 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-07-27T03:14:34.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.270+0000 7f19dd4af640 1 -- 172.21.15.120:0/2243996128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80cda80 msgr2=0x7f19d80d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.270+0000 7f19dd4af640 1 --2- 172.21.15.120:0/2243996128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80cda80 0x7f19d80d2910 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009830 tx=0x7f19c802a480 comp rx=0 tx=0).stop 2024-07-27T03:14:34.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.270+0000 7f19dd4af640 1 -- 172.21.15.120:0/2243996128 shutdown_connections 2024-07-27T03:14:34.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.270+0000 7f19dd4af640 1 --2- 172.21.15.120:0/2243996128 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f19d80d0590 0x7f19d80d09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.270+0000 7f19dd4af640 1 --2- 172.21.15.120:0/2243996128 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80cda80 0x7f19d80d2910 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.270+0000 7f19dd4af640 1 -- 172.21.15.120:0/2243996128 >> 172.21.15.120:0/2243996128 conn(0x7f19d80d1df0 msgr2=0x7f19d80d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:34.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.270+0000 7f19dd4af640 1 -- 172.21.15.120:0/2243996128 shutdown_connections 2024-07-27T03:14:34.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.270+0000 7f19dd4af640 1 -- 172.21.15.120:0/2243996128 wait complete. 2024-07-27T03:14:34.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.272+0000 7f19dd4af640 1 Processor -- start 2024-07-27T03:14:34.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.272+0000 7f19dd4af640 1 -- start start 2024-07-27T03:14:34.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.273+0000 7f19dd4af640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19d80cda80 0x7f19d806f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.273+0000 7f19dd4af640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f19d80ce960 0x7f19d81f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.273+0000 7f19dd4af640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80d0590 0x7f19d80c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.273+0000 7f19dd4af640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f19d80cc9e0 con 0x7f19d80d0590 2024-07-27T03:14:34.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.273+0000 7f19dd4af640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f19d80cf1d0 con 0x7f19d80cda80 2024-07-27T03:14:34.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.273+0000 7f19dd4af640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f19d80ccb60 con 0x7f19d80ce960 2024-07-27T03:14:34.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19d77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80d0590 0x7f19d80c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19d77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80d0590 0x7f19d80c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52704/0 (socket says 172.21.15.120:52704) 2024-07-27T03:14:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19d77fe640 1 -- 172.21.15.120:0/601000700 learned_addr learned my addr 172.21.15.120:0/601000700 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19d6ffd640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19d80cda80 0x7f19d806f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19cffff640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f19d80ce960 0x7f19d81f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19d77fe640 1 -- 172.21.15.120:0/601000700 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f19d80ce960 msgr2=0x7f19d81f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19d77fe640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f19d80ce960 0x7f19d81f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19d77fe640 1 -- 172.21.15.120:0/601000700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19d80cda80 msgr2=0x7f19d806f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19d77fe640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19d80cda80 0x7f19d806f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19d77fe640 1 -- 172.21.15.120:0/601000700 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d81f6730 con 0x7f19d80d0590 2024-07-27T03:14:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19d77fe640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80d0590 0x7f19d80c6530 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f19d000cab0 tx=0x7f19d000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19cf7fe640 1 -- 172.21.15.120:0/601000700 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0016020 con 0x7f19d80d0590 2024-07-27T03:14:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19cf7fe640 1 -- 172.21.15.120:0/601000700 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19d000ad20 con 0x7f19d80d0590 2024-07-27T03:14:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19dd4af640 1 -- 172.21.15.120:0/601000700 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d80c91d0 con 0x7f19d80d0590 2024-07-27T03:14:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19cf7fe640 1 -- 172.21.15.120:0/601000700 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0012660 con 0x7f19d80d0590 2024-07-27T03:14:34.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.274+0000 7f19dd4af640 1 -- 172.21.15.120:0/601000700 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d80c9790 con 0x7f19d80d0590 2024-07-27T03:14:34.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.275+0000 7f19dd4af640 1 -- 172.21.15.120:0/601000700 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19d80d2910 con 0x7f19d80d0590 2024-07-27T03:14:34.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.276+0000 7f19cf7fe640 1 -- 172.21.15.120:0/601000700 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f19d0019020 con 0x7f19d80d0590 2024-07-27T03:14:34.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.277+0000 7f19cf7fe640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f19b8077010 0x7f19b8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.277+0000 7f19cf7fe640 1 -- 172.21.15.120:0/601000700 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f19d0098d20 con 0x7f19d80d0590 2024-07-27T03:14:34.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.277+0000 7f19d6ffd640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f19b8077010 0x7f19b8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.277+0000 7f19cf7fe640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] conn(0x7f19b807d060 0x7f19b807f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.277+0000 7f19cf7fe640 1 -- 172.21.15.120:0/601000700 --> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19b807fb80 con 0x7f19b807d060 2024-07-27T03:14:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.277+0000 7f19cf7fe640 1 -- 172.21.15.120:0/601000700 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f19d0099110 con 0x7f19d80d0590 2024-07-27T03:14:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.277+0000 7f19cffff640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] conn(0x7f19b807d060 0x7f19b807f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.277+0000 7f19d6ffd640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f19b8077010 0x7f19b8079520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19c8034000 tx=0x7f19c8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.277+0000 7f19cffff640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] conn(0x7f19b807d060 0x7f19b807f4b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:34.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.278+0000 7f19cf7fe640 1 -- 172.21.15.120:0/601000700 <== osd.3 v2:172.21.15.120:6816/253357243 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19b807fb80 con 0x7f19b807d060 2024-07-27T03:14:34.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.291+0000 7f19dd4af640 1 -- 172.21.15.120:0/601000700 --> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f19d8075a30 con 0x7f19b807d060 2024-07-27T03:14:34.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.291+0000 7f19cf7fe640 1 -- 172.21.15.120:0/601000700 <== osd.3 v2:172.21.15.120:6816/253357243 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f19d8075a30 con 0x7f19b807d060 2024-07-27T03:14:34.294 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:14:34.294 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-27T03:14:34.294 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:14:34.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.291+0000 7f19dd4af640 1 -- 172.21.15.120:0/601000700 >> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] conn(0x7f19b807d060 msgr2=0x7f19b807f4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.291+0000 7f19dd4af640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.120:6816/253357243,v1:172.21.15.120:6817/253357243] conn(0x7f19b807d060 0x7f19b807f4b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.292+0000 7f19dd4af640 1 -- 172.21.15.120:0/601000700 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f19b8077010 msgr2=0x7f19b8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.292+0000 7f19dd4af640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f19b8077010 0x7f19b8079520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19c8034000 tx=0x7f19c8004730 comp rx=0 tx=0).stop 2024-07-27T03:14:34.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.292+0000 7f19dd4af640 1 -- 172.21.15.120:0/601000700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80d0590 msgr2=0x7f19d80c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.292+0000 7f19dd4af640 1 --2- 172.21.15.120:0/601000700 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19d80d0590 0x7f19d80c6530 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f19d000cab0 tx=0x7f19d000cf70 comp rx=0 tx=0).stop 2024-07-27T03:14:34.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.292+0000 7f19d77fe640 1 -- 172.21.15.120:0/601000700 reap_dead start 2024-07-27T03:14:34.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.292+0000 7f19dd4af640 1 -- 172.21.15.120:0/601000700 shutdown_connections 2024-07-27T03:14:34.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.292+0000 7f19dd4af640 1 -- 172.21.15.120:0/601000700 >> 172.21.15.120:0/601000700 conn(0x7f19d80d1df0 msgr2=0x7f19d80d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:34.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.292+0000 7f19dd4af640 1 -- 172.21.15.120:0/601000700 shutdown_connections 2024-07-27T03:14:34.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.292+0000 7f19dd4af640 1 -- 172.21.15.120:0/601000700 wait complete. 2024-07-27T03:14:34.305 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-07-27T03:14:34.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.416+0000 7fbddc36f640 1 -- 172.21.15.120:0/114875743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdc0004800 msgr2=0x7fbdc0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.416+0000 7fbddc36f640 1 --2- 172.21.15.120:0/114875743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdc0004800 0x7fbdc0004c10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009b20 tx=0x7fbdc0005830 comp rx=0 tx=0).stop 2024-07-27T03:14:34.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.416+0000 7fbdda90c640 1 -- 172.21.15.120:0/114875743 reap_dead start 2024-07-27T03:14:34.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.416+0000 7fbddc36f640 1 -- 172.21.15.120:0/114875743 shutdown_connections 2024-07-27T03:14:34.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.416+0000 7fbddc36f640 1 -- 172.21.15.120:0/114875743 >> 172.21.15.120:0/114875743 conn(0x7fbdd406cba0 msgr2=0x7fbdd406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:34.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.416+0000 7fbddc36f640 1 -- 172.21.15.120:0/114875743 shutdown_connections 2024-07-27T03:14:34.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.416+0000 7fbddc36f640 1 -- 172.21.15.120:0/114875743 wait complete. 2024-07-27T03:14:34.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.418+0000 7fbddc36f640 1 Processor -- start 2024-07-27T03:14:34.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.418+0000 7fbddc36f640 1 -- start start 2024-07-27T03:14:34.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.419+0000 7fbddc36f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdc0004800 0x7fbdd4150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.419+0000 7fbddc36f640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbdd41e7670 0x7fbdd4072d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.419+0000 7fbddc36f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdd4073240 0x7fbdd41e5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbddc36f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd41522e0 con 0x7fbdd4073240 2024-07-27T03:14:34.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbddc36f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd4152160 con 0x7fbdc0004800 2024-07-27T03:14:34.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbddc36f640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd4152460 con 0x7fbdd41e7670 2024-07-27T03:14:34.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdda90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdd4073240 0x7fbdd41e5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdda90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdd4073240 0x7fbdd41e5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52728/0 (socket says 172.21.15.120:52728) 2024-07-27T03:14:34.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdda90c640 1 -- 172.21.15.120:0/2723603908 learned_addr learned my addr 172.21.15.120:0/2723603908 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:34.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdd990a640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbdd41e7670 0x7fbdd4072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdda10b640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdc0004800 0x7fbdd4150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdda90c640 1 -- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbdd41e7670 msgr2=0x7fbdd4072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdda90c640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbdd41e7670 0x7fbdd4072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdda90c640 1 -- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdc0004800 msgr2=0x7fbdd4150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdda90c640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdc0004800 0x7fbdd4150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdda90c640 1 -- 172.21.15.120:0/2723603908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd40b22d0 con 0x7fbdd4073240 2024-07-27T03:14:34.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdda90c640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdd4073240 0x7fbdd41e5ac0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40b1b50 tx=0x7fbdcc011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:34.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdcaffd640 1 -- 172.21.15.120:0/2723603908 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc01f070 con 0x7fbdd4073240 2024-07-27T03:14:34.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdcaffd640 1 -- 172.21.15.120:0/2723603908 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdcc00fad0 con 0x7fbdd4073240 2024-07-27T03:14:34.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbdcaffd640 1 -- 172.21.15.120:0/2723603908 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc012450 con 0x7fbdd4073240 2024-07-27T03:14:34.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbddc36f640 1 -- 172.21.15.120:0/2723603908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd4073650 con 0x7fbdd4073240 2024-07-27T03:14:34.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.420+0000 7fbddc36f640 1 -- 172.21.15.120:0/2723603908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd40b2540 con 0x7fbdd4073240 2024-07-27T03:14:34.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.421+0000 7fbddc36f640 1 -- 172.21.15.120:0/2723603908 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd415f030 con 0x7fbdd4073240 2024-07-27T03:14:34.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.422+0000 7fbdcaffd640 1 -- 172.21.15.120:0/2723603908 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fbdcc022070 con 0x7fbdd4073240 2024-07-27T03:14:34.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.422+0000 7fbdcaffd640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbdb8077010 0x7fbdb8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.423+0000 7fbdcaffd640 1 -- 172.21.15.120:0/2723603908 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fbdcc098f70 con 0x7fbdd4073240 2024-07-27T03:14:34.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.423+0000 7fbdda10b640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbdb8077010 0x7fbdb8079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.423+0000 7fbdda10b640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbdb8077010 0x7fbdb8079520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0006fd0 tx=0x7fbdd0001f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:34.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.427+0000 7fbdcaffd640 1 -- 172.21.15.120:0/2723603908 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fbdd4073650 con 0x7fbdd4073240 2024-07-27T03:14:34.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.610+0000 7fbddc36f640 1 -- 172.21.15.120:0/2723603908 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fbdd4069c10 con 0x7fbdb8077010 2024-07-27T03:14:34.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.610+0000 7fbdcaffd640 1 -- 172.21.15.120:0/2723603908 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbdd0006510 con 0x7fbdb8077010 2024-07-27T03:14:34.614 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 3 to deep-scrub 2024-07-27T03:14:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 -- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbdb8077010 msgr2=0x7fbdb8079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbdb8077010 0x7fbdb8079520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0006fd0 tx=0x7fbdd0001f10 comp rx=0 tx=0).stop 2024-07-27T03:14:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 -- 172.21.15.120:0/2723603908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdd4073240 msgr2=0x7fbdd41e5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdd4073240 0x7fbdd41e5ac0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40b1b50 tx=0x7fbdcc011b30 comp rx=0 tx=0).stop 2024-07-27T03:14:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 -- 172.21.15.120:0/2723603908 shutdown_connections 2024-07-27T03:14:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbdb8077010 0x7fbdb8079520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbdd4073240 0x7fbdd41e5ac0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbdd41e7670 0x7fbdd4072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 --2- 172.21.15.120:0/2723603908 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdc0004800 0x7fbdd4150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 -- 172.21.15.120:0/2723603908 >> 172.21.15.120:0/2723603908 conn(0x7fbdd406cba0 msgr2=0x7fbdd415a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 -- 172.21.15.120:0/2723603908 shutdown_connections 2024-07-27T03:14:34.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.613+0000 7fbddc36f640 1 -- 172.21.15.120:0/2723603908 wait complete. 2024-07-27T03:14:34.627 INFO:tasks.ceph:Scrubbing osd.4 2024-07-27T03:14:34.627 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-07-27T03:14:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.743+0000 7f138e08b640 1 -- 172.21.15.120:0/832643554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1370004800 msgr2=0x7f1370004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.743+0000 7f138e08b640 1 --2- 172.21.15.120:0/832643554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1370004800 0x7f1370004c10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1388074510 tx=0x7f1370005830 comp rx=0 tx=0).stop 2024-07-27T03:14:34.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.743+0000 7f1387fff640 1 -- 172.21.15.120:0/832643554 reap_dead start 2024-07-27T03:14:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.743+0000 7f138e08b640 1 -- 172.21.15.120:0/832643554 shutdown_connections 2024-07-27T03:14:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.743+0000 7f138e08b640 1 -- 172.21.15.120:0/832643554 >> 172.21.15.120:0/832643554 conn(0x7f13880d1e40 msgr2=0x7f13880d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.743+0000 7f138e08b640 1 -- 172.21.15.120:0/832643554 shutdown_connections 2024-07-27T03:14:34.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.743+0000 7f138e08b640 1 -- 172.21.15.120:0/832643554 wait complete. 2024-07-27T03:14:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.745+0000 7f138e08b640 1 Processor -- start 2024-07-27T03:14:34.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.745+0000 7f138e08b640 1 -- start start 2024-07-27T03:14:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.746+0000 7f138e08b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1370004800 0x7f13880b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.746+0000 7f138e08b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f138809ccf0 0x7f13880cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.746+0000 7f138e08b640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13880afba0 0x7f13880affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.746+0000 7f138e08b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f13880b6590 con 0x7f1370004800 2024-07-27T03:14:34.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.746+0000 7f138e08b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f13880b6410 con 0x7f138809ccf0 2024-07-27T03:14:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.746+0000 7f138e08b640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f13880b6710 con 0x7f13880afba0 2024-07-27T03:14:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.746+0000 7f13877fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1370004800 0x7f13880b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.746+0000 7f13877fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1370004800 0x7f13880b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52748/0 (socket says 172.21.15.120:52748) 2024-07-27T03:14:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.746+0000 7f13877fe640 1 -- 172.21.15.120:0/2444227731 learned_addr learned my addr 172.21.15.120:0/2444227731 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.747+0000 7f13877fe640 1 -- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13880afba0 msgr2=0x7f13880affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.747+0000 7f13877fe640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13880afba0 0x7f13880affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.747+0000 7f13877fe640 1 -- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f138809ccf0 msgr2=0x7f13880cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.747+0000 7f13877fe640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f138809ccf0 0x7f13880cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.747+0000 7f13877fe640 1 -- 172.21.15.120:0/2444227731 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13880b04f0 con 0x7f1370004800 2024-07-27T03:14:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.747+0000 7f13877fe640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1370004800 0x7f13880b0840 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1378011a50 tx=0x7f1378011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.747+0000 7f136ffff640 1 -- 172.21.15.120:0/2444227731 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137801f070 con 0x7f1370004800 2024-07-27T03:14:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.747+0000 7f136ffff640 1 -- 172.21.15.120:0/2444227731 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f137800fd40 con 0x7f1370004800 2024-07-27T03:14:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.747+0000 7f138e08b640 1 -- 172.21.15.120:0/2444227731 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13880b0d80 con 0x7f1370004800 2024-07-27T03:14:34.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.747+0000 7f136ffff640 1 -- 172.21.15.120:0/2444227731 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13780126b0 con 0x7f1370004800 2024-07-27T03:14:34.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.747+0000 7f138e08b640 1 -- 172.21.15.120:0/2444227731 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13880af0c0 con 0x7f1370004800 2024-07-27T03:14:34.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.748+0000 7f138e08b640 1 -- 172.21.15.120:0/2444227731 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13880aeb90 con 0x7f1370004800 2024-07-27T03:14:34.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.749+0000 7f136ffff640 1 -- 172.21.15.120:0/2444227731 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1378022070 con 0x7f1370004800 2024-07-27T03:14:34.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.749+0000 7f136ffff640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1374077040 0x7f1374079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.749+0000 7f136ffff640 1 -- 172.21.15.120:0/2444227731 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f1378099b80 con 0x7f1370004800 2024-07-27T03:14:34.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.749+0000 7f136ffff640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] conn(0x7f137407d090 0x7f137407f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.749+0000 7f136ffff640 1 -- 172.21.15.120:0/2444227731 --> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1378004450 con 0x7f137407d090 2024-07-27T03:14:34.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.749+0000 7f136ffff640 1 -- 172.21.15.120:0/2444227731 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f137809a010 con 0x7f1370004800 2024-07-27T03:14:34.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.750+0000 7f1386ffd640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1374077040 0x7f1374079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.750+0000 7f1387fff640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] conn(0x7f137407d090 0x7f137407f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.750+0000 7f1386ffd640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1374077040 0x7f1374079550 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f137c035000 tx=0x7f137c02d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:34.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.750+0000 7f1387fff640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] conn(0x7f137407d090 0x7f137407f4e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:34.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.751+0000 7f136ffff640 1 -- 172.21.15.120:0/2444227731 <== osd.4 v2:172.21.15.121:6808/3344380023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1378004450 con 0x7f137407d090 2024-07-27T03:14:34.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.764+0000 7f138e08b640 1 -- 172.21.15.120:0/2444227731 --> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f138815c480 con 0x7f137407d090 2024-07-27T03:14:34.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f136ffff640 1 -- 172.21.15.120:0/2444227731 <== osd.4 v2:172.21.15.121:6808/3344380023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f138815c480 con 0x7f137407d090 2024-07-27T03:14:34.767 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:14:34.768 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-27T03:14:34.768 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:14:34.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f138e08b640 1 -- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] conn(0x7f137407d090 msgr2=0x7f137407f4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f138e08b640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:6808/3344380023,v1:172.21.15.121:6809/3344380023] conn(0x7f137407d090 0x7f137407f4e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f138e08b640 1 -- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1374077040 msgr2=0x7f1374079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f138e08b640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f1374077040 0x7f1374079550 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f137c035000 tx=0x7f137c02d040 comp rx=0 tx=0).stop 2024-07-27T03:14:34.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f138e08b640 1 -- 172.21.15.120:0/2444227731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1370004800 msgr2=0x7f13880b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f138e08b640 1 --2- 172.21.15.120:0/2444227731 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1370004800 0x7f13880b0840 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1378011a50 tx=0x7f1378011f10 comp rx=0 tx=0).stop 2024-07-27T03:14:34.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f1387fff640 1 -- 172.21.15.120:0/2444227731 reap_dead start 2024-07-27T03:14:34.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f138e08b640 1 -- 172.21.15.120:0/2444227731 shutdown_connections 2024-07-27T03:14:34.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f138e08b640 1 -- 172.21.15.120:0/2444227731 >> 172.21.15.120:0/2444227731 conn(0x7f13880d1e40 msgr2=0x7f1388071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:34.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f138e08b640 1 -- 172.21.15.120:0/2444227731 shutdown_connections 2024-07-27T03:14:34.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.765+0000 7f138e08b640 1 -- 172.21.15.120:0/2444227731 wait complete. 2024-07-27T03:14:34.778 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-07-27T03:14:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.890+0000 7f8f593fa640 1 -- 172.21.15.120:0/1272011384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f540d0f00 msgr2=0x7f8f540cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.890+0000 7f8f593fa640 1 --2- 172.21.15.120:0/1272011384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f540d0f00 0x7f8f540cebe0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c005fd0 tx=0x7f8f4c02a8b0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.890+0000 7f8f593fa640 1 -- 172.21.15.120:0/1272011384 shutdown_connections 2024-07-27T03:14:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.890+0000 7f8f593fa640 1 --2- 172.21.15.120:0/1272011384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f540d0f00 0x7f8f540cebe0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.890+0000 7f8f593fa640 1 --2- 172.21.15.120:0/1272011384 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f540b2c40 0x7f8f540d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.890+0000 7f8f593fa640 1 -- 172.21.15.120:0/1272011384 >> 172.21.15.120:0/1272011384 conn(0x7f8f5408d690 msgr2=0x7f8f5409d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.890+0000 7f8f593fa640 1 -- 172.21.15.120:0/1272011384 shutdown_connections 2024-07-27T03:14:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.890+0000 7f8f593fa640 1 -- 172.21.15.120:0/1272011384 wait complete. 2024-07-27T03:14:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.891+0000 7f8f593fa640 1 Processor -- start 2024-07-27T03:14:34.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.892+0000 7f8f593fa640 1 -- start start 2024-07-27T03:14:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f593fa640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f540b2c40 0x7f8f54158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f593fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f540b4740 0x7f8f540b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f593fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f540d0f00 0x7f8f540b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f593fa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8f540cf120 con 0x7f8f540d0f00 2024-07-27T03:14:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f593fa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8f540d3100 con 0x7f8f540b4740 2024-07-27T03:14:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f593fa640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f8f540cf2a0 con 0x7f8f540b2c40 2024-07-27T03:14:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f540d0f00 0x7f8f540b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f540d0f00 0x7f8f540b7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52764/0 (socket says 172.21.15.120:52764) 2024-07-27T03:14:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f537fe640 1 -- 172.21.15.120:0/2286201692 learned_addr learned my addr 172.21.15.120:0/2286201692 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:34.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f52ffd640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f540b2c40 0x7f8f54158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f4a7fc640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f540b4740 0x7f8f540b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f537fe640 1 -- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f540b2c40 msgr2=0x7f8f54158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f537fe640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f540b2c40 0x7f8f54158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f537fe640 1 -- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f540b4740 msgr2=0x7f8f540b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:34.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f537fe640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f540b4740 0x7f8f540b7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:34.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.893+0000 7f8f537fe640 1 -- 172.21.15.120:0/2286201692 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f540cc0b0 con 0x7f8f540d0f00 2024-07-27T03:14:34.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.894+0000 7f8f537fe640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f540d0f00 0x7f8f540b7d80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009cd0 tx=0x7f8f4c0039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:34.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.894+0000 7f8f4bfff640 1 -- 172.21.15.120:0/2286201692 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c031990 con 0x7f8f540d0f00 2024-07-27T03:14:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.894+0000 7f8f4bfff640 1 -- 172.21.15.120:0/2286201692 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f4c031c20 con 0x7f8f540d0f00 2024-07-27T03:14:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.894+0000 7f8f593fa640 1 -- 172.21.15.120:0/2286201692 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f541f9c90 con 0x7f8f540d0f00 2024-07-27T03:14:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.894+0000 7f8f4bfff640 1 -- 172.21.15.120:0/2286201692 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0332f0 con 0x7f8f540d0f00 2024-07-27T03:14:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.894+0000 7f8f593fa640 1 -- 172.21.15.120:0/2286201692 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f540a1840 con 0x7f8f540d0f00 2024-07-27T03:14:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.895+0000 7f8f593fa640 1 -- 172.21.15.120:0/2286201692 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f5415cfc0 con 0x7f8f540d0f00 2024-07-27T03:14:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.895+0000 7f8f4bfff640 1 -- 172.21.15.120:0/2286201692 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8f4c033490 con 0x7f8f540d0f00 2024-07-27T03:14:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.896+0000 7f8f4bfff640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8f34077010 0x7f8f34079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.896+0000 7f8f4bfff640 1 -- 172.21.15.120:0/2286201692 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f8f4c0b9b90 con 0x7f8f540d0f00 2024-07-27T03:14:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.896+0000 7f8f52ffd640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8f34077010 0x7f8f34079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.896+0000 7f8f52ffd640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8f34077010 0x7f8f34079520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8f44000f60 tx=0x7f8f44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:34.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:34.900+0000 7f8f4bfff640 1 -- 172.21.15.120:0/2286201692 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f8f4c03f030 con 0x7f8f540d0f00 2024-07-27T03:14:35.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.085+0000 7f8f593fa640 1 -- 172.21.15.120:0/2286201692 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f8f540d09c0 con 0x7f8f34077010 2024-07-27T03:14:35.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.085+0000 7f8f4bfff640 1 -- 172.21.15.120:0/2286201692 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8f540d09c0 con 0x7f8f34077010 2024-07-27T03:14:35.088 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 4 to deep-scrub 2024-07-27T03:14:35.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 -- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8f34077010 msgr2=0x7f8f34079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8f34077010 0x7f8f34079520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8f44000f60 tx=0x7f8f44009040 comp rx=0 tx=0).stop 2024-07-27T03:14:35.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 -- 172.21.15.120:0/2286201692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f540d0f00 msgr2=0x7f8f540b7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f540d0f00 0x7f8f540b7d80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009cd0 tx=0x7f8f4c0039f0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 -- 172.21.15.120:0/2286201692 shutdown_connections 2024-07-27T03:14:35.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f8f34077010 0x7f8f34079520 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8f540d0f00 0x7f8f540b7d80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f540b4740 0x7f8f540b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 --2- 172.21.15.120:0/2286201692 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8f540b2c40 0x7f8f54158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 -- 172.21.15.120:0/2286201692 >> 172.21.15.120:0/2286201692 conn(0x7f8f5408d690 msgr2=0x7f8f540b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:35.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 -- 172.21.15.120:0/2286201692 shutdown_connections 2024-07-27T03:14:35.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.088+0000 7f8f593fa640 1 -- 172.21.15.120:0/2286201692 wait complete. 2024-07-27T03:14:35.102 INFO:tasks.ceph:Scrubbing osd.5 2024-07-27T03:14:35.102 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-07-27T03:14:35.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.217+0000 7febd9db9640 1 -- 172.21.15.120:0/3081644471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd406f360 msgr2=0x7febd4073720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.217+0000 7febd9db9640 1 --2- 172.21.15.120:0/3081644471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd406f360 0x7febd4073720 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7febcc005fd0 tx=0x7febcc02ba30 comp rx=0 tx=0).stop 2024-07-27T03:14:35.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.217+0000 7febd9db9640 1 -- 172.21.15.120:0/3081644471 shutdown_connections 2024-07-27T03:14:35.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.217+0000 7febd9db9640 1 --2- 172.21.15.120:0/3081644471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd406f360 0x7febd4073720 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.217+0000 7febd9db9640 1 -- 172.21.15.120:0/3081644471 >> 172.21.15.120:0/3081644471 conn(0x7febd40cfd60 msgr2=0x7febd40d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:35.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.217+0000 7febd9db9640 1 -- 172.21.15.120:0/3081644471 shutdown_connections 2024-07-27T03:14:35.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.217+0000 7febd9db9640 1 -- 172.21.15.120:0/3081644471 wait complete. 2024-07-27T03:14:35.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.219+0000 7febd9db9640 1 Processor -- start 2024-07-27T03:14:35.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.219+0000 7febd9db9640 1 -- start start 2024-07-27T03:14:35.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.220+0000 7febd9db9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febd4073310 0x7febd414cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.220+0000 7febd9db9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febd40cb410 0x7febd413bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.220+0000 7febd9db9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd40ccc10 0x7febd40cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.220+0000 7febd9db9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7febd406e890 con 0x7febd40ccc10 2024-07-27T03:14:35.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.220+0000 7febd9db9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7febd406e710 con 0x7febd40cb410 2024-07-27T03:14:35.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.220+0000 7febd9db9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7febd406ea10 con 0x7febd4073310 2024-07-27T03:14:35.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.220+0000 7febd3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd40ccc10 0x7febd40cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.220+0000 7febd3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd40ccc10 0x7febd40cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52784/0 (socket says 172.21.15.120:52784) 2024-07-27T03:14:35.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.220+0000 7febd3fff640 1 -- 172.21.15.120:0/763763630 learned_addr learned my addr 172.21.15.120:0/763763630 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:35.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.220+0000 7febd37fe640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febd4073310 0x7febd414cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.220+0000 7febcaffd640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febd40cb410 0x7febd413bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.221+0000 7febd3fff640 1 -- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febd4073310 msgr2=0x7febd414cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.221+0000 7febd3fff640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7febd4073310 0x7febd414cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.221+0000 7febd3fff640 1 -- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febd40cb410 msgr2=0x7febd413bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.221+0000 7febd3fff640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febd40cb410 0x7febd413bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.221+0000 7febd3fff640 1 -- 172.21.15.120:0/763763630 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd40cd560 con 0x7febd40ccc10 2024-07-27T03:14:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.221+0000 7febd3fff640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd40ccc10 0x7febd40cd020 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7febcc006010 tx=0x7febcc0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.221+0000 7febd0ff9640 1 -- 172.21.15.120:0/763763630 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc03f070 con 0x7febd40ccc10 2024-07-27T03:14:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.221+0000 7febd0ff9640 1 -- 172.21.15.120:0/763763630 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febcc044460 con 0x7febd40ccc10 2024-07-27T03:14:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.221+0000 7febd9db9640 1 -- 172.21.15.120:0/763763630 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd413c4e0 con 0x7febd40ccc10 2024-07-27T03:14:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.221+0000 7febd0ff9640 1 -- 172.21.15.120:0/763763630 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febcc0448b0 con 0x7febd40ccc10 2024-07-27T03:14:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.221+0000 7febd9db9640 1 -- 172.21.15.120:0/763763630 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd41500d0 con 0x7febd40ccc10 2024-07-27T03:14:35.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.222+0000 7febd9db9640 1 -- 172.21.15.120:0/763763630 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7febd4073720 con 0x7febd40ccc10 2024-07-27T03:14:35.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.223+0000 7febd0ff9640 1 -- 172.21.15.120:0/763763630 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7febcc044a50 con 0x7febd40ccc10 2024-07-27T03:14:35.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.223+0000 7febd0ff9640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7febb4077040 0x7febb4079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.223+0000 7febd0ff9640 1 -- 172.21.15.120:0/763763630 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7febcc0bb0c0 con 0x7febd40ccc10 2024-07-27T03:14:35.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.223+0000 7febd0ff9640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] conn(0x7febb407d090 0x7febb407f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.223+0000 7febd0ff9640 1 -- 172.21.15.120:0/763763630 --> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febb407fbb0 con 0x7febb407d090 2024-07-27T03:14:35.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.223+0000 7febd37fe640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7febb4077040 0x7febb4079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.223+0000 7febd0ff9640 1 -- 172.21.15.120:0/763763630 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7febcc0bb550 con 0x7febd40ccc10 2024-07-27T03:14:35.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.224+0000 7febcaffd640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] conn(0x7febb407d090 0x7febb407f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.224+0000 7febd37fe640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7febb4077040 0x7febb4079550 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7febc4006fd0 tx=0x7febc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:35.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.224+0000 7febcaffd640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] conn(0x7febb407d090 0x7febb407f4e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:35.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.225+0000 7febd0ff9640 1 -- 172.21.15.120:0/763763630 <== osd.5 v2:172.21.15.121:6824/3272535131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7febb407fbb0 con 0x7febb407d090 2024-07-27T03:14:35.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.238+0000 7febd9db9640 1 -- 172.21.15.120:0/763763630 --> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7febd40b5ce0 con 0x7febb407d090 2024-07-27T03:14:35.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd0ff9640 1 -- 172.21.15.120:0/763763630 <== osd.5 v2:172.21.15.121:6824/3272535131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7febd40b5ce0 con 0x7febb407d090 2024-07-27T03:14:35.242 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:14:35.242 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-27T03:14:35.242 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:14:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd9db9640 1 -- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] conn(0x7febb407d090 msgr2=0x7febb407f4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd9db9640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:6824/3272535131,v1:172.21.15.121:6825/3272535131] conn(0x7febb407d090 0x7febb407f4e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd9db9640 1 -- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7febb4077040 msgr2=0x7febb4079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd9db9640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7febb4077040 0x7febb4079550 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7febc4006fd0 tx=0x7febc4008040 comp rx=0 tx=0).stop 2024-07-27T03:14:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd9db9640 1 -- 172.21.15.120:0/763763630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd40ccc10 msgr2=0x7febd40cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd9db9640 1 --2- 172.21.15.120:0/763763630 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd40ccc10 0x7febd40cd020 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7febcc006010 tx=0x7febcc0042c0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd3fff640 1 -- 172.21.15.120:0/763763630 reap_dead start 2024-07-27T03:14:35.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd9db9640 1 -- 172.21.15.120:0/763763630 shutdown_connections 2024-07-27T03:14:35.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd9db9640 1 -- 172.21.15.120:0/763763630 >> 172.21.15.120:0/763763630 conn(0x7febd40cfd60 msgr2=0x7febd41510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:35.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd9db9640 1 -- 172.21.15.120:0/763763630 shutdown_connections 2024-07-27T03:14:35.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.239+0000 7febd9db9640 1 -- 172.21.15.120:0/763763630 wait complete. 2024-07-27T03:14:35.252 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-07-27T03:14:35.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.366+0000 7f256aabf640 1 -- 172.21.15.120:0/614117467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25640ced80 msgr2=0x7f25640b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.366+0000 7f256aabf640 1 --2- 172.21.15.120:0/614117467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25640ced80 0x7f25640b14e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f25640ce3a0 tx=0x7f255c02a980 comp rx=0 tx=0).stop 2024-07-27T03:14:35.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.366+0000 7f256aabf640 1 -- 172.21.15.120:0/614117467 shutdown_connections 2024-07-27T03:14:35.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.366+0000 7f256aabf640 1 --2- 172.21.15.120:0/614117467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25640ced80 0x7f25640b14e0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.366+0000 7f256aabf640 1 --2- 172.21.15.120:0/614117467 >> v2:172.21.15.121:3300/0 conn(0x7f25640d28f0 0x7f25640ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.366+0000 7f256aabf640 1 --2- 172.21.15.120:0/614117467 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25640b75b0 0x7f25640d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.366+0000 7f256aabf640 1 -- 172.21.15.120:0/614117467 >> 172.21.15.120:0/614117467 conn(0x7f25640d1dd0 msgr2=0x7f25640d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:35.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.366+0000 7f256aabf640 1 -- 172.21.15.120:0/614117467 shutdown_connections 2024-07-27T03:14:35.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.366+0000 7f256aabf640 1 -- 172.21.15.120:0/614117467 wait complete. 2024-07-27T03:14:35.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.368+0000 7f256aabf640 1 Processor -- start 2024-07-27T03:14:35.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.368+0000 7f256aabf640 1 -- start start 2024-07-27T03:14:35.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f256aabf640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25640b75b0 0x7f25641f9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f256aabf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25640ced80 0x7f25640b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f256aabf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25640d28f0 0x7f25641e2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f256aabf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f25640ccab0 con 0x7f25640ced80 2024-07-27T03:14:35.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f256aabf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f25640cc930 con 0x7f25640d28f0 2024-07-27T03:14:35.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f256aabf640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f25640ccc30 con 0x7f25640b75b0 2024-07-27T03:14:35.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f255bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25640ced80 0x7f25640b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f255bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25640ced80 0x7f25640b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52792/0 (socket says 172.21.15.120:52792) 2024-07-27T03:14:35.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f255bfff640 1 -- 172.21.15.120:0/1589365706 learned_addr learned my addr 172.21.15.120:0/1589365706 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:35.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f256885b640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25640b75b0 0x7f25641f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f256905c640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25640d28f0 0x7f25641e2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f255bfff640 1 -- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25640b75b0 msgr2=0x7f25641f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f255bfff640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25640b75b0 0x7f25641f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f255bfff640 1 -- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25640d28f0 msgr2=0x7f25641e2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f255bfff640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25640d28f0 0x7f25641e2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f255bfff640 1 -- 172.21.15.120:0/1589365706 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256406f8b0 con 0x7f25640ced80 2024-07-27T03:14:35.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f255bfff640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25640ced80 0x7f25640b60b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f255400c940 tx=0x7f255400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.370+0000 7f25597fa640 1 -- 172.21.15.120:0/1589365706 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554007bb0 con 0x7f25640ced80 2024-07-27T03:14:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.371+0000 7f256aabf640 1 -- 172.21.15.120:0/1589365706 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25640c4c90 con 0x7f25640ced80 2024-07-27T03:14:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.371+0000 7f25597fa640 1 -- 172.21.15.120:0/1589365706 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2554007e40 con 0x7f25640ced80 2024-07-27T03:14:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.371+0000 7f25597fa640 1 -- 172.21.15.120:0/1589365706 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255400f6b0 con 0x7f25640ced80 2024-07-27T03:14:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.371+0000 7f256aabf640 1 -- 172.21.15.120:0/1589365706 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256406f390 con 0x7f25640ced80 2024-07-27T03:14:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.371+0000 7f256aabf640 1 -- 172.21.15.120:0/1589365706 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25640b14e0 con 0x7f25640ced80 2024-07-27T03:14:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.372+0000 7f25597fa640 1 -- 172.21.15.120:0/1589365706 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f255400f850 con 0x7f25640ced80 2024-07-27T03:14:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.373+0000 7f25597fa640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2550077010 0x7f2550079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.373+0000 7f25597fa640 1 -- 172.21.15.120:0/1589365706 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f2554098c30 con 0x7f25640ced80 2024-07-27T03:14:35.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.373+0000 7f256885b640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2550077010 0x7f2550079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.374+0000 7f256885b640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2550077010 0x7f2550079520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2560005fd0 tx=0x7f256000b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:35.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.377+0000 7f25597fa640 1 -- 172.21.15.120:0/1589365706 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f2554014030 con 0x7f25640ced80 2024-07-27T03:14:35.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.559+0000 7f256aabf640 1 -- 172.21.15.120:0/1589365706 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f25640c4a40 con 0x7f2550077010 2024-07-27T03:14:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.560+0000 7f25597fa640 1 -- 172.21.15.120:0/1589365706 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f25640c4a40 con 0x7f2550077010 2024-07-27T03:14:35.563 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 5 to deep-scrub 2024-07-27T03:14:35.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 -- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2550077010 msgr2=0x7f2550079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2550077010 0x7f2550079520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2560005fd0 tx=0x7f256000b260 comp rx=0 tx=0).stop 2024-07-27T03:14:35.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 -- 172.21.15.120:0/1589365706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25640ced80 msgr2=0x7f25640b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25640ced80 0x7f25640b60b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f255400c940 tx=0x7f255400ce00 comp rx=0 tx=0).stop 2024-07-27T03:14:35.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 -- 172.21.15.120:0/1589365706 shutdown_connections 2024-07-27T03:14:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f2550077010 0x7f2550079520 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25640ced80 0x7f25640b60b0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25640d28f0 0x7f25641e2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 --2- 172.21.15.120:0/1589365706 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25640b75b0 0x7f25641f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 -- 172.21.15.120:0/1589365706 >> 172.21.15.120:0/1589365706 conn(0x7f25640d1dd0 msgr2=0x7f25641e4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 -- 172.21.15.120:0/1589365706 shutdown_connections 2024-07-27T03:14:35.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.562+0000 7f256aabf640 1 -- 172.21.15.120:0/1589365706 wait complete. 2024-07-27T03:14:35.576 INFO:tasks.ceph:Scrubbing osd.6 2024-07-27T03:14:35.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-07-27T03:14:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.692+0000 7fa10aef2640 1 -- 172.21.15.120:0/2872303982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1040b3190 msgr2=0x7fa1040b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.692+0000 7fa10aef2640 1 --2- 172.21.15.120:0/2872303982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1040b3190 0x7fa1040b17d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa104074330 tx=0x7fa0f802a560 comp rx=0 tx=0).stop 2024-07-27T03:14:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.692+0000 7fa10aef2640 1 -- 172.21.15.120:0/2872303982 shutdown_connections 2024-07-27T03:14:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.692+0000 7fa10aef2640 1 --2- 172.21.15.120:0/2872303982 >> v2:172.21.15.121:3300/0 conn(0x7fa1040b1d10 0x7fa1040cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.692+0000 7fa10aef2640 1 --2- 172.21.15.120:0/2872303982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1040b3190 0x7fa1040b17d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.692+0000 7fa10aef2640 1 --2- 172.21.15.120:0/2872303982 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa1040b72e0 0x7fa1040d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.692+0000 7fa10aef2640 1 -- 172.21.15.120:0/2872303982 >> 172.21.15.120:0/2872303982 conn(0x7fa1040d1e40 msgr2=0x7fa1040d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.692+0000 7fa10aef2640 1 -- 172.21.15.120:0/2872303982 shutdown_connections 2024-07-27T03:14:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.692+0000 7fa10aef2640 1 -- 172.21.15.120:0/2872303982 wait complete. 2024-07-27T03:14:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.694+0000 7fa10aef2640 1 Processor -- start 2024-07-27T03:14:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.694+0000 7fa10aef2640 1 -- start start 2024-07-27T03:14:35.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa10aef2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1040b1d10 0x7fa1040b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa10aef2640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa1040b3190 0x7fa1040af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa10aef2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1040b72e0 0x7fa1040c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa10aef2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa1040cd220 con 0x7fa1040b1d10 2024-07-27T03:14:35.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa10aef2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1040cd0a0 con 0x7fa1040b72e0 2024-07-27T03:14:35.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa10aef2640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa1040cd3a0 con 0x7fa1040b3190 2024-07-27T03:14:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa108c8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1040b1d10 0x7fa1040b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa108c8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1040b1d10 0x7fa1040b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52824/0 (socket says 172.21.15.120:52824) 2024-07-27T03:14:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa108c8e640 1 -- 172.21.15.120:0/2636154260 learned_addr learned my addr 172.21.15.120:0/2636154260 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa103fff640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa1040b3190 0x7fa1040af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa10948f640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1040b72e0 0x7fa1040c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa108c8e640 1 -- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa1040b3190 msgr2=0x7fa1040af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.695+0000 7fa108c8e640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa1040b3190 0x7fa1040af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.696+0000 7fa108c8e640 1 -- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1040b72e0 msgr2=0x7fa1040c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.696+0000 7fa108c8e640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1040b72e0 0x7fa1040c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.696+0000 7fa108c8e640 1 -- 172.21.15.120:0/2636154260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1041f93f0 con 0x7fa1040b1d10 2024-07-27T03:14:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.696+0000 7fa10948f640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1040b72e0 0x7fa1040c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:14:35.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.696+0000 7fa108c8e640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1040b1d10 0x7fa1040b6710 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400d700 tx=0x7fa0f400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.696+0000 7fa1017fa640 1 -- 172.21.15.120:0/2636154260 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4017070 con 0x7fa1040b1d10 2024-07-27T03:14:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.696+0000 7fa1017fa640 1 -- 172.21.15.120:0/2636154260 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0f4004310 con 0x7fa1040b1d10 2024-07-27T03:14:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.696+0000 7fa10aef2640 1 -- 172.21.15.120:0/2636154260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1041f96d0 con 0x7fa1040b1d10 2024-07-27T03:14:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.696+0000 7fa1017fa640 1 -- 172.21.15.120:0/2636154260 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4009a80 con 0x7fa1040b1d10 2024-07-27T03:14:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.696+0000 7fa10aef2640 1 -- 172.21.15.120:0/2636154260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1041f9c90 con 0x7fa1040b1d10 2024-07-27T03:14:35.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.697+0000 7fa10aef2640 1 -- 172.21.15.120:0/2636154260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1041f5a20 con 0x7fa1040b1d10 2024-07-27T03:14:35.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.698+0000 7fa1017fa640 1 -- 172.21.15.120:0/2636154260 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fa0f4009c20 con 0x7fa1040b1d10 2024-07-27T03:14:35.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.698+0000 7fa1017fa640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa0f0077040 0x7fa0f0079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.698+0000 7fa1017fa640 1 -- 172.21.15.120:0/2636154260 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fa0f4098c00 con 0x7fa1040b1d10 2024-07-27T03:14:35.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.698+0000 7fa1017fa640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] conn(0x7fa0f007d090 0x7fa0f007f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.698+0000 7fa1017fa640 1 -- 172.21.15.120:0/2636154260 --> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0f007fbb0 con 0x7fa0f007d090 2024-07-27T03:14:35.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.698+0000 7fa1017fa640 1 -- 172.21.15.120:0/2636154260 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fa0f4099090 con 0x7fa1040b1d10 2024-07-27T03:14:35.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.698+0000 7fa103fff640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa0f0077040 0x7fa0f0079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.699+0000 7fa10948f640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] conn(0x7fa0f007d090 0x7fa0f007f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.699+0000 7fa103fff640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa0f0077040 0x7fa0f0079550 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8033000 tx=0x7fa0f8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:35.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.699+0000 7fa10948f640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] conn(0x7fa0f007d090 0x7fa0f007f4e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:35.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.700+0000 7fa1017fa640 1 -- 172.21.15.120:0/2636154260 <== osd.6 v2:172.21.15.121:6800/375857749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0f007fbb0 con 0x7fa0f007d090 2024-07-27T03:14:35.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.713+0000 7fa10aef2640 1 -- 172.21.15.120:0/2636154260 --> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa1040b17d0 con 0x7fa0f007d090 2024-07-27T03:14:35.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.713+0000 7fa1017fa640 1 -- 172.21.15.120:0/2636154260 <== osd.6 v2:172.21.15.121:6800/375857749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa1040b17d0 con 0x7fa0f007d090 2024-07-27T03:14:35.716 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:14:35.717 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-27T03:14:35.717 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:14:35.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.714+0000 7fa10aef2640 1 -- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] conn(0x7fa0f007d090 msgr2=0x7fa0f007f4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.714+0000 7fa10aef2640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:6800/375857749,v1:172.21.15.121:6801/375857749] conn(0x7fa0f007d090 0x7fa0f007f4e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.714+0000 7fa10aef2640 1 -- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa0f0077040 msgr2=0x7fa0f0079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.714+0000 7fa10aef2640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa0f0077040 0x7fa0f0079550 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8033000 tx=0x7fa0f8004730 comp rx=0 tx=0).stop 2024-07-27T03:14:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.714+0000 7fa10aef2640 1 -- 172.21.15.120:0/2636154260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1040b1d10 msgr2=0x7fa1040b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.714+0000 7fa10aef2640 1 --2- 172.21.15.120:0/2636154260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1040b1d10 0x7fa1040b6710 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400d700 tx=0x7fa0f400dbc0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.714+0000 7fa10948f640 1 -- 172.21.15.120:0/2636154260 reap_dead start 2024-07-27T03:14:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.714+0000 7fa10aef2640 1 -- 172.21.15.120:0/2636154260 shutdown_connections 2024-07-27T03:14:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.714+0000 7fa10aef2640 1 -- 172.21.15.120:0/2636154260 >> 172.21.15.120:0/2636154260 conn(0x7fa1040d1e40 msgr2=0x7fa104071950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.714+0000 7fa10aef2640 1 -- 172.21.15.120:0/2636154260 shutdown_connections 2024-07-27T03:14:35.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.714+0000 7fa10aef2640 1 -- 172.21.15.120:0/2636154260 wait complete. 2024-07-27T03:14:35.727 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-07-27T03:14:35.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.838+0000 7f6cb863c640 1 -- 172.21.15.120:0/2904074228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb01522e0 msgr2=0x7f6cb006e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.838+0000 7f6cb863c640 1 --2- 172.21.15.120:0/2904074228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb01522e0 0x7f6cb006e270 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00cfc50 tx=0x7f6cac02a4a0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.839+0000 7f6cb863c640 1 -- 172.21.15.120:0/2904074228 shutdown_connections 2024-07-27T03:14:35.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.839+0000 7f6cb863c640 1 --2- 172.21.15.120:0/2904074228 >> v2:172.21.15.121:3300/0 conn(0x7f6cb00733e0 0x7f6cb00737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.839+0000 7f6cb863c640 1 --2- 172.21.15.120:0/2904074228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb01522e0 0x7f6cb006e270 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.839+0000 7f6cb863c640 1 -- 172.21.15.120:0/2904074228 >> 172.21.15.120:0/2904074228 conn(0x7f6cb00b1a10 msgr2=0x7f6cb00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:35.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.839+0000 7f6cb863c640 1 -- 172.21.15.120:0/2904074228 shutdown_connections 2024-07-27T03:14:35.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.839+0000 7f6cb863c640 1 -- 172.21.15.120:0/2904074228 wait complete. 2024-07-27T03:14:35.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.840+0000 7f6cb863c640 1 Processor -- start 2024-07-27T03:14:35.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.840+0000 7f6cb863c640 1 -- start start 2024-07-27T03:14:35.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb863c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cb00733e0 0x7f6cb015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb863c640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6cb0073d30 0x7f6cb015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb863c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb01522e0 0x7f6cb009d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb863c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb015c220 con 0x7f6cb01522e0 2024-07-27T03:14:35.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb863c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb015c0a0 con 0x7f6cb00733e0 2024-07-27T03:14:35.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb863c640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb015c3a0 con 0x7f6cb0073d30 2024-07-27T03:14:35.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb6bd9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb01522e0 0x7f6cb009d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb63d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cb00733e0 0x7f6cb015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb6bd9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb01522e0 0x7f6cb009d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52850/0 (socket says 172.21.15.120:52850) 2024-07-27T03:14:35.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb6bd9640 1 -- 172.21.15.120:0/365456983 learned_addr learned my addr 172.21.15.120:0/365456983 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:35.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb5bd7640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6cb0073d30 0x7f6cb015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb6bd9640 1 -- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6cb0073d30 msgr2=0x7f6cb015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb6bd9640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6cb0073d30 0x7f6cb015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb6bd9640 1 -- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cb00733e0 msgr2=0x7f6cb015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:35.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb6bd9640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cb00733e0 0x7f6cb015aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:35.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb6bd9640 1 -- 172.21.15.120:0/365456983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb01f1db0 con 0x7f6cb01522e0 2024-07-27T03:14:35.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb6bd9640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb01522e0 0x7f6cb009d090 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800ca20 tx=0x7f6ca800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:35.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6ca6ffd640 1 -- 172.21.15.120:0/365456983 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800abd0 con 0x7f6cb01522e0 2024-07-27T03:14:35.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6ca6ffd640 1 -- 172.21.15.120:0/365456983 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ca8011470 con 0x7f6cb01522e0 2024-07-27T03:14:35.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6ca6ffd640 1 -- 172.21.15.120:0/365456983 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800ae60 con 0x7f6cb01522e0 2024-07-27T03:14:35.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb863c640 1 -- 172.21.15.120:0/365456983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb01f22e0 con 0x7f6cb01522e0 2024-07-27T03:14:35.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.842+0000 7f6cb863c640 1 -- 172.21.15.120:0/365456983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb01f28a0 con 0x7f6cb01522e0 2024-07-27T03:14:35.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.844+0000 7f6cb863c640 1 -- 172.21.15.120:0/365456983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb00737f0 con 0x7f6cb01522e0 2024-07-27T03:14:35.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.844+0000 7f6ca6ffd640 1 -- 172.21.15.120:0/365456983 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6ca80118c0 con 0x7f6cb01522e0 2024-07-27T03:14:35.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.844+0000 7f6ca6ffd640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c94077010 0x7f6c94079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:35.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.845+0000 7f6ca6ffd640 1 -- 172.21.15.120:0/365456983 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f6ca809aab0 con 0x7f6cb01522e0 2024-07-27T03:14:35.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.845+0000 7f6cb63d8640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c94077010 0x7f6c94079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:35.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.845+0000 7f6cb63d8640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c94077010 0x7f6c94079520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6cac034000 tx=0x7f6cac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:35.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:35.849+0000 7f6ca6ffd640 1 -- 172.21.15.120:0/365456983 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f6ca8016030 con 0x7f6cb01522e0 2024-07-27T03:14:36.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.031+0000 7f6cb863c640 1 -- 172.21.15.120:0/365456983 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f6cb0142000 con 0x7f6c94077010 2024-07-27T03:14:36.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.032+0000 7f6ca6ffd640 1 -- 172.21.15.120:0/365456983 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6cb0142000 con 0x7f6c94077010 2024-07-27T03:14:36.035 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 6 to deep-scrub 2024-07-27T03:14:36.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 -- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c94077010 msgr2=0x7f6c94079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c94077010 0x7f6c94079520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6cac034000 tx=0x7f6cac004730 comp rx=0 tx=0).stop 2024-07-27T03:14:36.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 -- 172.21.15.120:0/365456983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb01522e0 msgr2=0x7f6cb009d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb01522e0 0x7f6cb009d090 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800ca20 tx=0x7f6ca800cee0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 -- 172.21.15.120:0/365456983 shutdown_connections 2024-07-27T03:14:36.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f6c94077010 0x7f6c94079520 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6cb01522e0 0x7f6cb009d090 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6cb0073d30 0x7f6cb015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 --2- 172.21.15.120:0/365456983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6cb00733e0 0x7f6cb015aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 -- 172.21.15.120:0/365456983 >> 172.21.15.120:0/365456983 conn(0x7f6cb00b1a10 msgr2=0x7f6cb00af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:36.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 -- 172.21.15.120:0/365456983 shutdown_connections 2024-07-27T03:14:36.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.034+0000 7f6cb863c640 1 -- 172.21.15.120:0/365456983 wait complete. 2024-07-27T03:14:36.048 INFO:tasks.ceph:Scrubbing osd.7 2024-07-27T03:14:36.048 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-07-27T03:14:36.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.163+0000 7fa6a3c22640 1 -- 172.21.15.120:0/3859914701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa69c15bf70 msgr2=0x7fa69c06f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.163+0000 7fa6a3c22640 1 --2- 172.21.15.120:0/3859914701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa69c15bf70 0x7fa69c06f490 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0b6120 tx=0x7fa69402aa30 comp rx=0 tx=0).stop 2024-07-27T03:14:36.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.163+0000 7fa6a3c22640 1 -- 172.21.15.120:0/3859914701 shutdown_connections 2024-07-27T03:14:36.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.163+0000 7fa6a3c22640 1 --2- 172.21.15.120:0/3859914701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa69c15bf70 0x7fa69c06f490 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.163+0000 7fa6a3c22640 1 --2- 172.21.15.120:0/3859914701 >> v2:172.21.15.121:3300/0 conn(0x7fa69c073b40 0x7fa69c15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.163+0000 7fa6a3c22640 1 -- 172.21.15.120:0/3859914701 >> 172.21.15.120:0/3859914701 conn(0x7fa69c06dec0 msgr2=0x7fa69c0b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:36.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.163+0000 7fa6a3c22640 1 -- 172.21.15.120:0/3859914701 shutdown_connections 2024-07-27T03:14:36.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.163+0000 7fa6a3c22640 1 -- 172.21.15.120:0/3859914701 wait complete. 2024-07-27T03:14:36.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.165+0000 7fa6a3c22640 1 Processor -- start 2024-07-27T03:14:36.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.165+0000 7fa6a3c22640 1 -- start start 2024-07-27T03:14:36.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a3c22640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa69c152060 0x7fa69c1f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a3c22640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa69c15bf70 0x7fa69c149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a3c22640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa69c13bcb0 0x7fa69c149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a3c22640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c06fd60 con 0x7fa69c13bcb0 2024-07-27T03:14:36.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a3c22640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c06fbe0 con 0x7fa69c152060 2024-07-27T03:14:36.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a3c22640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fa69c06fee0 con 0x7fa69c15bf70 2024-07-27T03:14:36.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a21bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa69c13bcb0 0x7fa69c149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a21bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa69c13bcb0 0x7fa69c149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52864/0 (socket says 172.21.15.120:52864) 2024-07-27T03:14:36.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a21bf640 1 -- 172.21.15.120:0/2062379967 learned_addr learned my addr 172.21.15.120:0/2062379967 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:36.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a11bd640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa69c15bf70 0x7fa69c149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a19be640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa69c152060 0x7fa69c1f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a21bf640 1 -- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa69c15bf70 msgr2=0x7fa69c149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a21bf640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa69c15bf70 0x7fa69c149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a21bf640 1 -- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa69c152060 msgr2=0x7fa69c1f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a21bf640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa69c152060 0x7fa69c1f2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.166+0000 7fa6a21bf640 1 -- 172.21.15.120:0/2062379967 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c13c4e0 con 0x7fa69c13bcb0 2024-07-27T03:14:36.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.167+0000 7fa6a11bd640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa69c15bf70 0x7fa69c149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:14:36.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.167+0000 7fa6a21bf640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa69c13bcb0 0x7fa69c149d90 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa694009d60 tx=0x7fa694003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:36.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.167+0000 7fa69a7fc640 1 -- 172.21.15.120:0/2062379967 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694033050 con 0x7fa69c13bcb0 2024-07-27T03:14:36.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.167+0000 7fa69a7fc640 1 -- 172.21.15.120:0/2062379967 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa694004550 con 0x7fa69c13bcb0 2024-07-27T03:14:36.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.167+0000 7fa69a7fc640 1 -- 172.21.15.120:0/2062379967 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694038450 con 0x7fa69c13bcb0 2024-07-27T03:14:36.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.167+0000 7fa6a3c22640 1 -- 172.21.15.120:0/2062379967 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69c14c7a0 con 0x7fa69c13bcb0 2024-07-27T03:14:36.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.167+0000 7fa6a3c22640 1 -- 172.21.15.120:0/2062379967 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa69c14cd60 con 0x7fa69c13bcb0 2024-07-27T03:14:36.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.168+0000 7fa6a3c22640 1 -- 172.21.15.120:0/2062379967 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa69c14c550 con 0x7fa69c13bcb0 2024-07-27T03:14:36.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.169+0000 7fa69a7fc640 1 -- 172.21.15.120:0/2062379967 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fa694036070 con 0x7fa69c13bcb0 2024-07-27T03:14:36.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.169+0000 7fa69a7fc640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa688077040 0x7fa688079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.169+0000 7fa69a7fc640 1 -- 172.21.15.120:0/2062379967 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fa6940b9f30 con 0x7fa69c13bcb0 2024-07-27T03:14:36.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.169+0000 7fa69a7fc640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] conn(0x7fa68807d090 0x7fa68807f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.169+0000 7fa69a7fc640 1 -- 172.21.15.120:0/2062379967 --> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa694009360 con 0x7fa68807d090 2024-07-27T03:14:36.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.169+0000 7fa6a19be640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa688077040 0x7fa688079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.169+0000 7fa69a7fc640 1 -- 172.21.15.120:0/2062379967 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fa6940ba3c0 con 0x7fa69c13bcb0 2024-07-27T03:14:36.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.170+0000 7fa6a11bd640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] conn(0x7fa68807d090 0x7fa68807f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.170+0000 7fa6a19be640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa688077040 0x7fa688079550 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa68c006fd0 tx=0x7fa68c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:36.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.170+0000 7fa6a11bd640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] conn(0x7fa68807d090 0x7fa68807f4e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:36.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.171+0000 7fa69a7fc640 1 -- 172.21.15.120:0/2062379967 <== osd.7 v2:172.21.15.121:6816/2396581528 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa694009360 con 0x7fa68807d090 2024-07-27T03:14:36.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.184+0000 7fa6a3c22640 1 -- 172.21.15.120:0/2062379967 --> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa69c1f70f0 con 0x7fa68807d090 2024-07-27T03:14:36.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa69a7fc640 1 -- 172.21.15.120:0/2062379967 <== osd.7 v2:172.21.15.121:6816/2396581528 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa69c1f70f0 con 0x7fa68807d090 2024-07-27T03:14:36.188 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-07-27T03:14:36.188 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-27T03:14:36.188 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-07-27T03:14:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa6a3c22640 1 -- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] conn(0x7fa68807d090 msgr2=0x7fa68807f4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa6a3c22640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:6816/2396581528,v1:172.21.15.121:6817/2396581528] conn(0x7fa68807d090 0x7fa68807f4e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa6a3c22640 1 -- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa688077040 msgr2=0x7fa688079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa6a3c22640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fa688077040 0x7fa688079550 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa68c006fd0 tx=0x7fa68c008040 comp rx=0 tx=0).stop 2024-07-27T03:14:36.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa6a3c22640 1 -- 172.21.15.120:0/2062379967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa69c13bcb0 msgr2=0x7fa69c149d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa6a3c22640 1 --2- 172.21.15.120:0/2062379967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa69c13bcb0 0x7fa69c149d90 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa694009d60 tx=0x7fa694003f10 comp rx=0 tx=0).stop 2024-07-27T03:14:36.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa6a21bf640 1 -- 172.21.15.120:0/2062379967 reap_dead start 2024-07-27T03:14:36.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa6a3c22640 1 -- 172.21.15.120:0/2062379967 shutdown_connections 2024-07-27T03:14:36.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa6a3c22640 1 -- 172.21.15.120:0/2062379967 >> 172.21.15.120:0/2062379967 conn(0x7fa69c06dec0 msgr2=0x7fa69c15dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:36.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa6a3c22640 1 -- 172.21.15.120:0/2062379967 shutdown_connections 2024-07-27T03:14:36.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.185+0000 7fa6a3c22640 1 -- 172.21.15.120:0/2062379967 wait complete. 2024-07-27T03:14:36.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-07-27T03:14:36.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.311+0000 7f55170e9640 1 -- 172.21.15.120:0/1417245391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5510071cf0 msgr2=0x7f5510158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.311+0000 7f55170e9640 1 --2- 172.21.15.120:0/1417245391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5510071cf0 0x7f5510158da0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5510072230 tx=0x7f550802aa70 comp rx=0 tx=0).stop 2024-07-27T03:14:36.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.311+0000 7f55170e9640 1 -- 172.21.15.120:0/1417245391 shutdown_connections 2024-07-27T03:14:36.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.311+0000 7f55170e9640 1 --2- 172.21.15.120:0/1417245391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5510071cf0 0x7f5510158da0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.311+0000 7f55170e9640 1 --2- 172.21.15.120:0/1417245391 >> v2:172.21.15.121:3300/0 conn(0x7f551015c500 0x7f5510074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.311+0000 7f55170e9640 1 -- 172.21.15.120:0/1417245391 >> 172.21.15.120:0/1417245391 conn(0x7f55100d0f00 msgr2=0x7f55100d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:36.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.311+0000 7f55170e9640 1 -- 172.21.15.120:0/1417245391 shutdown_connections 2024-07-27T03:14:36.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.311+0000 7f55170e9640 1 -- 172.21.15.120:0/1417245391 wait complete. 2024-07-27T03:14:36.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.312+0000 7f55170e9640 1 Processor -- start 2024-07-27T03:14:36.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.312+0000 7f55170e9640 1 -- start start 2024-07-27T03:14:36.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f55170e9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55100b4d30 0x7f551006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f55170e9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f551015c500 0x7f5510152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f55170e9640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55100c5ea0 0x7f55100cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f55170e9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5510070330 con 0x7f551015c500 2024-07-27T03:14:36.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f55170e9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55100701b0 con 0x7f55100b4d30 2024-07-27T03:14:36.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f55170e9640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f55100704b0 con 0x7f55100c5ea0 2024-07-27T03:14:36.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f5507fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f551015c500 0x7f5510152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f5507fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f551015c500 0x7f5510152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52870/0 (socket says 172.21.15.120:52870) 2024-07-27T03:14:36.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f5507fff640 1 -- 172.21.15.120:0/1112298253 learned_addr learned my addr 172.21.15.120:0/1112298253 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:36.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f5515686640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55100c5ea0 0x7f55100cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f5514e85640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55100b4d30 0x7f551006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f5507fff640 1 -- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55100c5ea0 msgr2=0x7f55100cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f5507fff640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55100c5ea0 0x7f55100cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f5507fff640 1 -- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55100b4d30 msgr2=0x7f551006d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f5507fff640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55100b4d30 0x7f551006d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f5507fff640 1 -- 172.21.15.120:0/1112298253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55101f8c70 con 0x7f551015c500 2024-07-27T03:14:36.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.314+0000 7f5507fff640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f551015c500 0x7f5510152cd0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f550000c370 tx=0x7f550000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:36.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.315+0000 7f55057fa640 1 -- 172.21.15.120:0/1112298253 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500017070 con 0x7f551015c500 2024-07-27T03:14:36.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.315+0000 7f55057fa640 1 -- 172.21.15.120:0/1112298253 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55000053c0 con 0x7f551015c500 2024-07-27T03:14:36.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.315+0000 7f55170e9640 1 -- 172.21.15.120:0/1112298253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55101f8f50 con 0x7f551015c500 2024-07-27T03:14:36.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.315+0000 7f55057fa640 1 -- 172.21.15.120:0/1112298253 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500003850 con 0x7f551015c500 2024-07-27T03:14:36.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.315+0000 7f55170e9640 1 -- 172.21.15.120:0/1112298253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55101f9510 con 0x7f551015c500 2024-07-27T03:14:36.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.316+0000 7f55170e9640 1 -- 172.21.15.120:0/1112298253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55100709d0 con 0x7f551015c500 2024-07-27T03:14:36.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.316+0000 7f55057fa640 1 -- 172.21.15.120:0/1112298253 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f550001a070 con 0x7f551015c500 2024-07-27T03:14:36.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.317+0000 7f55057fa640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f54fc077010 0x7f54fc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.317+0000 7f55057fa640 1 -- 172.21.15.120:0/1112298253 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f5500097ab0 con 0x7f551015c500 2024-07-27T03:14:36.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.317+0000 7f5514e85640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f54fc077010 0x7f54fc079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.317+0000 7f5514e85640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f54fc077010 0x7f54fc079520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f550c009a00 tx=0x7f550c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:36.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.321+0000 7f55057fa640 1 -- 172.21.15.120:0/1112298253 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f55100b41a0 con 0x7f551015c500 2024-07-27T03:14:36.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.504+0000 7f55170e9640 1 -- 172.21.15.120:0/1112298253 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f55101590c0 con 0x7f54fc077010 2024-07-27T03:14:36.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.505+0000 7f55057fa640 1 -- 172.21.15.120:0/1112298253 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55101590c0 con 0x7f54fc077010 2024-07-27T03:14:36.508 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 7 to deep-scrub 2024-07-27T03:14:36.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 -- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f54fc077010 msgr2=0x7f54fc079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f54fc077010 0x7f54fc079520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f550c009a00 tx=0x7f550c005f90 comp rx=0 tx=0).stop 2024-07-27T03:14:36.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 -- 172.21.15.120:0/1112298253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f551015c500 msgr2=0x7f5510152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f551015c500 0x7f5510152cd0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f550000c370 tx=0x7f550000c830 comp rx=0 tx=0).stop 2024-07-27T03:14:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 -- 172.21.15.120:0/1112298253 shutdown_connections 2024-07-27T03:14:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f54fc077010 0x7f54fc079520 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f551015c500 0x7f5510152cd0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f55100c5ea0 0x7f55100cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 --2- 172.21.15.120:0/1112298253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55100b4d30 0x7f551006d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 -- 172.21.15.120:0/1112298253 >> 172.21.15.120:0/1112298253 conn(0x7f55100d0f00 msgr2=0x7f5510154b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:36.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 -- 172.21.15.120:0/1112298253 shutdown_connections 2024-07-27T03:14:36.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.507+0000 7f55170e9640 1 -- 172.21.15.120:0/1112298253 wait complete. 2024-07-27T03:14:36.522 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:14:36.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.633+0000 7f416425a640 1 -- 172.21.15.120:0/3376370162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f415c0d0c10 msgr2=0x7f415c0b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.633+0000 7f416425a640 1 --2- 172.21.15.120:0/3376370162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f415c0d0c10 0x7f415c0b2520 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f415c074120 tx=0x7f415002a4d0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.633+0000 7f416425a640 1 -- 172.21.15.120:0/3376370162 shutdown_connections 2024-07-27T03:14:36.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.633+0000 7f416425a640 1 --2- 172.21.15.120:0/3376370162 >> v2:172.21.15.121:3300/0 conn(0x7f415c0b5fe0 0x7f415c15e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.633+0000 7f416425a640 1 --2- 172.21.15.120:0/3376370162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f415c0d0c10 0x7f415c0b2520 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.633+0000 7f416425a640 1 -- 172.21.15.120:0/3376370162 >> 172.21.15.120:0/3376370162 conn(0x7f415c0b3920 msgr2=0x7f415c0b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:36.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.633+0000 7f416425a640 1 -- 172.21.15.120:0/3376370162 shutdown_connections 2024-07-27T03:14:36.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.633+0000 7f416425a640 1 -- 172.21.15.120:0/3376370162 wait complete. 2024-07-27T03:14:36.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.635+0000 7f416425a640 1 Processor -- start 2024-07-27T03:14:36.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.635+0000 7f416425a640 1 -- start start 2024-07-27T03:14:36.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.636+0000 7f416425a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f415c0b2110 0x7f415c155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.636+0000 7f416425a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f415c0b5fe0 0x7f415c1f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.636+0000 7f416425a640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f415c0ce680 0x7f415c0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.636+0000 7f416425a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f415c15f4b0 con 0x7f415c0b5fe0 2024-07-27T03:14:36.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.636+0000 7f416425a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f415c15f330 con 0x7f415c0b2110 2024-07-27T03:14:36.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.636+0000 7f416425a640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f415c15f630 con 0x7f415c0ce680 2024-07-27T03:14:36.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.636+0000 7f41617f5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f415c0b5fe0 0x7f415c1f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.636+0000 7f41617f5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f415c0b5fe0 0x7f415c1f5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52884/0 (socket says 172.21.15.120:52884) 2024-07-27T03:14:36.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.636+0000 7f41617f5640 1 -- 172.21.15.120:0/1757649396 learned_addr learned my addr 172.21.15.120:0/1757649396 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:36.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.636+0000 7f41627f7640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f415c0ce680 0x7f415c0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.636+0000 7f4161ff6640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f415c0b2110 0x7f415c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f41617f5640 1 -- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f415c0ce680 msgr2=0x7f415c0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f41617f5640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f415c0ce680 0x7f415c0cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f41617f5640 1 -- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f415c0b2110 msgr2=0x7f415c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f41617f5640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f415c0b2110 0x7f415c155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f41617f5640 1 -- 172.21.15.120:0/1757649396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415c1f5ca0 con 0x7f415c0b5fe0 2024-07-27T03:14:36.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f4161ff6640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f415c0b2110 0x7f415c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-27T03:14:36.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f41617f5640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f415c0b5fe0 0x7f415c1f5210 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4150000c00 tx=0x7f4150003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:36.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f415a7fc640 1 -- 172.21.15.120:0/1757649396 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415003e030 con 0x7f415c0b5fe0 2024-07-27T03:14:36.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f415a7fc640 1 -- 172.21.15.120:0/1757649396 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4150003e00 con 0x7f415c0b5fe0 2024-07-27T03:14:36.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f416425a640 1 -- 172.21.15.120:0/1757649396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f415c1f5f80 con 0x7f415c0b5fe0 2024-07-27T03:14:36.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f415a7fc640 1 -- 172.21.15.120:0/1757649396 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150035040 con 0x7f415c0b5fe0 2024-07-27T03:14:36.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.637+0000 7f416425a640 1 -- 172.21.15.120:0/1757649396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f415c06dd10 con 0x7f415c0b5fe0 2024-07-27T03:14:36.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.638+0000 7f416425a640 1 -- 172.21.15.120:0/1757649396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f415c15fb50 con 0x7f415c0b5fe0 2024-07-27T03:14:36.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.639+0000 7f415a7fc640 1 -- 172.21.15.120:0/1757649396 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4150041030 con 0x7f415c0b5fe0 2024-07-27T03:14:36.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.639+0000 7f415a7fc640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4148077040 0x7f4148079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:36.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.639+0000 7f415a7fc640 1 -- 172.21.15.120:0/1757649396 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f41500b8cf0 con 0x7f415c0b5fe0 2024-07-27T03:14:36.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.639+0000 7f4161ff6640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4148077040 0x7f4148079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:36.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.640+0000 7f4161ff6640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4148077040 0x7f4148079550 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f414c006fd0 tx=0x7f414c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:36.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.644+0000 7f415a7fc640 1 -- 172.21.15.120:0/1757649396 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f41500bd070 con 0x7f415c0b5fe0 2024-07-27T03:14:36.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.824+0000 7f416425a640 1 -- 172.21.15.120:0/1757649396 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f415c0713d0 con 0x7f4148077040 2024-07-27T03:14:36.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.825+0000 7f415a7fc640 1 -- 172.21.15.120:0/1757649396 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13403 (secure 0 0 0) 0x7f415c0713d0 con 0x7f4148077040 2024-07-27T03:14:36.828 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:36.829 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:14:36.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 -- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4148077040 msgr2=0x7f4148079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4148077040 0x7f4148079550 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f414c006fd0 tx=0x7f414c008040 comp rx=0 tx=0).stop 2024-07-27T03:14:36.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 -- 172.21.15.120:0/1757649396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f415c0b5fe0 msgr2=0x7f415c1f5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:36.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f415c0b5fe0 0x7f415c1f5210 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4150000c00 tx=0x7f4150003910 comp rx=0 tx=0).stop 2024-07-27T03:14:36.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 -- 172.21.15.120:0/1757649396 shutdown_connections 2024-07-27T03:14:36.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f4148077040 0x7f4148079550 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f415c0b5fe0 0x7f415c1f5210 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f415c0ce680 0x7f415c0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 --2- 172.21.15.120:0/1757649396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f415c0b2110 0x7f415c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:36.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 -- 172.21.15.120:0/1757649396 >> 172.21.15.120:0/1757649396 conn(0x7f415c0b3920 msgr2=0x7f415c155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:36.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 -- 172.21.15.120:0/1757649396 shutdown_connections 2024-07-27T03:14:36.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:36.827+0000 7f416425a640 1 -- 172.21.15.120:0/1757649396 wait complete. 2024-07-27T03:14:36.841 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-07-27T03:14:36.626754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":425588,"kb_used_data":8200,"kb_used_omap":12,"kb_used_meta":417267,"kb_avail":754549132,"statfs":{"total":773094113280,"available":772658311168,"internally_reserved":0,"allocated":8396800,"data_stored":4233104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":427281968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.308128"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":207,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-07-27T03:14:30.102765+0000","last_change":"2024-07-27T03:08:30.549134+0000","last_active":"2024-07-27T03:14:30.102765+0000","last_peered":"2024-07-27T03:14:30.102765+0000","last_clean":"2024-07-27T03:14:30.102765+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:14:30.102765+0000","last_undegraded":"2024-07-27T03:14:30.102765+0000","last_fullsized":"2024-07-27T03:14:30.102765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-27T03:08:28.868265+0000","last_clean_scrub_stamp":"2024-07-27T03:08:28.868265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:10:08.518192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77056,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294784,"statfs":{"total":96636764160,"available":96557858816,"internally_reserved":0,"allocated":1495040,"data_stored":971914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50108,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321732,"statfs":{"total":96636764160,"available":96585453568,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50108,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321732,"statfs":{"total":96636764160,"available":96585453568,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331456,"statfs":{"total":96636764160,"available":96595410944,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54848,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316992,"statfs":{"total":96636764160,"available":96580599808,"internally_reserved":0,"allocated":1495040,"data_stored":971914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542221,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36220,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76480,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94295360,"statfs":{"total":96636764160,"available":96558448640,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331456,"statfs":{"total":96636764160,"available":96595410944,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:14:36.845 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-07-27T03:08:28.868265+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=27, tm_hour=3, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=209, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=27, tm_hour=3, tm_min=14, tm_sec=31, tm_wday=5, tm_yday=209, tm_isdst=0) 2024-07-27T03:14:36.845 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-07-27T03:14:41.632 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:14:41.635 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:14:56.846 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-27T03:14:56.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.971+0000 7fba70eeb640 1 -- 172.21.15.120:0/930583925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba6c0b3f90 msgr2=0x7fba6c1554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:56.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.971+0000 7fba70eeb640 1 --2- 172.21.15.120:0/930583925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba6c0b3f90 0x7fba6c1554a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fba64005fd0 tx=0x7fba6402a820 comp rx=0 tx=0).stop 2024-07-27T03:14:56.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.971+0000 7fba70eeb640 1 -- 172.21.15.120:0/930583925 shutdown_connections 2024-07-27T03:14:56.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.971+0000 7fba70eeb640 1 --2- 172.21.15.120:0/930583925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba6c0b3f90 0x7fba6c1554a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:56.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.971+0000 7fba70eeb640 1 -- 172.21.15.120:0/930583925 >> 172.21.15.120:0/930583925 conn(0x7fba6c0b1a10 msgr2=0x7fba6c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:56.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.971+0000 7fba70eeb640 1 -- 172.21.15.120:0/930583925 shutdown_connections 2024-07-27T03:14:56.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.971+0000 7fba70eeb640 1 -- 172.21.15.120:0/930583925 wait complete. 2024-07-27T03:14:56.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.973+0000 7fba70eeb640 1 Processor -- start 2024-07-27T03:14:56.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.973+0000 7fba70eeb640 1 -- start start 2024-07-27T03:14:56.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.974+0000 7fba70eeb640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba6c06e270 0x7fba6c1454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:56.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.974+0000 7fba70eeb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba6c073e20 0x7fba6c142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:56.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.974+0000 7fba70eeb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba6c0b3f90 0x7fba6c1f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:56.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.974+0000 7fba70eeb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c15f3d0 con 0x7fba6c073e20 2024-07-27T03:14:56.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.974+0000 7fba70eeb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c15f250 con 0x7fba6c0b3f90 2024-07-27T03:14:56.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.974+0000 7fba70eeb640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fba6c15f550 con 0x7fba6c06e270 2024-07-27T03:14:56.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.974+0000 7fba69d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba6c073e20 0x7fba6c142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:56.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.974+0000 7fba69d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba6c073e20 0x7fba6c142000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35202/0 (socket says 172.21.15.120:35202) 2024-07-27T03:14:56.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.974+0000 7fba69d9b640 1 -- 172.21.15.120:0/4177954583 learned_addr learned my addr 172.21.15.120:0/4177954583 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:56.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba6ad9d640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba6c0b3f90 0x7fba6c1f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:56.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba6a59c640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba6c06e270 0x7fba6c1454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:56.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba69d9b640 1 -- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba6c06e270 msgr2=0x7fba6c1454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:56.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba69d9b640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba6c06e270 0x7fba6c1454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:56.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba69d9b640 1 -- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba6c0b3f90 msgr2=0x7fba6c1f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:56.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba69d9b640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba6c0b3f90 0x7fba6c1f5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:56.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba69d9b640 1 -- 172.21.15.120:0/4177954583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c145a00 con 0x7fba6c073e20 2024-07-27T03:14:56.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba69d9b640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba6c073e20 0x7fba6c142000 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fba6000e690 tx=0x7fba6000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:56.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba5affd640 1 -- 172.21.15.120:0/4177954583 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba60015070 con 0x7fba6c073e20 2024-07-27T03:14:56.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba5affd640 1 -- 172.21.15.120:0/4177954583 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba60005360 con 0x7fba6c073e20 2024-07-27T03:14:56.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba70eeb640 1 -- 172.21.15.120:0/4177954583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6c155eb0 con 0x7fba6c073e20 2024-07-27T03:14:56.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba5affd640 1 -- 172.21.15.120:0/4177954583 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6000cab0 con 0x7fba6c073e20 2024-07-27T03:14:56.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.975+0000 7fba70eeb640 1 -- 172.21.15.120:0/4177954583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6c09ba80 con 0x7fba6c073e20 2024-07-27T03:14:56.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.976+0000 7fba70eeb640 1 -- 172.21.15.120:0/4177954583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6c1554a0 con 0x7fba6c073e20 2024-07-27T03:14:56.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.977+0000 7fba5affd640 1 -- 172.21.15.120:0/4177954583 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fba60018070 con 0x7fba6c073e20 2024-07-27T03:14:56.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.977+0000 7fba5affd640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fba4c077010 0x7fba4c079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:56.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.977+0000 7fba5affd640 1 -- 172.21.15.120:0/4177954583 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fba6009ac20 con 0x7fba6c073e20 2024-07-27T03:14:56.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.977+0000 7fba6a59c640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fba4c077010 0x7fba4c079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:56.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.978+0000 7fba6a59c640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fba4c077010 0x7fba4c079520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00a730 tx=0x7fba5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:56.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:56.982+0000 7fba5affd640 1 -- 172.21.15.120:0/4177954583 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fba6c145a00 con 0x7fba6c073e20 2024-07-27T03:14:57.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.161+0000 7fba70eeb640 1 -- 172.21.15.120:0/4177954583 --> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba6c0b22e0 con 0x7fba4c077010 2024-07-27T03:14:57.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.162+0000 7fba5affd640 1 -- 172.21.15.120:0/4177954583 <== mgr.4100 v2:172.21.15.121:6832/1255903814 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13344 (secure 0 0 0) 0x7fba6c0b22e0 con 0x7fba4c077010 2024-07-27T03:14:57.166 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:57.166 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-07-27T03:14:57.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 -- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fba4c077010 msgr2=0x7fba4c079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fba4c077010 0x7fba4c079520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00a730 tx=0x7fba5c008040 comp rx=0 tx=0).stop 2024-07-27T03:14:57.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 -- 172.21.15.120:0/4177954583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba6c073e20 msgr2=0x7fba6c142000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba6c073e20 0x7fba6c142000 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fba6000e690 tx=0x7fba6000eb50 comp rx=0 tx=0).stop 2024-07-27T03:14:57.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 -- 172.21.15.120:0/4177954583 shutdown_connections 2024-07-27T03:14:57.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fba4c077010 0x7fba4c079520 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba6c073e20 0x7fba6c142000 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba6c0b3f90 0x7fba6c1f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 --2- 172.21.15.120:0/4177954583 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fba6c06e270 0x7fba6c1454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 -- 172.21.15.120:0/4177954583 >> 172.21.15.120:0/4177954583 conn(0x7fba6c0b1a10 msgr2=0x7fba6c0b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:57.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 -- 172.21.15.120:0/4177954583 shutdown_connections 2024-07-27T03:14:57.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.164+0000 7fba70eeb640 1 -- 172.21.15.120:0/4177954583 wait complete. 2024-07-27T03:14:57.179 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-07-27T03:14:56.631755+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":425580,"kb_used_data":8200,"kb_used_omap":12,"kb_used_meta":417267,"kb_avail":754549140,"statfs":{"total":773094113280,"available":772658319360,"internally_reserved":0,"allocated":8396800,"data_stored":4233104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":427281968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003008"},"pg_stats":[{"pgid":"1.0","version":"74'74","reported_seq":218,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-07-27T03:14:36.658913+0000","last_change":"2024-07-27T03:14:36.658985+0000","last_active":"2024-07-27T03:14:36.658913+0000","last_peered":"2024-07-27T03:14:36.658913+0000","last_clean":"2024-07-27T03:14:36.658913+0000","last_became_active":"2024-07-27T03:08:30.546129+0000","last_became_peered":"2024-07-27T03:08:30.546129+0000","last_unstale":"2024-07-27T03:14:36.658913+0000","last_undegraded":"2024-07-27T03:14:36.658913+0000","last_fullsized":"2024-07-27T03:14:36.658913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'74","last_scrub_stamp":"2024-07-27T03:14:36.658765+0000","last_deep_scrub":"74'74","last_deep_scrub_stamp":"2024-07-27T03:14:36.658765+0000","last_clean_scrub_stamp":"2024-07-27T03:14:36.658765+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-28T12:35:51.791413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509520,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77052,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94294788,"statfs":{"total":96636764160,"available":96557862912,"internally_reserved":0,"allocated":1495040,"data_stored":971914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":77396426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509521,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50108,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321732,"statfs":{"total":96636764160,"available":96585453568,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50108,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321732,"statfs":{"total":96636764160,"available":96585453568,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509521,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331456,"statfs":{"total":96636764160,"available":96595410944,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54844,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316996,"statfs":{"total":96636764160,"available":96580603904,"internally_reserved":0,"allocated":1495040,"data_stored":971914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542225,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36220,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542225,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76480,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94295360,"statfs":{"total":96636764160,"available":96558448640,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542224,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40384,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331456,"statfs":{"total":96636764160,"available":96595410944,"internally_reserved":0,"allocated":901120,"data_stored":381546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-27T03:14:57.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-07-27T03:14:57.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.290+0000 7fbcb7405640 1 -- 172.21.15.120:0/347136330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbcb006e270 msgr2=0x7fbcb0073af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.290+0000 7fbcb7405640 1 --2- 172.21.15.120:0/347136330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbcb006e270 0x7fbcb0073af0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fbcb015c650 tx=0x7fbca402a980 comp rx=0 tx=0).stop 2024-07-27T03:14:57.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.290+0000 7fbcb7405640 1 -- 172.21.15.120:0/347136330 shutdown_connections 2024-07-27T03:14:57.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.290+0000 7fbcb7405640 1 --2- 172.21.15.120:0/347136330 >> v2:172.21.15.121:3300/0 conn(0x7fbcb015ec10 0x7fbcb015f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.290+0000 7fbcb7405640 1 --2- 172.21.15.120:0/347136330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbcb006e270 0x7fbcb0073af0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.290+0000 7fbcb7405640 1 -- 172.21.15.120:0/347136330 >> 172.21.15.120:0/347136330 conn(0x7fbcb00b1a10 msgr2=0x7fbcb00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:57.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.290+0000 7fbcb7405640 1 -- 172.21.15.120:0/347136330 shutdown_connections 2024-07-27T03:14:57.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.290+0000 7fbcb7405640 1 -- 172.21.15.120:0/347136330 wait complete. 2024-07-27T03:14:57.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.292+0000 7fbcb7405640 1 Processor -- start 2024-07-27T03:14:57.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.292+0000 7fbcb7405640 1 -- start start 2024-07-27T03:14:57.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb7405640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbcb006e270 0x7fbcb01f9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:57.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb7405640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb01522e0 0x7fbcb0146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:57.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb7405640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbcb015ec10 0x7fbcb0072d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:57.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb7405640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb015f8f0 con 0x7fbcb006e270 2024-07-27T03:14:57.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb7405640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb015f770 con 0x7fbcb01522e0 2024-07-27T03:14:57.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb7405640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb015fa70 con 0x7fbcb015ec10 2024-07-27T03:14:57.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb51a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbcb006e270 0x7fbcb01f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:57.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb51a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbcb006e270 0x7fbcb01f9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35216/0 (socket says 172.21.15.120:35216) 2024-07-27T03:14:57.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb51a1640 1 -- 172.21.15.120:0/1545428140 learned_addr learned my addr 172.21.15.120:0/1545428140 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:57.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb49a0640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb01522e0 0x7fbcb0146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:57.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb59a2640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbcb015ec10 0x7fbcb0072d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:57.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb51a1640 1 -- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbcb015ec10 msgr2=0x7fbcb0072d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb51a1640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbcb015ec10 0x7fbcb0072d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb51a1640 1 -- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb01522e0 msgr2=0x7fbcb0146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb51a1640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb01522e0 0x7fbcb0146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.293+0000 7fbcb51a1640 1 -- 172.21.15.120:0/1545428140 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb01f5010 con 0x7fbcb006e270 2024-07-27T03:14:57.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.294+0000 7fbcb51a1640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbcb006e270 0x7fbcb01f9060 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fbca800b420 tx=0x7fbca800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:57.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.294+0000 7fbcadffb640 1 -- 172.21.15.120:0/1545428140 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8011830 con 0x7fbcb006e270 2024-07-27T03:14:57.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.294+0000 7fbcadffb640 1 -- 172.21.15.120:0/1545428140 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbca8016070 con 0x7fbcb006e270 2024-07-27T03:14:57.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.294+0000 7fbcb7405640 1 -- 172.21.15.120:0/1545428140 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb01f52a0 con 0x7fbcb006e270 2024-07-27T03:14:57.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.294+0000 7fbcadffb640 1 -- 172.21.15.120:0/1545428140 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8011d60 con 0x7fbcb006e270 2024-07-27T03:14:57.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.294+0000 7fbcb7405640 1 -- 172.21.15.120:0/1545428140 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb01f5860 con 0x7fbcb006e270 2024-07-27T03:14:57.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.295+0000 7fbcb7405640 1 -- 172.21.15.120:0/1545428140 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb015f020 con 0x7fbcb006e270 2024-07-27T03:14:57.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.296+0000 7fbcadffb640 1 -- 172.21.15.120:0/1545428140 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fbca801b460 con 0x7fbcb006e270 2024-07-27T03:14:57.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.296+0000 7fbcadffb640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbc9c077040 0x7fbc9c079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:57.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.296+0000 7fbcadffb640 1 -- 172.21.15.120:0/1545428140 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fbca8097fa0 con 0x7fbcb006e270 2024-07-27T03:14:57.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.296+0000 7fbcb49a0640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbc9c077040 0x7fbc9c079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:57.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.297+0000 7fbcb49a0640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbc9c077040 0x7fbc9c079550 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbca4035000 tx=0x7fbca4004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:57.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.300+0000 7fbcadffb640 1 -- 172.21.15.120:0/1545428140 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7fbca8020020 con 0x7fbcb006e270 2024-07-27T03:14:57.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.482+0000 7fbcb7405640 1 -- 172.21.15.120:0/1545428140 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbcb00b21f0 con 0x7fbcb006e270 2024-07-27T03:14:57.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.485+0000 7fbcadffb640 1 -- 172.21.15.120:0/1545428140 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v39)=0 v39) ==== 123+0+0 (secure 0 0 0) 0x7fbca8060ec0 con 0x7fbcb006e270 2024-07-27T03:14:57.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.487+0000 7fbcadffb640 1 -- 172.21.15.120:0/1545428140 <== mon.0 v2:172.21.15.120:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fbca80609d0 con 0x7fbcb006e270 2024-07-27T03:14:57.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 -- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbc9c077040 msgr2=0x7fbc9c079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbc9c077040 0x7fbc9c079550 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbca4035000 tx=0x7fbca4004ab0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 -- 172.21.15.120:0/1545428140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbcb006e270 msgr2=0x7fbcb01f9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbcb006e270 0x7fbcb01f9060 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fbca800b420 tx=0x7fbca800b8e0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 -- 172.21.15.120:0/1545428140 shutdown_connections 2024-07-27T03:14:57.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7fbc9c077040 0x7fbc9c079550 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbcb015ec10 0x7fbcb0072d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb01522e0 0x7fbcb0146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 --2- 172.21.15.120:0/1545428140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbcb006e270 0x7fbcb01f9060 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 -- 172.21.15.120:0/1545428140 >> 172.21.15.120:0/1545428140 conn(0x7fbcb00b1a10 msgr2=0x7fbcb015cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:57.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 -- 172.21.15.120:0/1545428140 shutdown_connections 2024-07-27T03:14:57.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.489+0000 7fbcb7405640 1 -- 172.21.15.120:0/1545428140 wait complete. 2024-07-27T03:14:57.504 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-07-27T03:14:57.504 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-27T03:14:57.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.615+0000 7f5ef9661640 1 -- 172.21.15.120:0/3095293458 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5edc004800 msgr2=0x7f5edc004cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.615+0000 7f5ef9661640 1 --2- 172.21.15.120:0/3095293458 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5edc004800 0x7f5edc004cb0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8006f60 tx=0x7f5edc005830 comp rx=0 tx=0).stop 2024-07-27T03:14:57.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.615+0000 7f5ef9661640 1 -- 172.21.15.120:0/3095293458 shutdown_connections 2024-07-27T03:14:57.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.615+0000 7f5ef9661640 1 --2- 172.21.15.120:0/3095293458 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5edc004800 0x7f5edc004cb0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.615+0000 7f5ef9661640 1 -- 172.21.15.120:0/3095293458 >> 172.21.15.120:0/3095293458 conn(0x7f5ef406cba0 msgr2=0x7f5ef406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:57.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.615+0000 7f5ef9661640 1 -- 172.21.15.120:0/3095293458 shutdown_connections 2024-07-27T03:14:57.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.615+0000 7f5ef9661640 1 -- 172.21.15.120:0/3095293458 wait complete. 2024-07-27T03:14:57.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.617+0000 7f5ef9661640 1 Processor -- start 2024-07-27T03:14:57.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.617+0000 7f5ef9661640 1 -- start start 2024-07-27T03:14:57.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef9661640 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5edc004800 0x7f5ef4156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:57.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef9661640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ef41f5e50 0x7f5ef41579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:57.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef9661640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ef4157ee0 0x7f5ef4159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:57.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef9661640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4153410 con 0x7f5ef4157ee0 2024-07-27T03:14:57.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef9661640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4073260 con 0x7f5ef41f5e50 2024-07-27T03:14:57.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef9661640 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef4153590 con 0x7f5edc004800 2024-07-27T03:14:57.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ef4157ee0 0x7f5ef4159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:57.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ef4157ee0 0x7f5ef4159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35224/0 (socket says 172.21.15.120:35224) 2024-07-27T03:14:57.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef37fe640 1 -- 172.21.15.120:0/1866699253 learned_addr learned my addr 172.21.15.120:0/1866699253 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-07-27T03:14:57.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef2ffd640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5edc004800 0x7f5ef4156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:57.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef27fc640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ef41f5e50 0x7f5ef41579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:57.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef37fe640 1 -- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5edc004800 msgr2=0x7f5ef4156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef37fe640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5edc004800 0x7f5ef4156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef37fe640 1 -- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ef41f5e50 msgr2=0x7f5ef41579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef37fe640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ef41f5e50 0x7f5ef41579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef37fe640 1 -- 172.21.15.120:0/1866699253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef41582f0 con 0x7f5ef4157ee0 2024-07-27T03:14:57.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef37fe640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ef4157ee0 0x7f5ef4159f30 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40c64f0 tx=0x7f5eec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:57.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5edb7fe640 1 -- 172.21.15.120:0/1866699253 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec003b70 con 0x7f5ef4157ee0 2024-07-27T03:14:57.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5edb7fe640 1 -- 172.21.15.120:0/1866699253 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f5eec003d10 con 0x7f5ef4157ee0 2024-07-27T03:14:57.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5edb7fe640 1 -- 172.21.15.120:0/1866699253 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec00ba60 con 0x7f5ef4157ee0 2024-07-27T03:14:57.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.619+0000 7f5ef9661640 1 -- 172.21.15.120:0/1866699253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef41f3f20 con 0x7f5ef4157ee0 2024-07-27T03:14:57.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.620+0000 7f5ef9661640 1 -- 172.21.15.120:0/1866699253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef41f3680 con 0x7f5ef4157ee0 2024-07-27T03:14:57.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.621+0000 7f5ef9661640 1 -- 172.21.15.120:0/1866699253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef41f33f0 con 0x7f5ef4157ee0 2024-07-27T03:14:57.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.621+0000 7f5edb7fe640 1 -- 172.21.15.120:0/1866699253 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5eec00bc00 con 0x7f5ef4157ee0 2024-07-27T03:14:57.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.622+0000 7f5edb7fe640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5ee0077010 0x7f5ee0079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-27T03:14:57.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.622+0000 7f5edb7fe640 1 -- 172.21.15.120:0/1866699253 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f5eec098900 con 0x7f5ef4157ee0 2024-07-27T03:14:57.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.622+0000 7f5ef2ffd640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5ee0077010 0x7f5ee0079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-27T03:14:57.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.622+0000 7f5ef2ffd640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5ee0077010 0x7f5ee0079520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009c30 tx=0x7f5ee4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-27T03:14:57.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.626+0000 7f5edb7fe640 1 -- 172.21.15.120:0/1866699253 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192900 (secure 0 0 0) 0x7f5ef41582f0 con 0x7f5ef4157ee0 2024-07-27T03:14:57.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.844+0000 7f5ef9661640 1 -- 172.21.15.120:0/1866699253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ef406a610 con 0x7f5ef4157ee0 2024-07-27T03:14:57.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.845+0000 7f5edb7fe640 1 -- 172.21.15.120:0/1866699253 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+3923 (secure 0 0 0) 0x7f5ef406a610 con 0x7f5ef4157ee0 2024-07-27T03:14:57.849 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-07-27T03:14:57.849 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":75,"btime":"2024-07-27T03:14:26:307375+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/2578460445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":2578460445},{"type":"v1","addr":"172.21.15.120:6835","nonce":2578460445}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":5660,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1588077784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1588077784},{"type":"v1","addr":"172.21.15.121:6837","nonce":1588077784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":6040,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1121069387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1121069387},{"type":"v1","addr":"172.21.15.121:6835","nonce":1121069387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":6450,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6833/1587970757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1587970757},{"type":"v1","addr":"172.21.15.120:6833","nonce":1587970757}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[]} 2024-07-27T03:14:57.849 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 75 2024-07-27T03:14:57.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 -- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5ee0077010 msgr2=0x7f5ee0079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5ee0077010 0x7f5ee0079520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009c30 tx=0x7f5ee4005f90 comp rx=0 tx=0).stop 2024-07-27T03:14:57.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 -- 172.21.15.120:0/1866699253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ef4157ee0 msgr2=0x7f5ef4159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-27T03:14:57.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ef4157ee0 0x7f5ef4159f30 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40c64f0 tx=0x7f5eec00dcc0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 -- 172.21.15.120:0/1866699253 shutdown_connections 2024-07-27T03:14:57.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:6832/1255903814,v1:172.21.15.121:6833/1255903814] conn(0x7f5ee0077010 0x7f5ee0079520 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ef4157ee0 0x7f5ef4159f30 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ef41f5e50 0x7f5ef41579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 --2- 172.21.15.120:0/1866699253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5edc004800 0x7f5ef4156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-27T03:14:57.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 -- 172.21.15.120:0/1866699253 >> 172.21.15.120:0/1866699253 conn(0x7f5ef406cba0 msgr2=0x7f5ef40c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-27T03:14:57.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 -- 172.21.15.120:0/1866699253 shutdown_connections 2024-07-27T03:14:57.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-07-27T03:14:57.847+0000 7f5ef9661640 1 -- 172.21.15.120:0/1866699253 wait complete. 2024-07-27T03:14:57.862 DEBUG:tasks.cephfs.filesystem:already dead... 2024-07-27T03:14:57.863 INFO:teuthology.misc:Shutting down mds daemons... 2024-07-27T03:14:57.863 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-07-27T03:14:57.863 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:57.872 INFO:tasks.ceph.mds.a:Stopped 2024-07-27T03:14:57.872 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-07-27T03:14:57.873 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:57.925 INFO:tasks.ceph.mds.c:Stopped 2024-07-27T03:14:57.925 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-07-27T03:14:57.925 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:57.939 INFO:tasks.ceph.mds.b:Stopped 2024-07-27T03:14:57.939 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-07-27T03:14:57.939 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:57.994 INFO:tasks.ceph.mds.d:Stopped 2024-07-27T03:14:57.994 INFO:teuthology.misc:Shutting down osd daemons... 2024-07-27T03:14:57.994 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-07-27T03:14:57.994 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.025 INFO:tasks.ceph.osd.0:Stopped 2024-07-27T03:14:58.025 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-07-27T03:14:58.025 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.093 INFO:tasks.ceph.osd.1:Stopped 2024-07-27T03:14:58.093 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-07-27T03:14:58.094 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.159 INFO:tasks.ceph.osd.2:Stopped 2024-07-27T03:14:58.160 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-07-27T03:14:58.160 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.227 INFO:tasks.ceph.osd.3:Stopped 2024-07-27T03:14:58.228 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-07-27T03:14:58.228 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.270 INFO:tasks.ceph.osd.4:Stopped 2024-07-27T03:14:58.271 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-07-27T03:14:58.271 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.323 INFO:tasks.ceph.osd.5:Stopped 2024-07-27T03:14:58.324 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-07-27T03:14:58.324 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.371 INFO:tasks.ceph.osd.6:Stopped 2024-07-27T03:14:58.371 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-07-27T03:14:58.371 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.413 INFO:tasks.ceph.osd.7:Stopped 2024-07-27T03:14:58.414 INFO:teuthology.misc:Shutting down mgr daemons... 2024-07-27T03:14:58.414 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-07-27T03:14:58.414 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.441 INFO:tasks.ceph.mgr.y:Stopped 2024-07-27T03:14:58.441 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-07-27T03:14:58.442 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.472 INFO:tasks.ceph.mgr.x:Stopped 2024-07-27T03:14:58.472 INFO:teuthology.misc:Shutting down mon daemons... 2024-07-27T03:14:58.472 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-07-27T03:14:58.472 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.494 INFO:tasks.ceph.mon.a:Stopped 2024-07-27T03:14:58.494 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-07-27T03:14:58.494 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.526 INFO:tasks.ceph.mon.b:Stopped 2024-07-27T03:14:58.526 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-07-27T03:14:58.526 INFO:teuthology.orchestra.run:waiting for 300 2024-07-27T03:14:58.580 INFO:tasks.ceph.mon.c:Stopped 2024-07-27T03:14:58.580 INFO:tasks.ceph:Checking cluster log for badness... 2024-07-27T03:14:58.581 DEBUG:teuthology.orchestra.run.smithi120:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | head -n 1 2024-07-27T03:14:58.613 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:14:58.614 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-07-27T03:14:58.799 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:14:58.800 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-07-27T03:14:58.869 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:14:58.870 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-07-27T03:14:58.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:14:58.920 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-07-27T03:14:58.970 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:14:58.971 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-07-27T03:14:59.160 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:14:59.161 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-07-27T03:14:59.222 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:14:59.223 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-07-27T03:14:59.278 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:14:59.278 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-07-27T03:14:59.330 INFO:tasks.ceph:Archiving mon data... 2024-07-27T03:14:59.331 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981/data/mon.a.tgz 2024-07-27T03:14:59.332 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-07-27T03:14:59.348 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.CWHs0TeYuf 2024-07-27T03:14:59.348 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.CWHs0TeYuf 2024-07-27T03:14:59.517 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.CWHs0TeYuf 2024-07-27T03:14:59.600 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.CWHs0TeYuf is 461KB 2024-07-27T03:14:59.697 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.CWHs0TeYuf 2024-07-27T03:14:59.713 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981/data/mon.b.tgz 2024-07-27T03:14:59.713 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-07-27T03:14:59.731 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.vMVrbzkVWp 2024-07-27T03:14:59.732 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vMVrbzkVWp 2024-07-27T03:14:59.952 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.vMVrbzkVWp 2024-07-27T03:15:00.035 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.vMVrbzkVWp is 599KB 2024-07-27T03:15:00.139 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.vMVrbzkVWp 2024-07-27T03:15:00.154 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981/data/mon.c.tgz 2024-07-27T03:15:00.154 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-07-27T03:15:00.208 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.iUh9fTk6DY 2024-07-27T03:15:00.209 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.iUh9fTk6DY 2024-07-27T03:15:00.386 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.iUh9fTk6DY 2024-07-27T03:15:00.469 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.iUh9fTk6DY is 599KB 2024-07-27T03:15:00.569 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.iUh9fTk6DY 2024-07-27T03:15:00.584 INFO:tasks.ceph:Cleaning ceph cluster... 2024-07-27T03:15:00.584 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-07-27T03:15:00.587 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-07-27T03:15:00.668 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-07-27T03:15:00.703 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-07-27T03:15:00.703 INFO:tasks.ceph:Archiving crash dumps... 2024-07-27T03:15:00.706 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981/remote/smithi120/crash 2024-07-27T03:15:00.707 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-07-27T03:15:00.735 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981/remote/smithi121/crash 2024-07-27T03:15:00.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-07-27T03:15:00.767 INFO:tasks.ceph:Shutting down logrotate 2024-07-27T03:15:00.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:15:00.779 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-27T03:15:00.858 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-07-27T03:15:00.884 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-07-27T03:15:00.908 INFO:tasks.ceph:Compressing logs... 2024-07-27T03:15:00.909 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-07-27T03:15:00.927 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-07-27T03:15:00.951 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62000.log 2024-07-27T03:15:00.951 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2024-07-27T03:15:00.951 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54815.log 2024-07-27T03:15:00.951 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45544.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62000.log.gz 2024-07-27T03:15:00.952 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54857.log 2024-07-27T03:15:00.952 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2024-07-27T03:15:00.952 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44969.log 2024-07-27T03:15:00.952 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54857.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54815.log.gz 2024-07-27T03:15:00.952 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45306.log 2024-07-27T03:15:00.952 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54857.log.gz 2024-07-27T03:15:00.952 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53220.log 2024-07-27T03:15:00.952 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44969.log.gz 2024-07-27T03:15:00.952 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52257.log 2024-07-27T03:15:00.987 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38196.log 2024-07-27T03:15:00.987 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-07-27T03:15:00.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.38196.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-07-27T03:15:00.988 INFO:teuthology.orchestra.run.smithi121.stderr: 86.7%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.38196.log.gz 2024-07-27T03:15:00.988 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-07-27T03:15:00.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-07-27T03:15:00.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-07-27T03:15:00.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44284.log 2024-07-27T03:15:00.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-07-27T03:15:00.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.3.44284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43886.log 2024-07-27T03:15:00.989 INFO:teuthology.orchestra.run.smithi121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44284.log.gz 2024-07-27T03:15:00.989 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38076.log 2024-07-27T03:15:00.989 INFO:teuthology.orchestra.run.smithi121.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-07-27T03:15:00.989 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.1.43886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38277.log 2024-07-27T03:15:00.989 INFO:teuthology.orchestra.run.smithi121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43886.log.gz 2024-07-27T03:15:00.989 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.38076.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-07-27T03:15:00.989 INFO:teuthology.orchestra.run.smithi121.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-07-27T03:15:00.989 INFO:teuthology.orchestra.run.smithi121.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38076.log.gz 2024-07-27T03:15:00.990 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.38277.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-07-27T03:15:00.990 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38277.log.gz 2024-07-27T03:15:00.990 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38317.log 2024-07-27T03:15:00.990 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-07-27T03:15:00.990 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.38317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38237.log 2024-07-27T03:15:00.990 INFO:teuthology.orchestra.run.smithi121.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.38317.log.gz 2024-07-27T03:15:01.005 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38156.log 2024-07-27T03:15:01.006 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.38237.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38237.log.gz 2024-07-27T03:15:01.017 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38357.log 2024-07-27T03:15:01.017 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.38156.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38156.log.gz 2024-07-27T03:15:01.030 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38116.log 2024-07-27T03:15:01.030 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.38357.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38357.log.gz 2024-07-27T03:15:01.036 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-07-27T03:15:01.036 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.38116.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38116.log.gz 2024-07-27T03:15:01.036 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-07-27T03:15:01.075 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-07-27T03:15:01.114 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45306.log.gz 2024-07-27T03:15:01.114 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59589.log 2024-07-27T03:15:01.114 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53220.log.gz 2024-07-27T03:15:01.114 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.52257.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48697.log 2024-07-27T03:15:01.114 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59589.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52257.log.gz 2024-07-27T03:15:01.115 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50656.log 2024-07-27T03:15:01.115 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54692.log 2024-07-27T03:15:01.115 INFO:teuthology.orchestra.run.smithi120.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59589.log.gz 2024-07-27T03:15:01.115 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48697.log.gz 2024-07-27T03:15:01.115 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61376.log 2024-07-27T03:15:01.115 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50656.log.gz 2024-07-27T03:15:01.115 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44392.log 2024-07-27T03:15:01.115 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54692.log.gz 2024-07-27T03:15:01.116 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38235.log 2024-07-27T03:15:01.116 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61376.log.gz 2024-07-27T03:15:01.116 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61292.log 2024-07-27T03:15:01.116 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44392.log.gz 2024-07-27T03:15:01.116 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49501.log 2024-07-27T03:15:01.116 INFO:teuthology.orchestra.run.smithi120.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38235.log.gz 2024-07-27T03:15:01.116 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45754.log 2024-07-27T03:15:01.116 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61292.log.gz 2024-07-27T03:15:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.49501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39027.log 2024-07-27T03:15:01.117 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49501.log.gz 2024-07-27T03:15:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54265.log 2024-07-27T03:15:01.117 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45754.log.gz 2024-07-27T03:15:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54307.log 2024-07-27T03:15:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.39027.log: /var/log/ceph/ceph-client.admin.54265.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.39027.log.gz 2024-07-27T03:15:01.117 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62042.log 2024-07-27T03:15:01.117 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54265.log.gz 2024-07-27T03:15:01.118 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51800.log 2024-07-27T03:15:01.118 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54307.log.gz 2024-07-27T03:15:01.118 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53088.log 2024-07-27T03:15:01.118 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62042.log.gz 2024-07-27T03:15:01.118 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61832.log 2024-07-27T03:15:01.118 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51800.log.gz 2024-07-27T03:15:01.118 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46857.log 2024-07-27T03:15:01.118 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58997.log 2024-07-27T03:15:01.119 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61832.log.gz 2024-07-27T03:15:01.119 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46857.log: 91.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.53088.log.gz 2024-07-27T03:15:01.119 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47717.log 2024-07-27T03:15:01.119 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46857.log.gz 2024-07-27T03:15:01.119 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47801.log 2024-07-27T03:15:01.119 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58997.log.gz 2024-07-27T03:15:01.119 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53154.log 2024-07-27T03:15:01.119 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47717.log.gz 2024-07-27T03:15:01.120 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52617.log 2024-07-27T03:15:01.120 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47801.log.gz 2024-07-27T03:15:01.120 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45300.log 2024-07-27T03:15:01.120 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58114.log 2024-07-27T03:15:01.120 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52617.log.gz 2024-07-27T03:15:01.120 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45300.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53154.log.gz 2024-07-27T03:15:01.120 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50750.log 2024-07-27T03:15:01.120 INFO:teuthology.orchestra.run.smithi120.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45300.log.gz 2024-07-27T03:15:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60144.log 2024-07-27T03:15:01.121 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58114.log.gz 2024-07-27T03:15:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47759.log 2024-07-27T03:15:01.121 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50750.log.gz 2024-07-27T03:15:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.60144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62126.log 2024-07-27T03:15:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53695.log 2024-07-27T03:15:01.121 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.60144.log.gz 2024-07-27T03:15:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62126.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47759.log.gz 2024-07-27T03:15:01.122 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58572.log 2024-07-27T03:15:01.122 INFO:teuthology.orchestra.run.smithi120.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.62126.log.gz 2024-07-27T03:15:01.122 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50918.log 2024-07-27T03:15:01.122 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58572.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53695.log.gz 2024-07-27T03:15:01.122 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55039.log 2024-07-27T03:15:01.122 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58572.log.gz 2024-07-27T03:15:01.122 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43989.log 2024-07-27T03:15:01.123 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50918.log.gz 2024-07-27T03:15:01.123 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62336.log 2024-07-27T03:15:01.123 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55039.log.gz 2024-07-27T03:15:01.123 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51556.log 2024-07-27T03:15:01.123 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43989.log.gz 2024-07-27T03:15:01.123 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55463.log 2024-07-27T03:15:01.123 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62336.log.gz 2024-07-27T03:15:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56300.log 2024-07-27T03:15:01.124 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51556.log.gz 2024-07-27T03:15:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44662.log 2024-07-27T03:15:01.124 INFO:teuthology.orchestra.run.smithi120.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.55463.log.gz 2024-07-27T03:15:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38475.log 2024-07-27T03:15:01.124 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56300.log.gz 2024-07-27T03:15:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48827.log 2024-07-27T03:15:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38475.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44662.log.gz 2024-07-27T03:15:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-07-27T03:15:01.125 INFO:teuthology.orchestra.run.smithi120.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.38475.log.gz 2024-07-27T03:15:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53390.log 2024-07-27T03:15:01.125 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48827.log.gz 2024-07-27T03:15:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49676.log 2024-07-27T03:15:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45670.log 2024-07-27T03:15:01.125 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53390.log.gz 2024-07-27T03:15:01.125 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54163.log 2024-07-27T03:15:01.126 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49676.log.gz 2024-07-27T03:15:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58488.log 2024-07-27T03:15:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54163.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45670.log.gz 2024-07-27T03:15:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46899.log 2024-07-27T03:15:01.126 INFO:teuthology.orchestra.run.smithi120.stderr: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-07-27T03:15:01.126 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54163.log.gz 2024-07-27T03:15:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49580.log 2024-07-27T03:15:01.126 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58488.log.gz 2024-07-27T03:15:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44960.log 2024-07-27T03:15:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49580.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46899.log.gz 2024-07-27T03:15:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44308.log 2024-07-27T03:15:01.127 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49580.log.gz 2024-07-27T03:15:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62420.log 2024-07-27T03:15:01.127 INFO:teuthology.orchestra.run.smithi120.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44960.log.gz 2024-07-27T03:15:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43873.log 2024-07-27T03:15:01.127 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44308.log.gz 2024-07-27T03:15:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61147.log 2024-07-27T03:15:01.128 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62420.log.gz 2024-07-27T03:15:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55589.log 2024-07-27T03:15:01.128 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43873.log.gz 2024-07-27T03:15:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37939.log 2024-07-27T03:15:01.128 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61147.log.gz 2024-07-27T03:15:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59463.log 2024-07-27T03:15:01.129 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.37939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48233.log 2024-07-27T03:15:01.129 INFO:teuthology.orchestra.run.smithi120.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.37939.log.gz 2024-07-27T03:15:01.129 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55589.log.gz 2024-07-27T03:15:01.129 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59463.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-07-27T03:15:01.129 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59463.log.gz 2024-07-27T03:15:01.129 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47304.log 2024-07-27T03:15:01.129 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.2.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48233.log.gz 2024-07-27T03:15:01.129 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47885.log 2024-07-27T03:15:01.130 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48995.log 2024-07-27T03:15:01.130 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47304.log.gz 2024-07-27T03:15:01.130 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.47885.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56126.log 2024-07-27T03:15:01.130 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47885.log.gz 2024-07-27T03:15:01.130 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45303.log 2024-07-27T03:15:01.130 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48995.log: /var/log/ceph/ceph-client.admin.56126.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.59253.log -- replaced with /var/log/ceph/ceph-client.admin.48995.log.gz 2024-07-27T03:15:01.130 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.130 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49205.log 2024-07-27T03:15:01.131 INFO:teuthology.orchestra.run.smithi120.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56126.log.gz 2024-07-27T03:15:01.131 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45303.log.gz 2024-07-27T03:15:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61916.log 2024-07-27T03:15:01.131 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59253.log.gz 2024-07-27T03:15:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47675.log 2024-07-27T03:15:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49205.log: /var/log/ceph/ceph-client.admin.61916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59547.log 2024-07-27T03:15:01.131 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49205.log.gz 2024-07-27T03:15:01.131 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61916.log.gz 2024-07-27T03:15:01.132 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55337.log 2024-07-27T03:15:01.132 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47675.log.gz 2024-07-27T03:15:01.132 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45502.log 2024-07-27T03:15:01.132 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59547.log.gz 2024-07-27T03:15:01.132 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46723.log 2024-07-27T03:15:01.132 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55337.log.gz 2024-07-27T03:15:01.132 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51636.log 2024-07-27T03:15:01.132 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45502.log.gz 2024-07-27T03:15:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.2.46723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58873.log 2024-07-27T03:15:01.133 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46723.log.gz 2024-07-27T03:15:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49958.log 2024-07-27T03:15:01.133 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51636.log.gz 2024-07-27T03:15:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51461.log 2024-07-27T03:15:01.133 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58873.log.gz 2024-07-27T03:15:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44746.log 2024-07-27T03:15:01.133 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49958.log.gz 2024-07-27T03:15:01.133 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51461.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-07-27T03:15:01.134 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51461.log.gz 2024-07-27T03:15:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.44746.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52299.log 2024-07-27T03:15:01.134 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44746.log.gz 2024-07-27T03:15:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55964.log 2024-07-27T03:15:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59991.log 2024-07-27T03:15:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55964.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52299.log.gz 2024-07-27T03:15:01.134 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57894.log 2024-07-27T03:15:01.134 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55964.log.gz 2024-07-27T03:15:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38722.log 2024-07-27T03:15:01.135 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59991.log.gz 2024-07-27T03:15:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44959.log 2024-07-27T03:15:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.57894.log: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-07-27T03:15:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44350.log 2024-07-27T03:15:01.135 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57894.log.gz 2024-07-27T03:15:01.135 INFO:teuthology.orchestra.run.smithi120.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.38722.log.gz 2024-07-27T03:15:01.135 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59295.log 2024-07-27T03:15:01.136 INFO:teuthology.orchestra.run.smithi120.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.44959.log.gz 2024-07-27T03:15:01.136 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61958.log 2024-07-27T03:15:01.136 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44350.log.gz 2024-07-27T03:15:01.136 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56360.log 2024-07-27T03:15:01.136 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59295.log.gz 2024-07-27T03:15:01.136 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58240.log 2024-07-27T03:15:01.136 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61958.log.gz 2024-07-27T03:15:01.136 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54612.log 2024-07-27T03:15:01.137 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56360.log.gz 2024-07-27T03:15:01.137 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47633.log 2024-07-27T03:15:01.137 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58240.log.gz 2024-07-27T03:15:01.137 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58530.log 2024-07-27T03:15:01.137 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54612.log.gz 2024-07-27T03:15:01.137 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59505.log 2024-07-27T03:15:01.137 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47633.log.gz 2024-07-27T03:15:01.137 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52805.log 2024-07-27T03:15:01.138 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58530.log.gz 2024-07-27T03:15:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52215.log 2024-07-27T03:15:01.138 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59505.log.gz 2024-07-27T03:15:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.52805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45796.log 2024-07-27T03:15:01.138 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52805.log.gz 2024-07-27T03:15:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61334.log 2024-07-27T03:15:01.138 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52215.log.gz 2024-07-27T03:15:01.138 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54517.log 2024-07-27T03:15:01.139 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38484.log 2024-07-27T03:15:01.139 INFO:teuthology.orchestra.run.smithi120.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45796.log.gz 2024-07-27T03:15:01.139 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61334.log.gz 2024-07-27T03:15:01.139 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54349.log 2024-07-27T03:15:01.139 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54517.log.gz 2024-07-27T03:15:01.139 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47025.log 2024-07-27T03:15:01.139 INFO:teuthology.orchestra.run.smithi120.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38484.log.gz 2024-07-27T03:15:01.139 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61739.log 2024-07-27T03:15:01.140 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54349.log.gz 2024-07-27T03:15:01.140 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47988.log 2024-07-27T03:15:01.140 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47025.log.gz 2024-07-27T03:15:01.140 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47591.log 2024-07-27T03:15:01.140 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61739.log.gz 2024-07-27T03:15:01.140 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55379.log 2024-07-27T03:15:01.140 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47988.log.gz 2024-07-27T03:15:01.140 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47591.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-07-27T03:15:01.141 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55379.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47591.log.gz 2024-07-27T03:15:01.141 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44518.log 2024-07-27T03:15:01.141 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55379.log.gz 2024-07-27T03:15:01.141 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56192.log 2024-07-27T03:15:01.141 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48655.log 2024-07-27T03:15:01.141 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44518.log.gz 2024-07-27T03:15:01.141 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44704.log 2024-07-27T03:15:01.142 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48785.log 2024-07-27T03:15:01.142 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48655.log: /var/log/ceph/ceph-client.admin.44704.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48655.log.gz 2024-07-27T03:15:01.142 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61695.log 2024-07-27T03:15:01.142 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56192.log.gz 2024-07-27T03:15:01.142 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44704.log.gz 2024-07-27T03:15:01.142 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59337.log 2024-07-27T03:15:01.142 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61695.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48785.log.gz 2024-07-27T03:15:01.142 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58404.log 2024-07-27T03:15:01.143 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61695.log.gz 2024-07-27T03:15:01.143 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60210.log 2024-07-27T03:15:01.143 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59337.log.gz 2024-07-27T03:15:01.143 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49163.log 2024-07-27T03:15:01.143 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58404.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58404.log.gz 2024-07-27T03:15:01.143 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.60210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48739.log 2024-07-27T03:15:01.143 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44266.log 2024-07-27T03:15:01.143 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49163.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60210.log.gz 2024-07-27T03:15:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48739.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.49163.log.gz -5 2024-07-27T03:15:01.144 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43789.log 2024-07-27T03:15:01.144 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48739.log.gz 2024-07-27T03:15:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-07-27T03:15:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44266.log: /var/log/ceph/ceph-client.admin.43789.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44266.log.gz 2024-07-27T03:15:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49247.log 2024-07-27T03:15:01.144 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43789.log.gz 2024-07-27T03:15:01.144 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60078.log 2024-07-27T03:15:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.49247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60937.log 2024-07-27T03:15:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.60078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49037.log 2024-07-27T03:15:01.145 INFO:teuthology.orchestra.run.smithi120.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49247.log.gz 2024-07-27T03:15:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.60937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62252.log 2024-07-27T03:15:01.145 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60078.log.gz 2024-07-27T03:15:01.145 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60937.log.gz 2024-07-27T03:15:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54902.log 2024-07-27T03:15:01.145 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49037.log.gz 2024-07-27T03:15:01.145 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58072.log 2024-07-27T03:15:01.146 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62252.log.gz 2024-07-27T03:15:01.146 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56015.log 2024-07-27T03:15:01.146 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54902.log.gz 2024-07-27T03:15:01.146 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51941.log 2024-07-27T03:15:01.146 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58072.log: /var/log/ceph/ceph-client.admin.56015.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58072.log.gz 2024-07-27T03:15:01.146 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45305.log 2024-07-27T03:15:01.146 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56015.log.gz 2024-07-27T03:15:01.147 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5/var/log/ceph/ceph-client.admin.51941.log: --verbose -- /var/log/ceph/ceph-client.admin.49079.log 2024-07-27T03:15:01.147 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44788.log 2024-07-27T03:15:01.147 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51941.log.gz 2024-07-27T03:15:01.147 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49079.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45305.log.gz 2024-07-27T03:15:01.147 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-07-27T03:15:01.147 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49079.log.gz 2024-07-27T03:15:01.147 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44788.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-07-27T03:15:01.147 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44788.log.gz 2024-07-27T03:15:01.147 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59127.log 2024-07-27T03:15:01.148 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53022.log 2024-07-27T03:15:01.148 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61610.log 2024-07-27T03:15:01.148 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7%/var/log/ceph/ceph-client.admin.53022.log: -- replaced with /var/log/ceph/ceph-client.admin.59127.log.gz 2024-07-27T03:15:01.148 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52383.log 2024-07-27T03:15:01.148 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61610.log: gzip 91.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.53022.log.gz --verbose 2024-07-27T03:15:01.148 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.admin.48911.log 2024-07-27T03:15:01.148 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61610.log.gz 2024-07-27T03:15:01.148 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49121.log 2024-07-27T03:15:01.149 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52383.log.gz 2024-07-27T03:15:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48911.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-07-27T03:15:01.149 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48911.log.gz 2024-07-27T03:15:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52425.log 2024-07-27T03:15:01.149 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49121.log.gz 2024-07-27T03:15:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59861.log 2024-07-27T03:15:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55169.log 2024-07-27T03:15:01.149 INFO:teuthology.orchestra.run.smithi120.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52425.log.gz 2024-07-27T03:15:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53262.log 2024-07-27T03:15:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55169.log: /var/log/ceph/ceph-client.0.59861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59861.log.gz 2024-07-27T03:15:01.150 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55169.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58282.log 2024-07-27T03:15:01.150 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53262.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53262.log.gz 2024-07-27T03:15:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49313.log 2024-07-27T03:15:01.150 INFO:teuthology.orchestra.run.smithi120.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-07-27T03:15:01.150 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48474.log 2024-07-27T03:15:01.151 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58282.log: /var/log/ceph/ceph-client.admin.49313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52025.log 2024-07-27T03:15:01.151 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58282.log.gz 2024-07-27T03:15:01.151 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48474.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49313.log.gz 2024-07-27T03:15:01.151 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61021.log 87.9% 2024-07-27T03:15:01.151 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48474.log.gz 2024-07-27T03:15:01.151 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.52025.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54433.log 2024-07-27T03:15:01.151 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61021.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52025.log.gz 2024-07-27T03:15:01.151 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48068.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61021.log.gz 2024-07-27T03:15:01.152 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.152 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54433.log: 86.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52341.log 2024-07-27T03:15:01.152 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54433.log.gz 2024-07-27T03:15:01.152 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45586.log 2024-07-27T03:15:01.152 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52089.log 2024-07-27T03:15:01.152 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48068.log.gz 2024-07-27T03:15:01.152 INFO:teuthology.orchestra.run.smithi120.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52341.log.gz 2024-07-27T03:15:01.152 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60843.log 2024-07-27T03:15:01.153 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45586.log.gz 2024-07-27T03:15:01.153 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38923.log 2024-07-27T03:15:01.153 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52089.log.gzgzip 2024-07-27T03:15:01.153 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47843.log 2024-07-27T03:15:01.153 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.60843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53831.log 2024-07-27T03:15:01.153 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60843.log.gz 2024-07-27T03:15:01.153 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38923.log: /var/log/ceph/ceph-client.admin.47843.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38923.log.gz 2024-07-27T03:15:01.153 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47843.log.gz 2024-07-27T03:15:01.154 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52467.log 2024-07-27T03:15:01.154 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48560.log 2024-07-27T03:15:01.154 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53831.log.gz 2024-07-27T03:15:01.154 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52467.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52467.log.gz 2024-07-27T03:15:01.154 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.51335.log 2024-07-27T03:15:01.154 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48560.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48560.log.gz 2024-07-27T03:15:01.154 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44434.log 2024-07-27T03:15:01.154 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48149.log 2024-07-27T03:15:01.155 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51002.log 2024-07-27T03:15:01.155 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51335.log.gz 2024-07-27T03:15:01.155 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44434.log.gz 2024-07-27T03:15:01.155 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54041.log 2024-07-27T03:15:01.155 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48149.log.gz 2024-07-27T03:15:01.155 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52131.log 2024-07-27T03:15:01.155 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54041.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51002.log.gz 2024-07-27T03:15:01.155 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45628.log 2024-07-27T03:15:01.156 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38459.log 2024-07-27T03:15:01.156 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54041.log.gz/var/log/ceph/ceph-client.admin.52131.log: 2024-07-27T03:15:01.156 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45628.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52131.log.gz 2024-07-27T03:15:01.156 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45628.log.gz 2024-07-27T03:15:01.156 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-07-27T03:15:01.156 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55081.log 2024-07-27T03:15:01.156 INFO:teuthology.orchestra.run.smithi120.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.38459.log.gz 2024-07-27T03:15:01.156 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38385.log 2024-07-27T03:15:01.157 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44041.log 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55081.log.gz 2024-07-27T03:15:01.157 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.157 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.38385.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62084.log 2024-07-27T03:15:01.157 INFO:teuthology.orchestra.run.smithi120.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.38385.log.gz 2024-07-27T03:15:01.157 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44041.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58030.log 2024-07-27T03:15:01.157 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44041.log.gz 2024-07-27T03:15:01.157 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62084.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.62084.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44085.log 2024-07-27T03:15:01.157 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.158 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55547.log 2024-07-27T03:15:01.158 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58030.log: /var/log/ceph/ceph-client.admin.44085.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58030.log.gz 2024-07-27T03:15:01.158 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37996.log 2024-07-27T03:15:01.158 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44085.log.gz 2024-07-27T03:15:01.158 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49916.log 2024-07-27T03:15:01.158 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55547.log: /var/log/ceph/ceph-client.admin.37996.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55547.log.gz 2024-07-27T03:15:01.158 INFO:teuthology.orchestra.run.smithi120.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.37996.log.gz 2024-07-27T03:15:01.158 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50960.log 2024-07-27T03:15:01.159 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31923.log 2024-07-27T03:15:01.159 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49916.log: /var/log/ceph/ceph-client.admin.50960.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49916.log.gz 2024-07-27T03:15:01.159 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50960.log.gz 2024-07-27T03:15:01.159 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45712.log 2024-07-27T03:15:01.159 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.tmp-client.admin.31923.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31923.log.gz 2024-07-27T03:15:01.159 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51846.log 2024-07-27T03:15:01.159 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61790.log 2024-07-27T03:15:01.159 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51846.log: /var/log/ceph/ceph-client.admin.45712.log: 87.8% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45712.log.gz 2024-07-27T03:15:01.160 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51846.log.gz 2024-07-27T03:15:01.160 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44968.log 2024-07-27T03:15:01.160 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51419.log 2024-07-27T03:15:01.160 INFO:teuthology.orchestra.run.smithi120.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.61790.log.gz 2024-07-27T03:15:01.160 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62210.log 2024-07-27T03:15:01.160 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51419.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44968.log.gz 2024-07-27T03:15:01.160 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51419.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51377.log 2024-07-27T03:15:01.160 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.161 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56060.log 2024-07-27T03:15:01.161 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62210.log: /var/log/ceph/ceph-client.admin.51377.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62210.log.gz 2024-07-27T03:15:01.161 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52935.log 2024-07-27T03:15:01.161 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51377.log.gz 2024-07-27T03:15:01.161 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47472.log 2024-07-27T03:15:01.161 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52935.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52935.log.gz 2024-07-27T03:15:01.161 INFO:teuthology.orchestra.run.smithi120.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56060.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60979.log 2024-07-27T03:15:01.161 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.161 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53873.log 2024-07-27T03:15:01.162 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47472.log.gz 2024-07-27T03:15:01.162 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.60979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49850.log 2024-07-27T03:15:01.162 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53873.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60979.log.gz 2024-07-27T03:15:01.162 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53873.log.gz 2024-07-27T03:15:01.162 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51716.log 2024-07-27T03:15:01.162 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62378.log 2024-07-27T03:15:01.162 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51716.log: /var/log/ceph/ceph-client.admin.49850.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51716.log.gz 2024-07-27T03:15:01.163 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49850.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46419.log 2024-07-27T03:15:01.163 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.163 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61063.log 2024-07-27T03:15:01.163 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62378.log.gz 2024-07-27T03:15:01.163 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57988.log 2024-07-27T03:15:01.163 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61063.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46419.log.gz 2024-07-27T03:15:01.163 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61063.log.gz 2024-07-27T03:15:01.163 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38080.log 2024-07-27T03:15:01.163 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55922.log 2024-07-27T03:15:01.164 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.57988.log: /var/log/ceph/ceph-client.admin.38080.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57988.log.gz 2024-07-27T03:15:01.164 INFO:teuthology.orchestra.run.smithi120.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.38080.log.gz 2024-07-27T03:15:01.164 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59039.log 2024-07-27T03:15:01.164 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38366.log 2024-07-27T03:15:01.164 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55922.log.gz 2024-07-27T03:15:01.164 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59039.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55421.log 2024-07-27T03:15:01.164 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59039.log.gz 2024-07-27T03:15:01.165 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44963.log 2024-07-27T03:15:01.165 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38366.log: /var/log/ceph/ceph-client.admin.55421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58955.log 2024-07-27T03:15:01.165 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2%/var/log/ceph/ceph-client.admin.44963.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.38366.log.gz 2024-07-27T03:15:01.165 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44963.log.gz 2024-07-27T03:15:01.165 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55421.log.gz 2024-07-27T03:15:01.165 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.58955.log: /var/log/ceph/ceph-client.admin.38300.log 2024-07-27T03:15:01.165 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58955.log.gz 2024-07-27T03:15:01.165 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48337.log 2024-07-27T03:15:01.166 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49631.log 2024-07-27T03:15:01.166 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48337.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.38300.log.gz 2024-07-27T03:15:01.166 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48337.log.gz 2024-07-27T03:15:01.166 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48276.log 2024-07-27T03:15:01.166 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51983.log 2024-07-27T03:15:01.166 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49631.log.gz 2024-07-27T03:15:01.166 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38462.log 2024-07-27T03:15:01.166 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51983.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48276.log.gz 2024-07-27T03:15:01.167 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51983.log.gz 2024-07-27T03:15:01.167 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51890.log 2024-07-27T03:15:01.167 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54997.log 2024-07-27T03:15:01.167 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38462.log: /var/log/ceph/ceph-client.admin.51890.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.38462.log.gz 2024-07-27T03:15:01.167 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51890.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48869.log 2024-07-27T03:15:01.167 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.167 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38108.log 2024-07-27T03:15:01.167 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48869.log: /var/log/ceph/ceph-client.admin.54997.log: 88.1% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54997.log.gz 2024-07-27T03:15:01.168 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48869.log.gz 2024-07-27T03:15:01.168 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58793.log 2024-07-27T03:15:01.168 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61874.log 2024-07-27T03:15:01.168 INFO:teuthology.orchestra.run.smithi120.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.38108.log.gz 2024-07-27T03:15:01.168 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62168.log 2024-07-27T03:15:01.168 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61874.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58793.log.gz 2024-07-27T03:15:01.168 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61874.log.gz 2024-07-27T03:15:01.168 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53789.log 2024-07-27T03:15:01.169 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48191.log 2024-07-27T03:15:01.169 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53789.log: /var/log/ceph/ceph-client.admin.62168.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62168.log.gz 2024-07-27T03:15:01.169 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53789.log.gz 2024-07-27T03:15:01.169 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59421.log 2024-07-27T03:15:01.169 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48191.log: gzip -5 --verbose 87.5% -- /var/log/ceph/ceph-client.admin.48953.log 2024-07-27T03:15:01.169 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48191.log.gz 2024-07-27T03:15:01.169 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38052.log 2024-07-27T03:15:01.169 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59421.log: gzip -5 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59421.log.gz 2024-07-27T03:15:01.170 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55655.log/var/log/ceph/ceph-client.admin.48953.log: 2024-07-27T03:15:01.170 INFO:teuthology.orchestra.run.smithi120.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48953.log.gz 2024-07-27T03:15:01.170 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38052.log: 75.9% -- replaced with /var/log/ceph/ceph-client.admin.38052.log.gz 2024-07-27T03:15:01.170 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49784.log 2024-07-27T03:15:01.170 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59169.log 2024-07-27T03:15:01.170 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55655.log.gz 2024-07-27T03:15:01.170 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44967.log 2024-07-27T03:15:01.170 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59169.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59169.log.gz 2024-07-27T03:15:01.171 INFO:teuthology.orchestra.run.smithi120.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49784.log.gz 2024-07-27T03:15:01.171 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54083.log 2024-07-27T03:15:01.171 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38166.log 2024-07-27T03:15:01.171 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44967.log: /var/log/ceph/ceph-client.admin.54083.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44967.log.gz 2024-07-27T03:15:01.171 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54083.log.gz 2024-07-27T03:15:01.171 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48516.log 2024-07-27T03:15:01.171 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47382.log 2024-07-27T03:15:01.171 INFO:teuthology.orchestra.run.smithi120.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.38166.log.gz 2024-07-27T03:15:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44560.log 2024-07-27T03:15:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47382.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48516.log.gz 2024-07-27T03:15:01.172 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47382.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62563.log 2024-07-27T03:15:01.172 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47946.log 2024-07-27T03:15:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44560.log: /var/log/ceph/ceph-client.admin.62563.log: 87.6% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44560.log.gz 2024-07-27T03:15:01.172 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62563.log.gz 2024-07-27T03:15:01.172 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55505.log 2024-07-27T03:15:01.173 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62294.log 2024-07-27T03:15:01.173 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47946.log.gz 2024-07-27T03:15:01.173 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58656.log 2024-07-27T03:15:01.173 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62294.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55505.log.gz 2024-07-27T03:15:01.173 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62294.log.gz 2024-07-27T03:15:01.173 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61652.log 2024-07-27T03:15:01.173 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61105.log 2024-07-27T03:15:01.174 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61652.log: /var/log/ceph/ceph-client.admin.58656.log: 87.8% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58656.log.gz 2024-07-27T03:15:01.174 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61652.log.gz 2024-07-27T03:15:01.174 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48431.log 2024-07-27T03:15:01.174 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54475.log 2024-07-27T03:15:01.174 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61105.log.gz 2024-07-27T03:15:01.174 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54391.log 2024-07-27T03:15:01.174 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54475.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48431.log.gz 2024-07-27T03:15:01.174 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54475.log.gz 2024-07-27T03:15:01.175 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58156.log 2024-07-27T03:15:01.175 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59083.log 2024-07-27T03:15:01.175 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54391.log: /var/log/ceph/ceph-client.admin.58156.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54391.log.gz 2024-07-27T03:15:01.175 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58156.log.gz 2024-07-27T03:15:01.175 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45304.log 2024-07-27T03:15:01.175 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62605.log 2024-07-27T03:15:01.175 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59083.log.gz 2024-07-27T03:15:01.175 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58446.log 2024-07-27T03:15:01.176 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62605.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45304.log.gz 2024-07-27T03:15:01.176 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62605.log.gz 2024-07-27T03:15:01.176 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50876.log 2024-07-27T03:15:01.176 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47067.log 2024-07-27T03:15:01.176 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58446.log: /var/log/ceph/ceph-client.admin.50876.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58446.log.gz 2024-07-27T03:15:01.176 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50876.log.gz 2024-07-27T03:15:01.176 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47109.log 2024-07-27T03:15:01.176 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45299.log 2024-07-27T03:15:01.177 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47067.log.gz 2024-07-27T03:15:01.177 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62523.log 2024-07-27T03:15:01.177 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47109.log.gz 2024-07-27T03:15:01.177 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45299.log: -- /var/log/ceph/ceph-client.admin.49718.log 2024-07-27T03:15:01.177 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45299.log.gz 2024-07-27T03:15:01.177 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44178.log 2024-07-27T03:15:01.177 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49718.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62523.log.gz 2024-07-27T03:15:01.177 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55843.log 2024-07-27T03:15:01.178 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44178.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49718.log.gz 2024-07-27T03:15:01.178 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44178.log.gz 2024-07-27T03:15:01.178 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51124.log 2024-07-27T03:15:01.178 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.55843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55843.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45934.log 2024-07-27T03:15:01.178 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.178 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47549.log 2024-07-27T03:15:01.178 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45934.log: /var/log/ceph/ceph-client.admin.51124.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51124.log.gz 2024-07-27T03:15:01.179 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45934.log.gz 2024-07-27T03:15:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38023.log 2024-07-27T03:15:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53999.log 2024-07-27T03:15:01.179 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47549.log.gz 2024-07-27T03:15:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52173.log 2024-07-27T03:15:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53999.log: 77.0% -- replaced with /var/log/ceph/ceph-client.admin.38023.log.gz 2024-07-27T03:15:01.179 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52509.log 2024-07-27T03:15:01.179 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53999.log.gz 2024-07-27T03:15:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51293.log 2024-07-27T03:15:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52509.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52173.log.gz 2024-07-27T03:15:01.180 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52509.log.gz 2024-07-27T03:15:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55295.log 2024-07-27T03:15:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56258.log 2024-07-27T03:15:01.180 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51293.log.gz 2024-07-27T03:15:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52551.log 2024-07-27T03:15:01.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56258.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55295.log.gz 2024-07-27T03:15:01.181 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56258.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51251.log 2024-07-27T03:15:01.181 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.181 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58362.log 2024-07-27T03:15:01.181 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52551.log: /var/log/ceph/ceph-client.admin.51251.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51251.log.gz 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52551.log.gz 2024-07-27T03:15:01.181 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.181 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55127.log 2024-07-27T03:15:01.181 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58614.log 2024-07-27T03:15:01.181 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58362.log.gz 2024-07-27T03:15:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61231.log 2024-07-27T03:15:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58614.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55127.log.gz 2024-07-27T03:15:01.182 INFO:teuthology.orchestra.run.smithi120.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.58614.log.gz 2024-07-27T03:15:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59655.log 2024-07-27T03:15:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53957.log 2024-07-27T03:15:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59655.log: /var/log/ceph/ceph-client.admin.61231.log: 87.6% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61231.log.gz 2024-07-27T03:15:01.182 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59655.log.gz 2024-07-27T03:15:01.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52884.log 2024-07-27T03:15:01.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47151.log 2024-07-27T03:15:01.183 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53957.log.gz 2024-07-27T03:15:01.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60318.log 2024-07-27T03:15:01.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47151.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52884.log.gz 2024-07-27T03:15:01.183 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44966.log 2024-07-27T03:15:01.183 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47151.log.gz 2024-07-27T03:15:01.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.60318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38266.log 2024-07-27T03:15:01.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44966.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60318.log.gz 2024-07-27T03:15:01.183 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44966.log.gz 2024-07-27T03:15:01.184 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50834.log 2024-07-27T03:15:01.184 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.38266.log: -- /var/log/ceph/ceph-client.admin.62462.log 2024-07-27T03:15:01.184 INFO:teuthology.orchestra.run.smithi120.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.38266.log.gz 2024-07-27T03:15:01.184 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52980.log 2024-07-27T03:15:01.184 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62462.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50834.log.gz 2024-07-27T03:15:01.184 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62462.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44220.log 2024-07-27T03:15:01.184 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:01.184 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60276.log 2024-07-27T03:15:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44220.log: /var/log/ceph/ceph-client.admin.52980.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52980.log.gz 2024-07-27T03:15:01.185 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44220.log.gz 2024-07-27T03:15:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-07-27T03:15:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.60276.log: gzip -5 --verbose 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60276.log.gz 2024-07-27T03:15:01.185 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.admin.54946.log 2024-07-27T03:15:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38476.log 2024-07-27T03:15:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54946.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54946.log.gz 2024-07-27T03:15:01.185 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48387.log 2024-07-27T03:15:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38476.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.38476.log.gz 2024-07-27T03:15:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46983.log 2024-07-27T03:15:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48387.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48387.log.gz 2024-07-27T03:15:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44476.log 2024-07-27T03:15:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46983.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46983.log.gz 2024-07-27T03:15:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61418.log 2024-07-27T03:15:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44476.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44476.log.gz 2024-07-27T03:15:01.186 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56402.log 2024-07-27T03:15:01.187 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61418.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61418.log.gz 2024-07-27T03:15:01.187 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58198.log 2024-07-27T03:15:01.187 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56402.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56402.log.gz 2024-07-27T03:15:01.187 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45301.log 2024-07-27T03:15:01.187 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58198.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58198.log.gz 2024-07-27T03:15:01.187 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51209.log 2024-07-27T03:15:01.187 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45301.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45301.log.gz 2024-07-27T03:15:01.187 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59211.log 2024-07-27T03:15:01.188 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51209.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51209.log.gz 2024-07-27T03:15:01.188 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43915.log 2024-07-27T03:15:01.188 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59211.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59211.log.gz 2024-07-27T03:15:01.188 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51758.log 2024-07-27T03:15:01.188 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43915.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43915.log.gz 2024-07-27T03:15:01.188 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58698.log 2024-07-27T03:15:01.188 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51758.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51758.log.gz 2024-07-27T03:15:01.188 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43693.log 2024-07-27T03:15:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58698.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.58698.log.gz 2024-07-27T03:15:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46941.log 2024-07-27T03:15:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43693.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43693.log.gz 2024-07-27T03:15:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44620.log 2024-07-27T03:15:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46941.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46941.log.gz 2024-07-27T03:15:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59379.log 2024-07-27T03:15:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44620.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44620.log.gz 2024-07-27T03:15:01.189 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50792.log 2024-07-27T03:15:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59379.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59379.log.gz 2024-07-27T03:15:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55253.log 2024-07-27T03:15:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50792.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50792.log.gz 2024-07-27T03:15:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44970.log 2024-07-27T03:15:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55253.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55253.log.gz 2024-07-27T03:15:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45294.log 2024-07-27T03:15:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44970.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44970.log.gz 2024-07-27T03:15:01.190 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38483.log 2024-07-27T03:15:01.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45294.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45294.log.gz 2024-07-27T03:15:01.191 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2024-07-27T03:15:01.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.38483.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38483.log.gz 2024-07-27T03:15:01.191 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53915.log 2024-07-27T03:15:01.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47193.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2024-07-27T03:15:01.191 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59940.log 2024-07-27T03:15:01.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53915.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53915.log.gz 2024-07-27T03:15:01.191 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51044.log 2024-07-27T03:15:01.192 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59940.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59940.log.gz 2024-07-27T03:15:01.192 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51166.log 2024-07-27T03:15:01.192 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51044.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51044.log.gz 2024-07-27T03:15:01.192 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61189.log 2024-07-27T03:15:01.192 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51166.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51166.log.gz 2024-07-27T03:15:01.192 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54205.log 2024-07-27T03:15:01.192 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61189.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61189.log.gz 2024-07-27T03:15:01.192 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46283.log 2024-07-27T03:15:01.193 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54205.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54205.log.gz 2024-07-27T03:15:01.193 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55211.log 2024-07-27T03:15:01.193 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.46283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46283.log.gz 2024-07-27T03:15:01.193 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44136.log 2024-07-27T03:15:01.193 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55211.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55211.log.gz 2024-07-27T03:15:01.193 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54773.log 2024-07-27T03:15:01.193 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44136.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44136.log.gz 2024-07-27T03:15:01.193 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60036.log 2024-07-27T03:15:01.194 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54773.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54773.log.gz 2024-07-27T03:15:01.194 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48604.log 2024-07-27T03:15:01.194 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.60036.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60036.log.gz 2024-07-27T03:15:01.195 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48604.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48604.log.gz 2024-07-27T03:15:01.232 INFO:teuthology.orchestra.run.smithi121.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-07-27T03:15:01.248 INFO:teuthology.orchestra.run.smithi121.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-07-27T03:15:01.527 INFO:teuthology.orchestra.run.smithi120.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-07-27T03:15:01.536 INFO:teuthology.orchestra.run.smithi121.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-07-27T03:15:01.671 INFO:teuthology.orchestra.run.smithi121.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-07-27T03:15:01.728 INFO:teuthology.orchestra.run.smithi120.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-07-27T03:15:01.786 INFO:teuthology.orchestra.run.smithi121.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-07-27T03:15:01.790 INFO:teuthology.orchestra.run.smithi120.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-07-27T03:15:01.970 INFO:teuthology.orchestra.run.smithi121.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-07-27T03:15:02.005 INFO:teuthology.orchestra.run.smithi121.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-07-27T03:15:02.032 INFO:teuthology.orchestra.run.smithi120.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-07-27T03:15:02.316 INFO:teuthology.orchestra.run.smithi120.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-07-27T03:15:02.578 INFO:teuthology.orchestra.run.smithi121.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-07-27T03:15:02.580 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-07-27T03:15:02.580 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m1.613s 2024-07-27T03:15:02.580 INFO:teuthology.orchestra.run.smithi121.stderr:user 0m5.943s 2024-07-27T03:15:02.581 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m0.219s 2024-07-27T03:15:03.081 INFO:teuthology.orchestra.run.smithi120.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-07-27T03:15:04.137 INFO:teuthology.orchestra.run.smithi120.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-07-27T03:15:04.139 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-07-27T03:15:04.139 INFO:teuthology.orchestra.run.smithi120.stderr:real 0m3.200s 2024-07-27T03:15:04.139 INFO:teuthology.orchestra.run.smithi120.stderr:user 0m9.418s 2024-07-27T03:15:04.139 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m0.511s 2024-07-27T03:15:04.139 INFO:tasks.ceph:Archiving logs... 2024-07-27T03:15:04.140 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981/remote/smithi120/log 2024-07-27T03:15:04.141 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-07-27T03:15:05.627 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981/remote/smithi121/log 2024-07-27T03:15:05.628 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-07-27T03:15:06.348 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-07-27T03:15:06.358 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-07-27T03:15:06.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-07-27T03:15:06.361 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-07-27T03:15:06.454 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-07-27T03:15:06.464 INFO:teuthology.task.clock:Checking final clock skew... 2024-07-27T03:15:06.464 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-27T03:15:06.467 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-27T03:15:06.481 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-07-27T03:15:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-07-27T03:15:06.485 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-27T03:15:06.486 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-07-27T03:15:06.486 INFO:teuthology.orchestra.run.smithi120.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 -197us[ -199us] +/- 55ms 2024-07-27T03:15:06.486 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -282us[ -282us] +/- 54ms 2024-07-27T03:15:06.486 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +628us[ +628us] +/- 62ms 2024-07-27T03:15:06.486 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-07-27T03:15:06.488 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-27T03:15:06.488 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-07-27T03:15:06.488 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv01.front.sepia.ceph.com 3 6 377 28 -186us[ -174us] +/- 55ms 2024-07-27T03:15:06.488 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -268us[ -268us] +/- 54ms 2024-07-27T03:15:06.488 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +640us[ +640us] +/- 62ms 2024-07-27T03:15:06.488 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-07-27T03:15:06.489 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-07-27T03:15:06.498 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-07-27T03:15:06.498 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-07-27T03:15:06.538 DEBUG:teuthology.orchestra.run.smithi120:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-07-27T03:15:06.616 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-07-27T03:15:06.683 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-27T03:15:06.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:15:06.713 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-27T03:15:06.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:15:06.742 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-07-27T03:15:06.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-07-27T03:15:06.814 INFO:teuthology.task.internal:Duration was 820.548804 seconds 2024-07-27T03:15:06.815 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-07-27T03:15:06.855 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-07-27T03:15:06.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-07-27T03:15:06.858 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-07-27T03:15:06.895 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-27T03:15:06.897 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-27T03:15:07.147 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-07-27T03:15:07.148 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-07-27T03:15:07.148 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-07-27T03:15:07.208 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-07-27T03:15:07.208 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-07-27T03:15:07.234 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-07-27T03:15:07.234 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-07-27T03:15:07.251 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-07-27T03:15:07.301 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-07-27T03:15:07.302 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-07-27T03:15:07.319 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-07-27T03:15:07.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-07-27T03:15:07.454 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-07-27T03:15:07.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-07-27T03:15:07.480 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-07-27T03:15:07.505 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-07-27T03:15:07.515 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-07-27T03:15:07.522 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-07-27T03:15:07.543 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-07-27T03:15:07.568 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-07-27T03:15:07.582 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-07-27T03:15:07.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:15:07.611 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-07-27T03:15:07.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-27T03:15:07.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-07-27T03:15:07.647 INFO:teuthology.task.internal:Transferring archived files... 2024-07-27T03:15:07.648 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981/remote/smithi120 2024-07-27T03:15:07.648 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-07-27T03:15:07.686 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7820981/remote/smithi121 2024-07-27T03:15:07.686 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-07-27T03:15:07.720 INFO:teuthology.task.internal:Removing archive directory... 2024-07-27T03:15:07.720 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-07-27T03:15:07.723 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-07-27T03:15:07.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-07-27T03:15:07.781 INFO:teuthology.task.internal:Not uploading archives. 2024-07-27T03:15:07.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-07-27T03:15:07.814 INFO:teuthology.task.internal:Tidying up after the test... 2024-07-27T03:15:07.814 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-07-27T03:15:07.817 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-07-27T03:15:07.829 INFO:teuthology.orchestra.run.smithi120.stdout: 266040 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 27 03:15 /home/ubuntu/cephtest 2024-07-27T03:15:07.831 INFO:teuthology.orchestra.run.smithi121.stdout: 265439 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 27 03:15 /home/ubuntu/cephtest 2024-07-27T03:15:07.833 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-07-27T03:15:07.856 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-07-27T03:15:07.951 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/exports} duration: 820.5488040447235 failure_reason: 'Test failure: test_mds_failover (tasks.cephfs.test_exports.TestBalMask)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9c90534c874d408da3f3a8ceb4f8b6e6 status: fail success: false 2024-07-27T03:15:07.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-07-27T03:15:08.038 INFO:teuthology.run:FAIL